2023-10-14T08:30:40.796 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T08:30:40.797 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117 --verbose --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/orig.config.yaml 2023-10-14T08:30:40.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T08:30:40.946 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117 branch: rishabh-2023oct13 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} email: null first_in_suite: false job_id: '7425117' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T08:30:40.947 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T08:30:40.948 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T08:30:40.948 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T08:30:40.950 INFO:teuthology.task.internal:Checking packages... 2023-10-14T08:30:40.973 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T08:30:40.974 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T08:30:40.974 INFO:teuthology.packaging:ref: None 2023-10-14T08:30:40.975 INFO:teuthology.packaging:tag: None 2023-10-14T08:30:40.975 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T08:30:40.975 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:30:40.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T08:30:42.366 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T08:30:42.367 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T08:30:42.373 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T08:30:42.374 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T08:30:42.379 INFO:teuthology.task.internal:Saving configuration 2023-10-14T08:30:42.401 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T08:30:42.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T08:30:42.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:25:16.156531', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T08:30:42.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:25:16.158101', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T08:30:42.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:25:16.155012', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T08:30:42.474 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T08:30:42.480 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-14T08:30:42.481 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-14T08:30:42.481 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-14T08:30:42.481 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T08:30:42.582 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3459032ca0>, signals=[15]) 2023-10-14T08:30:42.584 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T08:30:42.590 INFO:teuthology.task.internal:Opening connections... 2023-10-14T08:30:42.590 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T08:30:42.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T08:30:42.662 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-10-14T08:30:42.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T08:30:42.730 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-10-14T08:30:42.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T08:30:42.799 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T08:30:42.805 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-10-14T08:30:42.828 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-10-14T08:30:42.828 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-10-14T08:30:42.887 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T08:30:42.887 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T08:30:42.888 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-10-14T08:30:42.888 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-10-14T08:30:42.888 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-10-14T08:30:42.888 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-10-14T08:30:42.889 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T08:30:42.889 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-10-14T08:30:42.889 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T08:30:42.889 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T08:30:42.890 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T08:30:42.890 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T08:30:42.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:30:42.891 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T08:30:42.892 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T08:30:42.892 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T08:30:42.892 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T08:30:42.893 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-10-14T08:30:42.914 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-14T08:30:42.935 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-14T08:30:42.936 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-14T08:30:42.996 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T08:30:42.996 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T08:30:42.996 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-10-14T08:30:42.997 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-10-14T08:30:42.997 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-10-14T08:30:42.997 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-10-14T08:30:42.997 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T08:30:42.997 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-14T08:30:42.998 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T08:30:42.998 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T08:30:42.998 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T08:30:42.998 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T08:30:42.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:30:42.999 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T08:30:42.999 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T08:30:42.999 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T08:30:42.999 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T08:30:43.000 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-14T08:30:43.039 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-10-14T08:30:43.059 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-10-14T08:30:43.060 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-10-14T08:30:43.118 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T08:30:43.119 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T08:30:43.119 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-10-14T08:30:43.119 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-10-14T08:30:43.119 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2023-10-14T08:30:43.120 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-10-14T08:30:43.120 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T08:30:43.120 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-10-14T08:30:43.120 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T08:30:43.121 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T08:30:43.121 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T08:30:43.121 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T08:30:43.121 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:30:43.122 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T08:30:43.122 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T08:30:43.122 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T08:30:43.122 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T08:30:43.123 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-10-14T08:30:43.155 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T08:30:43.165 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T08:30:43.171 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T08:30:43.171 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-10-14T08:30:43.174 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-10-14T08:30:43.177 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-10-14T08:30:43.195 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T08:30:43.201 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T08:30:43.201 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-10-14T08:30:43.235 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-10-14T08:30:43.238 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-10-14T08:30:43.275 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T08:30:43.352 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T08:30:43.367 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T08:30:43.368 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-14T08:30:43.368 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-14T08:30:43.368 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T08:30:43.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:30:43.389 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-10-14T08:30:43.450 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T08:30:43.450 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-372.9.1.el8.x86_64 2023-10-14T08:30:43.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-10-14T08:30:44.684 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:30:44.684 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-14T08:30:46.392 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 8.0 kB/s | 3.5 kB 00:00 2023-10-14T08:30:47.717 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-14T08:30:51.392 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 428 kB/s | 24 kB 00:00 2023-10-14T08:30:52.136 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T08:30:52.183 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-14T08:30:52.184 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2023-10-14T08:30:52.184 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-14T08:30:52.303 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2023-10-14T08:30:52.655 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:30:52.656 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-14T08:30:52.930 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 08:30:51 AM UTC. 2023-10-14T08:30:52.975 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T08:30:53.007 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-10-14T08:30:53.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2023-10-14T08:30:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:30:53.403 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-10-14T08:30:53.675 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 08:30:51 AM UTC. 2023-10-14T08:30:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T08:30:53.740 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-10-14T08:30:53.787 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T08:30:53.870 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T08:30:53.871 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T08:30:53.871 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T08:30:53.871 DEBUG:teuthology.parallel:result is None 2023-10-14T08:30:53.872 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T08:30:53.879 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T08:30:53.879 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T08:30:53.882 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T08:30:53.884 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T08:30:53.905 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T08:30:53.913 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T08:30:53.936 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T08:30:53.937 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T08:30:53.939 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T08:30:53.945 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T08:30:53.981 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T08:30:53.988 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T08:30:53.988 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T08:30:54.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:30:54.033 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T08:30:54.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:30:54.051 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T08:30:54.054 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T08:30:54.075 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T08:30:54.091 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T08:30:54.111 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T08:30:54.116 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T08:30:54.131 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T08:30:54.147 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T08:30:54.164 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T08:30:54.166 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T08:30:54.173 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T08:30:54.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T08:30:54.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T08:30:54.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T08:30:54.207 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T08:30:54.216 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T08:30:54.216 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T08:30:54.244 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T08:30:54.248 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T08:30:54.266 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T08:30:54.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T08:30:54.395 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T08:30:54.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T08:30:54.522 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:30:54.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T08:30:54.589 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T08:30:54.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T08:30:54.689 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T08:30:54.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T08:30:54.822 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:30:54.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T08:30:54.892 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T08:30:54.940 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T08:30:54.998 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T08:30:55.084 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T08:30:55.130 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:30:55.130 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T08:30:55.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-10-14T08:30:55.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-10-14T08:30:55.205 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-10-14T08:30:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T08:30:55.267 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T08:30:55.302 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T08:30:55.709 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T08:30:55.717 INFO:teuthology.task.internal:Starting timer... 2023-10-14T08:30:55.718 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T08:30:55.727 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T08:30:55.739 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T08:30:55.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-10-14T08:30:55.804 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2023-10-14T08:30:55.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2023-10-14T08:30:55.863 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2023-10-14T08:30:55.865 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2023-10-14T08:30:55.924 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2023-10-14T08:30:55.926 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T08:30:55.926 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-10-14T08:30:55.961 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-10-14T08:30:55.961 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2023-10-14T08:30:55.988 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2023-10-14T08:30:55.989 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2023-10-14T08:30:56.025 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2023-10-14T08:30:56.025 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2023-10-14T08:30:56.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T08:30:56.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:30:56.055 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T08:30:56.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:30:56.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T08:30:56.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:30:56.114 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T08:30:56.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-10-14T08:30:56.141 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2023-10-14T08:30:56.170 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2023-10-14T08:30:56.198 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T08:30:56.207 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-14T08:30:56.212 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-14T08:30:56.363 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T08:30:56.379 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T08:30:56.380 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi057.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T08:40:10.548 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-10-14T08:40:10.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-14T08:40:10.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T08:40:10.620 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-10-14T08:40:10.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-10-14T08:40:10.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-14T08:40:10.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T08:40:10.766 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-14T08:40:10.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-14T08:40:10.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-10-14T08:40:10.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T08:40:10.907 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-10-14T08:40:10.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-10-14T08:40:10.977 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T08:40:10.987 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T08:40:10.988 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T08:40:10.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T08:40:10.991 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T08:40:10.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T08:40:10.994 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T08:40:10.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T08:40:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T08:40:11.029 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T08:40:11.043 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T08:40:11.046 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T08:40:11.050 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T08:40:11.065 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T08:40:11.120 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2023-10-14T08:40:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-10-14T08:40:11.133 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2023-10-14T08:40:11.135 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2023-10-14T08:40:11.136 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-10-14T08:40:11.147 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2023-10-14T08:40:11.149 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T08:40:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T08:40:11.161 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T08:40:11.164 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T08:40:11.167 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T08:40:11.175 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T08:40:11.230 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2023-10-14T08:40:11.234 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T08:40:11.235 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-10-14T08:40:11.235 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.235 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.235 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.235 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-10-14T08:40:11.243 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T08:40:11.244 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-10-14T08:40:11.244 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.244 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.244 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.245 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.249 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2023-10-14T08:40:11.253 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T08:40:11.254 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-10-14T08:40:11.254 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.254 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.254 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.255 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T08:40:11.256 INFO:teuthology.run_tasks:Running task pexec... 2023-10-14T08:40:11.276 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-14T08:40:11.277 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T08:40:11.277 DEBUG:teuthology.orchestra.run.smithi006:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-14T08:40:11.278 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi057.front.sepia.ceph.com 2023-10-14T08:40:11.278 DEBUG:teuthology.orchestra.run.smithi057:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-14T08:40:11.279 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi178.front.sepia.ceph.com 2023-10-14T08:40:11.279 DEBUG:teuthology.orchestra.run.smithi178:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-14T08:40:11.668 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:11.671 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:11.679 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:12.486 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Oct 2023 08:38:26 AM UTC. 2023-10-14T08:40:12.552 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:30 ago on Sat 14 Oct 2023 08:38:42 AM UTC. 2023-10-14T08:40:12.589 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:33 ago on Sat 14 Oct 2023 08:38:39 AM UTC. 2023-10-14T08:40:14.210 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-10-14T08:40:14.211 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-10-14T08:40:14.211 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2023-10-14T08:40:14.211 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-10-14T08:40:14.211 INFO:teuthology.orchestra.run.smithi178.stdout:Resetting modules: 2023-10-14T08:40:14.211 INFO:teuthology.orchestra.run.smithi178.stdout: container-tools 2023-10-14T08:40:14.212 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:14.212 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-10-14T08:40:14.212 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-10-14T08:40:14.212 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:14.517 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-10-14T08:40:14.518 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-10-14T08:40:14.518 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2023-10-14T08:40:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-10-14T08:40:14.519 INFO:teuthology.orchestra.run.smithi057.stdout:Resetting modules: 2023-10-14T08:40:14.519 INFO:teuthology.orchestra.run.smithi057.stdout: container-tools 2023-10-14T08:40:14.520 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-10-14T08:40:14.520 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-10-14T08:40:14.521 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:14.580 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-14T08:40:14.581 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-10-14T08:40:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2023-10-14T08:40:14.582 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-10-14T08:40:14.582 INFO:teuthology.orchestra.run.smithi006.stdout:Resetting modules: 2023-10-14T08:40:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools 2023-10-14T08:40:14.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:14.583 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-10-14T08:40:14.583 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-10-14T08:40:14.584 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:15.218 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Oct 2023 08:38:26 AM UTC. 2023-10-14T08:40:15.531 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:33 ago on Sat 14 Oct 2023 08:38:42 AM UTC. 2023-10-14T08:40:15.580 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:36 ago on Sat 14 Oct 2023 08:38:39 AM UTC. 2023-10-14T08:40:17.640 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-10-14T08:40:18.107 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:18.954 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-14T08:40:19.113 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Oct 2023 08:38:26 AM UTC. 2023-10-14T08:40:19.161 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-10-14T08:40:19.433 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:19.659 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:20.905 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-10-14T08:40:20.999 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================================================ 2023-10-14T08:40:20.999 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-10-14T08:40:20.999 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================================================ 2023-10-14T08:40:20.999 INFO:teuthology.orchestra.run.smithi178.stdout:Installing group/module packages: 2023-10-14T08:40:21.000 INFO:teuthology.orchestra.run.smithi178.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-14T08:40:21.000 INFO:teuthology.orchestra.run.smithi178.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-14T08:40:21.000 INFO:teuthology.orchestra.run.smithi178.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-14T08:40:21.000 INFO:teuthology.orchestra.run.smithi178.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-14T08:40:21.000 INFO:teuthology.orchestra.run.smithi178.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-14T08:40:21.001 INFO:teuthology.orchestra.run.smithi178.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-14T08:40:21.001 INFO:teuthology.orchestra.run.smithi178.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-14T08:40:21.001 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-10-14T08:40:21.001 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-14T08:40:21.001 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-14T08:40:21.002 INFO:teuthology.orchestra.run.smithi178.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-14T08:40:21.002 INFO:teuthology.orchestra.run.smithi178.stdout:Installing module profiles: 2023-10-14T08:40:21.002 INFO:teuthology.orchestra.run.smithi178.stdout: container-tools/common 2023-10-14T08:40:21.002 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:21.002 INFO:teuthology.orchestra.run.smithi178.stdout:Enabling module streams: 2023-10-14T08:40:21.003 INFO:teuthology.orchestra.run.smithi178.stdout: container-tools rhel8 2023-10-14T08:40:21.003 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:21.003 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-10-14T08:40:21.003 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================================================ 2023-10-14T08:40:21.003 INFO:teuthology.orchestra.run.smithi178.stdout:Install 10 Packages 2023-10-14T08:40:21.003 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:21.004 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 18 M 2023-10-14T08:40:21.004 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 65 M 2023-10-14T08:40:21.005 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-10-14T08:40:21.038 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:41 ago on Sat 14 Oct 2023 08:38:39 AM UTC. 2023-10-14T08:40:21.228 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:38 ago on Sat 14 Oct 2023 08:38:42 AM UTC. 2023-10-14T08:40:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 93 kB/s | 25 kB 00:00 2023-10-14T08:40:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 140 kB/s | 41 kB 00:00 2023-10-14T08:40:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 296 kB/s | 94 kB 00:00 2023-10-14T08:40:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 311 kB/s | 49 kB 00:00 2023-10-14T08:40:21.528 INFO:teuthology.orchestra.run.smithi178.stdout:(5/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.5 MB/s | 149 kB 00:00 2023-10-14T08:40:21.561 INFO:teuthology.orchestra.run.smithi178.stdout:(6/10): cockpit-podman-49.1-1.module+el8.6.0+16 1.9 MB/s | 524 kB 00:00 2023-10-14T08:40:21.703 INFO:teuthology.orchestra.run.smithi178.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 21 MB/s | 8.0 MB 00:00 2023-10-14T08:40:21.730 INFO:teuthology.orchestra.run.smithi178.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.0 MB/s | 213 kB 00:00 2023-10-14T08:40:21.932 INFO:teuthology.orchestra.run.smithi178.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 19 MB/s | 7.0 MB 00:00 2023-10-14T08:40:21.998 INFO:teuthology.orchestra.run.smithi178.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 7.5 MB/s | 2.2 MB 00:00 2023-10-14T08:40:21.998 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:40:21.999 INFO:teuthology.orchestra.run.smithi178.stdout:Total 18 MB/s | 18 MB 00:00 2023-10-14T08:40:22.198 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-10-14T08:40:22.217 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-10-14T08:40:22.217 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-10-14T08:40:22.399 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-10-14T08:40:22.403 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-10-14T08:40:22.923 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-10-14T08:40:22.968 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-14T08:40:23.071 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================================ 2023-10-14T08:40:23.071 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-10-14T08:40:23.071 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================================ 2023-10-14T08:40:23.071 INFO:teuthology.orchestra.run.smithi006.stdout:Installing group/module packages: 2023-10-14T08:40:23.072 INFO:teuthology.orchestra.run.smithi006.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-14T08:40:23.072 INFO:teuthology.orchestra.run.smithi006.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-14T08:40:23.072 INFO:teuthology.orchestra.run.smithi006.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-14T08:40:23.072 INFO:teuthology.orchestra.run.smithi006.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-14T08:40:23.072 INFO:teuthology.orchestra.run.smithi006.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-14T08:40:23.073 INFO:teuthology.orchestra.run.smithi006.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-14T08:40:23.073 INFO:teuthology.orchestra.run.smithi006.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-14T08:40:23.073 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-10-14T08:40:23.073 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-14T08:40:23.073 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-14T08:40:23.074 INFO:teuthology.orchestra.run.smithi006.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-14T08:40:23.074 INFO:teuthology.orchestra.run.smithi006.stdout:Installing module profiles: 2023-10-14T08:40:23.074 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools/common 2023-10-14T08:40:23.074 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:23.075 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-10-14T08:40:23.075 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools rhel8 2023-10-14T08:40:23.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:23.075 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-10-14T08:40:23.075 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================================ 2023-10-14T08:40:23.076 INFO:teuthology.orchestra.run.smithi006.stdout:Install 10 Packages 2023-10-14T08:40:23.076 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:23.076 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 18 M 2023-10-14T08:40:23.077 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 65 M 2023-10-14T08:40:23.077 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-10-14T08:40:23.140 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-14T08:40:23.191 INFO:teuthology.orchestra.run.smithi006.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 210 kB/s | 25 kB 00:00 2023-10-14T08:40:23.214 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-10-14T08:40:23.217 INFO:teuthology.orchestra.run.smithi006.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 285 kB/s | 41 kB 00:00 2023-10-14T08:40:23.242 INFO:teuthology.orchestra.run.smithi006.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 557 kB/s | 94 kB 00:00 2023-10-14T08:40:23.284 INFO:teuthology.orchestra.run.smithi006.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 536 kB/s | 49 kB 00:00 2023-10-14T08:40:23.314 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================================ 2023-10-14T08:40:23.315 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-10-14T08:40:23.315 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================================ 2023-10-14T08:40:23.315 INFO:teuthology.orchestra.run.smithi057.stdout:Installing group/module packages: 2023-10-14T08:40:23.315 INFO:teuthology.orchestra.run.smithi057.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-14T08:40:23.316 INFO:teuthology.orchestra.run.smithi057.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-14T08:40:23.316 INFO:teuthology.orchestra.run.smithi057.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-14T08:40:23.316 INFO:teuthology.orchestra.run.smithi057.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-14T08:40:23.316 INFO:teuthology.orchestra.run.smithi057.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-14T08:40:23.316 INFO:teuthology.orchestra.run.smithi057.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-14T08:40:23.317 INFO:teuthology.orchestra.run.smithi057.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-14T08:40:23.317 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-10-14T08:40:23.317 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-14T08:40:23.317 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-14T08:40:23.317 INFO:teuthology.orchestra.run.smithi057.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-14T08:40:23.318 INFO:teuthology.orchestra.run.smithi057.stdout:Installing module profiles: 2023-10-14T08:40:23.318 INFO:teuthology.orchestra.run.smithi057.stdout: container-tools/common 2023-10-14T08:40:23.318 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:23.318 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling module streams: 2023-10-14T08:40:23.318 INFO:teuthology.orchestra.run.smithi057.stdout: container-tools rhel8 2023-10-14T08:40:23.319 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:23.319 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-10-14T08:40:23.319 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================================ 2023-10-14T08:40:23.319 INFO:teuthology.orchestra.run.smithi057.stdout:Install 10 Packages 2023-10-14T08:40:23.320 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:23.320 INFO:teuthology.orchestra.run.smithi006.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.1 MB/s | 524 kB 00:00 2023-10-14T08:40:23.321 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 18 M 2023-10-14T08:40:23.321 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 65 M 2023-10-14T08:40:23.321 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-10-14T08:40:23.334 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-14T08:40:23.378 INFO:teuthology.orchestra.run.smithi006.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.6 MB/s | 149 kB 00:00 2023-10-14T08:40:23.401 INFO:teuthology.orchestra.run.smithi006.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.5 MB/s | 213 kB 00:00 2023-10-14T08:40:23.472 INFO:teuthology.orchestra.run.smithi057.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 161 kB/s | 25 kB 00:00 2023-10-14T08:40:23.497 INFO:teuthology.orchestra.run.smithi057.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 227 kB/s | 41 kB 00:00 2023-10-14T08:40:23.523 INFO:teuthology.orchestra.run.smithi057.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 457 kB/s | 94 kB 00:00 2023-10-14T08:40:23.570 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-14T08:40:23.577 INFO:teuthology.orchestra.run.smithi006.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 24 MB/s | 8.0 MB 00:00 2023-10-14T08:40:23.589 INFO:teuthology.orchestra.run.smithi057.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 421 kB/s | 49 kB 00:00 2023-10-14T08:40:23.644 INFO:teuthology.orchestra.run.smithi006.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 9.1 MB/s | 2.2 MB 00:00 2023-10-14T08:40:23.681 INFO:teuthology.orchestra.run.smithi057.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.8 MB/s | 524 kB 00:00 2023-10-14T08:40:23.707 INFO:teuthology.orchestra.run.smithi057.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-14T08:40:23.760 INFO:teuthology.orchestra.run.smithi006.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 18 MB/s | 7.0 MB 00:00 2023-10-14T08:40:23.761 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:40:23.761 INFO:teuthology.orchestra.run.smithi006.stdout:Total 26 MB/s | 18 MB 00:00 2023-10-14T08:40:23.798 INFO:teuthology.orchestra.run.smithi057.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.8 MB/s | 213 kB 00:00 2023-10-14T08:40:23.829 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-14T08:40:23.968 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-10-14T08:40:23.989 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-10-14T08:40:23.989 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-10-14T08:40:24.007 INFO:teuthology.orchestra.run.smithi057.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 16 MB/s | 8.0 MB 00:00 2023-10-14T08:40:24.066 INFO:teuthology.orchestra.run.smithi057.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 8.2 MB/s | 2.2 MB 00:00 2023-10-14T08:40:24.149 INFO:teuthology.orchestra.run.smithi057.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 16 MB/s | 7.0 MB 00:00 2023-10-14T08:40:24.150 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:40:24.150 INFO:teuthology.orchestra.run.smithi057.stdout:Total 22 MB/s | 18 MB 00:00 2023-10-14T08:40:24.184 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-10-14T08:40:24.188 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-10-14T08:40:24.221 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-14T08:40:24.356 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-10-14T08:40:24.376 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-10-14T08:40:24.377 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-10-14T08:40:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-10-14T08:40:24.574 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-10-14T08:40:24.723 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-10-14T08:40:24.943 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-14T08:40:25.061 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-14T08:40:25.120 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-14T08:40:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-10-14T08:40:25.287 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-14T08:40:25.333 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-14T08:40:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-14T08:40:25.515 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-14T08:40:25.665 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-14T08:40:25.883 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-14T08:40:25.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-14T08:40:25.966 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-14T08:40:26.207 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-14T08:40:26.240 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-14T08:40:26.416 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-14T08:40:26.610 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-14T08:40:26.706 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-14T08:40:26.902 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-14T08:40:26.903 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-14T08:40:26.903 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-14T08:40:26.903 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-14T08:40:26.903 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-14T08:40:26.904 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-14T08:40:26.904 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-14T08:40:26.904 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-14T08:40:26.904 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-14T08:40:26.904 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-14T08:40:27.066 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-14T08:40:27.638 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-14T08:40:27.843 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-14T08:40:27.995 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-14T08:40:28.052 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-14T08:40:28.082 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-14T08:40:28.083 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:01 ago on Sat 14 Oct 2023 08:38:26 AM UTC. 2023-10-14T08:40:28.228 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-14T08:40:28.245 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-14T08:40:28.414 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-14T08:40:28.493 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-14T08:40:28.493 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-14T08:40:28.494 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-14T08:40:28.494 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-14T08:40:28.494 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-14T08:40:28.494 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-14T08:40:28.494 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-14T08:40:28.495 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-14T08:40:28.495 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-14T08:40:28.495 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-14T08:40:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-14T08:40:28.874 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-14T08:40:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-14T08:40:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-14T08:40:28.875 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-14T08:40:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-14T08:40:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-14T08:40:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-14T08:40:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-14T08:40:28.876 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-14T08:40:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-14T08:40:29.714 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-14T08:40:29.714 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Oct 2023 08:38:39 AM UTC. 2023-10-14T08:40:30.040 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-14T08:40:30.041 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Oct 2023 08:38:42 AM UTC. 2023-10-14T08:40:30.820 INFO:teuthology.orchestra.run.smithi178.stdout:Installed products updated. 2023-10-14T08:40:31.022 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:31.022 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-10-14T08:40:31.022 INFO:teuthology.orchestra.run.smithi178.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:31.023 INFO:teuthology.orchestra.run.smithi178.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-14T08:40:31.023 INFO:teuthology.orchestra.run.smithi178.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:31.023 INFO:teuthology.orchestra.run.smithi178.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-14T08:40:31.023 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-14T08:40:31.023 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-14T08:40:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-14T08:40:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-14T08:40:31.024 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:40:31.024 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-10-14T08:40:31.170 DEBUG:teuthology.parallel:result is None 2023-10-14T08:40:34.069 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-10-14T08:40:34.283 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:34.283 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-10-14T08:40:34.284 INFO:teuthology.orchestra.run.smithi006.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:34.284 INFO:teuthology.orchestra.run.smithi006.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-14T08:40:34.284 INFO:teuthology.orchestra.run.smithi006.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:34.284 INFO:teuthology.orchestra.run.smithi006.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-14T08:40:34.284 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-14T08:40:34.285 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-14T08:40:34.285 INFO:teuthology.orchestra.run.smithi006.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:34.285 INFO:teuthology.orchestra.run.smithi006.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:34.285 INFO:teuthology.orchestra.run.smithi006.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-14T08:40:34.285 INFO:teuthology.orchestra.run.smithi006.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-14T08:40:34.286 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:40:34.286 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-14T08:40:34.416 DEBUG:teuthology.parallel:result is None 2023-10-14T08:40:34.785 INFO:teuthology.orchestra.run.smithi057.stdout:Installed products updated. 2023-10-14T08:40:34.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:35.000 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-10-14T08:40:35.000 INFO:teuthology.orchestra.run.smithi057.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:35.000 INFO:teuthology.orchestra.run.smithi057.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-14T08:40:35.000 INFO:teuthology.orchestra.run.smithi057.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:35.000 INFO:teuthology.orchestra.run.smithi057.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-14T08:40:35.001 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-14T08:40:35.001 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-14T08:40:35.001 INFO:teuthology.orchestra.run.smithi057.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:35.001 INFO:teuthology.orchestra.run.smithi057.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-14T08:40:35.001 INFO:teuthology.orchestra.run.smithi057.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-14T08:40:35.002 INFO:teuthology.orchestra.run.smithi057.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-14T08:40:35.002 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:40:35.002 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-10-14T08:40:35.151 DEBUG:teuthology.parallel:result is None 2023-10-14T08:40:35.151 INFO:teuthology.run_tasks:Running task install... 2023-10-14T08:40:35.161 DEBUG:teuthology.task.install:project ceph 2023-10-14T08:40:35.161 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T08:40:35.162 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T08:40:35.162 INFO:teuthology.task.install:Using flavor: default 2023-10-14T08:40:35.168 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T08:40:35.169 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T08:40:35.169 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T08:40:35.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:40:35.172 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T08:40:35.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:40:35.173 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T08:40:35.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:40:35.400 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T08:40:35.400 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T08:40:35.407 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T08:40:35.408 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T08:40:35.409 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T08:40:35.409 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T08:40:35.511 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T08:40:35.511 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:40:35.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T08:40:35.523 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T08:40:35.524 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:40:35.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T08:40:35.526 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T08:40:35.526 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:40:35.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T08:40:35.545 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T08:40:35.545 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T08:40:35.555 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T08:40:35.555 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T08:40:35.560 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T08:40:35.560 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T08:40:35.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T08:40:35.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T08:40:35.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T08:40:35.700 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T08:40:35.703 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T08:40:35.711 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T08:40:35.769 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-10-14T08:40:35.771 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2023-10-14T08:40:35.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-10-14T08:40:35.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2023-10-14T08:40:35.778 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2023-10-14T08:40:35.779 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2023-10-14T08:40:36.155 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:36.165 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:36.166 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:37.060 INFO:teuthology.orchestra.run.smithi006.stdout:44 files removed 2023-10-14T08:40:37.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T08:40:37.142 INFO:teuthology.orchestra.run.smithi178.stdout:44 files removed 2023-10-14T08:40:37.145 INFO:teuthology.orchestra.run.smithi057.stdout:44 files removed 2023-10-14T08:40:37.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T08:40:37.200 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T08:40:37.467 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:37.524 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:37.555 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-10-14T08:40:39.232 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 137 kB/s | 81 kB 00:00 2023-10-14T08:40:39.241 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 119 kB/s | 81 kB 00:00 2023-10-14T08:40:39.266 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 136 kB/s | 81 kB 00:00 2023-10-14T08:40:39.566 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-10-14T08:40:39.636 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-10-14T08:40:39.658 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-10-14T08:40:39.808 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 6.8 kB/s | 1.5 kB 00:00 2023-10-14T08:40:39.983 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-14T08:40:39.984 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-10-14T08:40:40.048 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-14T08:40:40.135 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-14T08:40:40.199 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-14T08:40:40.728 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-14T08:40:41.319 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-14T08:40:42.069 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-10-14T08:40:44.193 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 399 kB/s | 24 kB 00:00 2023-10-14T08:40:45.010 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 566 kB/s | 24 kB 00:00 2023-10-14T08:40:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-14T08:40:45.784 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 444 kB/s | 24 kB 00:00 2023-10-14T08:40:45.954 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-14T08:40:46.719 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-14T08:40:53.271 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-14T08:40:54.330 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-10-14T08:40:55.036 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-10-14T08:41:04.627 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T08:41:04.628 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T08:41:04.642 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T08:41:04.642 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T08:41:04.644 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T08:41:04.645 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T08:41:04.647 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T08:41:04.650 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T08:41:04.651 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T08:41:04.783 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-10-14T08:41:04.796 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-10-14T08:41:04.796 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-10-14T08:41:04.796 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-10-14T08:41:04.796 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-10-14T08:41:04.797 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T08:41:04.797 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T08:41:04.797 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T08:41:04.797 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T08:41:04.797 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T08:41:04.798 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T08:41:04.798 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T08:41:04.798 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T08:41:04.798 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T08:41:04.798 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T08:41:04.799 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T08:41:04.799 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T08:41:04.799 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T08:41:04.799 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T08:41:04.801 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T08:41:04.801 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T08:41:04.801 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T08:41:04.802 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T08:41:04.802 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T08:41:04.802 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T08:41:04.802 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T08:41:04.802 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T08:41:04.803 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T08:41:04.803 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T08:41:04.803 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T08:41:04.803 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T08:41:04.803 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T08:41:04.804 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T08:41:04.804 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T08:41:04.804 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T08:41:04.804 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T08:41:04.804 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T08:41:04.805 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T08:41:04.805 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T08:41:04.805 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T08:41:04.805 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T08:41:04.805 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T08:41:04.806 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2023-10-14T08:41:04.806 INFO:teuthology.orchestra.run.smithi178.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T08:41:04.806 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T08:41:04.806 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T08:41:04.807 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-10-14T08:41:04.807 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T08:41:04.807 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T08:41:04.807 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T08:41:04.807 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T08:41:04.808 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T08:41:04.808 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T08:41:04.808 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T08:41:04.808 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T08:41:04.808 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T08:41:04.809 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T08:41:04.809 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T08:41:04.809 INFO:teuthology.orchestra.run.smithi178.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T08:41:04.809 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T08:41:04.809 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T08:41:04.809 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T08:41:04.810 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T08:41:04.810 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T08:41:04.810 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T08:41:04.810 INFO:teuthology.orchestra.run.smithi178.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T08:41:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T08:41:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T08:41:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T08:41:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T08:41:04.811 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T08:41:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T08:41:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T08:41:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T08:41:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T08:41:04.812 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T08:41:04.813 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T08:41:04.813 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T08:41:04.813 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T08:41:04.813 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T08:41:04.813 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T08:41:04.813 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T08:41:04.814 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T08:41:04.814 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T08:41:04.814 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T08:41:04.814 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T08:41:04.815 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T08:41:04.815 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T08:41:04.815 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T08:41:04.815 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T08:41:04.815 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T08:41:04.816 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T08:41:04.816 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T08:41:04.816 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T08:41:04.816 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T08:41:04.816 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T08:41:04.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T08:41:04.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T08:41:04.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T08:41:04.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T08:41:04.817 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T08:41:04.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T08:41:04.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T08:41:04.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T08:41:04.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T08:41:04.818 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T08:41:04.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T08:41:04.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T08:41:04.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T08:41:04.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T08:41:04.819 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T08:41:04.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T08:41:04.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T08:41:04.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T08:41:04.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T08:41:04.820 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T08:41:04.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T08:41:04.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T08:41:04.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T08:41:04.821 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T08:41:04.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T08:41:04.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T08:41:04.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T08:41:04.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T08:41:04.822 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T08:41:04.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T08:41:04.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T08:41:04.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T08:41:04.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T08:41:04.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T08:41:04.823 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T08:41:04.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T08:41:04.824 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T08:41:04.824 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T08:41:04.824 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T08:41:04.824 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T08:41:04.825 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T08:41:04.825 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T08:41:04.825 INFO:teuthology.orchestra.run.smithi178.stdout:Enabling module streams: 2023-10-14T08:41:04.825 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql 10 2023-10-14T08:41:04.825 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:41:04.826 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-10-14T08:41:04.826 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2023-10-14T08:41:04.826 INFO:teuthology.orchestra.run.smithi178.stdout:Install 128 Packages 2023-10-14T08:41:04.826 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 3 Packages 2023-10-14T08:41:04.827 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:41:04.827 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 209 M 2023-10-14T08:41:04.828 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-10-14T08:41:05.338 INFO:teuthology.orchestra.run.smithi178.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2023-10-14T08:41:05.706 INFO:teuthology.orchestra.run.smithi178.stdout:(2/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 10 MB/s | 5.4 MB 00:00 2023-10-14T08:41:05.763 INFO:teuthology.orchestra.run.smithi178.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.9 MB/s | 167 kB 00:00 2023-10-14T08:41:05.839 INFO:teuthology.orchestra.run.smithi178.stdout:(4/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.8 MB/s | 918 kB 00:00 2023-10-14T08:41:05.947 INFO:teuthology.orchestra.run.smithi178.stdout:(5/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 13 MB/s | 2.3 MB 00:00 2023-10-14T08:41:06.170 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T08:41:06.171 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T08:41:06.186 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T08:41:06.187 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T08:41:06.188 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T08:41:06.190 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T08:41:06.192 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T08:41:06.195 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T08:41:06.196 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T08:41:06.293 INFO:teuthology.orchestra.run.smithi178.stdout:(6/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 13 MB/s | 4.6 MB 00:00 2023-10-14T08:41:06.341 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-10-14T08:41:06.354 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-10-14T08:41:06.355 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-10-14T08:41:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-10-14T08:41:06.355 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-10-14T08:41:06.355 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T08:41:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T08:41:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T08:41:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T08:41:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T08:41:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T08:41:06.357 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T08:41:06.357 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T08:41:06.357 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T08:41:06.357 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T08:41:06.357 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T08:41:06.358 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T08:41:06.358 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T08:41:06.358 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T08:41:06.358 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T08:41:06.358 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T08:41:06.359 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T08:41:06.359 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T08:41:06.359 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T08:41:06.359 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T08:41:06.359 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T08:41:06.360 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T08:41:06.360 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T08:41:06.360 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T08:41:06.360 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T08:41:06.360 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T08:41:06.361 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T08:41:06.361 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T08:41:06.361 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T08:41:06.361 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T08:41:06.361 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T08:41:06.362 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T08:41:06.362 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T08:41:06.362 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T08:41:06.362 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T08:41:06.362 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T08:41:06.363 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T08:41:06.363 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-10-14T08:41:06.363 INFO:teuthology.orchestra.run.smithi057.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T08:41:06.363 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T08:41:06.363 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T08:41:06.364 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-10-14T08:41:06.364 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T08:41:06.364 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T08:41:06.364 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T08:41:06.364 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T08:41:06.365 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T08:41:06.365 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T08:41:06.365 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T08:41:06.365 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T08:41:06.365 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T08:41:06.366 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T08:41:06.366 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T08:41:06.366 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T08:41:06.366 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T08:41:06.366 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T08:41:06.367 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T08:41:06.367 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T08:41:06.367 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T08:41:06.367 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T08:41:06.367 INFO:teuthology.orchestra.run.smithi057.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T08:41:06.368 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T08:41:06.368 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T08:41:06.368 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T08:41:06.368 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T08:41:06.368 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T08:41:06.369 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T08:41:06.369 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T08:41:06.369 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T08:41:06.369 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T08:41:06.369 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T08:41:06.370 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T08:41:06.370 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T08:41:06.370 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T08:41:06.370 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T08:41:06.370 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T08:41:06.371 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T08:41:06.371 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T08:41:06.371 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T08:41:06.371 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T08:41:06.371 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T08:41:06.372 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T08:41:06.372 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T08:41:06.372 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T08:41:06.372 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T08:41:06.372 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T08:41:06.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T08:41:06.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T08:41:06.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T08:41:06.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T08:41:06.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T08:41:06.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T08:41:06.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T08:41:06.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T08:41:06.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T08:41:06.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T08:41:06.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T08:41:06.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T08:41:06.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T08:41:06.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T08:41:06.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T08:41:06.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T08:41:06.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T08:41:06.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T08:41:06.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T08:41:06.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T08:41:06.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T08:41:06.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T08:41:06.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T08:41:06.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T08:41:06.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T08:41:06.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T08:41:06.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T08:41:06.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T08:41:06.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T08:41:06.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T08:41:06.379 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T08:41:06.379 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T08:41:06.379 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T08:41:06.379 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T08:41:06.379 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T08:41:06.380 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T08:41:06.380 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T08:41:06.380 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T08:41:06.380 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T08:41:06.380 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T08:41:06.381 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T08:41:06.381 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T08:41:06.381 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T08:41:06.381 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T08:41:06.381 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T08:41:06.382 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T08:41:06.382 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T08:41:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling module streams: 2023-10-14T08:41:06.382 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql 10 2023-10-14T08:41:06.382 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:41:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-10-14T08:41:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-10-14T08:41:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:Install 128 Packages 2023-10-14T08:41:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 3 Packages 2023-10-14T08:41:06.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:41:06.384 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 209 M 2023-10-14T08:41:06.384 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-10-14T08:41:06.389 INFO:teuthology.orchestra.run.smithi178.stdout:(7/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 3.0 MB/s | 1.6 MB 00:00 2023-10-14T08:41:06.929 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T08:41:06.930 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T08:41:06.946 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T08:41:06.947 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T08:41:06.948 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T08:41:06.949 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T08:41:06.952 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T08:41:06.955 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T08:41:06.956 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T08:41:07.005 INFO:teuthology.orchestra.run.smithi057.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-10-14T08:41:07.100 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-10-14T08:41:07.113 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-10-14T08:41:07.114 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-10-14T08:41:07.114 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-10-14T08:41:07.114 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-10-14T08:41:07.114 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T08:41:07.115 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T08:41:07.115 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T08:41:07.115 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T08:41:07.115 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T08:41:07.115 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T08:41:07.116 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T08:41:07.116 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T08:41:07.116 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T08:41:07.116 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T08:41:07.116 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T08:41:07.117 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T08:41:07.117 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T08:41:07.117 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T08:41:07.117 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T08:41:07.117 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T08:41:07.118 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T08:41:07.118 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T08:41:07.118 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T08:41:07.118 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T08:41:07.118 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T08:41:07.119 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T08:41:07.119 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T08:41:07.119 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T08:41:07.119 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T08:41:07.120 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T08:41:07.120 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T08:41:07.120 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T08:41:07.120 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T08:41:07.121 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T08:41:07.121 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T08:41:07.121 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T08:41:07.121 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T08:41:07.121 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T08:41:07.121 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T08:41:07.122 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T08:41:07.122 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T08:41:07.122 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-10-14T08:41:07.122 INFO:teuthology.orchestra.run.smithi006.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T08:41:07.122 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T08:41:07.123 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T08:41:07.123 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-10-14T08:41:07.123 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T08:41:07.123 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T08:41:07.123 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T08:41:07.124 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T08:41:07.124 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T08:41:07.124 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T08:41:07.124 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T08:41:07.124 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T08:41:07.125 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T08:41:07.125 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T08:41:07.125 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T08:41:07.125 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T08:41:07.125 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T08:41:07.125 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T08:41:07.126 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T08:41:07.126 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T08:41:07.126 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T08:41:07.126 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T08:41:07.127 INFO:teuthology.orchestra.run.smithi006.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T08:41:07.127 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T08:41:07.127 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T08:41:07.127 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T08:41:07.127 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T08:41:07.128 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T08:41:07.128 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T08:41:07.128 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T08:41:07.128 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T08:41:07.128 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T08:41:07.129 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T08:41:07.129 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T08:41:07.129 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T08:41:07.129 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T08:41:07.129 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T08:41:07.130 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T08:41:07.130 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T08:41:07.130 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T08:41:07.130 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T08:41:07.131 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T08:41:07.131 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T08:41:07.131 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T08:41:07.131 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T08:41:07.131 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T08:41:07.132 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T08:41:07.132 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T08:41:07.132 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T08:41:07.132 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T08:41:07.132 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T08:41:07.133 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T08:41:07.133 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T08:41:07.133 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T08:41:07.133 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T08:41:07.134 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T08:41:07.134 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T08:41:07.134 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T08:41:07.134 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T08:41:07.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T08:41:07.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T08:41:07.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T08:41:07.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T08:41:07.135 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T08:41:07.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T08:41:07.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T08:41:07.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T08:41:07.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T08:41:07.136 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T08:41:07.137 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T08:41:07.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T08:41:07.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T08:41:07.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T08:41:07.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T08:41:07.138 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T08:41:07.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T08:41:07.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T08:41:07.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T08:41:07.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T08:41:07.139 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T08:41:07.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T08:41:07.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T08:41:07.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T08:41:07.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T08:41:07.140 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T08:41:07.141 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T08:41:07.141 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T08:41:07.141 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T08:41:07.141 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T08:41:07.141 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T08:41:07.142 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T08:41:07.142 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-10-14T08:41:07.142 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql 10 2023-10-14T08:41:07.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:41:07.142 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-10-14T08:41:07.142 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-10-14T08:41:07.143 INFO:teuthology.orchestra.run.smithi006.stdout:Install 128 Packages 2023-10-14T08:41:07.143 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 3 Packages 2023-10-14T08:41:07.143 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:41:07.144 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 209 M 2023-10-14T08:41:07.144 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-10-14T08:41:07.479 INFO:teuthology.orchestra.run.smithi006.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-14T08:41:07.606 INFO:teuthology.orchestra.run.smithi178.stdout:(8/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x86 14 MB/s | 18 MB 00:01 2023-10-14T08:41:07.682 INFO:teuthology.orchestra.run.smithi178.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 323 kB/s | 24 kB 00:00 2023-10-14T08:41:07.739 INFO:teuthology.orchestra.run.smithi057.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.2 MB/s | 918 kB 00:00 2023-10-14T08:41:07.917 INFO:teuthology.orchestra.run.smithi057.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 940 kB/s | 167 kB 00:00 2023-10-14T08:41:08.254 INFO:teuthology.orchestra.run.smithi006.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.2 MB/s | 918 kB 00:00 2023-10-14T08:41:08.446 INFO:teuthology.orchestra.run.smithi006.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 871 kB/s | 167 kB 00:00 2023-10-14T08:41:08.591 INFO:teuthology.orchestra.run.smithi178.stdout:(10/131): ceph-common-18.0.0-6730.g4ba8a190.el8 6.6 MB/s | 23 MB 00:03 2023-10-14T08:41:08.705 INFO:teuthology.orchestra.run.smithi006.stdout:(4/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 3.5 MB/s | 5.4 MB 00:01 2023-10-14T08:41:08.782 INFO:teuthology.orchestra.run.smithi178.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.3 MB/s | 261 kB 00:00 2023-10-14T08:41:08.924 INFO:teuthology.orchestra.run.smithi178.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 219 kB/s | 31 kB 00:00 2023-10-14T08:41:08.956 INFO:teuthology.orchestra.run.smithi057.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-10-14T08:41:09.030 INFO:teuthology.orchestra.run.smithi006.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 5.0 MB/s | 1.6 MB 00:00 2023-10-14T08:41:09.241 INFO:teuthology.orchestra.run.smithi178.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 2.6 MB/s | 839 kB 00:00 2023-10-14T08:41:09.273 INFO:teuthology.orchestra.run.smithi057.stdout:(5/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-10-14T08:41:09.341 INFO:teuthology.orchestra.run.smithi178.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.8 MB/s | 184 kB 00:00 2023-10-14T08:41:09.450 INFO:teuthology.orchestra.run.smithi178.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.3 MB/s | 139 kB 00:00 2023-10-14T08:41:09.564 INFO:teuthology.orchestra.run.smithi006.stdout:(6/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-14T08:41:09.715 INFO:teuthology.orchestra.run.smithi057.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 1.6 MB 00:00 2023-10-14T08:41:09.725 INFO:teuthology.orchestra.run.smithi178.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 1.8 MB/s | 518 kB 00:00 2023-10-14T08:41:10.164 INFO:teuthology.orchestra.run.smithi006.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 4.1 MB/s | 4.6 MB 00:01 2023-10-14T08:41:11.876 INFO:teuthology.orchestra.run.smithi178.stdout:(17/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 2.5 MB/s | 14 MB 00:05 2023-10-14T08:41:11.984 INFO:teuthology.orchestra.run.smithi178.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 415 kB/s | 45 kB 00:00 2023-10-14T08:41:12.101 INFO:teuthology.orchestra.run.smithi178.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.1 MB/s | 126 kB 00:00 2023-10-14T08:41:12.226 INFO:teuthology.orchestra.run.smithi178.stdout:(20/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 2.8 MB/s | 6.9 MB 00:02 2023-10-14T08:41:12.265 INFO:teuthology.orchestra.run.smithi057.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 1.5 MB/s | 4.6 MB 00:02 2023-10-14T08:41:12.343 INFO:teuthology.orchestra.run.smithi178.stdout:(21/131): python3-cephfs-18.0.0-6730.g4ba8a190. 815 kB/s | 197 kB 00:00 2023-10-14T08:41:12.468 INFO:teuthology.orchestra.run.smithi178.stdout:(22/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.5 MB/s | 371 kB 00:00 2023-10-14T08:41:12.577 INFO:teuthology.orchestra.run.smithi178.stdout:(23/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 1.5 MB/s | 365 kB 00:00 2023-10-14T08:41:12.602 INFO:teuthology.orchestra.run.smithi178.stdout:(24/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 801 kB/s | 107 kB 00:00 2023-10-14T08:41:12.614 INFO:teuthology.orchestra.run.smithi006.stdout:(8/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el8 5.7 MB/s | 14 MB 00:02 2023-10-14T08:41:12.694 INFO:teuthology.orchestra.run.smithi178.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 801 kB/s | 94 kB 00:00 2023-10-14T08:41:12.740 INFO:teuthology.orchestra.run.smithi006.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 195 kB/s | 24 kB 00:00 2023-10-14T08:41:12.811 INFO:teuthology.orchestra.run.smithi178.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.5 MB/s | 179 kB 00:00 2023-10-14T08:41:12.928 INFO:teuthology.orchestra.run.smithi178.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 198 kB/s | 23 kB 00:00 2023-10-14T08:41:13.053 INFO:teuthology.orchestra.run.smithi178.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.0 MB/s | 132 kB 00:00 2023-10-14T08:41:13.498 INFO:teuthology.orchestra.run.smithi006.stdout:(10/131): ceph-common-18.0.0-6730.g4ba8a190.el8 3.6 MB/s | 23 MB 00:06 2023-10-14T08:41:13.665 INFO:teuthology.orchestra.run.smithi006.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.5 MB/s | 261 kB 00:00 2023-10-14T08:41:13.774 INFO:teuthology.orchestra.run.smithi006.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 287 kB/s | 31 kB 00:00 2023-10-14T08:41:13.987 INFO:teuthology.orchestra.run.smithi178.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 2.6 MB/s | 3.6 MB 00:01 2023-10-14T08:41:14.146 INFO:teuthology.orchestra.run.smithi178.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 1.6 MB/s | 1.8 MB 00:01 2023-10-14T08:41:14.157 INFO:teuthology.orchestra.run.smithi006.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 2.1 MB/s | 839 kB 00:00 2023-10-14T08:41:14.299 INFO:teuthology.orchestra.run.smithi006.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.3 MB/s | 184 kB 00:00 2023-10-14T08:41:14.354 INFO:teuthology.orchestra.run.smithi178.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 1.1 MB/s | 242 kB 00:00 2023-10-14T08:41:14.408 INFO:teuthology.orchestra.run.smithi006.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.3 MB/s | 139 kB 00:00 2023-10-14T08:41:14.496 INFO:teuthology.orchestra.run.smithi178.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 335 kB/s | 47 kB 00:00 2023-10-14T08:41:14.613 INFO:teuthology.orchestra.run.smithi178.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 129 kB/s | 15 kB 00:00 2023-10-14T08:41:14.682 INFO:teuthology.orchestra.run.smithi006.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 1.8 MB/s | 518 kB 00:00 2023-10-14T08:41:14.822 INFO:teuthology.orchestra.run.smithi178.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 1.2 MB/s | 261 kB 00:00 2023-10-14T08:41:15.056 INFO:teuthology.orchestra.run.smithi178.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 820 kB/s | 192 kB 00:00 2023-10-14T08:41:15.197 INFO:teuthology.orchestra.run.smithi178.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 129 kB/s | 18 kB 00:00 2023-10-14T08:41:15.208 INFO:teuthology.orchestra.run.smithi006.stdout:(17/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 3.2 MB/s | 18 MB 00:05 2023-10-14T08:41:15.326 INFO:teuthology.orchestra.run.smithi006.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 384 kB/s | 45 kB 00:00 2023-10-14T08:41:15.426 INFO:teuthology.orchestra.run.smithi006.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.2 MB/s | 126 kB 00:00 2023-10-14T08:41:15.535 INFO:teuthology.orchestra.run.smithi006.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 1.8 MB/s | 197 kB 00:00 2023-10-14T08:41:15.581 INFO:teuthology.orchestra.run.smithi178.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 799 kB/s | 306 kB 00:00 2023-10-14T08:41:15.681 INFO:teuthology.orchestra.run.smithi178.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 588 kB/s | 59 kB 00:00 2023-10-14T08:41:15.726 INFO:teuthology.orchestra.run.smithi006.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 371 kB 00:00 2023-10-14T08:41:15.765 INFO:teuthology.orchestra.run.smithi178.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 903 kB/s | 75 kB 00:00 2023-10-14T08:41:15.918 INFO:teuthology.orchestra.run.smithi006.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 1.9 MB/s | 365 kB 00:00 2023-10-14T08:41:15.942 INFO:teuthology.orchestra.run.smithi178.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.6 MB/s | 476 kB 00:00 2023-10-14T08:41:16.027 INFO:teuthology.orchestra.run.smithi006.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 986 kB/s | 107 kB 00:00 2023-10-14T08:41:16.073 INFO:teuthology.orchestra.run.smithi057.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 2.4 MB/s | 23 MB 00:09 2023-10-14T08:41:16.127 INFO:teuthology.orchestra.run.smithi006.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 936 kB/s | 94 kB 00:00 2023-10-14T08:41:16.165 INFO:teuthology.orchestra.run.smithi057.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 266 kB/s | 24 kB 00:00 2023-10-14T08:41:16.407 INFO:teuthology.orchestra.run.smithi178.stdout:(41/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 5.6 MB/s | 49 MB 00:08 2023-10-14T08:41:16.433 INFO:teuthology.orchestra.run.smithi178.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 89 kB/s | 44 kB 00:00 2023-10-14T08:41:16.508 INFO:teuthology.orchestra.run.smithi178.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 440 kB/s | 33 kB 00:00 2023-10-14T08:41:16.583 INFO:teuthology.orchestra.run.smithi178.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 220 kB/s | 16 kB 00:00 2023-10-14T08:41:16.675 INFO:teuthology.orchestra.run.smithi178.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-14T08:41:16.767 INFO:teuthology.orchestra.run.smithi178.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 516 kB/s | 185 kB 00:00 2023-10-14T08:41:16.801 INFO:teuthology.orchestra.run.smithi178.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-14T08:41:16.851 INFO:teuthology.orchestra.run.smithi178.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 972 kB/s | 81 kB 00:00 2023-10-14T08:41:16.884 INFO:teuthology.orchestra.run.smithi178.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-14T08:41:16.960 INFO:teuthology.orchestra.run.smithi178.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-10-14T08:41:17.010 INFO:teuthology.orchestra.run.smithi178.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 9.3 MB/s | 1.2 MB 00:00 2023-10-14T08:41:17.044 INFO:teuthology.orchestra.run.smithi178.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 582 kB/s | 49 kB 00:00 2023-10-14T08:41:17.094 INFO:teuthology.orchestra.run.smithi178.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 704 kB/s | 59 kB 00:00 2023-10-14T08:41:17.119 INFO:teuthology.orchestra.run.smithi006.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 2.8 MB/s | 6.9 MB 00:02 2023-10-14T08:41:17.127 INFO:teuthology.orchestra.run.smithi178.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 720 kB/s | 60 kB 00:00 2023-10-14T08:41:17.186 INFO:teuthology.orchestra.run.smithi006.stdout:(26/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 3.4 MB/s | 3.6 MB 00:01 2023-10-14T08:41:17.187 INFO:teuthology.orchestra.run.smithi178.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-14T08:41:17.211 INFO:teuthology.orchestra.run.smithi006.stdout:(27/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-14T08:41:17.237 INFO:teuthology.orchestra.run.smithi178.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-14T08:41:17.245 INFO:teuthology.orchestra.run.smithi006.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6730.g 394 kB/s | 23 kB 00:00 2023-10-14T08:41:17.296 INFO:teuthology.orchestra.run.smithi006.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.5 MB/s | 132 kB 00:00 2023-10-14T08:41:17.328 INFO:teuthology.orchestra.run.smithi178.stdout:(57/131): ceph-mgr-diskprediction-local-18.0.0- 2.2 MB/s | 7.4 MB 00:03 2023-10-14T08:41:17.354 INFO:teuthology.orchestra.run.smithi178.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 201 kB/s | 34 kB 00:00 2023-10-14T08:41:17.379 INFO:teuthology.orchestra.run.smithi178.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-10-14T08:41:17.429 INFO:teuthology.orchestra.run.smithi178.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2023-10-14T08:41:17.454 INFO:teuthology.orchestra.run.smithi178.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 338 kB/s | 24 kB 00:00 2023-10-14T08:41:17.538 INFO:teuthology.orchestra.run.smithi178.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-10-14T08:41:17.564 INFO:teuthology.orchestra.run.smithi178.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-10-14T08:41:17.614 INFO:teuthology.orchestra.run.smithi178.stdout:(64/131): python3-rsa-4.9-2.el8.noarch.rpm 225 kB/s | 64 kB 00:00 2023-10-14T08:41:17.639 INFO:teuthology.orchestra.run.smithi178.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-14T08:41:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 2.3 MB/s | 18 MB 00:07 2023-10-14T08:41:17.654 INFO:teuthology.orchestra.run.smithi006.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 4.3 MB/s | 1.8 MB 00:00 2023-10-14T08:41:17.673 INFO:teuthology.orchestra.run.smithi178.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-10-14T08:41:17.715 INFO:teuthology.orchestra.run.smithi178.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2023-10-14T08:41:17.740 INFO:teuthology.orchestra.run.smithi178.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 851 kB/s | 85 kB 00:00 2023-10-14T08:41:17.763 INFO:teuthology.orchestra.run.smithi006.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.2 MB/s | 242 kB 00:00 2023-10-14T08:41:17.765 INFO:teuthology.orchestra.run.smithi178.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 249 kB/s | 23 kB 00:00 2023-10-14T08:41:17.782 INFO:teuthology.orchestra.run.smithi057.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 261 kB 00:00 2023-10-14T08:41:17.824 INFO:teuthology.orchestra.run.smithi178.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 832 kB/s | 70 kB 00:00 2023-10-14T08:41:17.854 INFO:teuthology.orchestra.run.smithi006.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 518 kB/s | 47 kB 00:00 2023-10-14T08:41:17.865 INFO:teuthology.orchestra.run.smithi057.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 373 kB/s | 31 kB 00:00 2023-10-14T08:41:17.882 INFO:teuthology.orchestra.run.smithi178.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-10-14T08:41:17.925 INFO:teuthology.orchestra.run.smithi178.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-14T08:41:17.939 INFO:teuthology.orchestra.run.smithi006.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 180 kB/s | 15 kB 00:00 2023-10-14T08:41:17.966 INFO:teuthology.orchestra.run.smithi178.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-14T08:41:18.009 INFO:teuthology.orchestra.run.smithi178.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-14T08:41:18.047 INFO:teuthology.orchestra.run.smithi006.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.4 MB/s | 261 kB 00:00 2023-10-14T08:41:18.059 INFO:teuthology.orchestra.run.smithi178.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 5.0 MB/s | 1.7 MB 00:00 2023-10-14T08:41:18.109 INFO:teuthology.orchestra.run.smithi178.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 388 kB/s | 39 kB 00:00 2023-10-14T08:41:18.156 INFO:teuthology.orchestra.run.smithi006.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.7 MB/s | 192 kB 00:00 2023-10-14T08:41:18.168 INFO:teuthology.orchestra.run.smithi178.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-10-14T08:41:18.193 INFO:teuthology.orchestra.run.smithi178.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-10-14T08:41:18.218 INFO:teuthology.orchestra.run.smithi178.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-10-14T08:41:18.239 INFO:teuthology.orchestra.run.smithi006.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 217 kB/s | 18 kB 00:00 2023-10-14T08:41:18.244 INFO:teuthology.orchestra.run.smithi178.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-14T08:41:18.286 INFO:teuthology.orchestra.run.smithi178.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-14T08:41:18.311 INFO:teuthology.orchestra.run.smithi178.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-10-14T08:41:18.353 INFO:teuthology.orchestra.run.smithi178.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-14T08:41:18.411 INFO:teuthology.orchestra.run.smithi178.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 754 kB/s | 44 kB 00:00 2023-10-14T08:41:18.416 INFO:teuthology.orchestra.run.smithi057.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 1.5 MB/s | 839 kB 00:00 2023-10-14T08:41:18.566 INFO:teuthology.orchestra.run.smithi057.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 1.2 MB/s | 184 kB 00:00 2023-10-14T08:41:18.578 INFO:teuthology.orchestra.run.smithi178.stdout:(85/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-10-14T08:41:18.639 INFO:teuthology.orchestra.run.smithi006.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 765 kB/s | 306 kB 00:00 2023-10-14T08:41:18.658 INFO:teuthology.orchestra.run.smithi057.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 1.5 MB/s | 139 kB 00:00 2023-10-14T08:41:18.675 INFO:teuthology.orchestra.run.smithi178.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-10-14T08:41:18.712 INFO:teuthology.orchestra.run.smithi178.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-10-14T08:41:18.723 INFO:teuthology.orchestra.run.smithi006.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 705 kB/s | 59 kB 00:00 2023-10-14T08:41:18.737 INFO:teuthology.orchestra.run.smithi178.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.5 MB/s | 225 kB 00:00 2023-10-14T08:41:18.763 INFO:teuthology.orchestra.run.smithi178.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-10-14T08:41:18.788 INFO:teuthology.orchestra.run.smithi178.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-14T08:41:18.807 INFO:teuthology.orchestra.run.smithi006.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 902 kB/s | 75 kB 00:00 2023-10-14T08:41:18.867 INFO:teuthology.orchestra.run.smithi057.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 2.4 MB/s | 518 kB 00:00 2023-10-14T08:41:18.897 INFO:teuthology.orchestra.run.smithi178.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2023-10-14T08:41:18.932 INFO:teuthology.orchestra.run.smithi006.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-10-14T08:41:19.007 INFO:teuthology.orchestra.run.smithi006.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2023-10-14T08:41:19.031 INFO:teuthology.orchestra.run.smithi178.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 427 kB/s | 103 kB 00:00 2023-10-14T08:41:19.073 INFO:teuthology.orchestra.run.smithi178.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 4.0 MB/s | 709 kB 00:00 2023-10-14T08:41:19.124 INFO:teuthology.orchestra.run.smithi006.stdout:(42/131): ceph-mgr-diskprediction-local-18.0.0- 4.1 MB/s | 7.4 MB 00:01 2023-10-14T08:41:19.148 INFO:teuthology.orchestra.run.smithi178.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 5.1 MB/s | 3.7 MB 00:00 2023-10-14T08:41:19.173 INFO:teuthology.orchestra.run.smithi178.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-10-14T08:41:19.215 INFO:teuthology.orchestra.run.smithi178.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-14T08:41:19.225 INFO:teuthology.orchestra.run.smithi006.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 851 kB/s | 185 kB 00:00 2023-10-14T08:41:19.257 INFO:teuthology.orchestra.run.smithi178.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-14T08:41:19.349 INFO:teuthology.orchestra.run.smithi178.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-10-14T08:41:19.424 INFO:teuthology.orchestra.run.smithi178.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-14T08:41:19.434 INFO:teuthology.orchestra.run.smithi006.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 80 kB/s | 16 kB 00:00 2023-10-14T08:41:19.459 INFO:teuthology.orchestra.run.smithi006.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 99 kB/s | 33 kB 00:00 2023-10-14T08:41:19.466 INFO:teuthology.orchestra.run.smithi178.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-14T08:41:19.500 INFO:teuthology.orchestra.run.smithi178.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-14T08:41:19.526 INFO:teuthology.orchestra.run.smithi006.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-14T08:41:19.542 INFO:teuthology.orchestra.run.smithi178.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-10-14T08:41:19.593 INFO:teuthology.orchestra.run.smithi006.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-10-14T08:41:19.605 INFO:teuthology.orchestra.run.smithi178.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2023-10-14T08:41:19.634 INFO:teuthology.orchestra.run.smithi178.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 464 kB/s | 43 kB 00:00 2023-10-14T08:41:19.651 INFO:teuthology.orchestra.run.smithi178.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.7 MB/s | 220 kB 00:00 2023-10-14T08:41:19.668 INFO:teuthology.orchestra.run.smithi006.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-10-14T08:41:19.676 INFO:teuthology.orchestra.run.smithi178.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-10-14T08:41:19.701 INFO:teuthology.orchestra.run.smithi178.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-14T08:41:19.710 INFO:teuthology.orchestra.run.smithi006.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.5 MB/s | 384 kB 00:00 2023-10-14T08:41:19.727 INFO:teuthology.orchestra.run.smithi178.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 850 kB/s | 43 kB 00:00 2023-10-14T08:41:19.744 INFO:teuthology.orchestra.run.smithi006.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2023-10-14T08:41:19.752 INFO:teuthology.orchestra.run.smithi178.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-14T08:41:19.777 INFO:teuthology.orchestra.run.smithi178.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-10-14T08:41:19.819 INFO:teuthology.orchestra.run.smithi006.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2023-10-14T08:41:19.844 INFO:teuthology.orchestra.run.smithi178.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.6 MB/s | 5.1 MB 00:00 2023-10-14T08:41:19.861 INFO:teuthology.orchestra.run.smithi178.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 223 kB/s | 19 kB 00:00 2023-10-14T08:41:19.920 INFO:teuthology.orchestra.run.smithi178.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.0 MB/s | 155 kB 00:00 2023-10-14T08:41:19.928 INFO:teuthology.orchestra.run.smithi006.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 542 kB/s | 59 kB 00:00 2023-10-14T08:41:19.945 INFO:teuthology.orchestra.run.smithi178.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.8 MB/s | 560 kB 00:00 2023-10-14T08:41:19.961 INFO:teuthology.orchestra.run.smithi006.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 4.6 MB/s | 1.2 MB 00:00 2023-10-14T08:41:19.962 INFO:teuthology.orchestra.run.smithi178.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 427 kB/s | 18 kB 00:00 2023-10-14T08:41:20.003 INFO:teuthology.orchestra.run.smithi006.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 802 kB/s | 60 kB 00:00 2023-10-14T08:41:20.004 INFO:teuthology.orchestra.run.smithi178.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-14T08:41:20.029 INFO:teuthology.orchestra.run.smithi178.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.0 MB/s | 605 kB 00:00 2023-10-14T08:41:20.045 INFO:teuthology.orchestra.run.smithi006.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-10-14T08:41:20.055 INFO:teuthology.orchestra.run.smithi178.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-10-14T08:41:20.070 INFO:teuthology.orchestra.run.smithi006.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-10-14T08:41:20.088 INFO:teuthology.orchestra.run.smithi178.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-14T08:41:20.114 INFO:teuthology.orchestra.run.smithi178.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-10-14T08:41:20.121 INFO:teuthology.orchestra.run.smithi006.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-10-14T08:41:20.139 INFO:teuthology.orchestra.run.smithi178.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-14T08:41:20.154 INFO:teuthology.orchestra.run.smithi006.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-14T08:41:20.189 INFO:teuthology.orchestra.run.smithi178.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2023-10-14T08:41:20.196 INFO:teuthology.orchestra.run.smithi006.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 852 kB/s | 64 kB 00:00 2023-10-14T08:41:20.222 INFO:teuthology.orchestra.run.smithi006.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-10-14T08:41:20.223 INFO:teuthology.orchestra.run.smithi178.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 690 kB/s | 58 kB 00:00 2023-10-14T08:41:20.225 INFO:teuthology.orchestra.run.smithi057.stdout:(17/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 1.7 MB/s | 14 MB 00:07 2023-10-14T08:41:20.248 INFO:teuthology.orchestra.run.smithi178.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 656 kB/s | 39 kB 00:00 2023-10-14T08:41:20.264 INFO:teuthology.orchestra.run.smithi006.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 358 kB/s | 24 kB 00:00 2023-10-14T08:41:20.289 INFO:teuthology.orchestra.run.smithi006.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 436 kB/s | 29 kB 00:00 2023-10-14T08:41:20.290 INFO:teuthology.orchestra.run.smithi178.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-10-14T08:41:20.315 INFO:teuthology.orchestra.run.smithi178.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-14T08:41:20.317 INFO:teuthology.orchestra.run.smithi057.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 490 kB/s | 45 kB 00:00 2023-10-14T08:41:20.341 INFO:teuthology.orchestra.run.smithi178.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-14T08:41:20.364 INFO:teuthology.orchestra.run.smithi006.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-14T08:41:20.390 INFO:teuthology.orchestra.run.smithi006.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-10-14T08:41:20.391 INFO:teuthology.orchestra.run.smithi178.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.0 MB/s | 2.3 MB 00:00 2023-10-14T08:41:20.400 INFO:teuthology.orchestra.run.smithi057.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.5 MB/s | 126 kB 00:00 2023-10-14T08:41:20.441 INFO:teuthology.orchestra.run.smithi178.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-14T08:41:20.448 INFO:teuthology.orchestra.run.smithi006.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-14T08:41:20.474 INFO:teuthology.orchestra.run.smithi006.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 734 kB/s | 61 kB 00:00 2023-10-14T08:41:20.524 INFO:teuthology.orchestra.run.smithi006.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-14T08:41:20.549 INFO:teuthology.orchestra.run.smithi006.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-10-14T08:41:20.559 INFO:teuthology.orchestra.run.smithi057.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 1.2 MB/s | 197 kB 00:00 2023-10-14T08:41:20.574 INFO:teuthology.orchestra.run.smithi006.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-10-14T08:41:20.666 INFO:teuthology.orchestra.run.smithi006.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-10-14T08:41:20.746 INFO:teuthology.orchestra.run.smithi006.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-14T08:41:20.784 INFO:teuthology.orchestra.run.smithi006.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.4 MB/s | 54 kB 00:00 2023-10-14T08:41:20.793 INFO:teuthology.orchestra.run.smithi057.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 1.6 MB/s | 371 kB 00:00 2023-10-14T08:41:20.826 INFO:teuthology.orchestra.run.smithi006.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-14T08:41:20.868 INFO:teuthology.orchestra.run.smithi006.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-14T08:41:20.901 INFO:teuthology.orchestra.run.smithi006.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-10-14T08:41:20.943 INFO:teuthology.orchestra.run.smithi057.stdout:(22/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 3.3 MB/s | 6.9 MB 00:02 2023-10-14T08:41:20.952 INFO:teuthology.orchestra.run.smithi006.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-10-14T08:41:21.002 INFO:teuthology.orchestra.run.smithi006.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-10-14T08:41:21.035 INFO:teuthology.orchestra.run.smithi057.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.1 MB/s | 107 kB 00:00 2023-10-14T08:41:21.044 INFO:teuthology.orchestra.run.smithi006.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-14T08:41:21.060 INFO:teuthology.orchestra.run.smithi057.stdout:(24/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 1.3 MB/s | 365 kB 00:00 2023-10-14T08:41:21.119 INFO:teuthology.orchestra.run.smithi057.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.1 MB/s | 94 kB 00:00 2023-10-14T08:41:21.203 INFO:teuthology.orchestra.run.smithi057.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-14T08:41:21.211 INFO:teuthology.orchestra.run.smithi006.stdout:(79/131): python3-scipy-1.0.0-21.module+el8.5.0 22 MB/s | 14 MB 00:00 2023-10-14T08:41:21.237 INFO:teuthology.orchestra.run.smithi006.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 977 kB/s | 187 kB 00:00 2023-10-14T08:41:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 4.1 MB/s | 3.7 MB 00:00 2023-10-14T08:41:21.278 INFO:teuthology.orchestra.run.smithi057.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 308 kB/s | 23 kB 00:00 2023-10-14T08:41:21.278 INFO:teuthology.orchestra.run.smithi006.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-14T08:41:21.312 INFO:teuthology.orchestra.run.smithi006.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 796 kB/s | 27 kB 00:00 2023-10-14T08:41:21.354 INFO:teuthology.orchestra.run.smithi006.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-14T08:41:21.386 INFO:teuthology.orchestra.run.smithi057.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.2 MB/s | 132 kB 00:00 2023-10-14T08:41:21.387 INFO:teuthology.orchestra.run.smithi006.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-14T08:41:21.463 INFO:teuthology.orchestra.run.smithi006.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-10-14T08:41:21.505 INFO:teuthology.orchestra.run.smithi006.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-14T08:41:21.547 INFO:teuthology.orchestra.run.smithi006.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-14T08:41:21.887 INFO:teuthology.orchestra.run.smithi057.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 3.5 MB/s | 1.8 MB 00:00 2023-10-14T08:41:21.993 INFO:teuthology.orchestra.run.smithi006.stdout:(88/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 5.3 MB/s | 49 MB 00:09 2023-10-14T08:41:22.023 INFO:teuthology.orchestra.run.smithi006.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 135 kB/s | 64 kB 00:00 2023-10-14T08:41:22.106 INFO:teuthology.orchestra.run.smithi006.stdout:(90/131): python3-numpy-1.14.3-10.el8.x86_64.rp 5.2 MB/s | 3.7 MB 00:00 2023-10-14T08:41:22.131 INFO:teuthology.orchestra.run.smithi006.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2023-10-14T08:41:22.157 INFO:teuthology.orchestra.run.smithi006.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 775 kB/s | 126 kB 00:00 2023-10-14T08:41:22.182 INFO:teuthology.orchestra.run.smithi006.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-10-14T08:41:22.216 INFO:teuthology.orchestra.run.smithi006.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-10-14T08:41:22.241 INFO:teuthology.orchestra.run.smithi006.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-14T08:41:22.283 INFO:teuthology.orchestra.run.smithi006.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-14T08:41:22.333 INFO:teuthology.orchestra.run.smithi006.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.0 MB/s | 354 kB 00:00 2023-10-14T08:41:22.450 INFO:teuthology.orchestra.run.smithi006.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-10-14T08:41:22.517 INFO:teuthology.orchestra.run.smithi006.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-10-14T08:41:22.562 INFO:teuthology.orchestra.run.smithi057.stdout:(30/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 2.4 MB/s | 3.6 MB 00:01 2023-10-14T08:41:22.566 INFO:teuthology.orchestra.run.smithi178.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 1.7 MB/s | 3.7 MB 00:02 2023-10-14T08:41:22.567 INFO:teuthology.orchestra.run.smithi006.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.7 MB/s | 808 kB 00:00 2023-10-14T08:41:22.571 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:41:22.571 INFO:teuthology.orchestra.run.smithi178.stdout:Total 12 MB/s | 209 MB 00:17 2023-10-14T08:41:22.609 INFO:teuthology.orchestra.run.smithi006.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-14T08:41:22.651 INFO:teuthology.orchestra.run.smithi006.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-14T08:41:22.676 INFO:teuthology.orchestra.run.smithi006.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-14T08:41:22.702 INFO:teuthology.orchestra.run.smithi006.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-10-14T08:41:22.721 INFO:teuthology.orchestra.run.smithi057.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 1.5 MB/s | 242 kB 00:00 2023-10-14T08:41:22.727 INFO:teuthology.orchestra.run.smithi006.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-14T08:41:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 958 kB/s | 48 kB 00:00 2023-10-14T08:41:22.769 INFO:teuthology.orchestra.run.smithi006.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-10-14T08:41:22.821 INFO:teuthology.orchestra.run.smithi057.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 474 kB/s | 47 kB 00:00 2023-10-14T08:41:22.828 INFO:teuthology.orchestra.run.smithi006.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 566 kB/s | 43 kB 00:00 2023-10-14T08:41:22.853 INFO:teuthology.orchestra.run.smithi006.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.3 MB/s | 109 kB 00:00 2023-10-14T08:41:22.879 INFO:teuthology.orchestra.run.smithi006.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-14T08:41:22.905 INFO:teuthology.orchestra.run.smithi057.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 180 kB/s | 15 kB 00:00 2023-10-14T08:41:22.946 INFO:teuthology.orchestra.run.smithi006.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.3 MB/s | 5.1 MB 00:00 2023-10-14T08:41:22.971 INFO:teuthology.orchestra.run.smithi006.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 204 kB/s | 19 kB 00:00 2023-10-14T08:41:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-14T08:41:23.038 INFO:teuthology.orchestra.run.smithi006.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.0 MB/s | 560 kB 00:00 2023-10-14T08:41:23.063 INFO:teuthology.orchestra.run.smithi006.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 268 kB/s | 18 kB 00:00 2023-10-14T08:41:23.080 INFO:teuthology.orchestra.run.smithi057.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 1.5 MB/s | 261 kB 00:00 2023-10-14T08:41:23.097 INFO:teuthology.orchestra.run.smithi006.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.3 MB/s | 559 kB 00:00 2023-10-14T08:41:23.122 INFO:teuthology.orchestra.run.smithi006.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-14T08:41:23.164 INFO:teuthology.orchestra.run.smithi006.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-14T08:41:23.223 INFO:teuthology.orchestra.run.smithi006.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 723 kB/s | 72 kB 00:00 2023-10-14T08:41:23.240 INFO:teuthology.orchestra.run.smithi006.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-10-14T08:41:23.247 INFO:teuthology.orchestra.run.smithi057.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.1 MB/s | 192 kB 00:00 2023-10-14T08:41:23.265 INFO:teuthology.orchestra.run.smithi006.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-14T08:41:23.290 INFO:teuthology.orchestra.run.smithi006.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-14T08:41:23.316 INFO:teuthology.orchestra.run.smithi006.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-14T08:41:23.341 INFO:teuthology.orchestra.run.smithi006.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 795 kB/s | 39 kB 00:00 2023-10-14T08:41:23.347 INFO:teuthology.orchestra.run.smithi057.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 181 kB/s | 18 kB 00:00 2023-10-14T08:41:23.378 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-10-14T08:41:23.383 INFO:teuthology.orchestra.run.smithi006.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-10-14T08:41:23.408 INFO:teuthology.orchestra.run.smithi006.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-14T08:41:23.433 INFO:teuthology.orchestra.run.smithi006.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-14T08:41:23.493 INFO:teuthology.orchestra.run.smithi006.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-10-14T08:41:23.497 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-10-14T08:41:23.497 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-10-14T08:41:23.551 INFO:teuthology.orchestra.run.smithi006.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-14T08:41:23.564 INFO:teuthology.orchestra.run.smithi057.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 4.4 MB/s | 7.4 MB 00:01 2023-10-14T08:41:23.598 INFO:teuthology.orchestra.run.smithi057.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-10-14T08:41:23.631 INFO:teuthology.orchestra.run.smithi057.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 883 kB/s | 59 kB 00:00 2023-10-14T08:41:23.656 INFO:teuthology.orchestra.run.smithi057.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2023-10-14T08:41:23.682 INFO:teuthology.orchestra.run.smithi057.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.7 MB/s | 44 kB 00:00 2023-10-14T08:41:23.732 INFO:teuthology.orchestra.run.smithi057.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2023-10-14T08:41:23.757 INFO:teuthology.orchestra.run.smithi057.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-14T08:41:23.774 INFO:teuthology.orchestra.run.smithi057.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 789 kB/s | 33 kB 00:00 2023-10-14T08:41:23.908 INFO:teuthology.orchestra.run.smithi057.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 109 kB/s | 16 kB 00:00 2023-10-14T08:41:24.183 INFO:teuthology.orchestra.run.smithi057.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 422 kB/s | 173 kB 00:00 2023-10-14T08:41:24.209 INFO:teuthology.orchestra.run.smithi057.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2023-10-14T08:41:24.234 INFO:teuthology.orchestra.run.smithi057.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-10-14T08:41:24.259 INFO:teuthology.orchestra.run.smithi057.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-10-14T08:41:24.284 INFO:teuthology.orchestra.run.smithi057.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-10-14T08:41:24.343 INFO:teuthology.orchestra.run.smithi057.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2023-10-14T08:41:24.359 INFO:teuthology.orchestra.run.smithi006.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 4.0 MB/s | 3.7 MB 00:00 2023-10-14T08:41:24.368 INFO:teuthology.orchestra.run.smithi057.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 583 kB/s | 49 kB 00:00 2023-10-14T08:41:24.393 INFO:teuthology.orchestra.run.smithi057.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-14T08:41:24.419 INFO:teuthology.orchestra.run.smithi057.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-10-14T08:41:24.444 INFO:teuthology.orchestra.run.smithi057.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-10-14T08:41:24.469 INFO:teuthology.orchestra.run.smithi057.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-10-14T08:41:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2023-10-14T08:41:24.520 INFO:teuthology.orchestra.run.smithi057.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-10-14T08:41:24.537 INFO:teuthology.orchestra.run.smithi057.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2023-10-14T08:41:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 446 kB/s | 19 kB 00:00 2023-10-14T08:41:24.588 INFO:teuthology.orchestra.run.smithi057.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 476 kB/s | 24 kB 00:00 2023-10-14T08:41:24.613 INFO:teuthology.orchestra.run.smithi057.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-10-14T08:41:24.638 INFO:teuthology.orchestra.run.smithi057.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-10-14T08:41:24.663 INFO:teuthology.orchestra.run.smithi057.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-10-14T08:41:24.689 INFO:teuthology.orchestra.run.smithi057.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-10-14T08:41:24.693 INFO:teuthology.orchestra.run.smithi006.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 2.9 MB/s | 3.7 MB 00:01 2023-10-14T08:41:24.696 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:41:24.696 INFO:teuthology.orchestra.run.smithi006.stdout:Total 12 MB/s | 209 MB 00:17 2023-10-14T08:41:24.714 INFO:teuthology.orchestra.run.smithi057.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-14T08:41:24.739 INFO:teuthology.orchestra.run.smithi057.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-14T08:41:24.765 INFO:teuthology.orchestra.run.smithi057.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-10-14T08:41:24.790 INFO:teuthology.orchestra.run.smithi057.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-14T08:41:24.853 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-10-14T08:41:24.857 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-10-14T08:41:24.907 INFO:teuthology.orchestra.run.smithi057.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-14T08:41:24.974 INFO:teuthology.orchestra.run.smithi057.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-14T08:41:25.016 INFO:teuthology.orchestra.run.smithi057.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-14T08:41:25.058 INFO:teuthology.orchestra.run.smithi057.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-14T08:41:25.100 INFO:teuthology.orchestra.run.smithi057.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-14T08:41:25.158 INFO:teuthology.orchestra.run.smithi057.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 664 kB/s | 39 kB 00:00 2023-10-14T08:41:25.300 INFO:teuthology.orchestra.run.smithi057.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 27 MB/s | 14 MB 00:00 2023-10-14T08:41:25.334 INFO:teuthology.orchestra.run.smithi057.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2023-10-14T08:41:25.368 INFO:teuthology.orchestra.run.smithi057.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-10-14T08:41:25.393 INFO:teuthology.orchestra.run.smithi057.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-14T08:41:25.418 INFO:teuthology.orchestra.run.smithi057.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-14T08:41:25.451 INFO:teuthology.orchestra.run.smithi057.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-14T08:41:25.477 INFO:teuthology.orchestra.run.smithi057.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2023-10-14T08:41:25.519 INFO:teuthology.orchestra.run.smithi057.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-14T08:41:25.552 INFO:teuthology.orchestra.run.smithi057.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-14T08:41:25.575 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-10-14T08:41:25.619 INFO:teuthology.orchestra.run.smithi057.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-14T08:41:25.661 INFO:teuthology.orchestra.run.smithi057.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-14T08:41:25.695 INFO:teuthology.orchestra.run.smithi057.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.6 MB/s | 225 kB 00:00 2023-10-14T08:41:25.707 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-10-14T08:41:25.707 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-10-14T08:41:25.753 INFO:teuthology.orchestra.run.smithi057.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 19 MB/s | 3.7 MB 00:00 2023-10-14T08:41:25.779 INFO:teuthology.orchestra.run.smithi057.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 762 kB/s | 64 kB 00:00 2023-10-14T08:41:25.805 INFO:teuthology.orchestra.run.smithi057.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2023-10-14T08:41:25.830 INFO:teuthology.orchestra.run.smithi057.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-10-14T08:41:25.855 INFO:teuthology.orchestra.run.smithi057.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-14T08:41:25.889 INFO:teuthology.orchestra.run.smithi057.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-14T08:41:25.930 INFO:teuthology.orchestra.run.smithi057.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-14T08:41:26.039 INFO:teuthology.orchestra.run.smithi057.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 26 MB/s | 4.9 MB 00:00 2023-10-14T08:41:26.073 INFO:teuthology.orchestra.run.smithi057.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2023-10-14T08:41:26.115 INFO:teuthology.orchestra.run.smithi057.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-14T08:41:26.181 INFO:teuthology.orchestra.run.smithi057.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 19 MB/s | 4.7 MB 00:00 2023-10-14T08:41:26.240 INFO:teuthology.orchestra.run.smithi057.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 14 MB/s | 808 kB 00:00 2023-10-14T08:41:26.307 INFO:teuthology.orchestra.run.smithi057.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-10-14T08:41:26.383 INFO:teuthology.orchestra.run.smithi057.stdout:(101/131): postgresql-server-10.21-2.module+el8 19 MB/s | 5.1 MB 00:00 2023-10-14T08:41:26.408 INFO:teuthology.orchestra.run.smithi057.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 467 kB/s | 47 kB 00:00 2023-10-14T08:41:26.433 INFO:teuthology.orchestra.run.smithi057.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-10-14T08:41:26.458 INFO:teuthology.orchestra.run.smithi057.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 851 kB/s | 43 kB 00:00 2023-10-14T08:41:26.483 INFO:teuthology.orchestra.run.smithi057.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-14T08:41:26.509 INFO:teuthology.orchestra.run.smithi057.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 955 kB/s | 48 kB 00:00 2023-10-14T08:41:26.534 INFO:teuthology.orchestra.run.smithi057.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-14T08:41:26.559 INFO:teuthology.orchestra.run.smithi057.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-10-14T08:41:26.584 INFO:teuthology.orchestra.run.smithi057.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-14T08:41:26.610 INFO:teuthology.orchestra.run.smithi057.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-14T08:41:26.643 INFO:teuthology.orchestra.run.smithi057.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-10-14T08:41:26.669 INFO:teuthology.orchestra.run.smithi057.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 318 kB/s | 19 kB 00:00 2023-10-14T08:41:26.694 INFO:teuthology.orchestra.run.smithi057.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-14T08:41:26.728 INFO:teuthology.orchestra.run.smithi057.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-10-14T08:41:26.753 INFO:teuthology.orchestra.run.smithi057.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 304 kB/s | 18 kB 00:00 2023-10-14T08:41:26.809 INFO:teuthology.orchestra.run.smithi057.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.3 MB/s | 605 kB 00:00 2023-10-14T08:41:26.845 INFO:teuthology.orchestra.run.smithi057.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-10-14T08:41:26.887 INFO:teuthology.orchestra.run.smithi057.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-10-14T08:41:26.911 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-10-14T08:41:26.915 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-10-14T08:41:26.946 INFO:teuthology.orchestra.run.smithi057.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 17 MB/s | 2.3 MB 00:00 2023-10-14T08:41:26.971 INFO:teuthology.orchestra.run.smithi057.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 985 kB/s | 83 kB 00:00 2023-10-14T08:41:26.996 INFO:teuthology.orchestra.run.smithi057.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-14T08:41:27.022 INFO:teuthology.orchestra.run.smithi057.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-14T08:41:27.047 INFO:teuthology.orchestra.run.smithi057.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-14T08:41:27.072 INFO:teuthology.orchestra.run.smithi057.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-10-14T08:41:27.106 INFO:teuthology.orchestra.run.smithi057.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-14T08:41:27.123 INFO:teuthology.orchestra.run.smithi057.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 3.3 MB/s | 171 kB 00:00 2023-10-14T08:41:27.148 INFO:teuthology.orchestra.run.smithi057.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-10-14T08:41:28.057 INFO:teuthology.orchestra.run.smithi057.stdout:(128/131): librados2-18.0.0-6730.g4ba8a190.el8. 4.0 MB/s | 3.7 MB 00:00 2023-10-14T08:41:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-14T08:41:28.591 INFO:teuthology.orchestra.run.smithi057.stdout:(130/131): ceph-test-18.0.0-6730.g4ba8a190.el8. 3.9 MB/s | 49 MB 00:12 2023-10-14T08:41:28.932 INFO:teuthology.orchestra.run.smithi057.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.1 MB/s | 3.7 MB 00:01 2023-10-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:41:28.935 INFO:teuthology.orchestra.run.smithi057.stdout:Total 9.2 MB/s | 209 MB 00:22 2023-10-14T08:41:29.796 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-10-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-10-14T08:41:29.927 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-10-14T08:41:29.994 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-10-14T08:41:30.424 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T08:41:30.620 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T08:41:30.842 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T08:41:31.009 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T08:41:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-10-14T08:41:31.125 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-10-14T08:41:31.135 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T08:41:31.417 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T08:41:31.839 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T08:41:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-10-14T08:41:32.084 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:41:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T08:41:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T08:41:32.488 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:41:32.557 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T08:41:32.714 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T08:41:32.725 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:41:32.833 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T08:41:32.858 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:41:33.051 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:41:33.098 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T08:41:33.146 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:41:33.337 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T08:41:33.538 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T08:41:33.620 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T08:41:33.789 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:41:33.886 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T08:41:34.215 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:41:34.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T08:41:34.406 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:41:34.553 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:41:34.582 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T08:41:34.747 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:41:34.767 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T08:41:34.851 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:41:34.881 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T08:41:35.055 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T08:41:35.150 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T08:41:35.227 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T08:41:35.274 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T08:41:35.366 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T08:41:35.494 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T08:41:35.502 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T08:41:35.700 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T08:41:36.097 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T08:41:36.198 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-10-14T08:41:36.322 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T08:41:36.347 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T08:41:36.363 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T08:41:36.489 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T08:41:36.535 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T08:41:36.541 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T08:41:36.634 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T08:41:36.757 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T08:41:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T08:41:36.853 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T08:41:36.932 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T08:41:37.005 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T08:41:37.068 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T08:41:37.147 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T08:41:37.151 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T08:41:37.282 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T08:41:37.305 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T08:41:37.391 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T08:41:37.723 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T08:41:37.931 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:41:37.990 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T08:41:38.093 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T08:41:38.147 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T08:41:38.356 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:41:38.389 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T08:41:38.515 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:41:38.641 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T08:41:38.654 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:41:38.814 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:41:38.815 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T08:41:38.902 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T08:41:38.914 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:41:39.030 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T08:41:39.091 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T08:41:39.121 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T08:41:39.321 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T08:41:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T08:41:39.544 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T08:41:39.617 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T08:41:39.783 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T08:41:39.822 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T08:41:39.939 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T08:41:39.951 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T08:41:40.037 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T08:41:40.156 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T08:41:40.238 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T08:41:40.426 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T08:41:40.531 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T08:41:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T08:41:40.635 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T08:41:40.789 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T08:41:40.800 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T08:41:40.871 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T08:41:40.882 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T08:41:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T08:41:41.079 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T08:41:41.158 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T08:41:41.204 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T08:41:41.270 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T08:41:41.348 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T08:41:41.451 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T08:41:41.492 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T08:41:41.781 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T08:41:41.999 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T08:41:42.009 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T08:41:42.206 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T08:41:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T08:41:42.745 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T08:41:42.847 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T08:41:43.005 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T08:41:43.011 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T08:41:43.234 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T08:41:43.446 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T08:41:43.751 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T08:41:43.777 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T08:41:44.054 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T08:41:44.108 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T08:41:44.264 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T08:41:44.361 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T08:41:44.469 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T08:41:44.559 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T08:41:44.646 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T08:41:44.804 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T08:41:44.869 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T08:41:45.010 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T08:41:45.089 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T08:41:45.155 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T08:41:45.237 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T08:41:45.326 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T08:41:45.353 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T08:41:45.368 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T08:41:45.584 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T08:41:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T08:41:45.752 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T08:41:45.887 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T08:41:46.039 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T08:41:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T08:41:46.271 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T08:41:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T08:41:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T08:41:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T08:41:46.654 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T08:41:46.680 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T08:41:46.695 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T08:41:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T08:41:46.920 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T08:41:46.968 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T08:41:46.999 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T08:41:47.166 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T08:41:47.184 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T08:41:47.292 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T08:41:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T08:41:47.427 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T08:41:47.513 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T08:41:47.657 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T08:41:47.710 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T08:41:48.034 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T08:41:48.072 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T08:41:48.317 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T08:41:48.339 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T08:41:48.491 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T08:41:48.575 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T08:41:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T08:41:48.847 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T08:41:48.919 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T08:41:49.061 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T08:41:49.251 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T08:41:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T08:41:49.402 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T08:41:49.504 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T08:41:49.594 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T08:41:49.698 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T08:41:49.708 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T08:41:49.885 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T08:41:49.911 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T08:41:49.944 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T08:41:50.109 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T08:41:50.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T08:41:50.176 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T08:41:50.278 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T08:41:50.302 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T08:41:50.437 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T08:41:50.551 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T08:41:50.612 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T08:41:50.637 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T08:41:50.714 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T08:41:50.790 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T08:41:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T08:41:50.914 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T08:41:50.997 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T08:41:51.064 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T08:41:51.090 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T08:41:51.181 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T08:41:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T08:41:51.334 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T08:41:51.394 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T08:41:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T08:41:51.575 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T08:41:51.587 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T08:41:51.689 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T08:41:51.730 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T08:41:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T08:41:51.835 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T08:41:51.962 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T08:41:52.022 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T08:41:52.059 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T08:41:52.086 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T08:41:52.247 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T08:41:52.264 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T08:41:52.350 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T08:41:52.442 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T08:41:52.454 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T08:41:52.583 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T08:41:52.595 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T08:41:52.674 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T08:41:52.709 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T08:41:52.798 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T08:41:52.938 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T08:41:52.939 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T08:41:53.140 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T08:41:53.145 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T08:41:53.178 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T08:41:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T08:41:53.351 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T08:41:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T08:41:53.498 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T08:41:53.512 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T08:41:53.646 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T08:41:53.712 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T08:41:53.806 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T08:41:53.818 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T08:41:53.949 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T08:41:53.995 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T08:41:54.061 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T08:41:54.162 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T08:41:54.176 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T08:41:54.217 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T08:41:54.349 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T08:41:54.392 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T08:41:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T08:41:54.527 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T08:41:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T08:41:54.697 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T08:41:54.783 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T08:41:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T08:41:54.951 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T08:41:55.000 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T08:41:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T08:41:55.190 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T08:41:55.211 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T08:41:55.213 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T08:41:55.318 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T08:41:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T08:41:55.485 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T08:41:55.583 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T08:41:55.729 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T08:41:55.800 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T08:41:55.802 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T08:41:55.879 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T08:41:56.015 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T08:41:56.026 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T08:41:56.139 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T08:41:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T08:41:56.274 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T08:41:56.282 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T08:41:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T08:41:56.539 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T08:41:56.729 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T08:41:56.750 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T08:41:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T08:41:56.966 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T08:41:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T08:41:57.220 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T08:41:57.300 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T08:41:57.373 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T08:41:57.522 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T08:41:57.599 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T08:41:57.727 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T08:41:57.896 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T08:41:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T08:41:58.123 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T08:41:58.186 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T08:41:58.247 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T08:41:58.334 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T08:41:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T08:41:58.516 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T08:41:58.579 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T08:41:58.689 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T08:41:58.717 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T08:41:58.794 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T08:41:58.918 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T08:41:59.057 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T08:41:59.109 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T08:41:59.265 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T08:41:59.337 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T08:41:59.452 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T08:41:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T08:41:59.645 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T08:41:59.681 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T08:41:59.862 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T08:41:59.900 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T08:41:59.921 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T08:42:00.076 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T08:42:00.137 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T08:42:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T08:42:00.397 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T08:42:00.554 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T08:42:00.578 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T08:42:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T08:42:00.712 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T08:42:00.819 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T08:42:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T08:42:02.179 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T08:42:02.459 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T08:42:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T08:42:02.987 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T08:42:03.277 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T08:42:03.463 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T08:42:04.299 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T08:42:04.461 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T08:42:04.497 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:04.570 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T08:42:04.719 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T08:42:04.720 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:05.123 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:05.305 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:05.361 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:05.657 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T08:42:05.731 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T08:42:05.877 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T08:42:05.992 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:06.298 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T08:42:06.388 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T08:42:06.560 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T08:42:08.617 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:08.853 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:09.484 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T08:42:09.754 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T08:42:09.837 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T08:42:09.985 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T08:42:24.937 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T08:42:24.937 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2023-10-14T08:42:24.937 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2023-10-14T08:42:24.937 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2023-10-14T08:42:24.938 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /run 2023-10-14T08:42:24.938 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2023-10-14T08:42:24.938 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2023-10-14T08:42:24.938 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2023-10-14T08:42:24.938 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2023-10-14T08:42:24.939 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2023-10-14T08:42:24.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:42:25.324 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T08:42:26.369 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T08:42:26.370 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-10-14T08:42:26.370 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-10-14T08:42:26.370 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-10-14T08:42:26.370 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-10-14T08:42:26.370 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-10-14T08:42:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-10-14T08:42:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-10-14T08:42:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-10-14T08:42:26.371 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-10-14T08:42:26.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:42:26.725 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T08:42:26.912 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T08:42:27.111 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T08:42:27.332 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T08:42:27.574 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T08:42:28.032 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T08:42:28.215 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T08:42:28.232 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T08:42:28.433 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T08:42:28.595 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T08:42:28.829 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T08:42:29.007 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T08:42:29.502 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T08:42:29.671 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T08:42:29.671 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2023-10-14T08:42:29.672 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2023-10-14T08:42:29.672 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-10-14T08:42:29.672 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2023-10-14T08:42:29.672 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2023-10-14T08:42:29.673 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2023-10-14T08:42:29.673 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2023-10-14T08:42:29.673 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2023-10-14T08:42:29.673 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-10-14T08:42:29.673 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:42:29.683 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T08:42:29.701 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T08:42:29.962 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T08:42:30.065 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T08:42:30.188 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T08:42:30.321 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T08:42:30.573 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T08:42:30.798 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T08:42:31.014 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T08:42:31.202 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T08:42:31.548 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T08:42:31.756 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T08:42:31.775 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T08:42:31.872 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T08:42:31.925 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T08:42:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T08:42:32.159 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T08:42:32.160 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T08:42:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T08:42:32.324 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T08:42:32.356 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T08:42:32.446 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T08:42:32.527 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T08:42:32.805 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T08:42:32.810 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T08:42:32.824 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T08:42:32.965 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T08:42:32.983 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T08:42:33.007 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T08:42:33.042 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T08:42:33.197 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T08:42:33.208 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T08:42:33.830 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T08:42:33.998 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T08:42:34.095 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T08:42:34.462 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T08:42:34.581 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T08:42:34.700 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T08:42:34.737 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T08:42:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T08:42:34.812 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T08:42:34.846 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T08:42:34.931 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T08:42:34.944 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T08:42:34.989 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T08:42:35.011 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T08:42:35.030 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T08:42:35.163 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T08:42:35.222 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T08:42:35.358 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T08:42:35.539 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T08:42:35.592 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T08:42:35.768 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T08:42:35.789 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T08:42:36.050 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T08:42:36.365 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T08:42:36.577 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T08:42:36.612 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T08:42:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T08:42:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T08:42:36.990 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T08:42:37.079 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T08:42:37.247 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T08:42:37.345 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T08:42:37.387 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T08:42:37.540 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T08:42:37.703 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T08:42:37.911 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T08:42:37.948 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T08:42:38.114 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T08:42:38.126 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T08:42:39.549 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T08:42:39.742 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T08:42:39.777 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T08:42:39.914 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T08:42:39.958 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T08:42:40.114 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T08:42:40.428 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T08:42:40.509 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T08:42:40.672 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T08:42:40.759 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T08:42:40.946 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T08:42:41.134 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T08:42:42.016 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T08:42:42.366 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T08:42:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T08:42:42.565 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T08:42:42.791 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T08:42:42.812 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T08:42:43.024 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T08:42:43.097 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T08:42:43.189 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T08:42:43.304 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T08:42:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T08:42:44.573 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T08:42:44.759 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T08:42:44.918 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T08:42:45.126 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T08:42:45.273 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T08:42:45.391 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T08:42:45.695 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:45.714 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:45.920 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T08:42:45.986 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T08:42:46.087 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T08:42:46.212 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T08:42:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T08:42:46.558 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T08:42:46.905 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T08:42:47.036 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:47.044 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:47.221 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T08:42:47.265 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T08:42:47.478 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T08:42:47.556 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T08:42:47.556 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T08:42:47.740 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:47.758 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T08:42:47.778 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T08:42:47.790 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T08:42:47.791 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:47.942 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T08:42:47.972 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:48.014 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:48.015 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T08:42:48.125 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T08:42:48.131 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T08:42:48.255 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T08:42:48.267 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T08:42:48.456 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T08:42:48.485 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T08:42:49.024 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:49.024 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T08:42:49.024 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T08:42:49.025 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T08:42:49.025 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T08:42:49.025 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T08:42:49.025 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:42:49.025 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:42:49.026 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:42:49.026 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T08:42:49.026 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T08:42:49.026 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T08:42:49.026 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T08:42:49.027 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T08:42:49.027 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T08:42:49.027 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T08:42:49.028 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T08:42:49.028 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T08:42:49.028 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T08:42:49.028 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T08:42:49.028 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T08:42:49.028 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T08:42:49.029 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T08:42:49.029 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T08:42:49.029 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T08:42:49.029 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T08:42:49.029 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T08:42:49.030 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T08:42:49.030 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T08:42:49.030 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T08:42:49.030 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T08:42:49.030 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T08:42:49.031 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T08:42:49.031 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T08:42:49.031 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T08:42:49.031 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T08:42:49.031 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T08:42:49.032 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T08:42:49.032 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T08:42:49.032 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T08:42:49.032 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T08:42:49.032 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T08:42:49.033 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T08:42:49.033 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T08:42:49.033 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T08:42:49.033 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T08:42:49.033 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T08:42:49.033 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T08:42:49.034 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T08:42:49.034 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T08:42:49.034 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T08:42:49.035 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T08:42:49.035 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T08:42:49.035 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T08:42:49.035 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T08:42:49.035 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T08:42:49.036 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T08:42:49.036 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T08:42:49.036 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T08:42:49.036 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T08:42:49.036 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T08:42:49.037 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T08:42:49.037 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T08:42:49.037 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T08:42:49.037 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T08:42:49.037 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T08:42:49.037 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T08:42:49.038 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T08:42:49.038 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T08:42:49.038 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T08:42:49.038 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T08:42:49.038 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T08:42:49.039 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T08:42:49.039 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T08:42:49.039 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T08:42:49.040 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T08:42:49.040 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T08:42:49.040 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T08:42:49.040 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T08:42:49.040 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T08:42:49.040 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T08:42:49.041 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T08:42:49.041 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T08:42:49.041 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T08:42:49.041 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T08:42:49.041 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T08:42:49.042 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T08:42:49.042 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T08:42:49.042 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T08:42:49.042 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T08:42:49.042 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T08:42:49.043 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T08:42:49.043 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T08:42:49.043 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T08:42:49.043 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T08:42:49.043 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T08:42:49.044 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T08:42:49.044 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T08:42:49.044 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T08:42:49.044 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T08:42:49.044 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T08:42:49.045 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T08:42:49.045 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T08:42:49.045 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T08:42:49.045 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T08:42:49.045 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T08:42:49.046 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T08:42:49.046 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T08:42:49.046 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T08:42:49.046 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T08:42:49.046 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T08:42:49.046 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T08:42:49.047 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T08:42:49.047 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T08:42:49.047 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T08:42:49.047 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T08:42:49.047 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T08:42:49.048 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T08:42:49.048 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T08:42:49.048 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T08:42:49.048 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T08:42:49.048 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T08:42:49.049 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T08:42:49.049 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T08:42:49.049 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T08:42:49.049 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T08:42:49.049 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T08:42:49.049 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T08:42:49.050 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:49.050 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T08:42:49.050 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T08:42:49.050 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T08:42:49.050 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:49.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T08:42:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T08:42:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:49.465 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T08:42:49.655 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T08:42:49.744 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T08:42:49.980 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T08:42:49.995 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T08:42:49.995 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:50.183 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:50.184 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T08:42:50.445 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T08:42:50.638 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:50.648 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:50.945 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T08:42:51.219 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:51.220 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T08:42:51.220 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T08:42:51.220 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T08:42:51.220 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T08:42:51.221 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T08:42:51.221 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:42:51.221 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:42:51.221 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:42:51.221 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T08:42:51.222 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T08:42:51.222 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T08:42:51.222 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T08:42:51.222 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T08:42:51.222 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T08:42:51.223 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T08:42:51.223 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T08:42:51.223 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T08:42:51.223 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T08:42:51.223 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T08:42:51.224 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T08:42:51.224 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T08:42:51.224 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T08:42:51.224 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T08:42:51.224 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T08:42:51.225 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T08:42:51.225 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T08:42:51.225 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T08:42:51.225 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T08:42:51.225 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T08:42:51.226 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T08:42:51.226 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T08:42:51.226 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T08:42:51.226 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T08:42:51.226 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T08:42:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T08:42:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T08:42:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T08:42:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T08:42:51.227 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T08:42:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T08:42:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T08:42:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T08:42:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T08:42:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T08:42:51.228 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T08:42:51.229 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T08:42:51.229 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T08:42:51.229 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T08:42:51.229 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T08:42:51.229 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T08:42:51.230 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T08:42:51.230 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T08:42:51.230 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T08:42:51.230 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T08:42:51.230 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T08:42:51.231 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T08:42:51.231 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T08:42:51.231 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T08:42:51.231 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T08:42:51.231 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T08:42:51.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T08:42:51.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T08:42:51.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T08:42:51.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T08:42:51.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T08:42:51.232 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T08:42:51.233 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T08:42:51.233 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T08:42:51.233 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T08:42:51.233 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T08:42:51.233 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T08:42:51.234 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T08:42:51.234 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T08:42:51.234 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T08:42:51.234 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T08:42:51.234 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T08:42:51.234 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T08:42:51.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T08:42:51.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T08:42:51.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T08:42:51.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T08:42:51.235 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T08:42:51.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T08:42:51.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T08:42:51.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T08:42:51.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T08:42:51.236 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T08:42:51.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T08:42:51.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T08:42:51.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T08:42:51.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T08:42:51.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T08:42:51.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T08:42:51.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T08:42:51.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T08:42:51.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T08:42:51.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T08:42:51.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T08:42:51.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T08:42:51.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T08:42:51.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T08:42:51.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T08:42:51.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T08:42:51.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T08:42:51.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T08:42:51.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T08:42:51.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T08:42:51.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T08:42:51.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T08:42:51.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T08:42:51.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T08:42:51.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T08:42:51.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T08:42:51.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T08:42:51.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T08:42:51.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T08:42:51.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T08:42:51.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T08:42:51.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T08:42:51.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T08:42:51.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T08:42:51.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T08:42:51.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T08:42:51.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T08:42:51.243 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T08:42:51.244 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:51.245 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T08:42:51.246 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T08:42:51.429 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T08:42:51.592 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:51.593 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:59 ago on Sat 14 Oct 2023 08:40:52 AM UTC. 2023-10-14T08:42:51.730 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T08:42:52.039 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T08:42:52.170 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:52.354 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T08:42:52.511 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T08:42:52.600 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T08:42:52.820 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T08:42:52.834 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T08:42:52.834 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:53.023 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:53.024 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T08:42:53.238 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T08:42:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:53.728 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:59 ago on Sat 14 Oct 2023 08:40:54 AM UTC. 2023-10-14T08:42:53.966 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:53.966 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T08:42:53.966 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T08:42:53.966 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T08:42:53.967 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T08:42:53.967 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T08:42:53.967 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T08:42:53.967 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T08:42:53.968 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T08:42:53.968 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T08:42:53.968 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T08:42:53.970 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T08:42:53.970 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T08:42:53.970 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T08:42:53.971 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T08:42:53.971 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T08:42:53.971 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T08:42:53.971 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T08:42:53.972 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T08:42:53.972 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T08:42:53.972 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T08:42:53.972 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T08:42:53.973 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T08:42:53.973 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T08:42:53.973 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T08:42:53.973 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T08:42:53.973 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T08:42:53.973 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T08:42:53.974 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T08:42:53.974 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T08:42:53.974 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T08:42:53.974 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T08:42:53.975 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T08:42:53.975 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T08:42:53.975 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T08:42:53.975 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T08:42:53.976 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T08:42:53.976 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T08:42:53.976 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T08:42:53.976 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T08:42:53.976 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T08:42:53.976 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T08:42:53.977 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T08:42:53.977 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T08:42:53.977 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T08:42:53.977 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T08:42:53.977 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T08:42:53.978 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T08:42:53.978 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T08:42:53.978 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T08:42:53.978 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T08:42:53.978 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T08:42:53.979 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T08:42:53.979 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T08:42:53.979 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T08:42:53.979 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T08:42:53.979 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T08:42:53.980 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T08:42:53.980 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T08:42:53.980 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T08:42:53.980 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T08:42:53.980 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T08:42:53.981 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T08:42:53.981 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T08:42:53.981 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T08:42:53.981 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T08:42:53.981 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T08:42:53.982 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T08:42:53.982 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T08:42:53.982 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T08:42:53.982 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T08:42:53.982 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T08:42:53.983 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T08:42:53.983 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T08:42:53.983 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T08:42:53.983 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T08:42:53.983 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T08:42:53.984 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T08:42:53.984 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T08:42:53.984 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T08:42:53.984 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T08:42:53.984 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T08:42:53.985 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T08:42:53.985 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T08:42:53.985 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T08:42:53.985 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T08:42:53.985 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T08:42:53.986 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T08:42:53.986 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T08:42:53.986 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T08:42:53.986 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T08:42:53.986 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T08:42:53.987 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T08:42:53.987 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T08:42:53.987 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T08:42:53.987 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T08:42:53.987 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T08:42:53.987 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T08:42:53.988 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T08:42:53.988 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T08:42:53.988 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T08:42:53.988 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T08:42:53.988 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T08:42:53.989 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T08:42:53.989 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T08:42:53.989 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T08:42:53.989 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T08:42:53.989 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T08:42:53.990 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T08:42:53.990 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T08:42:53.990 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T08:42:53.990 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T08:42:53.990 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T08:42:53.991 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T08:42:53.991 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T08:42:53.991 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T08:42:53.991 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T08:42:53.991 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T08:42:53.992 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T08:42:53.992 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T08:42:53.992 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T08:42:53.992 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T08:42:53.992 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T08:42:53.993 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T08:42:53.993 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T08:42:53.993 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T08:42:53.993 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T08:42:53.993 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T08:42:53.994 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T08:42:53.994 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T08:42:53.994 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T08:42:53.994 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T08:42:53.994 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T08:42:53.995 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T08:42:54.184 INFO:teuthology.orchestra.run.smithi178.stdout:Installed products updated. 2023-10-14T08:42:54.402 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:42:54.403 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2023-10-14T08:42:54.403 INFO:teuthology.orchestra.run.smithi178.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T08:42:54.403 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.403 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.404 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-10-14T08:42:54.404 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T08:42:54.404 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T08:42:54.404 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T08:42:54.404 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.405 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.405 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.405 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.405 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.405 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.406 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.406 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.406 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.406 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.406 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.407 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.407 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.407 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.407 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.407 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.408 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.408 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.408 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.408 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.408 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.409 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.409 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:54.409 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T08:42:54.409 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T08:42:54.409 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T08:42:54.410 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T08:42:54.410 INFO:teuthology.orchestra.run.smithi178.stdout: jq-1.6-3.el8.x86_64 2023-10-14T08:42:54.410 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T08:42:54.410 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T08:42:54.410 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T08:42:54.411 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.411 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.411 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.411 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T08:42:54.411 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T08:42:54.411 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T08:42:54.412 INFO:teuthology.orchestra.run.smithi178.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T08:42:54.412 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T08:42:54.412 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T08:42:54.412 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.412 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.413 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T08:42:54.413 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.413 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T08:42:54.413 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T08:42:54.413 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T08:42:54.414 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T08:42:54.414 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T08:42:54.414 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T08:42:54.414 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T08:42:54.414 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T08:42:54.415 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T08:42:54.415 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T08:42:54.415 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T08:42:54.415 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T08:42:54.415 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T08:42:54.415 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T08:42:54.416 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:54.416 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:54.416 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:54.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T08:42:54.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T08:42:54.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T08:42:54.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T08:42:54.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T08:42:54.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.418 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.418 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.418 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T08:42:54.418 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T08:42:54.418 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T08:42:54.419 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T08:42:54.419 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T08:42:54.419 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T08:42:54.419 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T08:42:54.419 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T08:42:54.420 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T08:42:54.420 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T08:42:54.420 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T08:42:54.420 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T08:42:54.420 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T08:42:54.420 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T08:42:54.421 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T08:42:54.421 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T08:42:54.421 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T08:42:54.421 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T08:42:54.421 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T08:42:54.422 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T08:42:54.422 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T08:42:54.422 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T08:42:54.422 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T08:42:54.423 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T08:42:54.423 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T08:42:54.423 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T08:42:54.423 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T08:42:54.423 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T08:42:54.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T08:42:54.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T08:42:54.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T08:42:54.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T08:42:54.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T08:42:54.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T08:42:54.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T08:42:54.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T08:42:54.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T08:42:54.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T08:42:54.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T08:42:54.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T08:42:54.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T08:42:54.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T08:42:54.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T08:42:54.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T08:42:54.427 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.427 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.428 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:54.428 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T08:42:54.428 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T08:42:54.428 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T08:42:54.428 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T08:42:54.428 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T08:42:54.429 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T08:42:54.429 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:42:54.429 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-10-14T08:42:54.609 DEBUG:teuthology.parallel:result is None 2023-10-14T08:42:56.480 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T08:42:56.481 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:02 ago on Sat 14 Oct 2023 08:40:54 AM UTC. 2023-10-14T08:42:56.487 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-10-14T08:42:56.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-10-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi006.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.721 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-10-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T08:42:56.722 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.723 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.724 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.725 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.726 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T08:42:56.727 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-3.el8.x86_64 2023-10-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T08:42:56.728 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T08:42:56.729 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi006.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T08:42:56.730 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T08:42:56.731 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T08:42:56.732 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T08:42:56.733 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:56.734 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T08:42:56.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T08:42:56.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T08:42:56.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T08:42:56.738 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T08:42:56.739 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T08:42:56.740 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T08:42:56.741 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.742 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T08:42:56.743 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T08:42:56.744 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T08:42:56.745 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:56.746 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T08:42:56.747 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:42:56.748 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-10-14T08:42:56.934 DEBUG:teuthology.parallel:result is None 2023-10-14T08:42:59.591 INFO:teuthology.orchestra.run.smithi057.stdout:Installed products updated. 2023-10-14T08:42:59.848 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:42:59.849 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-10-14T08:42:59.849 INFO:teuthology.orchestra.run.smithi057.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T08:42:59.849 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.850 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.850 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-10-14T08:42:59.850 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T08:42:59.850 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T08:42:59.850 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T08:42:59.851 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.851 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.851 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.851 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.851 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.851 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.852 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.852 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.852 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.852 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.852 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.852 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.853 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.853 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.853 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.853 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.853 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.854 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.854 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.854 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.854 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.854 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.855 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T08:42:59.855 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T08:42:59.855 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T08:42:59.855 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T08:42:59.855 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T08:42:59.856 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-3.el8.x86_64 2023-10-14T08:42:59.856 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T08:42:59.856 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T08:42:59.856 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T08:42:59.856 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.856 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.857 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.857 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T08:42:59.857 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T08:42:59.857 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T08:42:59.857 INFO:teuthology.orchestra.run.smithi057.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T08:42:59.857 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T08:42:59.858 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T08:42:59.858 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.858 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.858 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T08:42:59.858 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.859 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T08:42:59.859 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T08:42:59.859 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T08:42:59.859 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T08:42:59.859 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T08:42:59.860 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T08:42:59.861 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T08:42:59.861 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T08:42:59.861 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T08:42:59.861 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:59.861 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:59.862 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T08:42:59.862 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T08:42:59.862 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T08:42:59.862 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T08:42:59.862 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T08:42:59.863 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T08:42:59.863 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.863 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.863 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.863 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T08:42:59.864 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T08:42:59.865 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T08:42:59.865 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T08:42:59.865 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T08:42:59.865 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T08:42:59.865 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T08:42:59.866 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T08:42:59.866 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T08:42:59.866 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T08:42:59.866 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T08:42:59.866 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T08:42:59.867 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T08:42:59.867 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T08:42:59.867 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T08:42:59.867 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T08:42:59.867 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T08:42:59.867 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T08:42:59.868 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T08:42:59.868 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T08:42:59.868 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T08:42:59.868 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T08:42:59.868 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T08:42:59.869 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T08:42:59.869 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.869 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.869 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T08:42:59.869 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T08:42:59.870 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.870 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T08:42:59.870 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T08:42:59.870 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T08:42:59.870 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T08:42:59.871 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T08:42:59.871 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T08:42:59.871 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T08:42:59.871 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T08:42:59.871 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T08:42:59.872 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T08:42:59.872 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T08:42:59.872 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T08:42:59.872 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T08:42:59.872 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.873 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.873 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T08:42:59.873 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T08:42:59.873 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T08:42:59.873 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T08:42:59.874 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T08:42:59.874 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T08:42:59.874 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T08:42:59.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-14T08:42:59.875 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-10-14T08:43:00.309 DEBUG:teuthology.parallel:result is None 2023-10-14T08:43:00.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:43:00.454 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T08:43:00.484 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T08:43:00.484 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T08:43:00.485 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T08:43:00.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:43:00.635 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T08:43:00.661 INFO:teuthology.orchestra.run.smithi057.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T08:43:00.662 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T08:43:00.662 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T08:43:00.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:43:00.892 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T08:43:00.922 INFO:teuthology.orchestra.run.smithi178.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T08:43:00.922 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T08:43:00.922 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T08:43:00.923 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T08:43:00.924 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:43:00.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T08:43:00.975 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:43:00.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T08:43:01.023 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:43:01.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T08:43:01.072 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T08:43:01.073 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:43:01.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T08:43:01.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T08:43:01.177 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:43:01.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T08:43:01.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T08:43:01.277 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:43:01.278 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T08:43:01.309 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T08:43:01.380 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T08:43:01.380 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:43:01.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T08:43:01.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T08:43:01.486 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:43:01.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T08:43:01.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T08:43:01.587 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:43:01.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T08:43:01.619 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T08:43:01.689 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T08:43:01.689 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:43:01.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T08:43:01.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T08:43:01.795 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:43:01.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T08:43:01.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T08:43:01.899 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:43:01.899 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T08:43:01.930 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T08:43:02.002 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-14T08:43:02.095 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-10-14T08:43:02.095 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:43:02.096 INFO:tasks.cephadm:Cluster fsid is af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:43:02.097 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-14T08:43:02.097 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.6', 'mon.b': '172.21.15.57', 'mon.c': '172.21.15.178'} 2023-10-14T08:43:02.097 INFO:tasks.cephadm:First mon is mon.a on smithi006 2023-10-14T08:43:02.098 INFO:tasks.cephadm:First mgr is x 2023-10-14T08:43:02.098 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-14T08:43:02.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2023-10-14T08:43:02.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname $(hostname -s) 2023-10-14T08:43:02.171 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2023-10-14T08:43:02.203 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-14T08:43:02.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:43:02.354 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73317/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6730-g4ba8a190', 'node_name': '172.21.4.66+confusa04', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6730.g4ba8a190'}, 'url': 'https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-13 15:58:27.010264', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023oct13', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'archs': ['source', 'x86_64', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73317/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6730-g4ba8a190', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6730.g4ba8a190'}, 'url': 'https://4.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-13 15:04:44.383342', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023oct13', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-14T08:43:02.500 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref rishabh-2023oct13, sha1 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T08:43:02.501 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm 2023-10-14T08:43:02.501 DEBUG:teuthology.orchestra.run.smithi006:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:03.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 14 08:43 /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:03.337 DEBUG:teuthology.orchestra.run.smithi057:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:04.162 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 14 08:43 /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:04.163 DEBUG:teuthology.orchestra.run.smithi178:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:04.980 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 14 08:43 /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:04.980 DEBUG:teuthology.orchestra.run.smithi006:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:05.003 DEBUG:teuthology.orchestra.run.smithi057:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:05.025 DEBUG:teuthology.orchestra.run.smithi178:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-14T08:43:05.061 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 on all hosts... 2023-10-14T08:43:05.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 pull 2023-10-14T08:43:05.064 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 pull 2023-10-14T08:43:05.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 pull 2023-10-14T08:43:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-14T08:43:10.351 INFO:teuthology.orchestra.run.smithi178.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-14T08:43:10.681 INFO:teuthology.orchestra.run.smithi057.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-14T08:43:46.730 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-14T08:43:46.731 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T08:43:46.731 INFO:teuthology.orchestra.run.smithi057.stdout: "image_id": "6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac", 2023-10-14T08:43:46.731 INFO:teuthology.orchestra.run.smithi057.stdout: "repo_digests": [ 2023-10-14T08:43:46.732 INFO:teuthology.orchestra.run.smithi057.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6730639e35896afbb2563e998f4d6436eacd40f6e8724777584c413b142f6992" 2023-10-14T08:43:46.732 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-10-14T08:43:46.732 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-14T08:43:47.447 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2023-10-14T08:43:47.447 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T08:43:47.447 INFO:teuthology.orchestra.run.smithi178.stdout: "image_id": "6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac", 2023-10-14T08:43:47.448 INFO:teuthology.orchestra.run.smithi178.stdout: "repo_digests": [ 2023-10-14T08:43:47.448 INFO:teuthology.orchestra.run.smithi178.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6730639e35896afbb2563e998f4d6436eacd40f6e8724777584c413b142f6992" 2023-10-14T08:43:47.448 INFO:teuthology.orchestra.run.smithi178.stdout: ] 2023-10-14T08:43:47.448 INFO:teuthology.orchestra.run.smithi178.stdout:} 2023-10-14T08:43:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:43:53.757 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T08:43:53.757 INFO:teuthology.orchestra.run.smithi006.stdout: "image_id": "6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac", 2023-10-14T08:43:53.757 INFO:teuthology.orchestra.run.smithi006.stdout: "repo_digests": [ 2023-10-14T08:43:53.758 INFO:teuthology.orchestra.run.smithi006.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6730639e35896afbb2563e998f4d6436eacd40f6e8724777584c413b142f6992" 2023-10-14T08:43:53.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T08:43:53.758 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:43:53.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2023-10-14T08:43:53.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph 2023-10-14T08:43:53.846 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2023-10-14T08:43:53.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /etc/ceph 2023-10-14T08:43:53.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /etc/ceph 2023-10-14T08:43:53.945 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2023-10-14T08:43:53.977 INFO:tasks.cephadm:Writing seed config... 2023-10-14T08:43:53.978 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-10-14T08:43:53.981 INFO:tasks.cephadm: override: [client] debug client = 20 2023-10-14T08:43:53.982 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-10-14T08:43:53.982 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-10-14T08:43:53.982 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-10-14T08:43:53.983 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-14T08:43:53.983 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-10-14T08:43:53.983 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-10-14T08:43:53.983 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-10-14T08:43:53.984 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-10-14T08:43:53.984 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-10-14T08:43:53.984 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-10-14T08:43:53.985 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-10-14T08:43:53.985 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-10-14T08:43:53.985 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-10-14T08:43:53.985 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-10-14T08:43:53.986 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-10-14T08:43:53.986 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-14T08:43:53.986 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-10-14T08:43:53.987 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-10-14T08:43:53.987 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-10-14T08:43:53.987 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-14T08:43:53.988 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-14T08:43:53.988 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-14T08:43:53.988 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-14T08:43:53.988 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-14T08:43:53.989 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-14T08:43:53.989 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-10-14T08:43:53.989 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-10-14T08:43:53.989 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-10-14T08:43:53.990 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-10-14T08:43:53.990 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-14T08:43:53.990 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-14T08:43:53.991 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-10-14T08:43:53.991 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-10-14T08:43:53.991 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-14T08:43:53.991 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-14T08:43:53.992 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-10-14T08:43:53.992 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-14T08:43:53.992 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-14T08:43:53.992 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-14T08:43:53.993 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-14T08:43:53.993 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-14T08:43:53.993 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-10-14T08:43:53.993 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-14T08:43:53.994 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-14T08:43:53.996 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:43:53.996 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-14T08:43:54.014 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-10-14T08:43:54.014 DEBUG:teuthology.orchestra.run.smithi006:mon.a> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a.service 2023-10-14T08:43:54.057 DEBUG:teuthology.orchestra.run.smithi006:mgr.x> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x.service 2023-10-14T08:43:54.083 INFO:journalctl@ceph.mon.a.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:43:54.084 INFO:tasks.cephadm:Bootstrapping... 2023-10-14T08:43:54.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 -v bootstrap --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.6 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-14T08:43:54.110 INFO:journalctl@ceph.mgr.x.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:43:54.254 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-10-14T08:43:54.255 INFO:teuthology.orchestra.run.smithi006.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', '-v', 'bootstrap', '--fsid', 'af5a2e5a-6a6d-11ee-8db6-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.6', '--skip-admin-label'] 2023-10-14T08:43:54.402 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 4.1.1 2023-10-14T08:43:54.403 INFO:teuthology.orchestra.run.smithi006.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-14T08:43:54.403 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying podman|docker is present... 2023-10-14T08:43:54.544 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 4.1.1 2023-10-14T08:43:54.545 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying lvm2 is present... 2023-10-14T08:43:54.545 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying time synchronization is in place... 2023-10-14T08:43:54.552 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-14T08:43:54.552 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-14T08:43:54.558 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-14T08:43:54.558 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-10-14T08:43:54.563 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2023-10-14T08:43:54.570 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2023-10-14T08:43:54.570 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2023-10-14T08:43:54.570 INFO:teuthology.orchestra.run.smithi006.stdout:Repeating the final host check... 2023-10-14T08:43:54.715 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 4.1.1 2023-10-14T08:43:54.716 INFO:teuthology.orchestra.run.smithi006.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-14T08:43:54.716 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl is present 2023-10-14T08:43:54.716 INFO:teuthology.orchestra.run.smithi006.stdout:lvcreate is present 2023-10-14T08:43:54.722 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-14T08:43:54.722 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-14T08:43:54.728 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-14T08:43:54.728 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-10-14T08:43:54.734 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2023-10-14T08:43:54.740 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2023-10-14T08:43:54.740 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2023-10-14T08:43:54.741 INFO:teuthology.orchestra.run.smithi006.stdout:Host looks OK 2023-10-14T08:43:54.741 INFO:teuthology.orchestra.run.smithi006.stdout:Cluster fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:43:54.741 INFO:teuthology.orchestra.run.smithi006.stdout:Acquiring lock 140030527277544 on /run/cephadm/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.lock 2023-10-14T08:43:54.741 INFO:teuthology.orchestra.run.smithi006.stdout:Lock 140030527277544 acquired on /run/cephadm/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.lock 2023-10-14T08:43:54.742 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 3300 ... 2023-10-14T08:43:54.742 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 6789 ... 2023-10-14T08:43:54.743 INFO:teuthology.orchestra.run.smithi006.stdout:Base mon IP(s) is [172.21.15.6:3300, 172.21.15.6:6789], mon addrv is [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2023-10-14T08:43:54.745 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-14T08:43:54.745 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.6 metric 100 2023-10-14T08:43:54.748 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-14T08:43:54.748 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-14T08:43:54.748 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2023-10-14T08:43:54.751 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-14T08:43:54.751 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-14T08:43:54.751 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-14T08:43:54.751 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-14T08:43:54.751 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-14T08:43:54.752 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-14T08:43:54.752 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2023-10-14T08:43:54.753 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2023-10-14T08:43:54.753 INFO:teuthology.orchestra.run.smithi006.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-14T08:43:54.753 INFO:teuthology.orchestra.run.smithi006.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-14T08:43:54.754 INFO:teuthology.orchestra.run.smithi006.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-14T08:43:55.209 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac 2023-10-14T08:43:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0... 2023-10-14T08:43:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Getting image source signatures 2023-10-14T08:43:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:a436693b466fb7b19e09eee08a577fdd5da6c190e9ac5a29f91603f2f63125a2 2023-10-14T08:43:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:8ed15414cb45b8b895a21f106743ceee45272cee0d9e7e5b1f49bd1e877e4a11 2023-10-14T08:43:55.210 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying config sha256:6c414e27a22dd493601dbea027b085af1f7a6d0d2000c05baef3637f1554baac 2023-10-14T08:43:55.211 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-14T08:43:55.211 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Storing signatures 2023-10-14T08:43:56.058 INFO:teuthology.orchestra.run.smithi006.stdout:ceph: stdout ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-14T08:43:56.059 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph version: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev) 2023-10-14T08:43:56.059 INFO:teuthology.orchestra.run.smithi006.stdout:Extracting ceph user uid/gid from container image... 2023-10-14T08:43:56.707 INFO:teuthology.orchestra.run.smithi006.stdout:stat: stdout 167 167 2023-10-14T08:43:56.707 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial keys... 2023-10-14T08:43:57.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQDNVCplInxIBBAAAr+e5yhWJlQPOO1bGSo4Gw== 2023-10-14T08:43:58.206 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQDNVCplHpsjMxAAzVuzEHDQuO5vbbpvAZVyiA== 2023-10-14T08:43:58.963 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQDOVCplp/WMIRAAmgzq/lUzvjqGavwcJYN7DA== 2023-10-14T08:43:58.963 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial monmap... 2023-10-14T08:43:59.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-14T08:43:59.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-14T08:43:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:43:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-14T08:43:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool for a [v2:172.21.15.6:3300,v1:172.21.15.6:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-14T08:43:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-10-14T08:43:59.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: set fsid to af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:43:59.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-14T08:43:59.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:43:59.718 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mon... 2023-10-14T08:44:00.462 INFO:teuthology.orchestra.run.smithi006.stdout:create mon.a on 2023-10-14T08:44:00.587 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-14T08:44:00.676 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-14T08:44:00.804 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.target. 2023-10-14T08:44:00.805 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.target → /etc/systemd/system/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.target. 2023-10-14T08:44:00.997 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a 2023-10-14T08:44:00.997 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a.service: Unit ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a.service not loaded. 2023-10-14T08:44:01.087 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.target.wants/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@.service. 2023-10-14T08:44:01.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:01 smithi006 systemd[1]: Starting Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:44:01.638 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:01 smithi006 podman[98910]: 2023-10-14T08:44:01.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:01 smithi006 bash[98910]: d35771feffd3949b4cf0f9613894bbc852b6732e56a3847448989e85dffd45c2 2023-10-14T08:44:01.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:01 smithi006 ceph-mon[98950]: mkfs af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:01.639 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:01 smithi006 ceph-mon[98950]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-14T08:44:01.698 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-14T08:44:01.698 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-10-14T08:44:01.705 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-14T08:44:01.705 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-10-14T08:44:01.705 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-10-14T08:44:01.705 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2023-10-14T08:44:01.706 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon to start... 2023-10-14T08:44:01.706 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon... 2023-10-14T08:44:01.934 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:01 smithi006 systemd[1]: Started Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:44:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout cluster: 2023-10-14T08:44:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout id: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-14T08:44:02.658 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:02.658 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout services: 2023-10-14T08:44:02.658 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.701715s) 2023-10-14T08:44:02.658 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-14T08:44:02.658 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-14T08:44:02.659 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:02.659 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout data: 2023-10-14T08:44:02.659 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-14T08:44:02.659 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-14T08:44:02.659 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-14T08:44:02.660 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pgs: 2023-10-14T08:44:02.660 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:02.660 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc15e15700 1 Processor -- start 2023-10-14T08:44:02.660 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc15e15700 1 -- start start 2023-10-14T08:44:02.660 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc15e15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc101096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:02.661 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc15e15700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10079e70 con 0x7fcc101072c0 2023-10-14T08:44:02.661 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc101096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:02.661 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc101096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57982/0 (socket says 172.21.15.6:57982) 2023-10-14T08:44:02.661 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.193+0000 7fcc0f7fe700 1 -- 172.21.15.6:0/837469979 learned_addr learned my addr 172.21.15.6:0/837469979 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:02.661 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc0f7fe700 1 -- 172.21.15.6:0/837469979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10109bf0 con 0x7fcc101072c0 2023-10-14T08:44:02.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc0f7fe700 1 --2- 172.21.15.6:0/837469979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc101096b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098a0 tx=0x7fcc00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3321e3851fe8f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:02.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc0e7fc700 1 -- 172.21.15.6:0/837469979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc00004160 con 0x7fcc101072c0 2023-10-14T08:44:02.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc0e7fc700 1 -- 172.21.15.6:0/837469979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc000042c0 con 0x7fcc101072c0 2023-10-14T08:44:02.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc0e7fc700 1 -- 172.21.15.6:0/837469979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc000045a0 con 0x7fcc101072c0 2023-10-14T08:44:02.662 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc15e15700 1 -- 172.21.15.6:0/837469979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 msgr2=0x7fcc101096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.194+0000 7fcc15e15700 1 --2- 172.21.15.6:0/837469979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc101096b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcc000098a0 tx=0x7fcc00009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 -- 172.21.15.6:0/837469979 shutdown_connections 2023-10-14T08:44:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 --2- 172.21.15.6:0/837469979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc101096b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 -- 172.21.15.6:0/837469979 >> 172.21.15.6:0/837469979 conn(0x7fcc10100cb0 msgr2=0x7fcc101030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 -- 172.21.15.6:0/837469979 shutdown_connections 2023-10-14T08:44:02.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 -- 172.21.15.6:0/837469979 wait complete. 2023-10-14T08:44:02.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 Processor -- start 2023-10-14T08:44:02.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.195+0000 7fcc15e15700 1 -- start start 2023-10-14T08:44:02.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc15e15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc10199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:02.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc15e15700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1019a1a0 con 0x7fcc101072c0 2023-10-14T08:44:02.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc10199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:02.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc10199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57984/0 (socket says 172.21.15.6:57984) 2023-10-14T08:44:02.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0f7fe700 1 -- 172.21.15.6:0/1096322211 learned_addr learned my addr 172.21.15.6:0/1096322211 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:02.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0f7fe700 1 -- 172.21.15.6:0/1096322211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00009550 con 0x7fcc101072c0 2023-10-14T08:44:02.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0f7fe700 1 --2- 172.21.15.6:0/1096322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc10199c60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcc100792b0 tx=0x7fcc00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc00011630 con 0x7fcc101072c0 2023-10-14T08:44:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00011790 con 0x7fcc101072c0 2023-10-14T08:44:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1019a3a0 con 0x7fcc101072c0 2023-10-14T08:44:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcc00011a30 con 0x7fcc101072c0 2023-10-14T08:44:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.196+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1019a7c0 con 0x7fcc101072c0 2023-10-14T08:44:02.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.197+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc00022070 con 0x7fcc101072c0 2023-10-14T08:44:02.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.197+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcc0001c450 con 0x7fcc101072c0 2023-10-14T08:44:02.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.198+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc10193af0 con 0x7fcc101072c0 2023-10-14T08:44:02.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.200+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcc0001b450 con 0x7fcc101072c0 2023-10-14T08:44:02.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.332+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fcc10109e40 con 0x7fcc101072c0 2023-10-14T08:44:02.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.333+0000 7fcc0cff9700 1 -- 172.21.15.6:0/1096322211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fcc0001b5f0 con 0x7fcc101072c0 2023-10-14T08:44:02.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.333+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 msgr2=0x7fcc10199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:02.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.333+0000 7fcc15e15700 1 --2- 172.21.15.6:0/1096322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc10199c60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcc100792b0 tx=0x7fcc00004750 comp rx=0 tx=0).stop 2023-10-14T08:44:02.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.334+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 shutdown_connections 2023-10-14T08:44:02.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.334+0000 7fcc15e15700 1 --2- 172.21.15.6:0/1096322211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc101072c0 0x7fcc10199c60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:02.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.334+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 >> 172.21.15.6:0/1096322211 conn(0x7fcc10100cb0 msgr2=0x7fcc10102680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:02.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.334+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 shutdown_connections 2023-10-14T08:44:02.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:02.334+0000 7fcc15e15700 1 -- 172.21.15.6:0/1096322211 wait complete. 2023-10-14T08:44:02.670 INFO:teuthology.orchestra.run.smithi006.stdout:mon is available 2023-10-14T08:44:02.670 INFO:teuthology.orchestra.run.smithi006.stdout:Assimilating anything we can from ceph.conf... 2023-10-14T08:44:02.899 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:02 smithi006 ceph-mon[98950]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-14T08:44:02.899 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:02 smithi006 ceph-mon[98950]: monmap e1: 1 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0]} removed_ranks: {} 2023-10-14T08:44:02.899 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:02 smithi006 ceph-mon[98950]: fsmap 2023-10-14T08:44:02.899 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:02 smithi006 ceph-mon[98950]: osdmap e1: 0 total, 0 up, 0 in 2023-10-14T08:44:02.900 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:02 smithi006 ceph-mon[98950]: mgrmap e1: no daemons active 2023-10-14T08:44:02.900 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:02 smithi006 ceph-mon[98950]: from='client.? 172.21.15.6:0/1096322211' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-14T08:44:03.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:03.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2023-10-14T08:44:03.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:03.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2023-10-14T08:44:03.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-14T08:44:03.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-14T08:44:03.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-14T08:44:03.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-14T08:44:03.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:03.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-14T08:44:03.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-14T08:44:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2023-10-14T08:44:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-14T08:44:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-14T08:44:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-14T08:44:03.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-14T08:44:03.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-14T08:44:03.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.154+0000 7f254a4a3700 1 Processor -- start 2023-10-14T08:44:03.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.154+0000 7f254a4a3700 1 -- start start 2023-10-14T08:44:03.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.154+0000 7f254a4a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f25441096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:03.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.154+0000 7f254a4a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544074740 con 0x7f25441072c0 2023-10-14T08:44:03.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2543fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f25441096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:03.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2543fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f25441096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57986/0 (socket says 172.21.15.6:57986) 2023-10-14T08:44:03.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2543fff700 1 -- 172.21.15.6:0/986920429 learned_addr learned my addr 172.21.15.6:0/986920429 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:03.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2543fff700 1 -- 172.21.15.6:0/986920429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544109bf0 con 0x7f25441072c0 2023-10-14T08:44:03.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2543fff700 1 --2- 172.21.15.6:0/986920429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f25441096b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f25340098a0 tx=0x7f2534009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6221f1f3bcd37af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:03.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2542ffd700 1 -- 172.21.15.6:0/986920429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2534004160 con 0x7f25441072c0 2023-10-14T08:44:03.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2542ffd700 1 -- 172.21.15.6:0/986920429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340042c0 con 0x7f25441072c0 2023-10-14T08:44:03.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.155+0000 7f2542ffd700 1 -- 172.21.15.6:0/986920429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25340045a0 con 0x7f25441072c0 2023-10-14T08:44:03.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 -- 172.21.15.6:0/986920429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 msgr2=0x7f25441096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:03.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 --2- 172.21.15.6:0/986920429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f25441096b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f25340098a0 tx=0x7f2534009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:03.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 -- 172.21.15.6:0/986920429 shutdown_connections 2023-10-14T08:44:03.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 --2- 172.21.15.6:0/986920429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f25441096b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:03.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 -- 172.21.15.6:0/986920429 >> 172.21.15.6:0/986920429 conn(0x7f2544100cb0 msgr2=0x7f25441030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 -- 172.21.15.6:0/986920429 shutdown_connections 2023-10-14T08:44:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.156+0000 7f254a4a3700 1 -- 172.21.15.6:0/986920429 wait complete. 2023-10-14T08:44:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.157+0000 7f254a4a3700 1 Processor -- start 2023-10-14T08:44:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.157+0000 7f254a4a3700 1 -- start start 2023-10-14T08:44:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.157+0000 7f254a4a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f2544199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.157+0000 7f254a4a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254419a1a0 con 0x7f25441072c0 2023-10-14T08:44:03.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f2543fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f2544199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:03.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f2543fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f2544199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57988/0 (socket says 172.21.15.6:57988) 2023-10-14T08:44:03.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f2543fff700 1 -- 172.21.15.6:0/3009323785 learned_addr learned my addr 172.21.15.6:0/3009323785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:03.712 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f2543fff700 1 -- 172.21.15.6:0/3009323785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009550 con 0x7f25441072c0 2023-10-14T08:44:03.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f2543fff700 1 --2- 172.21.15.6:0/3009323785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f2544199c60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2544073b80 tx=0x7f2534004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:03.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2534011630 con 0x7f25441072c0 2023-10-14T08:44:03.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2534011790 con 0x7f25441072c0 2023-10-14T08:44:03.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254419a3a0 con 0x7f25441072c0 2023-10-14T08:44:03.713 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2534011a30 con 0x7f25441072c0 2023-10-14T08:44:03.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.158+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254419a7c0 con 0x7f25441072c0 2023-10-14T08:44:03.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.159+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2534022070 con 0x7f25441072c0 2023-10-14T08:44:03.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.159+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f253401c450 con 0x7f25441072c0 2023-10-14T08:44:03.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.159+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2544193b10 con 0x7f25441072c0 2023-10-14T08:44:03.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.162+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f253401b450 con 0x7f25441072c0 2023-10-14T08:44:03.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.288+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f25440624e0 con 0x7f25441072c0 2023-10-14T08:44:03.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.291+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f253401b5f0 con 0x7f25441072c0 2023-10-14T08:44:03.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.292+0000 7f25417fa700 1 -- 172.21.15.6:0/3009323785 <== mon.0 v2:172.21.15.6:3300/0 8 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f253401b790 con 0x7f25441072c0 2023-10-14T08:44:03.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.292+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 msgr2=0x7f2544199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:03.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.292+0000 7f254a4a3700 1 --2- 172.21.15.6:0/3009323785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f2544199c60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2544073b80 tx=0x7f2534004750 comp rx=0 tx=0).stop 2023-10-14T08:44:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.293+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 shutdown_connections 2023-10-14T08:44:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.293+0000 7f254a4a3700 1 --2- 172.21.15.6:0/3009323785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25441072c0 0x7f2544199c60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.293+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 >> 172.21.15.6:0/3009323785 conn(0x7f2544100cb0 msgr2=0x7f25441025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.293+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 shutdown_connections 2023-10-14T08:44:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:03.293+0000 7f254a4a3700 1 -- 172.21.15.6:0/3009323785 wait complete. 2023-10-14T08:44:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:Generating new minimal ceph.conf... 2023-10-14T08:44:03.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:03 smithi006 ceph-mon[98950]: from='client.? 172.21.15.6:0/3009323785' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-14T08:44:03.905 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:03 smithi006 ceph-mon[98950]: from='client.? 172.21.15.6:0/3009323785' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-14T08:44:04.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.166+0000 7f0f7275d700 1 Processor -- start 2023-10-14T08:44:04.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.166+0000 7f0f7275d700 1 -- start start 2023-10-14T08:44:04.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f7275d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c107140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:04.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f7275d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c107710 con 0x7f0f6c106d20 2023-10-14T08:44:04.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c107140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:04.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c107140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57990/0 (socket says 172.21.15.6:57990) 2023-10-14T08:44:04.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6bfff700 1 -- 172.21.15.6:0/3807397185 learned_addr learned my addr 172.21.15.6:0/3807397185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:04.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6bfff700 1 -- 172.21.15.6:0/3807397185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c107850 con 0x7f0f6c106d20 2023-10-14T08:44:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6bfff700 1 --2- 172.21.15.6:0/3807397185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c107140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0098a0 tx=0x7f0f5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eade0b698426416 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6affd700 1 -- 172.21.15.6:0/3807397185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f5c004160 con 0x7f0f6c106d20 2023-10-14T08:44:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.167+0000 7f0f6affd700 1 -- 172.21.15.6:0/3807397185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f5c0042c0 con 0x7f0f6c106d20 2023-10-14T08:44:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f6affd700 1 -- 172.21.15.6:0/3807397185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f5c011a00 con 0x7f0f6c106d20 2023-10-14T08:44:04.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 -- 172.21.15.6:0/3807397185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 msgr2=0x7f0f6c107140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:04.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 --2- 172.21.15.6:0/3807397185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c107140 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0098a0 tx=0x7f0f5c009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:04.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 -- 172.21.15.6:0/3807397185 shutdown_connections 2023-10-14T08:44:04.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 --2- 172.21.15.6:0/3807397185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c107140 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:04.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 -- 172.21.15.6:0/3807397185 >> 172.21.15.6:0/3807397185 conn(0x7f0f6c100450 msgr2=0x7f0f6c102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:04.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 -- 172.21.15.6:0/3807397185 shutdown_connections 2023-10-14T08:44:04.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.168+0000 7f0f7275d700 1 -- 172.21.15.6:0/3807397185 wait complete. 2023-10-14T08:44:04.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f7275d700 1 Processor -- start 2023-10-14T08:44:04.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f7275d700 1 -- start start 2023-10-14T08:44:04.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f7275d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:04.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f7275d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c19cc10 con 0x7f0f6c106d20 2023-10-14T08:44:04.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:04.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57992/0 (socket says 172.21.15.6:57992) 2023-10-14T08:44:04.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.169+0000 7f0f6bfff700 1 -- 172.21.15.6:0/2400699931 learned_addr learned my addr 172.21.15.6:0/2400699931 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:04.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f6bfff700 1 -- 172.21.15.6:0/2400699931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c009550 con 0x7f0f6c106d20 2023-10-14T08:44:04.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f6bfff700 1 --2- 172.21.15.6:0/2400699931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c19c6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009fb0 tx=0x7f0f5c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:04.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f5c003930 con 0x7f0f6c106d20 2023-10-14T08:44:04.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f5c003a90 con 0x7f0f6c106d20 2023-10-14T08:44:04.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c19ce10 con 0x7f0f6c106d20 2023-10-14T08:44:04.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f5c0195e0 con 0x7f0f6c106d20 2023-10-14T08:44:04.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c19d230 con 0x7f0f6c106d20 2023-10-14T08:44:04.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f5c019c20 con 0x7f0f6c106d20 2023-10-14T08:44:04.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.170+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f5c0243f0 con 0x7f0f6c106d20 2023-10-14T08:44:04.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.171+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c196410 con 0x7f0f6c106d20 2023-10-14T08:44:04.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.173+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0f5c003c00 con 0x7f0f6c106d20 2023-10-14T08:44:04.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.301+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0f6c1054c0 con 0x7f0f6c106d20 2023-10-14T08:44:04.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.301+0000 7f0f697fa700 1 -- 172.21.15.6:0/2400699931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f0f5c01a9d0 con 0x7f0f6c106d20 2023-10-14T08:44:04.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 msgr2=0x7f0f6c19c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:04.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 --2- 172.21.15.6:0/2400699931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c19c6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009fb0 tx=0x7f0f5c011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:04.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 shutdown_connections 2023-10-14T08:44:04.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 --2- 172.21.15.6:0/2400699931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f6c106d20 0x7f0f6c19c6d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:04.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 >> 172.21.15.6:0/2400699931 conn(0x7f0f6c100450 msgr2=0x7f0f6c193550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:04.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 shutdown_connections 2023-10-14T08:44:04.657 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:04.302+0000 7f0f7275d700 1 -- 172.21.15.6:0/2400699931 wait complete. 2023-10-14T08:44:04.657 INFO:teuthology.orchestra.run.smithi006.stdout:Restarting the monitor... 2023-10-14T08:44:04.974 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:04 smithi006 ceph-mon[98950]: from='client.? 172.21.15.6:0/2400699931' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:44:04.974 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:04 smithi006 systemd[1]: Stopping Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:44:05.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[98926]: 2023-10-14T08:44:04.972+0000 7f4c70a48700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T08:44:05.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[98926]: 2023-10-14T08:44:04.972+0000 7f4c70a48700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-14T08:44:05.521 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 bash[99290]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a 2023-10-14T08:44:05.812 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 systemd[1]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a.service: Succeeded. 2023-10-14T08:44:05.812 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 systemd[1]: Stopped Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:44:05.812 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 systemd[1]: Starting Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:44:06.008 INFO:teuthology.orchestra.run.smithi006.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-14T08:44:06.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 podman[99412]: 2023-10-14T08:44:06.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 bash[99412]: 7de318dbf138d17061125d7e07f266b545f95203fa609e8cdb879d61e901f1f5 2023-10-14T08:44:06.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: set uid:gid to 167:167 (ceph:ceph) 2023-10-14T08:44:06.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev), process ceph-mon, pid 7 2023-10-14T08:44:06.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: pidfile_write: ignore empty --pid-file 2023-10-14T08:44:06.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: load: jerasure load: lrc 2023-10-14T08:44:06.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: RocksDB version: 7.9.2 2023-10-14T08:44:06.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Git sha 0 2023-10-14T08:44:06.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Compile date 2023-10-13 13:48:46 2023-10-14T08:44:06.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: DB SUMMARY 2023-10-14T08:44:06.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: DB Session ID: UTBY08LD54P2K1P6RLIK 2023-10-14T08:44:06.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: CURRENT file: CURRENT 2023-10-14T08:44:06.081 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: IDENTITY file: IDENTITY 2023-10-14T08:44:06.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-14T08:44:06.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-14T08:44:06.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99641 ; 2023-10-14T08:44:06.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.error_if_exists: 0 2023-10-14T08:44:06.082 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.create_if_missing: 0 2023-10-14T08:44:06.083 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.paranoid_checks: 1 2023-10-14T08:44:06.083 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-14T08:44:06.083 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-14T08:44:06.083 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-14T08:44:06.083 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.env: 0x557803e0ada0 2023-10-14T08:44:06.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.fs: PosixFileSystem 2023-10-14T08:44:06.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.info_log: 0x5578048ab5e0 2023-10-14T08:44:06.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_file_opening_threads: 16 2023-10-14T08:44:06.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.statistics: (nil) 2023-10-14T08:44:06.084 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.use_fsync: 0 2023-10-14T08:44:06.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_log_file_size: 0 2023-10-14T08:44:06.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-14T08:44:06.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-14T08:44:06.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.keep_log_file_num: 1000 2023-10-14T08:44:06.085 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.recycle_log_file_num: 0 2023-10-14T08:44:06.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.allow_fallocate: 1 2023-10-14T08:44:06.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.allow_mmap_reads: 0 2023-10-14T08:44:06.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.allow_mmap_writes: 0 2023-10-14T08:44:06.086 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.use_direct_reads: 0 2023-10-14T08:44:06.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-14T08:44:06.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.create_missing_column_families: 0 2023-10-14T08:44:06.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.db_log_dir: 2023-10-14T08:44:06.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.wal_dir: 2023-10-14T08:44:06.087 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-14T08:44:06.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-14T08:44:06.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-14T08:44:06.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-14T08:44:06.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-14T08:44:06.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-14T08:44:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.advise_random_on_open: 1 2023-10-14T08:44:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.db_write_buffer_size: 0 2023-10-14T08:44:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.write_buffer_manager: 0x557804863360 2023-10-14T08:44:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-14T08:44:06.089 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-14T08:44:06.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-14T08:44:06.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.rate_limiter: (nil) 2023-10-14T08:44:06.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-14T08:44:06.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.wal_recovery_mode: 2 2023-10-14T08:44:06.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.enable_thread_tracking: 0 2023-10-14T08:44:06.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.enable_pipelined_write: 0 2023-10-14T08:44:06.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.unordered_write: 0 2023-10-14T08:44:06.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-14T08:44:06.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-14T08:44:06.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-14T08:44:06.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-14T08:44:06.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.row_cache: None 2023-10-14T08:44:06.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.wal_filter: None 2023-10-14T08:44:06.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-14T08:44:06.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.allow_ingest_behind: 0 2023-10-14T08:44:06.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.two_write_queues: 0 2023-10-14T08:44:06.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.manual_wal_flush: 0 2023-10-14T08:44:06.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.wal_compression: 0 2023-10-14T08:44:06.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.atomic_flush: 0 2023-10-14T08:44:06.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-14T08:44:06.094 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-14T08:44:06.094 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-14T08:44:06.094 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.log_readahead_size: 0 2023-10-14T08:44:06.094 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-14T08:44:06.094 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.best_efforts_recovery: 0 2023-10-14T08:44:06.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-14T08:44:06.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-14T08:44:06.095 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.allow_data_in_errors: 0 2023-10-14T08:44:06.098 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.db_host_id: __hostname__ 2023-10-14T08:44:06.098 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-14T08:44:06.098 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_background_jobs: 2 2023-10-14T08:44:06.099 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_background_compactions: -1 2023-10-14T08:44:06.099 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_subcompactions: 1 2023-10-14T08:44:06.099 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-14T08:44:06.099 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-14T08:44:06.099 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-14T08:44:06.100 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_total_wal_size: 0 2023-10-14T08:44:06.100 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-14T08:44:06.100 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-14T08:44:06.100 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-14T08:44:06.100 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-14T08:44:06.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_open_files: -1 2023-10-14T08:44:06.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bytes_per_sync: 0 2023-10-14T08:44:06.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-14T08:44:06.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-14T08:44:06.101 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_readahead_size: 0 2023-10-14T08:44:06.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_background_flushes: -1 2023-10-14T08:44:06.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Compression algorithms supported: 2023-10-14T08:44:06.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-14T08:44:06.102 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kZSTD supported: 0 2023-10-14T08:44:06.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kXpressCompression supported: 0 2023-10-14T08:44:06.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kLZ4HCCompression supported: 1 2023-10-14T08:44:06.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kZlibCompression supported: 1 2023-10-14T08:44:06.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kSnappyCompression supported: 1 2023-10-14T08:44:06.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kLZ4Compression supported: 1 2023-10-14T08:44:06.103 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: kBZip2Compression supported: 0 2023-10-14T08:44:06.104 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-14T08:44:06.104 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-14T08:44:06.104 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-14T08:44:06.104 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-14T08:44:06.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-14T08:44:06.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.merge_operator: 2023-10-14T08:44:06.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_filter: None 2023-10-14T08:44:06.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_filter_factory: None 2023-10-14T08:44:06.105 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.sst_partitioner_factory: None 2023-10-14T08:44:06.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-14T08:44:06.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-14T08:44:06.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5578048ab6e0) 2023-10-14T08:44:06.106 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks: 1 2023-10-14T08:44:06.106 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-14T08:44:06.107 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-14T08:44:06.107 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_top_level_index_and_filter: 1 2023-10-14T08:44:06.107 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_type: 0 2023-10-14T08:44:06.107 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_index_type: 0 2023-10-14T08:44:06.107 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_shortening: 1 2023-10-14T08:44:06.108 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-14T08:44:06.108 INFO:journalctl@ceph.mon.a.smithi006.stdout: checksum: 4 2023-10-14T08:44:06.108 INFO:journalctl@ceph.mon.a.smithi006.stdout: no_block_cache: 0 2023-10-14T08:44:06.108 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache: 0x5578049011f0 2023-10-14T08:44:06.108 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_name: BinnedLRUCache 2023-10-14T08:44:06.109 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_options: 2023-10-14T08:44:06.109 INFO:journalctl@ceph.mon.a.smithi006.stdout: capacity : 536870912 2023-10-14T08:44:06.109 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_shard_bits : 4 2023-10-14T08:44:06.109 INFO:journalctl@ceph.mon.a.smithi006.stdout: strict_capacity_limit : 0 2023-10-14T08:44:06.109 INFO:journalctl@ceph.mon.a.smithi006.stdout: high_pri_pool_ratio: 0.000 2023-10-14T08:44:06.110 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_compressed: (nil) 2023-10-14T08:44:06.110 INFO:journalctl@ceph.mon.a.smithi006.stdout: persistent_cache: (nil) 2023-10-14T08:44:06.110 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size: 4096 2023-10-14T08:44:06.110 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size_deviation: 10 2023-10-14T08:44:06.110 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_restart_interval: 16 2023-10-14T08:44:06.111 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_block_restart_interval: 1 2023-10-14T08:44:06.111 INFO:journalctl@ceph.mon.a.smithi006.stdout: metadata_block_size: 4096 2023-10-14T08:44:06.111 INFO:journalctl@ceph.mon.a.smithi006.stdout: partition_filters: 0 2023-10-14T08:44:06.111 INFO:journalctl@ceph.mon.a.smithi006.stdout: use_delta_encoding: 1 2023-10-14T08:44:06.111 INFO:journalctl@ceph.mon.a.smithi006.stdout: filter_policy: bloomfilter 2023-10-14T08:44:06.112 INFO:journalctl@ceph.mon.a.smithi006.stdout: whole_key_filtering: 1 2023-10-14T08:44:06.112 INFO:journalctl@ceph.mon.a.smithi006.stdout: verify_compression: 0 2023-10-14T08:44:06.112 INFO:journalctl@ceph.mon.a.smithi006.stdout: read_amp_bytes_per_bit: 0 2023-10-14T08:44:06.112 INFO:journalctl@ceph.mon.a.smithi006.stdout: format_version: 5 2023-10-14T08:44:06.112 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_index_compression: 1 2023-10-14T08:44:06.113 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_align: 0 2023-10-14T08:44:06.113 INFO:journalctl@ceph.mon.a.smithi006.stdout: max_auto_readahead_size: 262144 2023-10-14T08:44:06.113 INFO:journalctl@ceph.mon.a.smithi006.stdout: prepopulate_block_cache: 0 2023-10-14T08:44:06.113 INFO:journalctl@ceph.mon.a.smithi006.stdout: initial_auto_readahead_size: 8192 2023-10-14T08:44:06.113 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_file_reads_for_auto_readahead: 2 2023-10-14T08:44:06.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.write_buffer_size: 33554432 2023-10-14T08:44:06.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_write_buffer_number: 2 2023-10-14T08:44:06.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression: NoCompression 2023-10-14T08:44:06.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression: Disabled 2023-10-14T08:44:06.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.prefix_extractor: nullptr 2023-10-14T08:44:06.115 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-14T08:44:06.115 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.num_levels: 7 2023-10-14T08:44:06.115 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-14T08:44:06.115 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-14T08:44:06.115 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-14T08:44:06.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-14T08:44:06.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-14T08:44:06.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-14T08:44:06.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-14T08:44:06.116 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-14T08:44:06.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-14T08:44:06.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-14T08:44:06.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-14T08:44:06.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-14T08:44:06.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-14T08:44:06.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.level: 32767 2023-10-14T08:44:06.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.strategy: 0 2023-10-14T08:44:06.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-14T08:44:06.118 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-14T08:44:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-14T08:44:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-14T08:44:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.enabled: false 2023-10-14T08:44:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-14T08:44:06.119 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-14T08:44:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-14T08:44:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-14T08:44:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.target_file_size_base: 67108864 2023-10-14T08:44:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-14T08:44:06.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-14T08:44:06.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-14T08:44:06.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-14T08:44:06.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-14T08:44:06.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-14T08:44:06.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-14T08:44:06.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-14T08:44:06.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-14T08:44:06.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-14T08:44:06.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-14T08:44:06.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-14T08:44:06.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-14T08:44:06.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-14T08:44:06.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.arena_block_size: 1048576 2023-10-14T08:44:06.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-14T08:44:06.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-14T08:44:06.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.disable_auto_compactions: 0 2023-10-14T08:44:06.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-14T08:44:06.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-14T08:44:06.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-14T08:44:06.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-14T08:44:06.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-14T08:44:06.125 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-14T08:44:06.125 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-14T08:44:06.125 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-14T08:44:06.125 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-14T08:44:06.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-14T08:44:06.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.table_properties_collectors: 2023-10-14T08:44:06.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.inplace_update_support: 0 2023-10-14T08:44:06.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-14T08:44:06.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-14T08:44:06.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-14T08:44:06.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-14T08:44:06.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.bloom_locality: 0 2023-10-14T08:44:06.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.max_successive_merges: 0 2023-10-14T08:44:06.127 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-14T08:44:06.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.paranoid_file_checks: 0 2023-10-14T08:44:06.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.force_consistency_checks: 1 2023-10-14T08:44:06.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.report_bg_io_stats: 0 2023-10-14T08:44:06.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.ttl: 2592000 2023-10-14T08:44:06.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-14T08:44:06.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-14T08:44:06.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-14T08:44:06.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.enable_blob_files: false 2023-10-14T08:44:06.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.min_blob_size: 0 2023-10-14T08:44:06.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.blob_file_size: 268435456 2023-10-14T08:44:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-14T08:44:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-14T08:44:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-14T08:44:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-14T08:44:06.130 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-14T08:44:06.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.blob_file_starting_level: 0 2023-10-14T08:44:06.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-14T08:44:06.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-14T08:44:06.131 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-14T08:44:06.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0fede03f-2276-482b-9325-725851227230 2023-10-14T08:44:06.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273045987063, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-14T08:44:06.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-14T08:44:06.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273045988589, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94800, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 92791, "index_size": 291, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13880, "raw_average_key_size": 50, "raw_value_size": 85232, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697273045, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0fede03f-2276-482b-9325-725851227230", "db_session_id": "UTBY08LD54P2K1P6RLIK", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-14T08:44:06.132 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273045988689, "job": 1, "event": "recovery_finished"} 2023-10-14T08:44:06.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-14T08:44:06.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-14T08:44:06.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55780499e000 2023-10-14T08:44:06.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: DB pointer 0x55780498a000 2023-10-14T08:44:06.133 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-14T08:44:06.134 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-14T08:44:06.134 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** DB Stats ** 2023-10-14T08:44:06.134 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-14T08:44:06.134 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-14T08:44:06.134 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-14T08:44:06.135 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-14T08:44:06.135 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-14T08:44:06.135 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-14T08:44:06.135 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-14T08:44:06.135 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-10-14T08:44:06.136 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2023-10-14T08:44:06.136 INFO:journalctl@ceph.mon.a.smithi006.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-14T08:44:06.136 INFO:journalctl@ceph.mon.a.smithi006.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-14T08:44:06.136 INFO:journalctl@ceph.mon.a.smithi006.stdout: L0 2/0 94.41 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:44:06.136 INFO:journalctl@ceph.mon.a.smithi006.stdout: Sum 2/0 94.41 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:44:06.137 INFO:journalctl@ceph.mon.a.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:44:06.137 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-10-14T08:44:06.137 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2023-10-14T08:44:06.137 INFO:journalctl@ceph.mon.a.smithi006.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-14T08:44:06.137 INFO:journalctl@ceph.mon.a.smithi006.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-14T08:44:06.138 INFO:journalctl@ceph.mon.a.smithi006.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 103.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:44:06.138 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-10-14T08:44:06.138 INFO:journalctl@ceph.mon.a.smithi006.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-14T08:44:06.138 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-10-14T08:44:06.138 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-14T08:44:06.139 INFO:journalctl@ceph.mon.a.smithi006.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-14T08:44:06.139 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-14T08:44:06.139 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-14T08:44:06.139 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-14T08:44:06.139 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-14T08:44:06.140 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative compaction: 0.00 GB write, 13.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-14T08:44:06.140 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval compaction: 0.00 GB write, 13.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-14T08:44:06.140 INFO:journalctl@ceph.mon.a.smithi006.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-14T08:44:06.140 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache BinnedLRUCache@0x5578049011f0#7 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-10-14T08:44:06.140 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2023-10-14T08:44:06.141 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-10-14T08:44:06.141 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-14T08:44:06.141 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: starting mon.a rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:06.141 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???) e1 preinit fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:06.141 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).mds e1 new map 2023-10-14T08:44:06.142 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).mds e1 print_map 2023-10-14T08:44:06.142 INFO:journalctl@ceph.mon.a.smithi006.stdout: e1 2023-10-14T08:44:06.142 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-14T08:44:06.142 INFO:journalctl@ceph.mon.a.smithi006.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-14T08:44:06.142 INFO:journalctl@ceph.mon.a.smithi006.stdout: legacy client fscid: -1 2023-10-14T08:44:06.143 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-10-14T08:44:06.143 INFO:journalctl@ceph.mon.a.smithi006.stdout: No filesystems configured 2023-10-14T08:44:06.143 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-14T08:44:06.143 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:44:06.143 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:44:06.144 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:44:06.144 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-14T08:44:06.144 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expand map: {default=false} 2023-10-14T08:44:06.144 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta from 'false' to 'false' 2023-10-14T08:44:06.144 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expanded map: {default=false} 2023-10-14T08:44:06.145 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expand map: {default=info} 2023-10-14T08:44:06.145 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta from 'info' to 'info' 2023-10-14T08:44:06.145 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expanded map: {default=info} 2023-10-14T08:44:06.145 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expand map: {default=daemon} 2023-10-14T08:44:06.145 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-14T08:44:06.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expanded map: {default=daemon} 2023-10-14T08:44:06.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expand map: {default=debug} 2023-10-14T08:44:06.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta from 'debug' to 'debug' 2023-10-14T08:44:06.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:05 smithi006 ceph-mon[99452]: expand_channel_meta expanded map: {default=debug} 2023-10-14T08:44:06.146 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:06 smithi006 systemd[1]: Started Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:44:06.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:06 smithi006 ceph-mon[99452]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-14T08:44:06.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:06 smithi006 ceph-mon[99452]: monmap e1: 1 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0]} removed_ranks: {} 2023-10-14T08:44:06.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:06 smithi006 ceph-mon[99452]: fsmap 2023-10-14T08:44:06.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:06 smithi006 ceph-mon[99452]: osdmap e1: 0 total, 0 up, 0 in 2023-10-14T08:44:06.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:06 smithi006 ceph-mon[99452]: mgrmap e1: no daemons active 2023-10-14T08:44:07.162 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.556+0000 7f02cae21700 1 Processor -- start 2023-10-14T08:44:07.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.556+0000 7f02cae21700 1 -- start start 2023-10-14T08:44:07.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.556+0000 7f02cae21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:07.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.556+0000 7f02cae21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4106100 con 0x7f02c4105710 2023-10-14T08:44:07.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c8bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c8bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57994/0 (socket says 172.21.15.6:57994) 2023-10-14T08:44:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c8bbd700 1 -- 172.21.15.6:0/455947442 learned_addr learned my addr 172.21.15.6:0/455947442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c8bbd700 1 -- 172.21.15.6:0/455947442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4106910 con 0x7f02c4105710 2023-10-14T08:44:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c8bbd700 1 --2- 172.21.15.6:0/455947442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4105b30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098a0 tx=0x7f02b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad23c3bd59a87c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c37fe700 1 -- 172.21.15.6:0/455947442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b8004160 con 0x7f02c4105710 2023-10-14T08:44:07.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c37fe700 1 -- 172.21.15.6:0/455947442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02b80042c0 con 0x7f02c4105710 2023-10-14T08:44:07.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.557+0000 7f02c37fe700 1 -- 172.21.15.6:0/455947442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b8011a00 con 0x7f02c4105710 2023-10-14T08:44:07.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 -- 172.21.15.6:0/455947442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 msgr2=0x7f02c4105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:07.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 --2- 172.21.15.6:0/455947442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4105b30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f02b80098a0 tx=0x7f02b8009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:07.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 -- 172.21.15.6:0/455947442 shutdown_connections 2023-10-14T08:44:07.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 --2- 172.21.15.6:0/455947442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4105b30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:07.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 -- 172.21.15.6:0/455947442 >> 172.21.15.6:0/455947442 conn(0x7f02c4100cb0 msgr2=0x7f02c41030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:07.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 -- 172.21.15.6:0/455947442 shutdown_connections 2023-10-14T08:44:07.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.558+0000 7f02cae21700 1 -- 172.21.15.6:0/455947442 wait complete. 2023-10-14T08:44:07.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02cae21700 1 Processor -- start 2023-10-14T08:44:07.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02cae21700 1 -- start start 2023-10-14T08:44:07.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02cae21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4074420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:07.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02cae21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c419d1f0 con 0x7f02c4105710 2023-10-14T08:44:07.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02c8bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:07.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02c8bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4074420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57996/0 (socket says 172.21.15.6:57996) 2023-10-14T08:44:07.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02c8bbd700 1 -- 172.21.15.6:0/329662731 learned_addr learned my addr 172.21.15.6:0/329662731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:07.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.559+0000 7f02c8bbd700 1 -- 172.21.15.6:0/329662731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009550 con 0x7f02c4105710 2023-10-14T08:44:07.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02c8bbd700 1 --2- 172.21.15.6:0/329662731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4074420 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f02b8006af0 tx=0x7f02b8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:07.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b8003a40 con 0x7f02c4105710 2023-10-14T08:44:07.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02b8003ba0 con 0x7f02c4105710 2023-10-14T08:44:07.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c419d330 con 0x7f02c4105710 2023-10-14T08:44:07.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02b801a700 con 0x7f02c4105710 2023-10-14T08:44:07.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c419d750 con 0x7f02c4105710 2023-10-14T08:44:07.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f02b801ac80 con 0x7f02c4105710 2023-10-14T08:44:07.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.560+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f02b8019700 con 0x7f02c4105710 2023-10-14T08:44:07.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.561+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c40624e0 con 0x7f02c4105710 2023-10-14T08:44:07.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.563+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f02b8024ad0 con 0x7f02c4105710 2023-10-14T08:44:07.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.690+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f02c4109ba0 con 0x7f02c4105710 2023-10-14T08:44:07.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.691+0000 7f02c1ffb700 1 -- 172.21.15.6:0/329662731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f02b8024c70 con 0x7f02c4105710 2023-10-14T08:44:07.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 msgr2=0x7f02c4074420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:07.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 --2- 172.21.15.6:0/329662731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4074420 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f02b8006af0 tx=0x7f02b8011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:07.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 shutdown_connections 2023-10-14T08:44:07.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 --2- 172.21.15.6:0/329662731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02c4105710 0x7f02c4074420 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:07.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 >> 172.21.15.6:0/329662731 conn(0x7f02c4100cb0 msgr2=0x7f02c4102370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:07.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 shutdown_connections 2023-10-14T08:44:07.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:06.692+0000 7f02cae21700 1 -- 172.21.15.6:0/329662731 wait complete. 2023-10-14T08:44:07.173 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-14T08:44:07.184 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-14T08:44:07.184 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mgr... 2023-10-14T08:44:07.185 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-14T08:44:07.185 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-14T08:44:07.415 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x 2023-10-14T08:44:07.415 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x.service: Unit ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x.service not loaded. 2023-10-14T08:44:07.507 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.target.wants/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@.service. 2023-10-14T08:44:07.693 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:07 smithi006 systemd[1]: Starting Ceph mgr.x for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:44:07.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:07 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/329662731' entity='client.admin' 2023-10-14T08:44:07.982 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:07 smithi006 podman[99680]: 2023-10-14T08:44:08.113 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-14T08:44:08.114 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-10-14T08:44:08.121 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-14T08:44:08.122 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-10-14T08:44:08.122 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-10-14T08:44:08.122 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2023-10-14T08:44:08.130 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-14T08:44:08.130 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-10-14T08:44:08.138 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-14T08:44:08.138 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-10-14T08:44:08.138 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-10-14T08:44:08.139 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-14T08:44:08.139 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr to start... 2023-10-14T08:44:08.139 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr... 2023-10-14T08:44:08.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 bash[99680]: b194b901c56bf79b0a71fe8b99253d677f3c06ebc7fe098e92d87042dbd49ebc 2023-10-14T08:44:08.350 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 systemd[1]: Started Ceph mgr.x for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:44:08.351 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:08.164+0000 7f1c46665200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T08:44:08.351 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:08.265+0000 7f1c46665200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T08:44:08.710 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:08.377+0000 7f1c46665200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T08:44:08.710 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:08.493+0000 7f1c46665200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T08:44:08.711 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:08.708+0000 7f1c46665200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T08:44:08.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:08 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1636843701' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-14T08:44:09.203 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:09.204 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:09.204 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:44:09.204 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-10-14T08:44:09.204 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-14T08:44:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-14T08:44:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-14T08:44:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-14T08:44:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-14T08:44:09.206 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-10-14T08:44:09.206 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:09.206 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-14T08:44:09.206 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-10-14T08:44:09.206 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:09.207 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-10-14T08:44:09.207 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-14T08:44:09.207 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:09.207 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-14T08:44:09.207 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-14T08:44:09.208 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.208 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-14T08:44:09.208 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:09.208 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-14T08:44:09.208 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-14T08:44:09.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-14T08:44:09.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-14T08:44:09.209 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-14T08:44:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-14T08:44:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-14T08:44:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-14T08:44:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-14T08:44:09.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-14T08:44:09.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-14T08:44:09.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-14T08:44:09.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-14T08:44:09.211 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-14T08:44:09.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-14T08:44:09.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-14T08:44:09.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:09.212 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-14T08:44:09.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-14T08:44:09.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-14T08:44:09.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-14T08:44:09.213 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-14T08:44:09.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-14T08:44:09.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-14T08:44:09.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-14T08:44:09.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-10-14T08:44:09.214 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:09.215 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:09.215 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.215 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-14T08:44:09.215 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:09.215 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-10-14T08:44:01.633574+0000", 2023-10-14T08:44:09.216 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:09.216 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:09.216 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-14T08:44:09.216 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:09.216 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe87fa700 1 Processor -- start 2023-10-14T08:44:09.217 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe87fa700 1 -- start start 2023-10-14T08:44:09.217 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe87fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe0106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:09.217 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe87fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe01071f0 con 0x7fdfe0106800 2023-10-14T08:44:09.217 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe6596700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe0106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:09.218 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe6596700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe0106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58002/0 (socket says 172.21.15.6:58002) 2023-10-14T08:44:09.218 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.655+0000 7fdfe6596700 1 -- 172.21.15.6:0/1988214217 learned_addr learned my addr 172.21.15.6:0/1988214217 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:09.218 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.656+0000 7fdfe6596700 1 -- 172.21.15.6:0/1988214217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0107a00 con 0x7fdfe0106800 2023-10-14T08:44:09.218 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.656+0000 7fdfe6596700 1 --2- 172.21.15.6:0/1988214217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe0106c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0098a0 tx=0x7fdfdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35ac91c4d2a7ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:09.218 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.656+0000 7fdfe5594700 1 -- 172.21.15.6:0/1988214217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfdc004160 con 0x7fdfe0106800 2023-10-14T08:44:09.219 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.656+0000 7fdfe5594700 1 -- 172.21.15.6:0/1988214217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfdc0042c0 con 0x7fdfe0106800 2023-10-14T08:44:09.219 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.656+0000 7fdfe5594700 1 -- 172.21.15.6:0/1988214217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfdc011a00 con 0x7fdfe0106800 2023-10-14T08:44:09.219 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1988214217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 msgr2=0x7fdfe0106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:09.219 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 --2- 172.21.15.6:0/1988214217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe0106c20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0098a0 tx=0x7fdfdc009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:09.219 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1988214217 shutdown_connections 2023-10-14T08:44:09.220 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 --2- 172.21.15.6:0/1988214217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe0106c20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:09.220 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1988214217 >> 172.21.15.6:0/1988214217 conn(0x7fdfe0101dc0 msgr2=0x7fdfe01041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:09.220 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1988214217 shutdown_connections 2023-10-14T08:44:09.220 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.657+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1988214217 wait complete. 2023-10-14T08:44:09.220 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe87fa700 1 Processor -- start 2023-10-14T08:44:09.221 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe87fa700 1 -- start start 2023-10-14T08:44:09.221 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe87fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe007ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:09.221 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe87fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe007b0a0 con 0x7fdfe0106800 2023-10-14T08:44:09.221 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe6596700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe007ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:09.221 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe6596700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe007ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58004/0 (socket says 172.21.15.6:58004) 2023-10-14T08:44:09.222 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe6596700 1 -- 172.21.15.6:0/1636843701 learned_addr learned my addr 172.21.15.6:0/1636843701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:09.222 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.658+0000 7fdfe6596700 1 -- 172.21.15.6:0/1636843701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc009550 con 0x7fdfe0106800 2023-10-14T08:44:09.222 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfe6596700 1 --2- 172.21.15.6:0/1636843701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe007ab60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc006af0 tx=0x7fdfdc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:09.222 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfdc003a40 con 0x7fdfe0106800 2023-10-14T08:44:09.223 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfdc003ba0 con 0x7fdfe0106800 2023-10-14T08:44:09.223 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfdc01a700 con 0x7fdfe0106800 2023-10-14T08:44:09.223 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe00791b0 con 0x7fdfe0106800 2023-10-14T08:44:09.223 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe00795d0 con 0x7fdfe0106800 2023-10-14T08:44:09.223 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdfdc01ac30 con 0x7fdfe0106800 2023-10-14T08:44:09.223 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.659+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdfdc019700 con 0x7fdfe0106800 2023-10-14T08:44:09.224 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.660+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe00624e0 con 0x7fdfe0106800 2023-10-14T08:44:09.224 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.662+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdfdc024ad0 con 0x7fdfe0106800 2023-10-14T08:44:09.224 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.796+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdfe010ac00 con 0x7fdfe0106800 2023-10-14T08:44:09.224 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.797+0000 7fdfd77fe700 1 -- 172.21.15.6:0/1636843701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fdfdc024c70 con 0x7fdfe0106800 2023-10-14T08:44:09.225 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.797+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 msgr2=0x7fdfe007ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:09.225 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.797+0000 7fdfe87fa700 1 --2- 172.21.15.6:0/1636843701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe007ab60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc006af0 tx=0x7fdfdc011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:09.225 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.797+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 shutdown_connections 2023-10-14T08:44:09.225 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.798+0000 7fdfe87fa700 1 --2- 172.21.15.6:0/1636843701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe0106800 0x7fdfe007ab60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:09.225 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.798+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 >> 172.21.15.6:0/1636843701 conn(0x7fdfe0101dc0 msgr2=0x7fdfe0103480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:09.226 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.798+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 shutdown_connections 2023-10-14T08:44:09.226 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:08.798+0000 7fdfe87fa700 1 -- 172.21.15.6:0/1636843701 wait complete. 2023-10-14T08:44:09.226 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (1/15)... 2023-10-14T08:44:09.467 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:09 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:09.198+0000 7f1c46665200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T08:44:09.467 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:09 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:09.358+0000 7f1c46665200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T08:44:09.468 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:09 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:09.465+0000 7f1c46665200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T08:44:09.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:09 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:09.580+0000 7f1c46665200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T08:44:10.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:10 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:10.091+0000 7f1c46665200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T08:44:11.232 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:10 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:10.885+0000 7f1c46665200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T08:44:11.232 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:10 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:10.982+0000 7f1c46665200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T08:44:12.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1806019338' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-14T08:44:12.227 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:11 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:11.976+0000 7f1c46665200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:44:12.227 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:12 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:12.088+0000 7f1c46665200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T08:44:12.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:12.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:12.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:44:12.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-10-14T08:44:12.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-14T08:44:12.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-14T08:44:12.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-14T08:44:12.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-14T08:44:12.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-14T08:44:12.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-10-14T08:44:12.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:12.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-14T08:44:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-10-14T08:44:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-14T08:44:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-14T08:44:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-14T08:44:12.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-14T08:44:12.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-14T08:44:12.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:12.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-14T08:44:12.257 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-14T08:44:12.257 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-14T08:44:12.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-14T08:44:12.264 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-14T08:44:12.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-14T08:44:12.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-14T08:44:12.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-14T08:44:12.265 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-14T08:44:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-14T08:44:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-14T08:44:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-14T08:44:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-14T08:44:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-14T08:44:12.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-14T08:44:12.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-14T08:44:12.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:12.267 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-14T08:44:12.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-14T08:44:12.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-14T08:44:12.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-14T08:44:12.268 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-14T08:44:12.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-14T08:44:12.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-14T08:44:12.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-14T08:44:12.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-10-14T08:44:12.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:12.269 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:12.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-14T08:44:12.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:12.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-10-14T08:44:01.633574+0000", 2023-10-14T08:44:12.270 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:12.271 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:12.271 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-14T08:44:12.271 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:12.271 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.722+0000 7fdc3abd2700 1 Processor -- start 2023-10-14T08:44:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.722+0000 7fdc3abd2700 1 -- start start 2023-10-14T08:44:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3abd2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc34105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3abd2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34106100 con 0x7fdc34105710 2023-10-14T08:44:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3896e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc34105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3896e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc34105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58006/0 (socket says 172.21.15.6:58006) 2023-10-14T08:44:12.273 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3896e700 1 -- 172.21.15.6:0/3836920985 learned_addr learned my addr 172.21.15.6:0/3836920985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:12.273 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3896e700 1 -- 172.21.15.6:0/3836920985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc34106910 con 0x7fdc34105710 2023-10-14T08:44:12.273 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.723+0000 7fdc3896e700 1 --2- 172.21.15.6:0/3836920985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc34105b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdc280098a0 tx=0x7fdc28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1ae9a2a3570836 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:12.273 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc337fe700 1 -- 172.21.15.6:0/3836920985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc28004160 con 0x7fdc34105710 2023-10-14T08:44:12.273 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc337fe700 1 -- 172.21.15.6:0/3836920985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc280042c0 con 0x7fdc34105710 2023-10-14T08:44:12.274 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc337fe700 1 -- 172.21.15.6:0/3836920985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc28011a00 con 0x7fdc34105710 2023-10-14T08:44:12.274 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc3abd2700 1 -- 172.21.15.6:0/3836920985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 msgr2=0x7fdc34105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:12.274 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc3abd2700 1 --2- 172.21.15.6:0/3836920985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc34105b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdc280098a0 tx=0x7fdc28009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:12.274 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc3abd2700 1 -- 172.21.15.6:0/3836920985 shutdown_connections 2023-10-14T08:44:12.275 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc3abd2700 1 --2- 172.21.15.6:0/3836920985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc34105b30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:12.275 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.724+0000 7fdc3abd2700 1 -- 172.21.15.6:0/3836920985 >> 172.21.15.6:0/3836920985 conn(0x7fdc34100cb0 msgr2=0x7fdc341030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:12.275 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3abd2700 1 -- 172.21.15.6:0/3836920985 shutdown_connections 2023-10-14T08:44:12.275 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3abd2700 1 -- 172.21.15.6:0/3836920985 wait complete. 2023-10-14T08:44:12.275 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3abd2700 1 Processor -- start 2023-10-14T08:44:12.276 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3abd2700 1 -- start start 2023-10-14T08:44:12.276 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3abd2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc3419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:12.276 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3abd2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3419aa20 con 0x7fdc34105710 2023-10-14T08:44:12.276 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.725+0000 7fdc3896e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc3419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:12.276 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc3896e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc3419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58008/0 (socket says 172.21.15.6:58008) 2023-10-14T08:44:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc3896e700 1 -- 172.21.15.6:0/1806019338 learned_addr learned my addr 172.21.15.6:0/1806019338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc3896e700 1 -- 172.21.15.6:0/1806019338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009550 con 0x7fdc34105710 2023-10-14T08:44:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc3896e700 1 --2- 172.21.15.6:0/1806019338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc3419a4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc28006af0 tx=0x7fdc28011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc28003a40 con 0x7fdc34105710 2023-10-14T08:44:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc28003ba0 con 0x7fdc34105710 2023-10-14T08:44:12.278 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3419ac20 con 0x7fdc34105710 2023-10-14T08:44:12.278 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc2801a700 con 0x7fdc34105710 2023-10-14T08:44:12.278 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.726+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3419b040 con 0x7fdc34105710 2023-10-14T08:44:12.278 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.727+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdc2801ac80 con 0x7fdc34105710 2023-10-14T08:44:12.278 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.727+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdc28019700 con 0x7fdc34105710 2023-10-14T08:44:12.279 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.728+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc340624e0 con 0x7fdc34105710 2023-10-14T08:44:12.279 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.730+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdc28024ad0 con 0x7fdc34105710 2023-10-14T08:44:12.279 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.863+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdc34109b30 con 0x7fdc34105710 2023-10-14T08:44:12.279 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.863+0000 7fdc31ffb700 1 -- 172.21.15.6:0/1806019338 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fdc28024c70 con 0x7fdc34105710 2023-10-14T08:44:12.279 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.864+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 msgr2=0x7fdc3419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:12.280 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.864+0000 7fdc3abd2700 1 --2- 172.21.15.6:0/1806019338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc3419a4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc28006af0 tx=0x7fdc28011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:12.280 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.864+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 shutdown_connections 2023-10-14T08:44:12.280 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.864+0000 7fdc3abd2700 1 --2- 172.21.15.6:0/1806019338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc34105710 0x7fdc3419a4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:12.280 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.864+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 >> 172.21.15.6:0/1806019338 conn(0x7fdc34100cb0 msgr2=0x7fdc34074150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:12.280 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.864+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 shutdown_connections 2023-10-14T08:44:12.281 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:11.865+0000 7fdc3abd2700 1 -- 172.21.15.6:0/1806019338 wait complete. 2023-10-14T08:44:12.281 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (2/15)... 2023-10-14T08:44:12.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:12 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:12.311+0000 7f1c46665200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:44:12.919 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:12 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:12.665+0000 7f1c46665200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T08:44:13.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:12 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:12.917+0000 7f1c46665200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T08:44:13.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:13 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:13.099+0000 7f1c46665200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T08:44:13.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:13 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:13.429+0000 7f1c46665200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T08:44:14.514 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:14 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:14.250+0000 7f1c46665200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T08:44:14.514 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:14 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:14.417+0000 7f1c46665200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T08:44:14.813 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:14 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:14.670+0000 7f1c46665200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T08:44:15.094 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:14 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2908108197' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-14T08:44:15.095 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:14 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:14.811+0000 7f1c46665200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T08:44:15.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:15.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:15.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:44:15.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-10-14T08:44:15.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-14T08:44:15.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-14T08:44:15.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-14T08:44:15.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-14T08:44:15.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-14T08:44:15.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-10-14T08:44:15.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:15.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-14T08:44:15.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-10-14T08:44:15.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:15.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-10-14T08:44:15.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-14T08:44:15.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:15.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-14T08:44:15.314 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-14T08:44:15.314 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-14T08:44:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-14T08:44:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-14T08:44:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-14T08:44:15.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-14T08:44:15.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-14T08:44:15.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-14T08:44:15.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-14T08:44:15.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-14T08:44:15.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-14T08:44:15.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-14T08:44:15.317 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-14T08:44:15.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-14T08:44:15.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-14T08:44:15.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-14T08:44:15.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-14T08:44:15.318 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-14T08:44:15.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:15.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-14T08:44:15.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-14T08:44:15.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.319 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-14T08:44:15.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-14T08:44:15.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-14T08:44:15.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-14T08:44:15.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-14T08:44:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-14T08:44:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-10-14T08:44:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-14T08:44:15.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:15.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-10-14T08:44:01.633574+0000", 2023-10-14T08:44:15.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:15.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:15.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-14T08:44:15.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:15.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.768+0000 7f03be40e700 1 Processor -- start 2023-10-14T08:44:15.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.768+0000 7f03be40e700 1 -- start start 2023-10-14T08:44:15.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03be40e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b8079230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:15.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03be40e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8079800 con 0x7f03b807add0 2023-10-14T08:44:15.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b8079230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:15.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b8079230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58010/0 (socket says 172.21.15.6:58010) 2023-10-14T08:44:15.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03b7fff700 1 -- 172.21.15.6:0/1588609027 learned_addr learned my addr 172.21.15.6:0/1588609027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:15.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03b7fff700 1 -- 172.21.15.6:0/1588609027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8079940 con 0x7f03b807add0 2023-10-14T08:44:15.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.769+0000 7f03b7fff700 1 --2- 172.21.15.6:0/1588609027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b8079230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f03a80098a0 tx=0x7f03a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8fb16a6756a090 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:15.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03b6ffd700 1 -- 172.21.15.6:0/1588609027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a8004160 con 0x7f03b807add0 2023-10-14T08:44:15.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03b6ffd700 1 -- 172.21.15.6:0/1588609027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03a80042c0 con 0x7f03b807add0 2023-10-14T08:44:15.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03b6ffd700 1 -- 172.21.15.6:0/1588609027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a8011a00 con 0x7f03b807add0 2023-10-14T08:44:15.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 -- 172.21.15.6:0/1588609027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 msgr2=0x7f03b8079230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:15.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 --2- 172.21.15.6:0/1588609027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b8079230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f03a80098a0 tx=0x7f03a8009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:15.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 -- 172.21.15.6:0/1588609027 shutdown_connections 2023-10-14T08:44:15.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 --2- 172.21.15.6:0/1588609027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b8079230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:15.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 -- 172.21.15.6:0/1588609027 >> 172.21.15.6:0/1588609027 conn(0x7f03b8101dc0 msgr2=0x7f03b81041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 -- 172.21.15.6:0/1588609027 shutdown_connections 2023-10-14T08:44:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.770+0000 7f03be40e700 1 -- 172.21.15.6:0/1588609027 wait complete. 2023-10-14T08:44:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03be40e700 1 Processor -- start 2023-10-14T08:44:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03be40e700 1 -- start start 2023-10-14T08:44:15.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03be40e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:15.328 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03be40e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b819cc00 con 0x7f03b807add0 2023-10-14T08:44:15.328 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:15.328 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b819c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58012/0 (socket says 172.21.15.6:58012) 2023-10-14T08:44:15.328 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.771+0000 7f03b7fff700 1 -- 172.21.15.6:0/2908108197 learned_addr learned my addr 172.21.15.6:0/2908108197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03b7fff700 1 -- 172.21.15.6:0/2908108197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8009550 con 0x7f03b807add0 2023-10-14T08:44:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03b7fff700 1 --2- 172.21.15.6:0/2908108197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b819c6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009fb0 tx=0x7f03a8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a8003930 con 0x7f03b807add0 2023-10-14T08:44:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03a8003a90 con 0x7f03b807add0 2023-10-14T08:44:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b819ce00 con 0x7f03b807add0 2023-10-14T08:44:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03a80195e0 con 0x7f03b807add0 2023-10-14T08:44:15.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f03a8019ba0 con 0x7f03b807add0 2023-10-14T08:44:15.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.772+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b819d220 con 0x7f03b807add0 2023-10-14T08:44:15.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.773+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f03a8024550 con 0x7f03b807add0 2023-10-14T08:44:15.330 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.773+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80624e0 con 0x7f03b807add0 2023-10-14T08:44:15.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.776+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f03a8003c00 con 0x7f03b807add0 2023-10-14T08:44:15.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.910+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f03b810cbb0 con 0x7f03b807add0 2023-10-14T08:44:15.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.910+0000 7f03b57fa700 1 -- 172.21.15.6:0/2908108197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f03a801a9d0 con 0x7f03b807add0 2023-10-14T08:44:15.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 msgr2=0x7f03b819c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:15.331 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 --2- 172.21.15.6:0/2908108197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b819c6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009fb0 tx=0x7f03a8011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 shutdown_connections 2023-10-14T08:44:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 --2- 172.21.15.6:0/2908108197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b807add0 0x7f03b819c6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 >> 172.21.15.6:0/2908108197 conn(0x7f03b8101dc0 msgr2=0x7f03b81034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 shutdown_connections 2023-10-14T08:44:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:14.911+0000 7f03be40e700 1 -- 172.21.15.6:0/2908108197 wait complete. 2023-10-14T08:44:15.333 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (3/15)... 2023-10-14T08:44:15.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:15 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:15.093+0000 7f1c46665200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T08:44:16.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:16 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:16.150+0000 7f1c46665200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T08:44:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: Activating manager daemon x 2023-10-14T08:44:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: mgrmap e2: x(active, starting, since 0.00312987s) 2023-10-14T08:44:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-14T08:44:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-14T08:44:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-14T08:44:17.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:44:17.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-14T08:44:17.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: Manager daemon x is now available 2023-10-14T08:44:17.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-14T08:44:17.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-14T08:44:17.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' 2023-10-14T08:44:17.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' 2023-10-14T08:44:17.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:17 smithi006 ceph-mon[99452]: from='mgr.14100 172.21.15.6:0/1718892167' entity='mgr.x' 2023-10-14T08:44:18.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:18 smithi006 ceph-mon[99452]: mgrmap e3: x(active, since 1.00926s) 2023-10-14T08:44:20.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:20 smithi006 ceph-mon[99452]: mgrmap e4: x(active, since 3s) 2023-10-14T08:44:20.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:20 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4218862848' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-14T08:44:22.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:22.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:22.975 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:44:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-10-14T08:44:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-14T08:44:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-14T08:44:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-14T08:44:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-14T08:44:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-14T08:44:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-10-14T08:44:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-14T08:44:22.978 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-10-14T08:44:22.978 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:22.978 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2023-10-14T08:44:22.978 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-14T08:44:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-14T08:44:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-14T08:44:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-14T08:44:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-14T08:44:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-14T08:44:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-14T08:44:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-14T08:44:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-14T08:44:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-14T08:44:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-14T08:44:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-14T08:44:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-14T08:44:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-14T08:44:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-14T08:44:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-14T08:44:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-14T08:44:22.983 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-14T08:44:22.983 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-14T08:44:22.983 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.983 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-14T08:44:22.983 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-14T08:44:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-14T08:44:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-14T08:44:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-14T08:44:22.985 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-14T08:44:22.985 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-14T08:44:22.985 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-14T08:44:22.985 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-14T08:44:22.985 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-10-14T08:44:22.986 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-10-14T08:44:22.986 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:22.986 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.986 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-14T08:44:22.986 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-14T08:44:22.987 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-10-14T08:44:01.633574+0000", 2023-10-14T08:44:22.987 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-14T08:44:22.987 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-10-14T08:44:22.987 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-14T08:44:22.987 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:22.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fbaa1108700 1 Processor -- start 2023-10-14T08:44:22.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fbaa1108700 1 -- start start 2023-10-14T08:44:22.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fbaa1108700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:22.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fbaa1108700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c106100 con 0x7fba9c105710 2023-10-14T08:44:22.988 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:22.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58038/0 (socket says 172.21.15.6:58038) 2023-10-14T08:44:22.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.349+0000 7fba9ad9d700 1 -- 172.21.15.6:0/2583700485 learned_addr learned my addr 172.21.15.6:0/2583700485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:22.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fba9ad9d700 1 -- 172.21.15.6:0/2583700485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c106910 con 0x7fba9c105710 2023-10-14T08:44:22.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fba9ad9d700 1 --2- 172.21.15.6:0/2583700485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c105b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0098a0 tx=0x7fba8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d379a59860ea50fe server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:22.989 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fba99d9b700 1 -- 172.21.15.6:0/2583700485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba8c004160 con 0x7fba9c105710 2023-10-14T08:44:22.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fba99d9b700 1 -- 172.21.15.6:0/2583700485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba8c0042c0 con 0x7fba9c105710 2023-10-14T08:44:22.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fba99d9b700 1 -- 172.21.15.6:0/2583700485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba8c011a00 con 0x7fba9c105710 2023-10-14T08:44:22.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fbaa1108700 1 -- 172.21.15.6:0/2583700485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 msgr2=0x7fba9c105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:22.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fbaa1108700 1 --2- 172.21.15.6:0/2583700485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c105b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0098a0 tx=0x7fba8c009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:22.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fbaa1108700 1 -- 172.21.15.6:0/2583700485 shutdown_connections 2023-10-14T08:44:22.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fbaa1108700 1 --2- 172.21.15.6:0/2583700485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c105b30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:22.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.350+0000 7fbaa1108700 1 -- 172.21.15.6:0/2583700485 >> 172.21.15.6:0/2583700485 conn(0x7fba9c100cb0 msgr2=0x7fba9c1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:22.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.351+0000 7fbaa1108700 1 -- 172.21.15.6:0/2583700485 shutdown_connections 2023-10-14T08:44:22.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.351+0000 7fbaa1108700 1 -- 172.21.15.6:0/2583700485 wait complete. 2023-10-14T08:44:22.991 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.351+0000 7fbaa1108700 1 Processor -- start 2023-10-14T08:44:22.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fbaa1108700 1 -- start start 2023-10-14T08:44:22.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fbaa1108700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c074420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:22.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fbaa1108700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c19d220 con 0x7fba9c105710 2023-10-14T08:44:22.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:22.992 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fba9ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c074420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58040/0 (socket says 172.21.15.6:58040) 2023-10-14T08:44:22.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fba9ad9d700 1 -- 172.21.15.6:0/4218862848 learned_addr learned my addr 172.21.15.6:0/4218862848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:22.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fba9ad9d700 1 -- 172.21.15.6:0/4218862848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c009550 con 0x7fba9c105710 2023-10-14T08:44:22.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.352+0000 7fba9ad9d700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c074420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009fb0 tx=0x7fba8c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:22.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.353+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba8c003930 con 0x7fba9c105710 2023-10-14T08:44:22.993 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.353+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba8c003a90 con 0x7fba9c105710 2023-10-14T08:44:22.994 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.353+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9c19d360 con 0x7fba9c105710 2023-10-14T08:44:22.994 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.353+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba8c0195e0 con 0x7fba9c105710 2023-10-14T08:44:22.994 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.353+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c19d780 con 0x7fba9c105710 2023-10-14T08:44:22.994 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.353+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7fba8c019890 con 0x7fba9c105710 2023-10-14T08:44:22.994 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.354+0000 7fba83fff700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7fba840387d0 0x7fba8403ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:22.995 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.354+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fba8c04d5a0 con 0x7fba9c105710 2023-10-14T08:44:22.995 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.354+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c0624e0 con 0x7fba9c105710 2023-10-14T08:44:22.995 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.354+0000 7fba9a59c700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7fba840387d0 0x7fba8403ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:22.995 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.354+0000 7fba9a59c700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7fba840387d0 0x7fba8403ac90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba90006fd0 tx=0x7fba90006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:22.995 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.359+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fba8c019b40 con 0x7fba9c105710 2023-10-14T08:44:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.882+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fba9c109cb0 con 0x7fba9c105710 2023-10-14T08:44:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.883+0000 7fba83fff700 1 -- 172.21.15.6:0/4218862848 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fba8c018350 con 0x7fba9c105710 2023-10-14T08:44:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7fba840387d0 msgr2=0x7fba8403ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7fba840387d0 0x7fba8403ac90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba90006fd0 tx=0x7fba90006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:22.996 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 msgr2=0x7fba9c074420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:22.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c074420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009fb0 tx=0x7fba8c011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:22.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 shutdown_connections 2023-10-14T08:44:22.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7fba840387d0 0x7fba8403ac90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:22.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 --2- 172.21.15.6:0/4218862848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba9c105710 0x7fba9c074420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:22.997 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 >> 172.21.15.6:0/4218862848 conn(0x7fba9c100cb0 msgr2=0x7fba9c102390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:22.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 shutdown_connections 2023-10-14T08:44:22.998 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:19.885+0000 7fbaa1108700 1 -- 172.21.15.6:0/4218862848 wait complete. 2023-10-14T08:44:22.998 INFO:teuthology.orchestra.run.smithi006.stdout:mgr is available 2023-10-14T08:44:25.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:25 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1089802457' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-14T08:44:27.736 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:27.736 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2023-10-14T08:44:27.736 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:27.737 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-14T08:44:27.737 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-14T08:44:27.737 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-14T08:44:27.737 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-14T08:44:27.737 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:27.737 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-14T08:44:27.738 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-14T08:44:27.738 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-10-14T08:44:27.738 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2023-10-14T08:44:27.738 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-14T08:44:27.738 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-14T08:44:27.739 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-14T08:44:27.739 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-14T08:44:27.741 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-14T08:44:27.741 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.191+0000 7feae3e4f700 1 Processor -- start 2023-10-14T08:44:27.741 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae3e4f700 1 -- start start 2023-10-14T08:44:27.741 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae3e4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc107110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:27.741 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae3e4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc1076e0 con 0x7feadc106cf0 2023-10-14T08:44:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae1beb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc107110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae1beb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc107110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58044/0 (socket says 172.21.15.6:58044) 2023-10-14T08:44:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae1beb700 1 -- 172.21.15.6:0/1692621541 learned_addr learned my addr 172.21.15.6:0/1692621541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.192+0000 7feae1beb700 1 -- 172.21.15.6:0/1692621541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc105900 con 0x7feadc106cf0 2023-10-14T08:44:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae1beb700 1 --2- 172.21.15.6:0/1692621541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc107110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feacc0098a0 tx=0x7feacc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f222c88fcab37422 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:27.743 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae0be9700 1 -- 172.21.15.6:0/1692621541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc004160 con 0x7feadc106cf0 2023-10-14T08:44:27.743 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae0be9700 1 -- 172.21.15.6:0/1692621541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feacc0042c0 con 0x7feadc106cf0 2023-10-14T08:44:27.743 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae0be9700 1 -- 172.21.15.6:0/1692621541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc011a00 con 0x7feadc106cf0 2023-10-14T08:44:27.743 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae3e4f700 1 -- 172.21.15.6:0/1692621541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 msgr2=0x7feadc107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:27.743 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae3e4f700 1 --2- 172.21.15.6:0/1692621541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc107110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feacc0098a0 tx=0x7feacc009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:27.744 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae3e4f700 1 -- 172.21.15.6:0/1692621541 shutdown_connections 2023-10-14T08:44:27.744 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae3e4f700 1 --2- 172.21.15.6:0/1692621541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc107110 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:27.744 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.193+0000 7feae3e4f700 1 -- 172.21.15.6:0/1692621541 >> 172.21.15.6:0/1692621541 conn(0x7feadc100450 msgr2=0x7feadc102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:27.744 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.194+0000 7feae3e4f700 1 -- 172.21.15.6:0/1692621541 shutdown_connections 2023-10-14T08:44:27.744 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.194+0000 7feae3e4f700 1 -- 172.21.15.6:0/1692621541 wait complete. 2023-10-14T08:44:27.745 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.194+0000 7feae3e4f700 1 Processor -- start 2023-10-14T08:44:27.745 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.194+0000 7feae3e4f700 1 -- start start 2023-10-14T08:44:27.745 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.194+0000 7feae3e4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:27.745 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.194+0000 7feae3e4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc19aa00 con 0x7feadc106cf0 2023-10-14T08:44:27.745 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae1beb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:27.745 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae1beb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58046/0 (socket says 172.21.15.6:58046) 2023-10-14T08:44:27.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae1beb700 1 -- 172.21.15.6:0/1089802457 learned_addr learned my addr 172.21.15.6:0/1089802457 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:27.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae1beb700 1 -- 172.21.15.6:0/1089802457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009550 con 0x7feadc106cf0 2023-10-14T08:44:27.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae1beb700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc19a4c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feacc006af0 tx=0x7feacc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:27.746 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc003a40 con 0x7feadc106cf0 2023-10-14T08:44:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc19ac00 con 0x7feadc106cf0 2023-10-14T08:44:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feacc003ba0 con 0x7feadc106cf0 2023-10-14T08:44:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feacc01a700 con 0x7feadc106cf0 2023-10-14T08:44:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.195+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc19b020 con 0x7feadc106cf0 2023-10-14T08:44:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.196+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7feacc01a930 con 0x7feadc106cf0 2023-10-14T08:44:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.196+0000 7fead2ffd700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7feac8038820 0x7feac803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.196+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feacc04c990 con 0x7feadc106cf0 2023-10-14T08:44:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.196+0000 7feae13ea700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7feac8038820 0x7feac803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.196+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc0624e0 con 0x7feadc106cf0 2023-10-14T08:44:27.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.197+0000 7feae13ea700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7feac8038820 0x7feac803ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fead8006fd0 tx=0x7fead8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:27.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.201+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feacc01abe0 con 0x7feadc106cf0 2023-10-14T08:44:27.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.560+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7feadc109b10 con 0x7feadc106cf0 2023-10-14T08:44:27.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.561+0000 7fead2ffd700 1 -- 172.21.15.6:0/1089802457 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7feacc018350 con 0x7feadc106cf0 2023-10-14T08:44:27.749 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.563+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7feac8038820 msgr2=0x7feac803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:27.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.563+0000 7feae3e4f700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7feac8038820 0x7feac803ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fead8006fd0 tx=0x7fead8006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:27.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.563+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 msgr2=0x7feadc19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:27.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.563+0000 7feae3e4f700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc19a4c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feacc006af0 tx=0x7feacc011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:27.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.564+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 shutdown_connections 2023-10-14T08:44:27.750 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.564+0000 7feae3e4f700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7feac8038820 0x7feac803ace0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:27.751 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.564+0000 7feae3e4f700 1 --2- 172.21.15.6:0/1089802457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feadc106cf0 0x7feadc19a4c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:27.751 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.564+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 >> 172.21.15.6:0/1089802457 conn(0x7feadc100450 msgr2=0x7feadc101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:27.751 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.564+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 shutdown_connections 2023-10-14T08:44:27.752 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:25.564+0000 7feae3e4f700 1 -- 172.21.15.6:0/1089802457 wait complete. 2023-10-14T08:44:27.752 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling cephadm module... 2023-10-14T08:44:29.088 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:28 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3282422425' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-14T08:44:29.089 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: ignoring --setuser ceph since I am not root 2023-10-14T08:44:29.089 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: ignoring --setgroup ceph since I am not root 2023-10-14T08:44:29.089 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:28.990+0000 7efd7b62b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T08:44:29.089 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:29.086+0000 7efd7b62b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T08:44:29.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.260+0000 7f5cf6b03700 1 Processor -- start 2023-10-14T08:44:29.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.260+0000 7f5cf6b03700 1 -- start start 2023-10-14T08:44:29.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.260+0000 7f5cf6b03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf0105510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:29.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.260+0000 7f5cf6b03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0074700 con 0x7f5cf01050f0 2023-10-14T08:44:29.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cf489f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf0105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:29.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cf489f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf0105510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58050/0 (socket says 172.21.15.6:58050) 2023-10-14T08:44:29.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cf489f700 1 -- 172.21.15.6:0/457509061 learned_addr learned my addr 172.21.15.6:0/457509061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:29.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cf489f700 1 -- 172.21.15.6:0/457509061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0105a50 con 0x7f5cf01050f0 2023-10-14T08:44:29.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cf489f700 1 --2- 172.21.15.6:0/457509061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf0105510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40098a0 tx=0x7f5ce4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b51a6752dcaa954 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cef7fe700 1 -- 172.21.15.6:0/457509061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce4004160 con 0x7f5cf01050f0 2023-10-14T08:44:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cef7fe700 1 -- 172.21.15.6:0/457509061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ce40042c0 con 0x7f5cf01050f0 2023-10-14T08:44:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.261+0000 7f5cef7fe700 1 -- 172.21.15.6:0/457509061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce4011a00 con 0x7f5cf01050f0 2023-10-14T08:44:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 -- 172.21.15.6:0/457509061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 msgr2=0x7f5cf0105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:29.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 --2- 172.21.15.6:0/457509061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf0105510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40098a0 tx=0x7f5ce4009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:29.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 -- 172.21.15.6:0/457509061 shutdown_connections 2023-10-14T08:44:29.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 --2- 172.21.15.6:0/457509061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf0105510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:29.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 -- 172.21.15.6:0/457509061 >> 172.21.15.6:0/457509061 conn(0x7f5cf0100cb0 msgr2=0x7f5cf01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:29.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 -- 172.21.15.6:0/457509061 shutdown_connections 2023-10-14T08:44:29.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 -- 172.21.15.6:0/457509061 wait complete. 2023-10-14T08:44:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.262+0000 7f5cf6b03700 1 Processor -- start 2023-10-14T08:44:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf6b03700 1 -- start start 2023-10-14T08:44:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf6b03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf6b03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf019cbc0 con 0x7f5cf01050f0 2023-10-14T08:44:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf489f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:29.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf489f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58052/0 (socket says 172.21.15.6:58052) 2023-10-14T08:44:29.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf489f700 1 -- 172.21.15.6:0/3282422425 learned_addr learned my addr 172.21.15.6:0/3282422425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:29.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf489f700 1 -- 172.21.15.6:0/3282422425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4009550 con 0x7f5cf01050f0 2023-10-14T08:44:29.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cf489f700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf019c680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4006af0 tx=0x7f5ce4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:29.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce4003a40 con 0x7f5cf01050f0 2023-10-14T08:44:29.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.263+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ce4003ba0 con 0x7f5cf01050f0 2023-10-14T08:44:29.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.264+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf019cdc0 con 0x7f5cf01050f0 2023-10-14T08:44:29.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.264+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ce401a6e0 con 0x7f5cf01050f0 2023-10-14T08:44:29.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.264+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf019d1e0 con 0x7f5cf01050f0 2023-10-14T08:44:29.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.265+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 45568+0+0 (secure 0 0 0) 0x7f5ce401a860 con 0x7f5cf01050f0 2023-10-14T08:44:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.265+0000 7f5cedffb700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f5ce0038820 0x7f5ce003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.265+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5ce404c8d0 con 0x7f5cf01050f0 2023-10-14T08:44:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.265+0000 7f5ceffff700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f5ce0038820 0x7f5ce003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.265+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0195f60 con 0x7f5cf01050f0 2023-10-14T08:44:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.265+0000 7f5ceffff700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f5ce0038820 0x7f5ce003ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006fd0 tx=0x7f5cdc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:29.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.270+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ce401ab10 con 0x7f5cf01050f0 2023-10-14T08:44:29.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.747+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5cf01068c0 con 0x7f5cf01050f0 2023-10-14T08:44:29.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.799+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5ce4018350 con 0x7f5cf01050f0 2023-10-14T08:44:29.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.800+0000 7f5cedffb700 1 -- 172.21.15.6:0/3282422425 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f5ce401acf0 con 0x7f5cf01050f0 2023-10-14T08:44:29.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f5ce0038820 msgr2=0x7f5ce003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f5ce0038820 0x7f5ce003ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006fd0 tx=0x7f5cdc006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 msgr2=0x7f5cf019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf019c680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4006af0 tx=0x7f5ce4011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 shutdown_connections 2023-10-14T08:44:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f5ce0038820 0x7f5ce003ace0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:29.201 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 --2- 172.21.15.6:0/3282422425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf01050f0 0x7f5cf019c680 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:29.201 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 >> 172.21.15.6:0/3282422425 conn(0x7f5cf0100cb0 msgr2=0x7f5cf0190cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:29.201 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 shutdown_connections 2023-10-14T08:44:29.201 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:28.802+0000 7f5cf6b03700 1 -- 172.21.15.6:0/3282422425 wait complete. 2023-10-14T08:44:29.405 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:29.197+0000 7efd7b62b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T08:44:29.405 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:29.313+0000 7efd7b62b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T08:44:29.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:29.532+0000 7efd7b62b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T08:44:30.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:29 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3282422425' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-14T08:44:30.173 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:29 smithi006 ceph-mon[99452]: mgrmap e5: x(active, since 12s) 2023-10-14T08:44:30.174 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:30.014+0000 7efd7b62b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T08:44:30.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:30.171+0000 7efd7b62b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T08:44:30.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:30.285+0000 7efd7b62b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T08:44:30.482 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:30.401+0000 7efd7b62b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T08:44:30.542 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:30.542 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-14T08:44:30.542 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-14T08:44:30.543 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-14T08:44:30.543 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-14T08:44:30.543 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:30.543 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.691+0000 7f906833e700 1 Processor -- start 2023-10-14T08:44:30.543 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.691+0000 7f906833e700 1 -- start start 2023-10-14T08:44:30.543 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.691+0000 7f906833e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f9060105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:30.544 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.691+0000 7f906833e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9060106100 con 0x7f9060105710 2023-10-14T08:44:30.544 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90660da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f9060105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:30.544 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90660da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f9060105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58066/0 (socket says 172.21.15.6:58066) 2023-10-14T08:44:30.544 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90660da700 1 -- 172.21.15.6:0/877208457 learned_addr learned my addr 172.21.15.6:0/877208457 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:30.545 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90660da700 1 -- 172.21.15.6:0/877208457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060106910 con 0x7f9060105710 2023-10-14T08:44:30.545 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90660da700 1 --2- 172.21.15.6:0/877208457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f9060105b30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f905c0098a0 tx=0x7f905c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5625a5662c49b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:30.545 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90650d8700 1 -- 172.21.15.6:0/877208457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f905c004160 con 0x7f9060105710 2023-10-14T08:44:30.545 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90650d8700 1 -- 172.21.15.6:0/877208457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f905c0042c0 con 0x7f9060105710 2023-10-14T08:44:30.545 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.692+0000 7f90650d8700 1 -- 172.21.15.6:0/877208457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f905c011a00 con 0x7f9060105710 2023-10-14T08:44:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 -- 172.21.15.6:0/877208457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 msgr2=0x7f9060105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 --2- 172.21.15.6:0/877208457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f9060105b30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f905c0098a0 tx=0x7f905c009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 -- 172.21.15.6:0/877208457 shutdown_connections 2023-10-14T08:44:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 --2- 172.21.15.6:0/877208457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f9060105b30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:30.546 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 -- 172.21.15.6:0/877208457 >> 172.21.15.6:0/877208457 conn(0x7f9060100cb0 msgr2=0x7f90601030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:30.547 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 -- 172.21.15.6:0/877208457 shutdown_connections 2023-10-14T08:44:30.547 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.693+0000 7f906833e700 1 -- 172.21.15.6:0/877208457 wait complete. 2023-10-14T08:44:30.547 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f906833e700 1 Processor -- start 2023-10-14T08:44:30.547 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f906833e700 1 -- start start 2023-10-14T08:44:30.547 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f906833e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f90601993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:30.548 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f906833e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9060199930 con 0x7f9060105710 2023-10-14T08:44:30.548 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f90660da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f90601993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:30.548 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f90660da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f90601993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58068/0 (socket says 172.21.15.6:58068) 2023-10-14T08:44:30.548 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.694+0000 7f90660da700 1 -- 172.21.15.6:0/3209319182 learned_addr learned my addr 172.21.15.6:0/3209319182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:30.548 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f90660da700 1 -- 172.21.15.6:0/3209319182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c009550 con 0x7f9060105710 2023-10-14T08:44:30.549 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f90660da700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f90601993f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f905c006af0 tx=0x7f905c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:30.549 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f905c003a40 con 0x7f9060105710 2023-10-14T08:44:30.549 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f905c003ba0 con 0x7f9060105710 2023-10-14T08:44:30.549 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f905c01a700 con 0x7f9060105710 2023-10-14T08:44:30.549 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9060199b30 con 0x7f9060105710 2023-10-14T08:44:30.550 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.695+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9060199f50 con 0x7f9060105710 2023-10-14T08:44:30.550 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.696+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f905c01a930 con 0x7f9060105710 2023-10-14T08:44:30.550 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.696+0000 7f90577fe700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 0x7f904c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:30.550 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.696+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f905c04c7f0 con 0x7f9060105710 2023-10-14T08:44:30.550 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.696+0000 7f90658d9700 1 -- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 msgr2=0x7f904c03ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.696+0000 7f90658d9700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 0x7f904c03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:44:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.696+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90600624e0 con 0x7f9060105710 2023-10-14T08:44:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.706+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f905c018db0 con 0x7f9060105710 2023-10-14T08:44:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.897+0000 7f90658d9700 1 -- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 msgr2=0x7f904c03ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:29.897+0000 7f90658d9700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 0x7f904c03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T08:44:30.552 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.182+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f906019cae0 con 0x7f9060105710 2023-10-14T08:44:30.552 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.182+0000 7f90577fe700 1 -- 172.21.15.6:0/3209319182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f905c018350 con 0x7f9060105710 2023-10-14T08:44:30.552 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 msgr2=0x7f904c03ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:44:30.552 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 0x7f904c03ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:30.552 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 msgr2=0x7f90601993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:30.553 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f90601993f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f905c006af0 tx=0x7f905c011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:30.553 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 shutdown_connections 2023-10-14T08:44:30.553 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f904c038870 0x7f904c03ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:30.553 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 --2- 172.21.15.6:0/3209319182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9060105710 0x7f90601993f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:30.553 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.184+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 >> 172.21.15.6:0/3209319182 conn(0x7f9060100cb0 msgr2=0x7f9060102390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:30.554 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.185+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 shutdown_connections 2023-10-14T08:44:30.554 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:30.185+0000 7f906833e700 1 -- 172.21.15.6:0/3209319182 wait complete. 2023-10-14T08:44:30.554 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2023-10-14T08:44:30.554 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 5... 2023-10-14T08:44:31.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:30 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3209319182' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-14T08:44:31.232 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:30.936+0000 7efd7b62b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T08:44:31.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:31 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:31.722+0000 7efd7b62b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T08:44:31.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:31 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:31.821+0000 7efd7b62b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T08:44:33.129 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:32.794+0000 7efd7b62b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:44:33.129 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:32.905+0000 7efd7b62b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T08:44:33.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:33.127+0000 7efd7b62b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:44:33.732 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:33.479+0000 7efd7b62b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T08:44:34.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:33.732+0000 7efd7b62b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T08:44:34.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:33.915+0000 7efd7b62b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T08:44:34.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:34.245+0000 7efd7b62b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T08:44:35.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:35.071+0000 7efd7b62b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T08:44:35.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:35.231+0000 7efd7b62b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T08:44:35.897 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:35.479+0000 7efd7b62b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T08:44:35.898 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:35.617+0000 7efd7b62b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T08:44:37.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:35.894+0000 7efd7b62b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T08:44:37.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:36.971+0000 7efd7b62b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T08:44:37.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: Active manager daemon x restarted 2023-10-14T08:44:37.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: Activating manager daemon x 2023-10-14T08:44:37.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: osdmap e2: 0 total, 0 up, 0 in 2023-10-14T08:44:37.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: mgrmap e6: x(active, starting, since 0.0038692s) 2023-10-14T08:44:37.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:44:37.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-14T08:44:37.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-14T08:44:37.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-14T08:44:37.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:37 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-14T08:44:38.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: Manager daemon x is now available 2023-10-14T08:44:38.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: Found migration_current of "None". Setting to last migration. 2023-10-14T08:44:38.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:38.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:38.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:44:38.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:44:38.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:44:38.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-14T08:44:38.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:38 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-14T08:44:38.403 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:38.410 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-14T08:44:38.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-14T08:44:38.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:38.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.070+0000 7f937c757700 1 Processor -- start 2023-10-14T08:44:38.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.070+0000 7f937c757700 1 -- start start 2023-10-14T08:44:38.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.071+0000 7f937c757700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f93741054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:38.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.071+0000 7f937c757700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374074720 con 0x7f93741050d0 2023-10-14T08:44:38.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.071+0000 7f937a4f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f93741054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:38.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.071+0000 7f937a4f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f93741054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58076/0 (socket says 172.21.15.6:58076) 2023-10-14T08:44:38.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.071+0000 7f937a4f3700 1 -- 172.21.15.6:0/239269862 learned_addr learned my addr 172.21.15.6:0/239269862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:38.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.071+0000 7f937a4f3700 1 -- 172.21.15.6:0/239269862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374105a30 con 0x7f93741050d0 2023-10-14T08:44:38.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.072+0000 7f937a4f3700 1 --2- 172.21.15.6:0/239269862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f93741054f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93700098a0 tx=0x7f9370009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa41afb6d40453e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:38.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.072+0000 7f93794f1700 1 -- 172.21.15.6:0/239269862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9370004160 con 0x7f93741050d0 2023-10-14T08:44:38.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.072+0000 7f93794f1700 1 -- 172.21.15.6:0/239269862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93700042c0 con 0x7f93741050d0 2023-10-14T08:44:38.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.072+0000 7f93794f1700 1 -- 172.21.15.6:0/239269862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9370011a00 con 0x7f93741050d0 2023-10-14T08:44:38.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.072+0000 7f937c757700 1 -- 172.21.15.6:0/239269862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 msgr2=0x7f93741054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:38.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.072+0000 7f937c757700 1 --2- 172.21.15.6:0/239269862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f93741054f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93700098a0 tx=0x7f9370009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 -- 172.21.15.6:0/239269862 shutdown_connections 2023-10-14T08:44:38.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 --2- 172.21.15.6:0/239269862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f93741054f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 -- 172.21.15.6:0/239269862 >> 172.21.15.6:0/239269862 conn(0x7f9374100cb0 msgr2=0x7f93741030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:38.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 -- 172.21.15.6:0/239269862 shutdown_connections 2023-10-14T08:44:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 -- 172.21.15.6:0/239269862 wait complete. 2023-10-14T08:44:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 Processor -- start 2023-10-14T08:44:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.073+0000 7f937c757700 1 -- start start 2023-10-14T08:44:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937c757700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f937419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937c757700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937419cbb0 con 0x7f93741050d0 2023-10-14T08:44:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937a4f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f937419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:38.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937a4f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f937419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58078/0 (socket says 172.21.15.6:58078) 2023-10-14T08:44:38.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937a4f3700 1 -- 172.21.15.6:0/3109034240 learned_addr learned my addr 172.21.15.6:0/3109034240 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:38.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937a4f3700 1 -- 172.21.15.6:0/3109034240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370009550 con 0x7f93741050d0 2023-10-14T08:44:38.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937a4f3700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f937419c670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9370009fb0 tx=0x7f9370011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:38.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9370003930 con 0x7f93741050d0 2023-10-14T08:44:38.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9370003a90 con 0x7f93741050d0 2023-10-14T08:44:38.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937419cdb0 con 0x7f93741050d0 2023-10-14T08:44:38.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.074+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937419d1d0 con 0x7f93741050d0 2023-10-14T08:44:38.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.075+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9370019610 con 0x7f93741050d0 2023-10-14T08:44:38.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.075+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f9370019900 con 0x7f93741050d0 2023-10-14T08:44:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.076+0000 7f936b7fe700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.076+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 --> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f936003b3f0 con 0x7f9360038820 2023-10-14T08:44:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.076+0000 7f9379cf2700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 msgr2=0x7f936003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.076+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f937004c5a0 con 0x7f93741050d0 2023-10-14T08:44:38.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.076+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:44:38.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.277+0000 7f9379cf2700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 msgr2=0x7f936003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:38.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.277+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T08:44:38.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.678+0000 7f9379cf2700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 msgr2=0x7f936003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:38.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:31.678+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T08:44:38.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:32.479+0000 7f9379cf2700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 msgr2=0x7f936003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:38.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:32.479+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T08:44:38.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:34.080+0000 7f9379cf2700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 msgr2=0x7f936003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3410563111 2023-10-14T08:44:38.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:34.080+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-14T08:44:38.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:36.986+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 6) v1 ==== 45346+0+0 (secure 0 0 0) 0x7f937002d9b0 con 0x7f93741050d0 2023-10-14T08:44:38.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:36.987+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 msgr2=0x7f936003ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:44:38.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:36.987+0000 7f936b7fe700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.008+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f937004e010 con 0x7f93741050d0 2023-10-14T08:44:38.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.008+0000 7f936b7fe700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f936003bff0 0x7f936003e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:38.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.008+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f936003b3f0 con 0x7f936003bff0 2023-10-14T08:44:38.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.009+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f936003bff0 0x7f936003e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:38.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.009+0000 7f9379cf2700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f936003bff0 0x7f936003e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9364003a10 tx=0x7f93640092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.010+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f936003b3f0 con 0x7f936003bff0 2023-10-14T08:44:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9358002630 con 0x7f936003bff0 2023-10-14T08:44:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f936b7fe700 1 -- 172.21.15.6:0/3109034240 <== mgr.14120 v2:172.21.15.6:6800/516951061 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9358002630 con 0x7f936003bff0 2023-10-14T08:44:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f936003bff0 msgr2=0x7f936003e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f936003bff0 0x7f936003e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9364003a10 tx=0x7f93640092b0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 msgr2=0x7f937419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:38.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f937419c670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9370009fb0 tx=0x7f9370011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 shutdown_connections 2023-10-14T08:44:38.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f936003bff0 0x7f936003e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93741050d0 0x7f937419c670 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 --2- 172.21.15.6:0/3109034240 >> [v2:172.21.15.6:6800/3410563111,v1:172.21.15.6:6801/3410563111] conn(0x7f9360038820 0x7f936003ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:38.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 >> 172.21.15.6:0/3109034240 conn(0x7f9374100cb0 msgr2=0x7f9374190c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:38.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 shutdown_connections 2023-10-14T08:44:38.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.021+0000 7f937c757700 1 -- 172.21.15.6:0/3109034240 wait complete. 2023-10-14T08:44:38.424 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 5 is available 2023-10-14T08:44:38.424 INFO:teuthology.orchestra.run.smithi006.stdout:Setting orchestrator backend to cephadm... 2023-10-14T08:44:39.417 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:39 smithi006 ceph-mon[99452]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-14T08:44:39.418 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:39 smithi006 ceph-mon[99452]: mgrmap e7: x(active, since 1.0257s) 2023-10-14T08:44:39.418 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:39 smithi006 ceph-mon[99452]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-14T08:44:39.418 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:39 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:39.418 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:39 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:39.754 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f855d755700 1 Processor -- start 2023-10-14T08:44:39.755 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f855d755700 1 -- start start 2023-10-14T08:44:39.755 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f855d755700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f8558105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:39.755 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f855d755700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558106100 con 0x7f8558105710 2023-10-14T08:44:39.755 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f8556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f8558105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:39.756 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f8556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f8558105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58124/0 (socket says 172.21.15.6:58124) 2023-10-14T08:44:39.756 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f8556ffd700 1 -- 172.21.15.6:0/3942090801 learned_addr learned my addr 172.21.15.6:0/3942090801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:39.756 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f8556ffd700 1 -- 172.21.15.6:0/3942090801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558106910 con 0x7f8558105710 2023-10-14T08:44:39.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.977+0000 7f8556ffd700 1 --2- 172.21.15.6:0/3942090801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f8558105b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85480098a0 tx=0x7f8548009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a957e55b6dc8d9d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:39.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f8555ffb700 1 -- 172.21.15.6:0/3942090801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8548004160 con 0x7f8558105710 2023-10-14T08:44:39.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f8555ffb700 1 -- 172.21.15.6:0/3942090801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85480042c0 con 0x7f8558105710 2023-10-14T08:44:39.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f8555ffb700 1 -- 172.21.15.6:0/3942090801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8548011a00 con 0x7f8558105710 2023-10-14T08:44:39.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f855d755700 1 -- 172.21.15.6:0/3942090801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 msgr2=0x7f8558105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:39.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f855d755700 1 --2- 172.21.15.6:0/3942090801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f8558105b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85480098a0 tx=0x7f8548009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:39.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f855d755700 1 -- 172.21.15.6:0/3942090801 shutdown_connections 2023-10-14T08:44:39.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f855d755700 1 --2- 172.21.15.6:0/3942090801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f8558105b30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:39.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f855d755700 1 -- 172.21.15.6:0/3942090801 >> 172.21.15.6:0/3942090801 conn(0x7f8558100cb0 msgr2=0x7f85581030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:39.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.978+0000 7f855d755700 1 -- 172.21.15.6:0/3942090801 shutdown_connections 2023-10-14T08:44:39.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.979+0000 7f855d755700 1 -- 172.21.15.6:0/3942090801 wait complete. 2023-10-14T08:44:39.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.979+0000 7f855d755700 1 Processor -- start 2023-10-14T08:44:39.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.979+0000 7f855d755700 1 -- start start 2023-10-14T08:44:39.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.979+0000 7f855d755700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f85581908a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:39.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.979+0000 7f855d755700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558190de0 con 0x7f8558105710 2023-10-14T08:44:39.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f8556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f85581908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:39.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f8556ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f85581908a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58126/0 (socket says 172.21.15.6:58126) 2023-10-14T08:44:39.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f8556ffd700 1 -- 172.21.15.6:0/1646774299 learned_addr learned my addr 172.21.15.6:0/1646774299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:39.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f8556ffd700 1 -- 172.21.15.6:0/1646774299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009550 con 0x7f8558105710 2023-10-14T08:44:39.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f8556ffd700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f85581908a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8548006af0 tx=0x7f8548011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:39.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8548003a40 con 0x7f8558105710 2023-10-14T08:44:39.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8548003ba0 con 0x7f8558105710 2023-10-14T08:44:39.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855818eef0 con 0x7f8558105710 2023-10-14T08:44:39.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f854801a700 con 0x7f8558105710 2023-10-14T08:44:39.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.980+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855818f310 con 0x7f8558105710 2023-10-14T08:44:39.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.981+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 7) v1 ==== 45473+0+0 (secure 0 0 0) 0x7f854801a860 con 0x7f8558105710 2023-10-14T08:44:39.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.982+0000 7f853ffff700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8540038740 0x7f854003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:39.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.982+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85580624e0 con 0x7f8558105710 2023-10-14T08:44:39.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.982+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f854804c800 con 0x7f8558105710 2023-10-14T08:44:39.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.982+0000 7f85567fc700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8540038740 0x7f854003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:39.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.982+0000 7f85567fc700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8540038740 0x7f854003ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f854c006fd0 tx=0x7f854c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:39.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:38.987+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f854801ab60 con 0x7f8558105710 2023-10-14T08:44:39.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.385+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f855818fb70 con 0x7f8540038740 2023-10-14T08:44:39.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.391+0000 7f853ffff700 1 -- 172.21.15.6:0/1646774299 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f855818fb70 con 0x7f8540038740 2023-10-14T08:44:39.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8540038740 msgr2=0x7f854003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:39.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8540038740 0x7f854003ac00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f854c006fd0 tx=0x7f854c006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:39.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 msgr2=0x7f85581908a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:39.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f85581908a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8548006af0 tx=0x7f8548011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:39.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 shutdown_connections 2023-10-14T08:44:39.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8540038740 0x7f854003ac00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:39.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 --2- 172.21.15.6:0/1646774299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8558105710 0x7f85581908a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:39.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 >> 172.21.15.6:0/1646774299 conn(0x7f8558100cb0 msgr2=0x7f85580741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:39.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 shutdown_connections 2023-10-14T08:44:39.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:39.394+0000 7f855d755700 1 -- 172.21.15.6:0/1646774299 wait complete. 2023-10-14T08:44:40.721 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:40.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:40.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:44:40.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: mgrmap e8: x(active, since 2s) 2023-10-14T08:44:40.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: [14/Oct/2023:08:44:39] ENGINE Bus STARTING 2023-10-14T08:44:40.722 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: [14/Oct/2023:08:44:39] ENGINE Serving on https://172.21.15.6:7150 2023-10-14T08:44:40.723 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:40 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:44:40.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-14T08:44:40.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.200+0000 7f54ad527700 1 Processor -- start 2023-10-14T08:44:40.902 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.200+0000 7f54ad527700 1 -- start start 2023-10-14T08:44:40.902 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.200+0000 7f54ad527700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a8105b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:40.902 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.200+0000 7f54ad527700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a81060e0 con 0x7f54a81056f0 2023-10-14T08:44:40.902 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a8105b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a8105b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58138/0 (socket says 172.21.15.6:58138) 2023-10-14T08:44:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a6ffd700 1 -- 172.21.15.6:0/184537544 learned_addr learned my addr 172.21.15.6:0/184537544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a6ffd700 1 -- 172.21.15.6:0/184537544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a81068f0 con 0x7f54a81056f0 2023-10-14T08:44:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a6ffd700 1 --2- 172.21.15.6:0/184537544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a8105b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54900098a0 tx=0x7f5490009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede8e40d72089a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a5ffb700 1 -- 172.21.15.6:0/184537544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5490004160 con 0x7f54a81056f0 2023-10-14T08:44:40.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a5ffb700 1 -- 172.21.15.6:0/184537544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54900042c0 con 0x7f54a81056f0 2023-10-14T08:44:40.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.201+0000 7f54a5ffb700 1 -- 172.21.15.6:0/184537544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5490011a00 con 0x7f54a81056f0 2023-10-14T08:44:40.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 -- 172.21.15.6:0/184537544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 msgr2=0x7f54a8105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:40.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 --2- 172.21.15.6:0/184537544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a8105b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54900098a0 tx=0x7f5490009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:40.904 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 -- 172.21.15.6:0/184537544 shutdown_connections 2023-10-14T08:44:40.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 --2- 172.21.15.6:0/184537544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a8105b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:40.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 -- 172.21.15.6:0/184537544 >> 172.21.15.6:0/184537544 conn(0x7f54a8100cb0 msgr2=0x7f54a81030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:40.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 -- 172.21.15.6:0/184537544 shutdown_connections 2023-10-14T08:44:40.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.202+0000 7f54ad527700 1 -- 172.21.15.6:0/184537544 wait complete. 2023-10-14T08:44:40.905 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.203+0000 7f54ad527700 1 Processor -- start 2023-10-14T08:44:40.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.203+0000 7f54ad527700 1 -- start start 2023-10-14T08:44:40.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.203+0000 7f54ad527700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:40.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.203+0000 7f54ad527700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a819a9f0 con 0x7f54a81056f0 2023-10-14T08:44:40.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:40.906 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58140/0 (socket says 172.21.15.6:58140) 2023-10-14T08:44:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54a6ffd700 1 -- 172.21.15.6:0/3892798615 learned_addr learned my addr 172.21.15.6:0/3892798615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54a6ffd700 1 -- 172.21.15.6:0/3892798615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490009550 con 0x7f54a81056f0 2023-10-14T08:44:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54a6ffd700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a819a4b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5490009fb0 tx=0x7f5490011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5490003930 con 0x7f54a81056f0 2023-10-14T08:44:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5490003a90 con 0x7f54a81056f0 2023-10-14T08:44:40.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54900195e0 con 0x7f54a81056f0 2023-10-14T08:44:40.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a819abf0 con 0x7f54a81056f0 2023-10-14T08:44:40.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.204+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a819b010 con 0x7f54a81056f0 2023-10-14T08:44:40.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.205+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f549001a9d0 con 0x7f54a81056f0 2023-10-14T08:44:40.908 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.205+0000 7f549ffff700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f54940387d0 0x7f549403ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:40.909 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.205+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f549004ca10 con 0x7f54a81056f0 2023-10-14T08:44:40.909 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.205+0000 7f54a67fc700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f54940387d0 0x7f549403ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:40.909 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.205+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a80624e0 con 0x7f54a81056f0 2023-10-14T08:44:40.909 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.206+0000 7f54a67fc700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f54940387d0 0x7f549403ac90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:40.909 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.211+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f54900198a0 con 0x7f54a81056f0 2023-10-14T08:44:40.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.578+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f54a8102f70 con 0x7f54940387d0 2023-10-14T08:44:40.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.579+0000 7f549ffff700 1 -- 172.21.15.6:0/3892798615 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f54a8102f70 con 0x7f54940387d0 2023-10-14T08:44:40.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f54940387d0 msgr2=0x7f549403ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:40.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f54940387d0 0x7f549403ac90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5498006fd0 tx=0x7f5498006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:40.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 msgr2=0x7f54a819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:40.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a819a4b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5490009fb0 tx=0x7f5490011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:40.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 shutdown_connections 2023-10-14T08:44:40.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f54940387d0 0x7f549403ac90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:40.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 --2- 172.21.15.6:0/3892798615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54a81056f0 0x7f54a819a4b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:40.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 >> 172.21.15.6:0/3892798615 conn(0x7f54a8100cb0 msgr2=0x7f54a8102350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:40.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 shutdown_connections 2023-10-14T08:44:40.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:40.581+0000 7f54ad527700 1 -- 172.21.15.6:0/3892798615 wait complete. 2023-10-14T08:44:40.912 INFO:teuthology.orchestra.run.smithi006.stdout:Generating ssh key... 2023-10-14T08:44:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:41 smithi006 ceph-mon[99452]: [14/Oct/2023:08:44:39] ENGINE Serving on http://172.21.15.6:8765 2023-10-14T08:44:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:41 smithi006 ceph-mon[99452]: [14/Oct/2023:08:44:39] ENGINE Bus STARTED 2023-10-14T08:44:41.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:41 smithi006 ceph-mon[99452]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:42.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-mon[99452]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:42.618 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-mon[99452]: Generating ssh key... 2023-10-14T08:44:42.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:42.619 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:42.619 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: Generating public/private rsa key pair. 2023-10-14T08:44:42.619 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: Your identification has been saved in /tmp/tmp45rdnr1w/key. 2023-10-14T08:44:42.620 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: Your public key has been saved in /tmp/tmp45rdnr1w/key.pub. 2023-10-14T08:44:42.620 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: The key fingerprint is: 2023-10-14T08:44:42.620 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: SHA256:8LZ+inwI573uwxPhovCM5mFmw4OXgpUPqjFhgRzqW30 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:42.620 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: The key's randomart image is: 2023-10-14T08:44:42.621 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: +---[RSA 3072]----+ 2023-10-14T08:44:42.621 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: | . | 2023-10-14T08:44:42.621 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |+ . | 2023-10-14T08:44:42.621 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |oo . | 2023-10-14T08:44:42.621 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |. ... o. | 2023-10-14T08:44:42.622 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |.o+. . ES. | 2023-10-14T08:44:42.622 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |o*++. +.o. | 2023-10-14T08:44:42.622 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |B.@=.= =.. | 2023-10-14T08:44:42.622 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |.Oo++.oo* . | 2023-10-14T08:44:42.622 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: |.o. o+** | 2023-10-14T08:44:42.623 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: +----[SHA256]-----+ 2023-10-14T08:44:42.646 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bc16ff700 1 Processor -- start 2023-10-14T08:44:42.646 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bc16ff700 1 -- start start 2023-10-14T08:44:42.646 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bc16ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc1096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:42.646 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bc16ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc074740 con 0x7f6bbc1072c0 2023-10-14T08:44:42.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bbaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc1096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:42.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bbaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc1096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58144/0 (socket says 172.21.15.6:58144) 2023-10-14T08:44:42.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.374+0000 7f6bbaffd700 1 -- 172.21.15.6:0/2841287219 learned_addr learned my addr 172.21.15.6:0/2841287219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:42.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.375+0000 7f6bbaffd700 1 -- 172.21.15.6:0/2841287219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc109bf0 con 0x7f6bbc1072c0 2023-10-14T08:44:42.647 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.375+0000 7f6bbaffd700 1 --2- 172.21.15.6:0/2841287219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc1096b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00098a0 tx=0x7f6bb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f90bfa0921c2e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:42.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.375+0000 7f6bb9ffb700 1 -- 172.21.15.6:0/2841287219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bb0004160 con 0x7f6bbc1072c0 2023-10-14T08:44:42.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.375+0000 7f6bb9ffb700 1 -- 172.21.15.6:0/2841287219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bb00042c0 con 0x7f6bbc1072c0 2023-10-14T08:44:42.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.375+0000 7f6bb9ffb700 1 -- 172.21.15.6:0/2841287219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bb0011a00 con 0x7f6bbc1072c0 2023-10-14T08:44:42.648 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 -- 172.21.15.6:0/2841287219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 msgr2=0x7f6bbc1096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:42.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 --2- 172.21.15.6:0/2841287219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc1096b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00098a0 tx=0x7f6bb0009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:42.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 -- 172.21.15.6:0/2841287219 shutdown_connections 2023-10-14T08:44:42.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 --2- 172.21.15.6:0/2841287219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc1096b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:42.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 -- 172.21.15.6:0/2841287219 >> 172.21.15.6:0/2841287219 conn(0x7f6bbc100cb0 msgr2=0x7f6bbc1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:42.649 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 -- 172.21.15.6:0/2841287219 shutdown_connections 2023-10-14T08:44:42.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 -- 172.21.15.6:0/2841287219 wait complete. 2023-10-14T08:44:42.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.376+0000 7f6bc16ff700 1 Processor -- start 2023-10-14T08:44:42.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bc16ff700 1 -- start start 2023-10-14T08:44:42.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bc16ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc106c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:42.650 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bc16ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc107160 con 0x7f6bbc1072c0 2023-10-14T08:44:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bbaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bbaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58146/0 (socket says 172.21.15.6:58146) 2023-10-14T08:44:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bbaffd700 1 -- 172.21.15.6:0/487575650 learned_addr learned my addr 172.21.15.6:0/487575650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bbaffd700 1 -- 172.21.15.6:0/487575650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009550 con 0x7f6bbc1072c0 2023-10-14T08:44:42.651 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.377+0000 7f6bbaffd700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc106c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009fb0 tx=0x7f6bb0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:42.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.378+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bb0003930 con 0x7f6bbc1072c0 2023-10-14T08:44:42.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.378+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bb0003a90 con 0x7f6bbc1072c0 2023-10-14T08:44:42.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.378+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc105270 con 0x7f6bbc1072c0 2023-10-14T08:44:42.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.378+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bb0019610 con 0x7f6bbc1072c0 2023-10-14T08:44:42.652 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.378+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc105690 con 0x7f6bbc1072c0 2023-10-14T08:44:42.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.379+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc10a990 con 0x7f6bbc1072c0 2023-10-14T08:44:42.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.379+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f6bb001a9d0 con 0x7f6bbc1072c0 2023-10-14T08:44:42.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.379+0000 7f6ba3fff700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6ba40387d0 0x7f6ba403ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:42.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.379+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6bb004cd60 con 0x7f6bbc1072c0 2023-10-14T08:44:42.653 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.380+0000 7f6bba7fc700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6ba40387d0 0x7f6ba403ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:42.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.380+0000 7f6bba7fc700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6ba40387d0 0x7f6ba403ac90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6bac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:42.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.384+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6bb0003c00 con 0x7f6bbc1072c0 2023-10-14T08:44:42.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:41.750+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bbc105db0 con 0x7f6ba40387d0 2023-10-14T08:44:42.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.236+0000 7f6ba3fff700 1 -- 172.21.15.6:0/487575650 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6bbc105db0 con 0x7f6ba40387d0 2023-10-14T08:44:42.654 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6ba40387d0 msgr2=0x7f6ba403ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:42.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6ba40387d0 0x7f6ba403ac90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bac006fd0 tx=0x7f6bac006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:42.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 msgr2=0x7f6bbc106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:42.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc106c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009fb0 tx=0x7f6bb0011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:42.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 shutdown_connections 2023-10-14T08:44:42.655 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6ba40387d0 0x7f6ba403ac90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:42.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 --2- 172.21.15.6:0/487575650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc1072c0 0x7f6bbc106c20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:42.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.238+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 >> 172.21.15.6:0/487575650 conn(0x7f6bbc100cb0 msgr2=0x7f6bbc101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:42.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.239+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 shutdown_connections 2023-10-14T08:44:42.656 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:42.239+0000 7f6bc16ff700 1 -- 172.21.15.6:0/487575650 wait complete. 2023-10-14T08:44:43.891 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:44:43.891 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f080a5ba700 1 Processor -- start 2023-10-14T08:44:43.891 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f080a5ba700 1 -- start start 2023-10-14T08:44:43.892 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f080a5ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f0804105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:43.892 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f080a5ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804106100 con 0x7f0804105710 2023-10-14T08:44:43.892 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f0803fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f0804105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:43.892 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f0803fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f0804105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58150/0 (socket says 172.21.15.6:58150) 2023-10-14T08:44:43.892 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.113+0000 7f0803fff700 1 -- 172.21.15.6:0/2122088574 learned_addr learned my addr 172.21.15.6:0/2122088574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:43.893 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.114+0000 7f0803fff700 1 -- 172.21.15.6:0/2122088574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804106910 con 0x7f0804105710 2023-10-14T08:44:43.893 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.114+0000 7f0803fff700 1 --2- 172.21.15.6:0/2122088574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f0804105b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07f40098a0 tx=0x7f07f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4047e055dc93e1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:43.893 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.114+0000 7f0802ffd700 1 -- 172.21.15.6:0/2122088574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f4004160 con 0x7f0804105710 2023-10-14T08:44:43.893 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.114+0000 7f0802ffd700 1 -- 172.21.15.6:0/2122088574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07f40042c0 con 0x7f0804105710 2023-10-14T08:44:43.893 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.114+0000 7f0802ffd700 1 -- 172.21.15.6:0/2122088574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f4011a00 con 0x7f0804105710 2023-10-14T08:44:43.894 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 -- 172.21.15.6:0/2122088574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 msgr2=0x7f0804105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:43.894 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 --2- 172.21.15.6:0/2122088574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f0804105b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07f40098a0 tx=0x7f07f4009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:43.894 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 -- 172.21.15.6:0/2122088574 shutdown_connections 2023-10-14T08:44:43.895 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 --2- 172.21.15.6:0/2122088574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f0804105b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:43.895 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 -- 172.21.15.6:0/2122088574 >> 172.21.15.6:0/2122088574 conn(0x7f0804100cb0 msgr2=0x7f08041030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:43.895 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 -- 172.21.15.6:0/2122088574 shutdown_connections 2023-10-14T08:44:43.895 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 -- 172.21.15.6:0/2122088574 wait complete. 2023-10-14T08:44:43.895 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 Processor -- start 2023-10-14T08:44:43.896 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.115+0000 7f080a5ba700 1 -- start start 2023-10-14T08:44:43.896 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f080a5ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f08041993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:43.896 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f080a5ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804199930 con 0x7f0804105710 2023-10-14T08:44:43.896 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f0803fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f08041993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:43.896 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f0803fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f08041993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58152/0 (socket says 172.21.15.6:58152) 2023-10-14T08:44:43.897 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f0803fff700 1 -- 172.21.15.6:0/750736199 learned_addr learned my addr 172.21.15.6:0/750736199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:43.897 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f0803fff700 1 -- 172.21.15.6:0/750736199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009550 con 0x7f0804105710 2023-10-14T08:44:43.897 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f0803fff700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f08041993f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009fb0 tx=0x7f07f4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:43.897 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f4003930 con 0x7f0804105710 2023-10-14T08:44:43.897 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07f4003a90 con 0x7f0804105710 2023-10-14T08:44:43.898 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804199b30 con 0x7f0804105710 2023-10-14T08:44:43.898 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f40195e0 con 0x7f0804105710 2023-10-14T08:44:43.898 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.116+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0804199f50 con 0x7f0804105710 2023-10-14T08:44:43.898 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.117+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f07f40198a0 con 0x7f0804105710 2023-10-14T08:44:43.898 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.118+0000 7f08017fa700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f07ec0387d0 0x7f07ec03ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:43.899 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.118+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f07f404ca10 con 0x7f0804105710 2023-10-14T08:44:43.899 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.118+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08040624e0 con 0x7f0804105710 2023-10-14T08:44:43.899 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.118+0000 7f08037fe700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f07ec0387d0 0x7f07ec03ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:43.899 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.118+0000 7f08037fe700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f07ec0387d0 0x7f07ec03ac90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07f8006fd0 tx=0x7f07f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:43.899 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.123+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f07f4019ba0 con 0x7f0804105710 2023-10-14T08:44:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.486+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0804102fb0 con 0x7f07ec0387d0 2023-10-14T08:44:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.487+0000 7f08017fa700 1 -- 172.21.15.6:0/750736199 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f0804102fb0 con 0x7f07ec0387d0 2023-10-14T08:44:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f07ec0387d0 msgr2=0x7f07ec03ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f07ec0387d0 0x7f07ec03ac90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07f8006fd0 tx=0x7f07f8006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 msgr2=0x7f08041993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f08041993f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009fb0 tx=0x7f07f4011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 shutdown_connections 2023-10-14T08:44:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f07ec0387d0 0x7f07ec03ac90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 --2- 172.21.15.6:0/750736199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0804105710 0x7f08041993f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 >> 172.21.15.6:0/750736199 conn(0x7f0804100cb0 msgr2=0x7f0804102390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:43.902 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 shutdown_connections 2023-10-14T08:44:43.902 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:43.489+0000 7f080a5ba700 1 -- 172.21.15.6:0/750736199 wait complete. 2023-10-14T08:44:43.902 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-14T08:44:43.902 INFO:teuthology.orchestra.run.smithi006.stdout:Adding key to root@localhost authorized_keys... 2023-10-14T08:44:43.902 INFO:teuthology.orchestra.run.smithi006.stdout:Adding host smithi006... 2023-10-14T08:44:44.093 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:43 smithi006 ceph-mon[99452]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:45.032 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:44 smithi006 ceph-mon[99452]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:46.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:45 smithi006 ceph-mon[99452]: Deploying cephadm binary to smithi006 2023-10-14T08:44:48.147 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Added host 'smithi006' with addr '172.21.15.6' 2023-10-14T08:44:48.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.367+0000 7f752afbd700 1 Processor -- start 2023-10-14T08:44:48.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.367+0000 7f752afbd700 1 -- start start 2023-10-14T08:44:48.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f752afbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f7524106c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:48.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f752afbd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241071f0 con 0x7f7524106800 2023-10-14T08:44:48.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f7528d59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f7524106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:48.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f7528d59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f7524106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58156/0 (socket says 172.21.15.6:58156) 2023-10-14T08:44:48.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f7528d59700 1 -- 172.21.15.6:0/2560080388 learned_addr learned my addr 172.21.15.6:0/2560080388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:48.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f7528d59700 1 -- 172.21.15.6:0/2560080388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524107a00 con 0x7f7524106800 2023-10-14T08:44:48.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f7528d59700 1 --2- 172.21.15.6:0/2560080388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f7524106c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75180098a0 tx=0x7f7518009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa8057d6f6294d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:48.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.368+0000 7f75237fe700 1 -- 172.21.15.6:0/2560080388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7518004160 con 0x7f7524106800 2023-10-14T08:44:48.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f75237fe700 1 -- 172.21.15.6:0/2560080388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75180042c0 con 0x7f7524106800 2023-10-14T08:44:48.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f75237fe700 1 -- 172.21.15.6:0/2560080388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7518011a00 con 0x7f7524106800 2023-10-14T08:44:48.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 -- 172.21.15.6:0/2560080388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 msgr2=0x7f7524106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:48.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 --2- 172.21.15.6:0/2560080388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f7524106c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f75180098a0 tx=0x7f7518009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:48.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 -- 172.21.15.6:0/2560080388 shutdown_connections 2023-10-14T08:44:48.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 --2- 172.21.15.6:0/2560080388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f7524106c20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:48.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 -- 172.21.15.6:0/2560080388 >> 172.21.15.6:0/2560080388 conn(0x7f7524101dc0 msgr2=0x7f75241041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:48.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 -- 172.21.15.6:0/2560080388 shutdown_connections 2023-10-14T08:44:48.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.369+0000 7f752afbd700 1 -- 172.21.15.6:0/2560080388 wait complete. 2023-10-14T08:44:48.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f752afbd700 1 Processor -- start 2023-10-14T08:44:48.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f752afbd700 1 -- start start 2023-10-14T08:44:48.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f752afbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f752419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:48.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f752afbd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752419aa00 con 0x7f7524106800 2023-10-14T08:44:48.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f7528d59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f752419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:48.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f7528d59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f752419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58158/0 (socket says 172.21.15.6:58158) 2023-10-14T08:44:48.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f7528d59700 1 -- 172.21.15.6:0/757335478 learned_addr learned my addr 172.21.15.6:0/757335478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:48.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f7528d59700 1 -- 172.21.15.6:0/757335478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009550 con 0x7f7524106800 2023-10-14T08:44:48.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.370+0000 7f7528d59700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f752419a4c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7518009fb0 tx=0x7f7518011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:48.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.371+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7518003930 con 0x7f7524106800 2023-10-14T08:44:48.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.371+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7518003a90 con 0x7f7524106800 2023-10-14T08:44:48.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.371+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752419ac00 con 0x7f7524106800 2023-10-14T08:44:48.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.371+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75180195e0 con 0x7f7524106800 2023-10-14T08:44:48.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.371+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752419b020 con 0x7f7524106800 2023-10-14T08:44:48.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.372+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f7518019850 con 0x7f7524106800 2023-10-14T08:44:48.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.372+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75240624e0 con 0x7f7524106800 2023-10-14T08:44:48.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.372+0000 7f7521ffb700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7514038820 0x7f751403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:48.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.372+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f751804c8c0 con 0x7f7524106800 2023-10-14T08:44:48.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.372+0000 7f7523fff700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7514038820 0x7f751403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:48.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.373+0000 7f7523fff700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7514038820 0x7f751403ace0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7510006fd0 tx=0x7f7510006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:48.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.377+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f751802b340 con 0x7f7524106800 2023-10-14T08:44:48.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:44.746+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7524104090 con 0x7f7514038820 2023-10-14T08:44:48.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.763+0000 7f7521ffb700 1 -- 172.21.15.6:0/757335478 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7524104090 con 0x7f7514038820 2023-10-14T08:44:48.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7514038820 msgr2=0x7f751403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:48.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7514038820 0x7f751403ace0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7510006fd0 tx=0x7f7510006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:48.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 msgr2=0x7f752419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:48.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f752419a4c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7518009fb0 tx=0x7f7518011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:48.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 shutdown_connections 2023-10-14T08:44:48.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7514038820 0x7f751403ace0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:48.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 --2- 172.21.15.6:0/757335478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7524106800 0x7f752419a4c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:48.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 >> 172.21.15.6:0/757335478 conn(0x7f7524101dc0 msgr2=0x7f7524103430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:48.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 shutdown_connections 2023-10-14T08:44:48.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:47.767+0000 7f752afbd700 1 -- 172.21.15.6:0/757335478 wait complete. 2023-10-14T08:44:48.161 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mon service... 2023-10-14T08:44:49.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:48 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:49.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:48 smithi006 ceph-mon[99452]: Added host smithi006 2023-10-14T08:44:49.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:48 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:44:49.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-14T08:44:49.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.609+0000 7f8d87f94700 1 Processor -- start 2023-10-14T08:44:49.795 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.609+0000 7f8d87f94700 1 -- start start 2023-10-14T08:44:49.796 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.609+0000 7f8d87f94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d80104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:49.796 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.609+0000 7f8d87f94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d801054f0 con 0x7f8d80104b00 2023-10-14T08:44:49.796 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d85d30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d80104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:49.796 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d85d30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d80104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58192/0 (socket says 172.21.15.6:58192) 2023-10-14T08:44:49.796 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d85d30700 1 -- 172.21.15.6:0/1878934227 learned_addr learned my addr 172.21.15.6:0/1878934227 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d85d30700 1 -- 172.21.15.6:0/1878934227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80107a90 con 0x7f8d80104b00 2023-10-14T08:44:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d85d30700 1 --2- 172.21.15.6:0/1878934227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d80104f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098a0 tx=0x7f8d70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efae31deebe34f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d84d2e700 1 -- 172.21.15.6:0/1878934227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d70004160 con 0x7f8d80104b00 2023-10-14T08:44:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d84d2e700 1 -- 172.21.15.6:0/1878934227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d700042c0 con 0x7f8d80104b00 2023-10-14T08:44:49.797 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.610+0000 7f8d84d2e700 1 -- 172.21.15.6:0/1878934227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d70011a00 con 0x7f8d80104b00 2023-10-14T08:44:49.801 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 -- 172.21.15.6:0/1878934227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 msgr2=0x7f8d80104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:49.802 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 --2- 172.21.15.6:0/1878934227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d80104f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098a0 tx=0x7f8d70009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:49.802 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 -- 172.21.15.6:0/1878934227 shutdown_connections 2023-10-14T08:44:49.802 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 --2- 172.21.15.6:0/1878934227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d80104f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:49.802 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 -- 172.21.15.6:0/1878934227 >> 172.21.15.6:0/1878934227 conn(0x7f8d80100450 msgr2=0x7f8d80102870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:49.803 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 -- 172.21.15.6:0/1878934227 shutdown_connections 2023-10-14T08:44:49.803 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.611+0000 7f8d87f94700 1 -- 172.21.15.6:0/1878934227 wait complete. 2023-10-14T08:44:49.803 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d87f94700 1 Processor -- start 2023-10-14T08:44:49.803 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d87f94700 1 -- start start 2023-10-14T08:44:49.803 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d87f94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d8019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:49.804 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d87f94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8019aa00 con 0x7f8d80104b00 2023-10-14T08:44:49.804 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d85d30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d8019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:49.804 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d85d30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d8019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58194/0 (socket says 172.21.15.6:58194) 2023-10-14T08:44:49.804 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d85d30700 1 -- 172.21.15.6:0/1522125101 learned_addr learned my addr 172.21.15.6:0/1522125101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:49.804 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d85d30700 1 -- 172.21.15.6:0/1522125101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70009550 con 0x7f8d80104b00 2023-10-14T08:44:49.805 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d85d30700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d8019a4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d70006af0 tx=0x7f8d70011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:49.805 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.612+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d70003a40 con 0x7f8d80104b00 2023-10-14T08:44:49.805 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.613+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d70003ba0 con 0x7f8d80104b00 2023-10-14T08:44:49.806 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.613+0000 7f8d87f94700 1 -- 172.21.15.6:0/1522125101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8019ac00 con 0x7f8d80104b00 2023-10-14T08:44:49.806 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.613+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7001a700 con 0x7f8d80104b00 2023-10-14T08:44:49.806 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.613+0000 7f8d87f94700 1 -- 172.21.15.6:0/1522125101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8019b020 con 0x7f8d80104b00 2023-10-14T08:44:49.806 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.614+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f8d70024430 con 0x7f8d80104b00 2023-10-14T08:44:49.807 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.614+0000 7f8d76ffd700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8d6c038870 0x7f8d6c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:49.807 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.614+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680052f0 con 0x7f8d80104b00 2023-10-14T08:44:49.807 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.614+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8d7004c880 con 0x7f8d80104b00 2023-10-14T08:44:49.807 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.614+0000 7f8d8552f700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8d6c038870 0x7f8d6c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:49.807 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.614+0000 7f8d8552f700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8d6c038870 0x7f8d6c03ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006fd0 tx=0x7f8d7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:49.808 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:48.619+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8d700246e0 con 0x7f8d80104b00 2023-10-14T08:44:49.808 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.019+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8d68000bc0 con 0x7f8d6c038870 2023-10-14T08:44:49.808 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.024+0000 7f8d76ffd700 1 -- 172.21.15.6:0/1522125101 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8d68000bc0 con 0x7f8d6c038870 2023-10-14T08:44:49.808 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8d6c038870 msgr2=0x7f8d6c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:49.809 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8d6c038870 0x7f8d6c03ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006fd0 tx=0x7f8d7c006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:49.809 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 msgr2=0x7f8d8019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:49.809 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d8019a4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d70006af0 tx=0x7f8d70011ad0 comp rx=0 tx=0).stop 2023-10-14T08:44:49.809 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 shutdown_connections 2023-10-14T08:44:49.809 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f8d6c038870 0x7f8d6c03ad30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:49.810 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 --2- 172.21.15.6:0/1522125101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d80104b00 0x7f8d8019a4c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:49.810 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 >> 172.21.15.6:0/1522125101 conn(0x7f8d80100450 msgr2=0x7f8d80101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:49.810 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 shutdown_connections 2023-10-14T08:44:49.810 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:49.026+0000 7f8d74ff9700 1 -- 172.21.15.6:0/1522125101 wait complete. 2023-10-14T08:44:49.811 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mgr service... 2023-10-14T08:44:50.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:50 smithi006 ceph-mon[99452]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:50.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:50 smithi006 ceph-mon[99452]: Saving service mon spec with placement count:5 2023-10-14T08:44:50.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:50 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:50.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:50 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:51.146 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-14T08:44:51.146 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.320+0000 7f69c87c5700 1 Processor -- start 2023-10-14T08:44:51.146 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.320+0000 7f69c87c5700 1 -- start start 2023-10-14T08:44:51.146 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.321+0000 7f69c87c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c0105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:51.147 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.321+0000 7f69c87c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c0106100 con 0x7f69c0105710 2023-10-14T08:44:51.147 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.321+0000 7f69c6561700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c0105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:51.147 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.321+0000 7f69c6561700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c0105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58198/0 (socket says 172.21.15.6:58198) 2023-10-14T08:44:51.147 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.321+0000 7f69c6561700 1 -- 172.21.15.6:0/1956280688 learned_addr learned my addr 172.21.15.6:0/1956280688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:51.147 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.321+0000 7f69c6561700 1 -- 172.21.15.6:0/1956280688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0106910 con 0x7f69c0105710 2023-10-14T08:44:51.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.322+0000 7f69c6561700 1 --2- 172.21.15.6:0/1956280688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c0105b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00bb40 tx=0x7f69bc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bee63c6cff86d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:51.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.322+0000 7f69c555f700 1 -- 172.21.15.6:0/1956280688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69bc00dbe0 con 0x7f69c0105710 2023-10-14T08:44:51.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.322+0000 7f69c555f700 1 -- 172.21.15.6:0/1956280688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69bc0044f0 con 0x7f69c0105710 2023-10-14T08:44:51.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.322+0000 7f69c555f700 1 -- 172.21.15.6:0/1956280688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69bc003e60 con 0x7f69c0105710 2023-10-14T08:44:51.148 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 -- 172.21.15.6:0/1956280688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 msgr2=0x7f69c0105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:51.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 --2- 172.21.15.6:0/1956280688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c0105b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00bb40 tx=0x7f69bc00be50 comp rx=0 tx=0).stop 2023-10-14T08:44:51.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 -- 172.21.15.6:0/1956280688 shutdown_connections 2023-10-14T08:44:51.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 --2- 172.21.15.6:0/1956280688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c0105b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:51.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 -- 172.21.15.6:0/1956280688 >> 172.21.15.6:0/1956280688 conn(0x7f69c0100cb0 msgr2=0x7f69c01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:51.149 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 -- 172.21.15.6:0/1956280688 shutdown_connections 2023-10-14T08:44:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 -- 172.21.15.6:0/1956280688 wait complete. 2023-10-14T08:44:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 Processor -- start 2023-10-14T08:44:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.323+0000 7f69c87c5700 1 -- start start 2023-10-14T08:44:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c87c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:51.150 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c87c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c01987f0 con 0x7f69c0105710 2023-10-14T08:44:51.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c6561700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:51.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c6561700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c01982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58200/0 (socket says 172.21.15.6:58200) 2023-10-14T08:44:51.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c6561700 1 -- 172.21.15.6:0/41160994 learned_addr learned my addr 172.21.15.6:0/41160994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:51.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c6561700 1 -- 172.21.15.6:0/41160994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc00b7f0 con 0x7f69c0105710 2023-10-14T08:44:51.151 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c6561700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c01982b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0046e0 tx=0x7f69bc004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:51.152 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69bc01e070 con 0x7f69c0105710 2023-10-14T08:44:51.152 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69bc010c20 con 0x7f69c0105710 2023-10-14T08:44:51.152 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c01989f0 con 0x7f69c0105710 2023-10-14T08:44:51.152 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.324+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69bc022b60 con 0x7f69c0105710 2023-10-14T08:44:51.152 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.325+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c0198e10 con 0x7f69c0105710 2023-10-14T08:44:51.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.325+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f69bc010760 con 0x7f69c0105710 2023-10-14T08:44:51.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.326+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c0191fa0 con 0x7f69c0105710 2023-10-14T08:44:51.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.326+0000 7f69b77fe700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f69ac0387d0 0x7f69ac03ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:51.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.326+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f69bc04f0d0 con 0x7f69c0105710 2023-10-14T08:44:51.153 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.326+0000 7f69c5d60700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f69ac0387d0 0x7f69ac03ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:51.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.326+0000 7f69c5d60700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f69ac0387d0 0x7f69ac03ac90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006fd0 tx=0x7f69b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:51.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.331+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f69bc021820 con 0x7f69c0105710 2023-10-14T08:44:51.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.725+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f69c002d130 con 0x7f69ac0387d0 2023-10-14T08:44:51.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.732+0000 7f69b77fe700 1 -- 172.21.15.6:0/41160994 <== mgr.14120 v2:172.21.15.6:6800/516951061 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f69c002d130 con 0x7f69ac0387d0 2023-10-14T08:44:51.154 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f69ac0387d0 msgr2=0x7f69ac03ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:51.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f69ac0387d0 0x7f69ac03ac90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006fd0 tx=0x7f69b0006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:51.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 msgr2=0x7f69c01982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:51.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c01982b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0046e0 tx=0x7f69bc004020 comp rx=0 tx=0).stop 2023-10-14T08:44:51.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 shutdown_connections 2023-10-14T08:44:51.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f69ac0387d0 0x7f69ac03ac90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:51.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 --2- 172.21.15.6:0/41160994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69c0105710 0x7f69c01982b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:51.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 >> 172.21.15.6:0/41160994 conn(0x7f69c0100cb0 msgr2=0x7f69c018f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:51.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 shutdown_connections 2023-10-14T08:44:51.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:50.735+0000 7f69c87c5700 1 -- 172.21.15.6:0/41160994 wait complete. 2023-10-14T08:44:51.377 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:51 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:51.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:51 smithi006 ceph-mon[99452]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:44:51.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:51 smithi006 ceph-mon[99452]: Saving service mgr spec with placement count:2 2023-10-14T08:44:51.378 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:51 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:52.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.639+0000 7f6752ecf700 1 Processor -- start 2023-10-14T08:44:52.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6752ecf700 1 -- start start 2023-10-14T08:44:52.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6752ecf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c105b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:52.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6752ecf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c1060e0 con 0x7f674c1056f0 2023-10-14T08:44:52.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6750c6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c105b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:52.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6750c6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c105b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58204/0 (socket says 172.21.15.6:58204) 2023-10-14T08:44:52.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6750c6b700 1 -- 172.21.15.6:0/4163679573 learned_addr learned my addr 172.21.15.6:0/4163679573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:52.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6750c6b700 1 -- 172.21.15.6:0/4163679573 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c1068f0 con 0x7f674c1056f0 2023-10-14T08:44:52.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.640+0000 7f6750c6b700 1 --2- 172.21.15.6:0/4163679573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c105b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f673c0098a0 tx=0x7f673c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9098e4d609795e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:52.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f674b7fe700 1 -- 172.21.15.6:0/4163679573 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f673c004160 con 0x7f674c1056f0 2023-10-14T08:44:52.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f674b7fe700 1 -- 172.21.15.6:0/4163679573 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f673c0042c0 con 0x7f674c1056f0 2023-10-14T08:44:52.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f674b7fe700 1 -- 172.21.15.6:0/4163679573 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f673c0119b0 con 0x7f674c1056f0 2023-10-14T08:44:52.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f6752ecf700 1 -- 172.21.15.6:0/4163679573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 msgr2=0x7f674c105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:52.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f6752ecf700 1 --2- 172.21.15.6:0/4163679573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c105b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f673c0098a0 tx=0x7f673c009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:52.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f6752ecf700 1 -- 172.21.15.6:0/4163679573 shutdown_connections 2023-10-14T08:44:52.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f6752ecf700 1 --2- 172.21.15.6:0/4163679573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c105b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f6752ecf700 1 -- 172.21.15.6:0/4163679573 >> 172.21.15.6:0/4163679573 conn(0x7f674c100cb0 msgr2=0x7f674c1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.641+0000 7f6752ecf700 1 -- 172.21.15.6:0/4163679573 shutdown_connections 2023-10-14T08:44:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6752ecf700 1 -- 172.21.15.6:0/4163679573 wait complete. 2023-10-14T08:44:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6752ecf700 1 Processor -- start 2023-10-14T08:44:52.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6752ecf700 1 -- start start 2023-10-14T08:44:52.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6752ecf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:52.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6752ecf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c19aa40 con 0x7f674c1056f0 2023-10-14T08:44:52.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6750c6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:52.394 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6750c6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58206/0 (socket says 172.21.15.6:58206) 2023-10-14T08:44:52.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.642+0000 7f6750c6b700 1 -- 172.21.15.6:0/2113781299 learned_addr learned my addr 172.21.15.6:0/2113781299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:52.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6750c6b700 1 -- 172.21.15.6:0/2113781299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c009550 con 0x7f674c1056f0 2023-10-14T08:44:52.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6750c6b700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c19a500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f673c003e60 tx=0x7f673c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:52.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f673c003970 con 0x7f674c1056f0 2023-10-14T08:44:52.395 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f673c003ad0 con 0x7f674c1056f0 2023-10-14T08:44:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c19ac40 con 0x7f674c1056f0 2023-10-14T08:44:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f673c0195e0 con 0x7f674c1056f0 2023-10-14T08:44:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.643+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c19b060 con 0x7f674c1056f0 2023-10-14T08:44:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.644+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f673c019850 con 0x7f674c1056f0 2023-10-14T08:44:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.644+0000 7f6749ffb700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6734038820 0x7f673403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.644+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f673c04ca80 con 0x7f674c1056f0 2023-10-14T08:44:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.644+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c0624e0 con 0x7f674c1056f0 2023-10-14T08:44:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.644+0000 7f674bfff700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6734038820 0x7f673403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.645+0000 7f674bfff700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6734038820 0x7f673403ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6740006fd0 tx=0x7f6740006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:51.649+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f673c019b50 con 0x7f674c1056f0 2023-10-14T08:44:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.016+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f674c109b20 con 0x7f674c1056f0 2023-10-14T08:44:52.398 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.022+0000 7f6749ffb700 1 -- 172.21.15.6:0/2113781299 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f673c018b40 con 0x7f674c1056f0 2023-10-14T08:44:52.398 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.024+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6734038820 msgr2=0x7f673403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:52.398 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.024+0000 7f6752ecf700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6734038820 0x7f673403ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6740006fd0 tx=0x7f6740006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:52.398 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.024+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 msgr2=0x7f674c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:52.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.024+0000 7f6752ecf700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c19a500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f673c003e60 tx=0x7f673c011aa0 comp rx=0 tx=0).stop 2023-10-14T08:44:52.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.025+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 shutdown_connections 2023-10-14T08:44:52.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.025+0000 7f6752ecf700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f6734038820 0x7f673403ace0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:52.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.025+0000 7f6752ecf700 1 --2- 172.21.15.6:0/2113781299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f674c1056f0 0x7f674c19a500 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:52.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.025+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 >> 172.21.15.6:0/2113781299 conn(0x7f674c100cb0 msgr2=0x7f674c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:52.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.025+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 shutdown_connections 2023-10-14T08:44:52.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.025+0000 7f6752ecf700 1 -- 172.21.15.6:0/2113781299 wait complete. 2023-10-14T08:44:53.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:52 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:53.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:52 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2113781299' entity='client.admin' 2023-10-14T08:44:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf7fad700 1 Processor -- start 2023-10-14T08:44:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf7fad700 1 -- start start 2023-10-14T08:44:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf7fad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0105b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf7fad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0106100 con 0x7f2bf0105710 2023-10-14T08:44:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf5d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf5d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0105b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58210/0 (socket says 172.21.15.6:58210) 2023-10-14T08:44:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.883+0000 7f2bf5d49700 1 -- 172.21.15.6:0/3439081605 learned_addr learned my addr 172.21.15.6:0/3439081605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.884+0000 7f2bf5d49700 1 -- 172.21.15.6:0/3439081605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0106910 con 0x7f2bf0105710 2023-10-14T08:44:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.884+0000 7f2bf5d49700 1 --2- 172.21.15.6:0/3439081605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0105b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0098a0 tx=0x7f2bec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8f3877f54d7350 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.884+0000 7f2bf4d47700 1 -- 172.21.15.6:0/3439081605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec004160 con 0x7f2bf0105710 2023-10-14T08:44:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.884+0000 7f2bf4d47700 1 -- 172.21.15.6:0/3439081605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bec0042c0 con 0x7f2bf0105710 2023-10-14T08:44:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.884+0000 7f2bf4d47700 1 -- 172.21.15.6:0/3439081605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec0119b0 con 0x7f2bf0105710 2023-10-14T08:44:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 -- 172.21.15.6:0/3439081605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 msgr2=0x7f2bf0105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 --2- 172.21.15.6:0/3439081605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0105b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0098a0 tx=0x7f2bec009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 -- 172.21.15.6:0/3439081605 shutdown_connections 2023-10-14T08:44:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 --2- 172.21.15.6:0/3439081605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0105b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 -- 172.21.15.6:0/3439081605 >> 172.21.15.6:0/3439081605 conn(0x7f2bf0100cb0 msgr2=0x7f2bf01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 -- 172.21.15.6:0/3439081605 shutdown_connections 2023-10-14T08:44:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.885+0000 7f2bf7fad700 1 -- 172.21.15.6:0/3439081605 wait complete. 2023-10-14T08:44:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf7fad700 1 Processor -- start 2023-10-14T08:44:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf7fad700 1 -- start start 2023-10-14T08:44:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf7fad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0190960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf7fad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0190ea0 con 0x7f2bf0105710 2023-10-14T08:44:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf5d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0190960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf5d49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0190960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58212/0 (socket says 172.21.15.6:58212) 2023-10-14T08:44:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf5d49700 1 -- 172.21.15.6:0/4057409335 learned_addr learned my addr 172.21.15.6:0/4057409335 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf5d49700 1 -- 172.21.15.6:0/4057409335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009550 con 0x7f2bf0105710 2023-10-14T08:44:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.886+0000 7f2bf5d49700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0190960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec003e60 tx=0x7f2bec011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.887+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec003970 con 0x7f2bf0105710 2023-10-14T08:44:53.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.887+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf018efb0 con 0x7f2bf0105710 2023-10-14T08:44:53.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.887+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bec003ad0 con 0x7f2bf0105710 2023-10-14T08:44:53.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.887+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bec0195e0 con 0x7f2bf0105710 2023-10-14T08:44:53.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.887+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf018f3d0 con 0x7f2bf0105710 2023-10-14T08:44:53.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.888+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf0109b00 con 0x7f2bf0105710 2023-10-14T08:44:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.888+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f2bec019920 con 0x7f2bf0105710 2023-10-14T08:44:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.889+0000 7f2be6ffd700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f2bdc0387d0 0x7f2bdc03ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.889+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2bec04c9d0 con 0x7f2bf0105710 2023-10-14T08:44:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.889+0000 7f2bf5548700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f2bdc0387d0 0x7f2bdc03ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.889+0000 7f2bf5548700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f2bdc0387d0 0x7f2bdc03ac90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006fd0 tx=0x7f2be0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:53.642 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:52.893+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2bec003c40 con 0x7f2bf0105710 2023-10-14T08:44:53.642 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.263+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2bf0109d70 con 0x7f2bf0105710 2023-10-14T08:44:53.642 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.268+0000 7f2be6ffd700 1 -- 172.21.15.6:0/4057409335 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2bec018350 con 0x7f2bf0105710 2023-10-14T08:44:53.642 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f2bdc0387d0 msgr2=0x7f2bdc03ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:53.642 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f2bdc0387d0 0x7f2bdc03ac90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006fd0 tx=0x7f2be0006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 msgr2=0x7f2bf0190960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0190960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec003e60 tx=0x7f2bec011aa0 comp rx=0 tx=0).stop 2023-10-14T08:44:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 shutdown_connections 2023-10-14T08:44:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f2bdc0387d0 0x7f2bdc03ac90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 --2- 172.21.15.6:0/4057409335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0105710 0x7f2bf0190960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:53.644 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 >> 172.21.15.6:0/4057409335 conn(0x7f2bf0100cb0 msgr2=0x7f2bf0074190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:53.644 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 shutdown_connections 2023-10-14T08:44:53.644 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:53.271+0000 7f2bf7fad700 1 -- 172.21.15.6:0/4057409335 wait complete. 2023-10-14T08:44:53.644 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling the dashboard module... 2023-10-14T08:44:54.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:54 smithi006 ceph-mon[99452]: from='mgr.14120 172.21.15.6:0/3879706534' entity='mgr.x' 2023-10-14T08:44:54.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:54 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4057409335' entity='client.admin' 2023-10-14T08:44:55.410 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2572052542' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-14T08:44:55.410 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: ignoring --setuser ceph since I am not root 2023-10-14T08:44:55.410 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: ignoring --setgroup ceph since I am not root 2023-10-14T08:44:55.411 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:55.310+0000 7f995563f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T08:44:55.411 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:55.408+0000 7f995563f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T08:44:55.483 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f7305632700 1 Processor -- start 2023-10-14T08:44:55.484 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f7305632700 1 -- start start 2023-10-14T08:44:55.484 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f7305632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f7300109750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:55.484 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f7305632700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000746a0 con 0x7f7300107360 2023-10-14T08:44:55.484 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f72feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f7300109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:55.485 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f72feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f7300109750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58216/0 (socket says 172.21.15.6:58216) 2023-10-14T08:44:55.485 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.145+0000 7f72feffd700 1 -- 172.21.15.6:0/2734298403 learned_addr learned my addr 172.21.15.6:0/2734298403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:55.485 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.146+0000 7f72feffd700 1 -- 172.21.15.6:0/2734298403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000747e0 con 0x7f7300107360 2023-10-14T08:44:55.485 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.146+0000 7f72feffd700 1 --2- 172.21.15.6:0/2734298403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f7300109750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009e80 tx=0x7f72f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5b7b612c97b02c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:55.485 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.146+0000 7f72fdffb700 1 -- 172.21.15.6:0/2734298403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f000e070 con 0x7f7300107360 2023-10-14T08:44:55.486 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.146+0000 7f72fdffb700 1 -- 172.21.15.6:0/2734298403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72f000b8c0 con 0x7f7300107360 2023-10-14T08:44:55.486 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.146+0000 7f72fdffb700 1 -- 172.21.15.6:0/2734298403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f00043e0 con 0x7f7300107360 2023-10-14T08:44:55.486 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 -- 172.21.15.6:0/2734298403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 msgr2=0x7f7300109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:55.486 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 --2- 172.21.15.6:0/2734298403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f7300109750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009e80 tx=0x7f72f000b330 comp rx=0 tx=0).stop 2023-10-14T08:44:55.487 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 -- 172.21.15.6:0/2734298403 shutdown_connections 2023-10-14T08:44:55.487 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 --2- 172.21.15.6:0/2734298403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f7300109750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:55.487 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 -- 172.21.15.6:0/2734298403 >> 172.21.15.6:0/2734298403 conn(0x7f7300100cb0 msgr2=0x7f73001030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:55.487 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 -- 172.21.15.6:0/2734298403 shutdown_connections 2023-10-14T08:44:55.487 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 -- 172.21.15.6:0/2734298403 wait complete. 2023-10-14T08:44:55.488 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.147+0000 7f7305632700 1 Processor -- start 2023-10-14T08:44:55.488 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f7305632700 1 -- start start 2023-10-14T08:44:55.488 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f7305632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f730019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:55.488 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f7305632700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730019a980 con 0x7f7300107360 2023-10-14T08:44:55.488 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f730019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:55.489 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f730019a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58218/0 (socket says 172.21.15.6:58218) 2023-10-14T08:44:55.489 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72feffd700 1 -- 172.21.15.6:0/2572052542 learned_addr learned my addr 172.21.15.6:0/2572052542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:55.489 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72feffd700 1 -- 172.21.15.6:0/2572052542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0009b30 con 0x7f7300107360 2023-10-14T08:44:55.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72feffd700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f730019a440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009e50 tx=0x7f72f0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:55.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f000e040 con 0x7f7300107360 2023-10-14T08:44:55.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72f000be30 con 0x7f7300107360 2023-10-14T08:44:55.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730019ab80 con 0x7f7300107360 2023-10-14T08:44:55.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.148+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f001c750 con 0x7f7300107360 2023-10-14T08:44:55.492 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.149+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730019b000 con 0x7f7300107360 2023-10-14T08:44:55.492 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.149+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45579+0+0 (secure 0 0 0) 0x7f72f001c990 con 0x7f7300107360 2023-10-14T08:44:55.493 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.150+0000 7f72e7fff700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f72e80387d0 0x7f72e803ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:55.493 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.150+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f72f004c7c0 con 0x7f7300107360 2023-10-14T08:44:55.493 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.150+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73000624e0 con 0x7f7300107360 2023-10-14T08:44:55.493 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.150+0000 7f72fe7fc700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f72e80387d0 0x7f72e803ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.150+0000 7f72fe7fc700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f72e80387d0 0x7f72e803ac90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72f4006fd0 tx=0x7f72f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.155+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f72f0017020 con 0x7f7300107360 2023-10-14T08:44:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:54.640+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f730019db10 con 0x7f7300107360 2023-10-14T08:44:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.105+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f72f0020020 con 0x7f7300107360 2023-10-14T08:44:55.494 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.107+0000 7f72e7fff700 1 -- 172.21.15.6:0/2572052542 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f72f001cc90 con 0x7f7300107360 2023-10-14T08:44:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f72e80387d0 msgr2=0x7f72e803ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f72e80387d0 0x7f72e803ac90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f72f4006fd0 tx=0x7f72f4006e40 comp rx=0 tx=0).stop 2023-10-14T08:44:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 msgr2=0x7f730019a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f730019a440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009e50 tx=0x7f72f0003d00 comp rx=0 tx=0).stop 2023-10-14T08:44:55.495 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 shutdown_connections 2023-10-14T08:44:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f72e80387d0 0x7f72e803ac90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 --2- 172.21.15.6:0/2572052542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7300107360 0x7f730019a440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 >> 172.21.15.6:0/2572052542 conn(0x7f7300100cb0 msgr2=0x7f7300101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 shutdown_connections 2023-10-14T08:44:55.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.109+0000 7f7305632700 1 -- 172.21.15.6:0/2572052542 wait complete. 2023-10-14T08:44:55.683 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:55.530+0000 7f995563f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T08:44:55.683 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:55.644+0000 7f995563f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T08:44:55.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:55.873+0000 7f995563f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T08:44:56.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:56.354+0000 7f995563f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T08:44:56.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:56 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2572052542' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-14T08:44:56.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:56 smithi006 ceph-mon[99452]: mgrmap e9: x(active, since 18s) 2023-10-14T08:44:56.751 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:56.511+0000 7f995563f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T08:44:56.751 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:56.632+0000 7f995563f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T08:44:56.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:44:56.837 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-14T08:44:56.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-14T08:44:56.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-14T08:44:56.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-14T08:44:56.838 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:44:56.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.975+0000 7f7a643b9700 1 Processor -- start 2023-10-14T08:44:56.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.975+0000 7f7a643b9700 1 -- start start 2023-10-14T08:44:56.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.975+0000 7f7a643b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c109670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:56.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.975+0000 7f7a643b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c074780 con 0x7f7a5c107280 2023-10-14T08:44:56.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a62155700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:56.839 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a62155700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58232/0 (socket says 172.21.15.6:58232) 2023-10-14T08:44:56.840 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a62155700 1 -- 172.21.15.6:0/1711877197 learned_addr learned my addr 172.21.15.6:0/1711877197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:56.840 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a62155700 1 -- 172.21.15.6:0/1711877197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c109bb0 con 0x7f7a5c107280 2023-10-14T08:44:56.840 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a62155700 1 --2- 172.21.15.6:0/1711877197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c109670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a580098a0 tx=0x7f7a58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb37771afffe0c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:56.840 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a61153700 1 -- 172.21.15.6:0/1711877197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a58004160 con 0x7f7a5c107280 2023-10-14T08:44:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a61153700 1 -- 172.21.15.6:0/1711877197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a580042c0 con 0x7f7a5c107280 2023-10-14T08:44:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.976+0000 7f7a61153700 1 -- 172.21.15.6:0/1711877197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a580119b0 con 0x7f7a5c107280 2023-10-14T08:44:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 -- 172.21.15.6:0/1711877197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 msgr2=0x7f7a5c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 --2- 172.21.15.6:0/1711877197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c109670 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a580098a0 tx=0x7f7a58009bb0 comp rx=0 tx=0).stop 2023-10-14T08:44:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 -- 172.21.15.6:0/1711877197 shutdown_connections 2023-10-14T08:44:56.841 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 --2- 172.21.15.6:0/1711877197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c109670 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:56.842 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 -- 172.21.15.6:0/1711877197 >> 172.21.15.6:0/1711877197 conn(0x7f7a5c100cb0 msgr2=0x7f7a5c1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:56.842 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 -- 172.21.15.6:0/1711877197 shutdown_connections 2023-10-14T08:44:56.842 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.977+0000 7f7a643b9700 1 -- 172.21.15.6:0/1711877197 wait complete. 2023-10-14T08:44:56.842 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a643b9700 1 Processor -- start 2023-10-14T08:44:56.843 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a643b9700 1 -- start start 2023-10-14T08:44:56.843 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a643b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:56.843 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a643b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c19a9c0 con 0x7f7a5c107280 2023-10-14T08:44:56.843 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a62155700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:44:56.843 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a62155700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58234/0 (socket says 172.21.15.6:58234) 2023-10-14T08:44:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.978+0000 7f7a62155700 1 -- 172.21.15.6:0/1521015672 learned_addr learned my addr 172.21.15.6:0/1521015672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:44:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a62155700 1 -- 172.21.15.6:0/1521015672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58009550 con 0x7f7a5c107280 2023-10-14T08:44:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a62155700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c19a480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a58003e60 tx=0x7f7a58011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:44:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a58003970 con 0x7f7a5c107280 2023-10-14T08:44:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c19abc0 con 0x7f7a5c107280 2023-10-14T08:44:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a58003ad0 con 0x7f7a5c107280 2023-10-14T08:44:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c19afe0 con 0x7f7a5c107280 2023-10-14T08:44:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.979+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a580195e0 con 0x7f7a5c107280 2023-10-14T08:44:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.980+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f7a580198d0 con 0x7f7a5c107280 2023-10-14T08:44:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.980+0000 7f7a537fe700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 0x7f7a4803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:44:56.845 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.980+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7a5804d9a0 con 0x7f7a5c107280 2023-10-14T08:44:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.980+0000 7f7a61954700 1 -- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 msgr2=0x7f7a4803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:44:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.980+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40005320 con 0x7f7a5c107280 2023-10-14T08:44:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.980+0000 7f7a61954700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 0x7f7a4803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:44:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:55.985+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7a58019e00 con 0x7f7a5c107280 2023-10-14T08:44:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.181+0000 7f7a61954700 1 -- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 msgr2=0x7f7a4803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:44:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.181+0000 7f7a61954700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 0x7f7a4803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T08:44:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.463+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7a40005de0 con 0x7f7a5c107280 2023-10-14T08:44:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.464+0000 7f7a537fe700 1 -- 172.21.15.6:0/1521015672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f7a580172b0 con 0x7f7a5c107280 2023-10-14T08:44:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 msgr2=0x7f7a4803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:44:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 0x7f7a4803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 msgr2=0x7f7a5c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:44:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c19a480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a58003e60 tx=0x7f7a58011aa0 comp rx=0 tx=0).stop 2023-10-14T08:44:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 shutdown_connections 2023-10-14T08:44:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f7a48038870 0x7f7a4803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 --2- 172.21.15.6:0/1521015672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a5c107280 0x7f7a5c19a480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:44:56.849 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 >> 172.21.15.6:0/1521015672 conn(0x7f7a5c100cb0 msgr2=0x7f7a5c101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:44:56.849 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 shutdown_connections 2023-10-14T08:44:56.849 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:56.467+0000 7f7a643b9700 1 -- 172.21.15.6:0/1521015672 wait complete. 2023-10-14T08:44:56.849 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2023-10-14T08:44:56.849 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 9... 2023-10-14T08:44:57.067 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:56.749+0000 7f995563f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T08:44:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:44:57 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1521015672' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-14T08:44:57.482 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:57 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:57.281+0000 7f995563f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T08:44:58.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:58.064+0000 7f995563f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T08:44:58.482 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:58.164+0000 7f995563f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T08:44:59.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:59.143+0000 7f995563f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:44:59.482 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:59.258+0000 7f995563f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T08:44:59.845 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:59.485+0000 7f995563f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:45:00.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:44:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:44:59.843+0000 7f995563f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T08:45:00.482 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:00 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:00.114+0000 7f995563f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T08:45:00.482 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:00 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:00.298+0000 7f995563f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T08:45:00.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:00 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:00.632+0000 7f995563f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T08:45:01.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:01.460+0000 7f995563f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T08:45:01.732 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:01.620+0000 7f995563f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T08:45:02.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:01.872+0000 7f995563f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T08:45:02.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:02.013+0000 7f995563f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T08:45:02.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:02.288+0000 7f995563f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T08:45:03.731 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:45:03.338+0000 7f995563f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T08:45:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: Active manager daemon x restarted 2023-10-14T08:45:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: Activating manager daemon x 2023-10-14T08:45:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: osdmap e3: 0 total, 0 up, 0 in 2023-10-14T08:45:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: mgrmap e10: x(active, starting, since 0.00351814s) 2023-10-14T08:45:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:03.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-14T08:45:03.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-14T08:45:03.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-14T08:45:03.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-14T08:45:03.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: Manager daemon x is now available 2023-10-14T08:45:03.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:03.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:04.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-14T08:45:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-14T08:45:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:04 smithi006 ceph-mon[99452]: mgrmap e11: x(active, since 1.00589s) 2023-10-14T08:45:04.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-10-14T08:45:04.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-14T08:45:04.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-14T08:45:04.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-10-14T08:45:04.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e803e7700 1 Processor -- start 2023-10-14T08:45:04.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e803e7700 1 -- start start 2023-10-14T08:45:04.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e803e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e781054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:04.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e803e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78074740 con 0x7f3e781050b0 2023-10-14T08:45:04.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e7e183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e781054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:04.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e7e183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e781054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58242/0 (socket says 172.21.15.6:58242) 2023-10-14T08:45:04.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.331+0000 7f3e7e183700 1 -- 172.21.15.6:0/285604999 learned_addr learned my addr 172.21.15.6:0/285604999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:04.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.332+0000 7f3e7e183700 1 -- 172.21.15.6:0/285604999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78105a10 con 0x7f3e781050b0 2023-10-14T08:45:04.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.332+0000 7f3e7e183700 1 --2- 172.21.15.6:0/285604999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e781054d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e740098a0 tx=0x7f3e74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454397c19c333014 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:04.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.332+0000 7f3e7d181700 1 -- 172.21.15.6:0/285604999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e74004160 con 0x7f3e781050b0 2023-10-14T08:45:04.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.332+0000 7f3e7d181700 1 -- 172.21.15.6:0/285604999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e740042c0 con 0x7f3e781050b0 2023-10-14T08:45:04.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.332+0000 7f3e7d181700 1 -- 172.21.15.6:0/285604999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e740119b0 con 0x7f3e781050b0 2023-10-14T08:45:04.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 -- 172.21.15.6:0/285604999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 msgr2=0x7f3e781054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:04.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 --2- 172.21.15.6:0/285604999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e781054d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e740098a0 tx=0x7f3e74009bb0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 -- 172.21.15.6:0/285604999 shutdown_connections 2023-10-14T08:45:04.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 --2- 172.21.15.6:0/285604999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e781054d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 -- 172.21.15.6:0/285604999 >> 172.21.15.6:0/285604999 conn(0x7f3e78100cb0 msgr2=0x7f3e781030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 -- 172.21.15.6:0/285604999 shutdown_connections 2023-10-14T08:45:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.333+0000 7f3e803e7700 1 -- 172.21.15.6:0/285604999 wait complete. 2023-10-14T08:45:04.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e803e7700 1 Processor -- start 2023-10-14T08:45:04.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e803e7700 1 -- start start 2023-10-14T08:45:04.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e803e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e7819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:04.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e803e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7819cbc0 con 0x7f3e781050b0 2023-10-14T08:45:04.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e7e183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e7819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:04.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e7e183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e7819c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58244/0 (socket says 172.21.15.6:58244) 2023-10-14T08:45:04.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.334+0000 7f3e7e183700 1 -- 172.21.15.6:0/1051105731 learned_addr learned my addr 172.21.15.6:0/1051105731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:04.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e7e183700 1 -- 172.21.15.6:0/1051105731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009550 con 0x7f3e781050b0 2023-10-14T08:45:04.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e7e183700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e7819c680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e74011980 tx=0x7f3e74011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:04.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e74003a60 con 0x7f3e781050b0 2023-10-14T08:45:04.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7819cdc0 con 0x7f3e781050b0 2023-10-14T08:45:04.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e74003bc0 con 0x7f3e781050b0 2023-10-14T08:45:04.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7401a670 con 0x7f3e781050b0 2023-10-14T08:45:04.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.335+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7819d1e0 con 0x7f3e781050b0 2023-10-14T08:45:04.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.336+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f3e7401a930 con 0x7f3e781050b0 2023-10-14T08:45:04.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.336+0000 7f3e6f7fe700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.336+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 --> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e6403b440 con 0x7f3e64038870 2023-10-14T08:45:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.336+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3e7404ca40 con 0x7f3e781050b0 2023-10-14T08:45:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.336+0000 7f3e7d982700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 msgr2=0x7f3e6403ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:45:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.336+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:45:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.537+0000 7f3e7d982700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 msgr2=0x7f3e6403ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:45:04.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.537+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-14T08:45:04.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.938+0000 7f3e7d982700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 msgr2=0x7f3e6403ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:45:04.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:57.938+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-14T08:45:04.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:58.739+0000 7f3e7d982700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 msgr2=0x7f3e6403ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:45:04.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:44:58.739+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-14T08:45:04.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:00.340+0000 7f3e7d982700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 msgr2=0x7f3e6403ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/516951061 2023-10-14T08:45:04.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:00.340+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-14T08:45:04.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:03.354+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 10) v1 ==== 45359+0+0 (secure 0 0 0) 0x7f3e7402d960 con 0x7f3e781050b0 2023-10-14T08:45:04.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:03.354+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 msgr2=0x7f3e6403ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:45:04.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:03.354+0000 7f3e6f7fe700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.355+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7f3e7404e710 con 0x7f3e781050b0 2023-10-14T08:45:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.355+0000 7f3e6f7fe700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3e6403c1b0 0x7f3e6403e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.355+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e6403b440 con 0x7f3e6403c1b0 2023-10-14T08:45:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.356+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3e6403c1b0 0x7f3e6403e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:04.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.356+0000 7f3e7d982700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3e6403c1b0 0x7f3e6403e5a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3e68003a10 tx=0x7f3e680092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.357+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f3e6403b440 con 0x7f3e6403c1b0 2023-10-14T08:45:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.368+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3e7819d9c0 con 0x7f3e6403c1b0 2023-10-14T08:45:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.368+0000 7f3e6f7fe700 1 -- 172.21.15.6:0/1051105731 <== mgr.14152 v2:172.21.15.6:6800/827561147 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f3e7819d9c0 con 0x7f3e6403c1b0 2023-10-14T08:45:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3e6403c1b0 msgr2=0x7f3e6403e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3e6403c1b0 0x7f3e6403e5a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3e68003a10 tx=0x7f3e680092b0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 msgr2=0x7f3e7819c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:04.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e7819c680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3e74011980 tx=0x7f3e74011a60 comp rx=0 tx=0).stop 2023-10-14T08:45:04.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 shutdown_connections 2023-10-14T08:45:04.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3e6403c1b0 0x7f3e6403e5a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e781050b0 0x7f3e7819c680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 --2- 172.21.15.6:0/1051105731 >> [v2:172.21.15.6:6800/516951061,v1:172.21.15.6:6801/516951061] conn(0x7f3e64038870 0x7f3e6403ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:04.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 >> 172.21.15.6:0/1051105731 conn(0x7f3e78100cb0 msgr2=0x7f3e78190c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:04.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 shutdown_connections 2023-10-14T08:45:04.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:04.369+0000 7f3e803e7700 1 -- 172.21.15.6:0/1051105731 wait complete. 2023-10-14T08:45:04.926 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 9 is available 2023-10-14T08:45:04.927 INFO:teuthology.orchestra.run.smithi006.stdout:Generating a dashboard self-signed certificate... 2023-10-14T08:45:05.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:05 smithi006 ceph-mon[99452]: [14/Oct/2023:08:45:04] ENGINE Bus STARTING 2023-10-14T08:45:05.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:05 smithi006 ceph-mon[99452]: [14/Oct/2023:08:45:04] ENGINE Serving on https://172.21.15.6:7150 2023-10-14T08:45:05.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:05 smithi006 ceph-mon[99452]: [14/Oct/2023:08:45:04] ENGINE Serving on http://172.21.15.6:8765 2023-10-14T08:45:05.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:05 smithi006 ceph-mon[99452]: [14/Oct/2023:08:45:04] ENGINE Bus STARTED 2023-10-14T08:45:05.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:05 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:06.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-14T08:45:06.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8eda1d2700 1 Processor -- start 2023-10-14T08:45:06.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8eda1d2700 1 -- start start 2023-10-14T08:45:06.155 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8eda1d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4109750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:06.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8eda1d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40746a0 con 0x7f8ed4107360 2023-10-14T08:45:06.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8ed37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:06.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8ed37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4109750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58298/0 (socket says 172.21.15.6:58298) 2023-10-14T08:45:06.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.392+0000 7f8ed37fe700 1 -- 172.21.15.6:0/3139093537 learned_addr learned my addr 172.21.15.6:0/3139093537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:06.156 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.393+0000 7f8ed37fe700 1 -- 172.21.15.6:0/3139093537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed40747e0 con 0x7f8ed4107360 2023-10-14T08:45:06.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.393+0000 7f8ed37fe700 1 --2- 172.21.15.6:0/3139093537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4109750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098a0 tx=0x7f8ec4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdfae4e64e03eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:06.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.393+0000 7f8ed27fc700 1 -- 172.21.15.6:0/3139093537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4004160 con 0x7f8ed4107360 2023-10-14T08:45:06.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.393+0000 7f8ed27fc700 1 -- 172.21.15.6:0/3139093537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec40042c0 con 0x7f8ed4107360 2023-10-14T08:45:06.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.393+0000 7f8ed27fc700 1 -- 172.21.15.6:0/3139093537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec40119b0 con 0x7f8ed4107360 2023-10-14T08:45:06.157 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3139093537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 msgr2=0x7f8ed4109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:06.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 --2- 172.21.15.6:0/3139093537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4109750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40098a0 tx=0x7f8ec4009bb0 comp rx=0 tx=0).stop 2023-10-14T08:45:06.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3139093537 shutdown_connections 2023-10-14T08:45:06.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 --2- 172.21.15.6:0/3139093537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4109750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:06.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3139093537 >> 172.21.15.6:0/3139093537 conn(0x7f8ed4100cb0 msgr2=0x7f8ed41030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:06.158 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3139093537 shutdown_connections 2023-10-14T08:45:06.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3139093537 wait complete. 2023-10-14T08:45:06.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.394+0000 7f8eda1d2700 1 Processor -- start 2023-10-14T08:45:06.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8eda1d2700 1 -- start start 2023-10-14T08:45:06.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8eda1d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4106cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:06.159 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8eda1d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4107200 con 0x7f8ed4107360 2023-10-14T08:45:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8ed37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4106cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8ed37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4106cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58300/0 (socket says 172.21.15.6:58300) 2023-10-14T08:45:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8ed37fe700 1 -- 172.21.15.6:0/3012511903 learned_addr learned my addr 172.21.15.6:0/3012511903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8ed37fe700 1 -- 172.21.15.6:0/3012511903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009550 con 0x7f8ed4107360 2023-10-14T08:45:06.160 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.395+0000 7f8ed37fe700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4106cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4003e60 tx=0x7f8ec4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.396+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec4003970 con 0x7f8ed4107360 2023-10-14T08:45:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.396+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed4105310 con 0x7f8ed4107360 2023-10-14T08:45:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.396+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ec4003ad0 con 0x7f8ed4107360 2023-10-14T08:45:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.396+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ec40195e0 con 0x7f8ed4107360 2023-10-14T08:45:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.396+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed4105730 con 0x7f8ed4107360 2023-10-14T08:45:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.397+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed410aa00 con 0x7f8ed4107360 2023-10-14T08:45:06.162 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.397+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 11) v1 ==== 45486+0+0 (secure 0 0 0) 0x7f8ec40198c0 con 0x7f8ed4107360 2023-10-14T08:45:06.162 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.398+0000 7f8ed0ff9700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ebc038700 0x7f8ebc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:06.162 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.398+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8ec40558a0 con 0x7f8ed4107360 2023-10-14T08:45:06.162 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.398+0000 7f8ed2ffd700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ebc038700 0x7f8ebc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:06.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.398+0000 7f8ed2ffd700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ebc038700 0x7f8ebc03abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8006fd0 tx=0x7f8ec8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:06.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.403+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ec4003c40 con 0x7f8ed4107360 2023-10-14T08:45:06.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.777+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ed4105ee0 con 0x7f8ebc038700 2023-10-14T08:45:06.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.832+0000 7f8ed0ff9700 1 -- 172.21.15.6:0/3012511903 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f8ed4105ee0 con 0x7f8ebc038700 2023-10-14T08:45:06.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ebc038700 msgr2=0x7f8ebc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:06.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ebc038700 0x7f8ebc03abc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8006fd0 tx=0x7f8ec8006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:06.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 msgr2=0x7f8ed4106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:06.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4106cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4003e60 tx=0x7f8ec4011aa0 comp rx=0 tx=0).stop 2023-10-14T08:45:06.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 shutdown_connections 2023-10-14T08:45:06.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ebc038700 0x7f8ebc03abc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:06.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 --2- 172.21.15.6:0/3012511903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed4107360 0x7f8ed4106cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:06.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 >> 172.21.15.6:0/3012511903 conn(0x7f8ed4100cb0 msgr2=0x7f8ed4101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:06.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 shutdown_connections 2023-10-14T08:45:06.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:05.834+0000 7f8eda1d2700 1 -- 172.21.15.6:0/3012511903 wait complete. 2023-10-14T08:45:06.165 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial admin user... 2023-10-14T08:45:07.182 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:06 smithi006 ceph-mon[99452]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:07.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:07.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:07.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:06 smithi006 ceph-mon[99452]: mgrmap e12: x(active, since 2s) 2023-10-14T08:45:07.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:08.003 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$zIeUjbp7dIMwjdxI.0.2vuN9wrA2B7uiy/l2ffifU0H3qcEHZvIHS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1697273107, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-14T08:45:08.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63b4caf700 1 Processor -- start 2023-10-14T08:45:08.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63b4caf700 1 -- start start 2023-10-14T08:45:08.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63b4caf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b0105490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:08.004 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63b4caf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0074780 con 0x7f63b0105070 2023-10-14T08:45:08.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b0105490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:08.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b0105490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58304/0 (socket says 172.21.15.6:58304) 2023-10-14T08:45:08.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63ae59c700 1 -- 172.21.15.6:0/14776635 learned_addr learned my addr 172.21.15.6:0/14776635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:08.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.679+0000 7f63ae59c700 1 -- 172.21.15.6:0/14776635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b01059d0 con 0x7f63b0105070 2023-10-14T08:45:08.005 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63ae59c700 1 --2- 172.21.15.6:0/14776635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b0105490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009e80 tx=0x7f63a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe618526ef90375 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:08.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63ad59a700 1 -- 172.21.15.6:0/14776635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63a000e070 con 0x7f63b0105070 2023-10-14T08:45:08.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63ad59a700 1 -- 172.21.15.6:0/14776635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63a000b8c0 con 0x7f63b0105070 2023-10-14T08:45:08.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63ad59a700 1 -- 172.21.15.6:0/14776635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63a00043e0 con 0x7f63b0105070 2023-10-14T08:45:08.006 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 -- 172.21.15.6:0/14776635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 msgr2=0x7f63b0105490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:08.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 --2- 172.21.15.6:0/14776635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b0105490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009e80 tx=0x7f63a000b330 comp rx=0 tx=0).stop 2023-10-14T08:45:08.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 -- 172.21.15.6:0/14776635 shutdown_connections 2023-10-14T08:45:08.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 --2- 172.21.15.6:0/14776635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b0105490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:08.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 -- 172.21.15.6:0/14776635 >> 172.21.15.6:0/14776635 conn(0x7f63b0100cb0 msgr2=0x7f63b01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:08.007 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 -- 172.21.15.6:0/14776635 shutdown_connections 2023-10-14T08:45:08.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.680+0000 7f63b4caf700 1 -- 172.21.15.6:0/14776635 wait complete. 2023-10-14T08:45:08.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.681+0000 7f63b4caf700 1 Processor -- start 2023-10-14T08:45:08.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.681+0000 7f63b4caf700 1 -- start start 2023-10-14T08:45:08.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.681+0000 7f63b4caf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:08.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.681+0000 7f63b4caf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b019cbc0 con 0x7f63b0105070 2023-10-14T08:45:08.008 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58306/0 (socket says 172.21.15.6:58306) 2023-10-14T08:45:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63ae59c700 1 -- 172.21.15.6:0/1109178470 learned_addr learned my addr 172.21.15.6:0/1109178470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63ae59c700 1 -- 172.21.15.6:0/1109178470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009b30 con 0x7f63b0105070 2023-10-14T08:45:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63ae59c700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b019c680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63a0004000 tx=0x7f63a0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63a000e040 con 0x7f63b0105070 2023-10-14T08:45:08.010 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63a000be30 con 0x7f63b0105070 2023-10-14T08:45:08.010 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63a001c6b0 con 0x7f63b0105070 2023-10-14T08:45:08.010 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.682+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b019cdc0 con 0x7f63b0105070 2023-10-14T08:45:08.010 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.683+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b019d240 con 0x7f63b0105070 2023-10-14T08:45:08.010 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.683+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f63a001c8e0 con 0x7f63b0105070 2023-10-14T08:45:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.683+0000 7f63a77fe700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f639c038910 0x7f639c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.684+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f63a004cb10 con 0x7f63b0105070 2023-10-14T08:45:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.684+0000 7f63add9b700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f639c038910 0x7f639c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.684+0000 7f63add9b700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f639c038910 0x7f639c03add0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6398006fd0 tx=0x7f6398006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.684+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b0195f30 con 0x7f63b0105070 2023-10-14T08:45:08.012 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:06.690+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f63a0017080 con 0x7f63b0105070 2023-10-14T08:45:08.012 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.102+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f63b0062300 con 0x7f639c038910 2023-10-14T08:45:08.012 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.349+0000 7f63a77fe700 1 -- 172.21.15.6:0/1109178470 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f63b0062300 con 0x7f639c038910 2023-10-14T08:45:08.012 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f639c038910 msgr2=0x7f639c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:08.012 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f639c038910 0x7f639c03add0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6398006fd0 tx=0x7f6398006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:08.013 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 msgr2=0x7f63b019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:08.013 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b019c680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63a0004000 tx=0x7f63a0003d00 comp rx=0 tx=0).stop 2023-10-14T08:45:08.013 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 shutdown_connections 2023-10-14T08:45:08.013 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f639c038910 0x7f639c03add0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:08.013 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 --2- 172.21.15.6:0/1109178470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63b0105070 0x7f63b019c680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:08.014 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 >> 172.21.15.6:0/1109178470 conn(0x7f63b0100cb0 msgr2=0x7f63b0190c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:08.014 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 shutdown_connections 2023-10-14T08:45:08.014 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:07.351+0000 7f63b4caf700 1 -- 172.21.15.6:0/1109178470 wait complete. 2023-10-14T08:45:08.014 INFO:teuthology.orchestra.run.smithi006.stdout:Fetching dashboard port number... 2023-10-14T08:45:08.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:07 smithi006 ceph-mon[99452]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:08.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:07 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:09.211 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:08 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/240585458' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-14T08:45:09.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 8443 2023-10-14T08:45:09.250 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.471+0000 7f8ab820a700 1 Processor -- start 2023-10-14T08:45:09.251 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.471+0000 7f8ab820a700 1 -- start start 2023-10-14T08:45:09.251 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.471+0000 7f8ab820a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab01096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:09.251 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.471+0000 7f8ab820a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0074740 con 0x7f8ab01072c0 2023-10-14T08:45:09.251 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab5fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab01096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:09.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab5fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab01096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58310/0 (socket says 172.21.15.6:58310) 2023-10-14T08:45:09.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab5fa6700 1 -- 172.21.15.6:0/1911407210 learned_addr learned my addr 172.21.15.6:0/1911407210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:09.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab5fa6700 1 -- 172.21.15.6:0/1911407210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0109bf0 con 0x7f8ab01072c0 2023-10-14T08:45:09.252 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab5fa6700 1 --2- 172.21.15.6:0/1911407210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab01096b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0098a0 tx=0x7f8aac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f992a3182e1800 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:09.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab4fa4700 1 -- 172.21.15.6:0/1911407210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8aac004160 con 0x7f8ab01072c0 2023-10-14T08:45:09.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab4fa4700 1 -- 172.21.15.6:0/1911407210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8aac0042c0 con 0x7f8ab01072c0 2023-10-14T08:45:09.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.472+0000 7f8ab4fa4700 1 -- 172.21.15.6:0/1911407210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8aac0119b0 con 0x7f8ab01072c0 2023-10-14T08:45:09.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 -- 172.21.15.6:0/1911407210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 msgr2=0x7f8ab01096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:09.253 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 --2- 172.21.15.6:0/1911407210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab01096b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0098a0 tx=0x7f8aac009bb0 comp rx=0 tx=0).stop 2023-10-14T08:45:09.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 -- 172.21.15.6:0/1911407210 shutdown_connections 2023-10-14T08:45:09.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 --2- 172.21.15.6:0/1911407210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab01096b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:09.254 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 -- 172.21.15.6:0/1911407210 >> 172.21.15.6:0/1911407210 conn(0x7f8ab0100cb0 msgr2=0x7f8ab01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:09.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 -- 172.21.15.6:0/1911407210 shutdown_connections 2023-10-14T08:45:09.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.473+0000 7f8ab820a700 1 -- 172.21.15.6:0/1911407210 wait complete. 2023-10-14T08:45:09.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab820a700 1 Processor -- start 2023-10-14T08:45:09.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab820a700 1 -- start start 2023-10-14T08:45:09.255 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab820a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab0106c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:09.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab820a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0107160 con 0x7f8ab01072c0 2023-10-14T08:45:09.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab5fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab0106c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:09.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab5fa6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab0106c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58312/0 (socket says 172.21.15.6:58312) 2023-10-14T08:45:09.256 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab5fa6700 1 -- 172.21.15.6:0/240585458 learned_addr learned my addr 172.21.15.6:0/240585458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:09.257 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.474+0000 7f8ab5fa6700 1 -- 172.21.15.6:0/240585458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac009550 con 0x7f8ab01072c0 2023-10-14T08:45:09.257 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.475+0000 7f8ab5fa6700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab0106c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8aac003e60 tx=0x7f8aac011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:09.257 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.475+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8aac003970 con 0x7f8ab01072c0 2023-10-14T08:45:09.257 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.475+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8aac003ad0 con 0x7f8ab01072c0 2023-10-14T08:45:09.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.475+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab0105270 con 0x7f8ab01072c0 2023-10-14T08:45:09.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.475+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8aac0195e0 con 0x7f8ab01072c0 2023-10-14T08:45:09.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.475+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab0105690 con 0x7f8ab01072c0 2023-10-14T08:45:09.258 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.476+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f8aac019850 con 0x7f8ab01072c0 2023-10-14T08:45:09.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.476+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab010a9d0 con 0x7f8ab01072c0 2023-10-14T08:45:09.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.476+0000 7f8aa6ffd700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a9c038870 0x7f8a9c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:09.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.476+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8aac04cae0 con 0x7f8ab01072c0 2023-10-14T08:45:09.259 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.476+0000 7f8ab57a5700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a9c038870 0x7f8a9c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:09.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.477+0000 7f8ab57a5700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a9c038870 0x7f8a9c03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006fd0 tx=0x7f8aa0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:09.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.481+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8aac02b340 con 0x7f8ab01072c0 2023-10-14T08:45:09.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.853+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f8ab010ac40 con 0x7f8ab01072c0 2023-10-14T08:45:09.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.854+0000 7f8aa6ffd700 1 -- 172.21.15.6:0/240585458 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f8aac0172b0 con 0x7f8ab01072c0 2023-10-14T08:45:09.260 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a9c038870 msgr2=0x7f8a9c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:09.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a9c038870 0x7f8a9c03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0006fd0 tx=0x7f8aa0006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:09.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 msgr2=0x7f8ab0106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:09.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab0106c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8aac003e60 tx=0x7f8aac011aa0 comp rx=0 tx=0).stop 2023-10-14T08:45:09.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 shutdown_connections 2023-10-14T08:45:09.261 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a9c038870 0x7f8a9c03ad30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:09.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 --2- 172.21.15.6:0/240585458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ab01072c0 0x7f8ab0106c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:09.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 >> 172.21.15.6:0/240585458 conn(0x7f8ab0100cb0 msgr2=0x7f8ab0101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:09.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 shutdown_connections 2023-10-14T08:45:09.262 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:08.856+0000 7f8ab820a700 1 -- 172.21.15.6:0/240585458 wait complete. 2023-10-14T08:45:09.263 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-14T08:45:09.263 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-10-14T08:45:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-14T08:45:09.264 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-10-14T08:45:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-10-14T08:45:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-14T08:45:09.266 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph Dashboard is now available at: 2023-10-14T08:45:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: URL: https://smithi006:8443/ 2023-10-14T08:45:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: User: admin 2023-10-14T08:45:09.266 INFO:teuthology.orchestra.run.smithi006.stdout: Password: crut8aplnb 2023-10-14T08:45:09.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:09.267 INFO:teuthology.orchestra.run.smithi006.stdout:Saving cluster configuration to /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config directory 2023-10-14T08:45:09.268 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling autotune for osd_memory_target 2023-10-14T08:45:10.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.724+0000 7f0cf7899700 1 Processor -- start 2023-10-14T08:45:10.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf7899700 1 -- start start 2023-10-14T08:45:10.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf7899700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf01054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:10.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf7899700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0074720 con 0x7f0cf01050d0 2023-10-14T08:45:10.415 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf5635700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf01054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:10.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf5635700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf01054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58320/0 (socket says 172.21.15.6:58320) 2023-10-14T08:45:10.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf5635700 1 -- 172.21.15.6:0/59915682 learned_addr learned my addr 172.21.15.6:0/59915682 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:10.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.725+0000 7f0cf5635700 1 -- 172.21.15.6:0/59915682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0105a30 con 0x7f0cf01050d0 2023-10-14T08:45:10.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0cf5635700 1 --2- 172.21.15.6:0/59915682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf01054f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00098a0 tx=0x7f0ce0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ce795f33cc03bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:10.416 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0ce7fff700 1 -- 172.21.15.6:0/59915682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0004160 con 0x7f0cf01050d0 2023-10-14T08:45:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0ce7fff700 1 -- 172.21.15.6:0/59915682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ce00042c0 con 0x7f0cf01050d0 2023-10-14T08:45:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0ce7fff700 1 -- 172.21.15.6:0/59915682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ce00119b0 con 0x7f0cf01050d0 2023-10-14T08:45:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0cf7899700 1 -- 172.21.15.6:0/59915682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 msgr2=0x7f0cf01054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0cf7899700 1 --2- 172.21.15.6:0/59915682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf01054f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00098a0 tx=0x7f0ce0009bb0 comp rx=0 tx=0).stop 2023-10-14T08:45:10.417 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0cf7899700 1 -- 172.21.15.6:0/59915682 shutdown_connections 2023-10-14T08:45:10.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0cf7899700 1 --2- 172.21.15.6:0/59915682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf01054f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:10.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.726+0000 7f0cf7899700 1 -- 172.21.15.6:0/59915682 >> 172.21.15.6:0/59915682 conn(0x7f0cf0100cb0 msgr2=0x7f0cf01030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:10.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf7899700 1 -- 172.21.15.6:0/59915682 shutdown_connections 2023-10-14T08:45:10.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf7899700 1 -- 172.21.15.6:0/59915682 wait complete. 2023-10-14T08:45:10.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf7899700 1 Processor -- start 2023-10-14T08:45:10.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf7899700 1 -- start start 2023-10-14T08:45:10.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf7899700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:10.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf7899700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf019cbe0 con 0x7f0cf01050d0 2023-10-14T08:45:10.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf5635700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:10.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.727+0000 7f0cf5635700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58322/0 (socket says 172.21.15.6:58322) 2023-10-14T08:45:10.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0cf5635700 1 -- 172.21.15.6:0/1302007675 learned_addr learned my addr 172.21.15.6:0/1302007675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:10.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0cf5635700 1 -- 172.21.15.6:0/1302007675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0009550 con 0x7f0cf01050d0 2023-10-14T08:45:10.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0cf5635700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf019c6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0011980 tx=0x7f0ce0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:10.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ce0003a60 con 0x7f0cf01050d0 2023-10-14T08:45:10.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ce0003bc0 con 0x7f0cf01050d0 2023-10-14T08:45:10.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf019cde0 con 0x7f0cf01050d0 2023-10-14T08:45:10.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ce001a670 con 0x7f0cf01050d0 2023-10-14T08:45:10.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.728+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf019d200 con 0x7f0cf01050d0 2023-10-14T08:45:10.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.729+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 45592+0+0 (secure 0 0 0) 0x7f0ce0024a00 con 0x7f0cf01050d0 2023-10-14T08:45:10.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.729+0000 7f0ce67fc700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0cdc038870 0x7f0cdc03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:10.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.729+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf0195f50 con 0x7f0cf01050d0 2023-10-14T08:45:10.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.729+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0ce004ca60 con 0x7f0cf01050d0 2023-10-14T08:45:10.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.729+0000 7f0cf4e34700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0cdc038870 0x7f0cdc03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:10.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.730+0000 7f0cf4e34700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0cdc038870 0x7f0cdc03ad30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0cec006fd0 tx=0x7f0cec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:10.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.734+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ce00189a0 con 0x7f0cf01050d0 2023-10-14T08:45:10.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:09.907+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f0ce002d910 con 0x7f0cf01050d0 2023-10-14T08:45:10.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.096+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0cf0106bc0 con 0x7f0cf01050d0 2023-10-14T08:45:10.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.097+0000 7f0ce67fc700 1 -- 172.21.15.6:0/1302007675 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0cf0106bc0 con 0x7f0cf01050d0 2023-10-14T08:45:10.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0cdc038870 msgr2=0x7f0cdc03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:10.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0cdc038870 0x7f0cdc03ad30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0cec006fd0 tx=0x7f0cec006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:10.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 msgr2=0x7f0cf019c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:10.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf019c6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0011980 tx=0x7f0ce0011a60 comp rx=0 tx=0).stop 2023-10-14T08:45:10.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 shutdown_connections 2023-10-14T08:45:10.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0cdc038870 0x7f0cdc03ad30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:10.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 --2- 172.21.15.6:0/1302007675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf01050d0 0x7f0cf019c6a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:10.425 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 >> 172.21.15.6:0/1302007675 conn(0x7f0cf0100cb0 msgr2=0x7f0cf0190c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:10.425 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 shutdown_connections 2023-10-14T08:45:10.425 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.099+0000 7f0cf7899700 1 -- 172.21.15.6:0/1302007675 wait complete. 2023-10-14T08:45:11.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:10 smithi006 ceph-mon[99452]: mgrmap e13: x(active, since 6s) 2023-10-14T08:45:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.906+0000 7faad6856700 1 Processor -- start 2023-10-14T08:45:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.906+0000 7faad6856700 1 -- start start 2023-10-14T08:45:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.906+0000 7faad6856700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad01096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:11.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.906+0000 7faad6856700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad0079e70 con 0x7faad01072c0 2023-10-14T08:45:11.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.906+0000 7faacffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad01096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:11.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.907+0000 7faacffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad01096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58326/0 (socket says 172.21.15.6:58326) 2023-10-14T08:45:11.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.907+0000 7faacffff700 1 -- 172.21.15.6:0/3041768736 learned_addr learned my addr 172.21.15.6:0/3041768736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.907+0000 7faacffff700 1 -- 172.21.15.6:0/3041768736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0109bf0 con 0x7faad01072c0 2023-10-14T08:45:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.907+0000 7faacffff700 1 --2- 172.21.15.6:0/3041768736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad01096b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faac00098a0 tx=0x7faac0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb6535f975eac58 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.908+0000 7faacf7fe700 1 -- 172.21.15.6:0/3041768736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac0004160 con 0x7faad01072c0 2023-10-14T08:45:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.908+0000 7faacf7fe700 1 -- 172.21.15.6:0/3041768736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faac00042c0 con 0x7faad01072c0 2023-10-14T08:45:11.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.908+0000 7faacf7fe700 1 -- 172.21.15.6:0/3041768736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac00119b0 con 0x7faad01072c0 2023-10-14T08:45:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 -- 172.21.15.6:0/3041768736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 msgr2=0x7faad01096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 --2- 172.21.15.6:0/3041768736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad01096b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faac00098a0 tx=0x7faac0009bb0 comp rx=0 tx=0).stop 2023-10-14T08:45:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 -- 172.21.15.6:0/3041768736 shutdown_connections 2023-10-14T08:45:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 --2- 172.21.15.6:0/3041768736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad01096b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 -- 172.21.15.6:0/3041768736 >> 172.21.15.6:0/3041768736 conn(0x7faad0100cb0 msgr2=0x7faad01030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:11.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 -- 172.21.15.6:0/3041768736 shutdown_connections 2023-10-14T08:45:11.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.909+0000 7faad6856700 1 -- 172.21.15.6:0/3041768736 wait complete. 2023-10-14T08:45:11.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faad6856700 1 Processor -- start 2023-10-14T08:45:11.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faad6856700 1 -- start start 2023-10-14T08:45:11.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faad6856700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:11.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faad6856700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad019a9b0 con 0x7faad01072c0 2023-10-14T08:45:11.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faacffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:11.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faacffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58328/0 (socket says 172.21.15.6:58328) 2023-10-14T08:45:11.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faacffff700 1 -- 172.21.15.6:0/1066011796 learned_addr learned my addr 172.21.15.6:0/1066011796 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:11.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faacffff700 1 -- 172.21.15.6:0/1066011796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009550 con 0x7faad01072c0 2023-10-14T08:45:11.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.910+0000 7faacffff700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad019a470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faac0011980 tx=0x7faac0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:11.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.911+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac0003a60 con 0x7faad01072c0 2023-10-14T08:45:11.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.911+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faac0003bc0 con 0x7faad01072c0 2023-10-14T08:45:11.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.911+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad019abb0 con 0x7faad01072c0 2023-10-14T08:45:11.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.911+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faac001a670 con 0x7faad01072c0 2023-10-14T08:45:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.911+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad019afd0 con 0x7faad01072c0 2023-10-14T08:45:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.912+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad00624e0 con 0x7faad01072c0 2023-10-14T08:45:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.912+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7faac0024a00 con 0x7faad01072c0 2023-10-14T08:45:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.912+0000 7faacdffb700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faabc038910 0x7faabc03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.912+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faac004cb20 con 0x7faad01072c0 2023-10-14T08:45:11.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.912+0000 7faac7fff700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faabc038910 0x7faabc03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:11.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.913+0000 7faac7fff700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faabc038910 0x7faabc03add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faab8006fd0 tx=0x7faab8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:11.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:10.917+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faac0024440 con 0x7faad01072c0 2023-10-14T08:45:11.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.493+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7faad019da10 con 0x7faad01072c0 2023-10-14T08:45:11.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.496+0000 7faacdffb700 1 -- 172.21.15.6:0/1066011796 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7faac0018350 con 0x7faad01072c0 2023-10-14T08:45:11.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faabc038910 msgr2=0x7faabc03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:11.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faabc038910 0x7faabc03add0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faab8006fd0 tx=0x7faab8006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:11.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 msgr2=0x7faad019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:11.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad019a470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faac0011980 tx=0x7faac0011a60 comp rx=0 tx=0).stop 2023-10-14T08:45:11.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 shutdown_connections 2023-10-14T08:45:11.870 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faabc038910 0x7faabc03add0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:11.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 --2- 172.21.15.6:0/1066011796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faad01072c0 0x7faad019a470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:11.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 >> 172.21.15.6:0/1066011796 conn(0x7faad0100cb0 msgr2=0x7faad0101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:11.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 shutdown_connections 2023-10-14T08:45:11.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-10-14T08:45:11.498+0000 7faad6856700 1 -- 172.21.15.6:0/1066011796 wait complete. 2023-10-14T08:45:11.871 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-14T08:45:11.872 INFO:teuthology.orchestra.run.smithi006.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-14T08:45:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.872 INFO:teuthology.orchestra.run.smithi006.stdout:Or, if you are only running a single cluster on this host: 2023-10-14T08:45:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-14T08:45:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.873 INFO:teuthology.orchestra.run.smithi006.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-14T08:45:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: ceph telemetry on 2023-10-14T08:45:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:For more information see: 2023-10-14T08:45:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-14T08:45:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:11.875 INFO:teuthology.orchestra.run.smithi006.stdout:Bootstrap complete. 2023-10-14T08:45:11.898 INFO:tasks.cephadm:Fetching config... 2023-10-14T08:45:11.898 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:45:11.898 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-14T08:45:11.917 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-14T08:45:11.917 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:45:11.918 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-14T08:45:11.976 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-14T08:45:11.976 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:45:11.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-14T08:45:12.044 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-14T08:45:12.045 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:45:12.045 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-14T08:45:12.101 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-14T08:45:12.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-14T08:45:12.182 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:12.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-14T08:45:12.245 INFO:teuthology.orchestra.run.smithi057.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:12.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-14T08:45:12.306 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYwe0vBgI8viJf+5bbqBkrykvVB4CbmLzKGrnS+7rcrqx57pteTpzGMAON027Io5tqP0BOUiqEwT2lW3OS53aEn6imI7XAnRaPSsdy4TCNUKSe/H3jIrUJZOJl+oaCQYhA4CfyTU+CYl78sIO2dOO0AadvZSGPYWrWL0KDUROMUfMhRjMR978gC0s9RvfFxU5o3sfIs21/4HQ2JvCSezcknxhK1F6IZ3xCUTX5tdBBIkodSyiE0iKpU1+qNGNb1p8fhyeRttfjgo7+y6dDbvm2CcG+F+dpLaXyIhrjyytxmrYmnQQExCkPNro7tKaYbmCxsmS9WoYTRvDJNdtiNYw9S1xpGYKQaPJHuhkJSUe8UN3WrNfb3mEooWtB8Ao8qOCg7f9J2YbPitedXt2Y0/phy7wHWcbXHpC2/YydqQzEYcCAEDELl0X948W3kCNzXsbUgnnBt+cZ72ybcT5wIOTXPfTdkIbKS2Ok1BDav1M1wWWdAKQ4/7BUVk6ScsaFm4M= ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:12.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-14T08:45:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:12.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1066011796' entity='client.admin' 2023-10-14T08:45:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/700572412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 msgr2=0x7f0c941013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 --2- 172.21.15.6:0/700572412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c941013e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009910 tx=0x7f0c90009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/700572412 shutdown_connections 2023-10-14T08:45:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 --2- 172.21.15.6:0/700572412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c941013e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/700572412 >> 172.21.15.6:0/700572412 conn(0x7f0c940fae80 msgr2=0x7f0c940fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:14.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/700572412 shutdown_connections 2023-10-14T08:45:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.465+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/700572412 wait complete. 2023-10-14T08:45:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9c5bb700 1 Processor -- start 2023-10-14T08:45:14.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9c5bb700 1 -- start start 2023-10-14T08:45:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9c5bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c94068c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:14.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9c5bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941988e0 con 0x7f0c94100fc0 2023-10-14T08:45:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9a357700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c94068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9a357700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c94068c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58334/0 (socket says 172.21.15.6:58334) 2023-10-14T08:45:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9a357700 1 -- 172.21.15.6:0/718561431 learned_addr learned my addr 172.21.15.6:0/718561431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.466+0000 7f0c9a357700 1 -- 172.21.15.6:0/718561431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900095f0 con 0x7f0c94100fc0 2023-10-14T08:45:14.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.467+0000 7f0c9a357700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c94068c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c90004f40 tx=0x7f0c900057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.467+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c9001d070 con 0x7f0c94100fc0 2023-10-14T08:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.467+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c9000bc10 con 0x7f0c94100fc0 2023-10-14T08:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.467+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c94198a20 con 0x7f0c94100fc0 2023-10-14T08:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.467+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c90003a70 con 0x7f0c94100fc0 2023-10-14T08:45:14.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.467+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c94198ec0 con 0x7f0c94100fc0 2023-10-14T08:45:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.468+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9418e4f0 con 0x7f0c94100fc0 2023-10-14T08:45:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.468+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f0c90003ce0 con 0x7f0c94100fc0 2023-10-14T08:45:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.469+0000 7f0c8b7fe700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c80038910 0x7f0c8003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:14.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.469+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c9004ca20 con 0x7f0c94100fc0 2023-10-14T08:45:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.469+0000 7f0c99b56700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c80038910 0x7f0c8003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.469+0000 7f0c99b56700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c80038910 0x7f0c8003add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006fd0 tx=0x7f0c84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:14.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.473+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c90021c00 con 0x7f0c94100fc0 2023-10-14T08:45:14.664 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:14.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:14.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:14.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:14.665 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:14.666 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:14.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.710+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f0c94105a00 con 0x7f0c94100fc0 2023-10-14T08:45:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.713+0000 7f0c8b7fe700 1 -- 172.21.15.6:0/718561431 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0c90026030 con 0x7f0c94100fc0 2023-10-14T08:45:14.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c80038910 msgr2=0x7f0c8003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:14.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c80038910 0x7f0c8003add0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006fd0 tx=0x7f0c84006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:14.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 msgr2=0x7f0c94068c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:14.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c94068c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c90004f40 tx=0x7f0c900057c0 comp rx=0 tx=0).stop 2023-10-14T08:45:14.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 shutdown_connections 2023-10-14T08:45:14.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c80038910 0x7f0c8003add0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:14.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.715+0000 7f0c9c5bb700 1 --2- 172.21.15.6:0/718561431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c94100fc0 0x7f0c94068c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:14.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.716+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 >> 172.21.15.6:0/718561431 conn(0x7f0c940fae80 msgr2=0x7f0c940fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:14.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.716+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 shutdown_connections 2023-10-14T08:45:14.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:14.716+0000 7f0c9c5bb700 1 -- 172.21.15.6:0/718561431 wait complete. 2023-10-14T08:45:15.159 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-14T08:45:15.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-14T08:45:15.781 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:15.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:15 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/718561431' entity='client.admin' 2023-10-14T08:45:15.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:15.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.004+0000 7f158b527700 1 -- 172.21.15.6:0/3493549415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 msgr2=0x7f15840ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.004+0000 7f158b527700 1 --2- 172.21.15.6:0/3493549415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15840ffcf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1580009910 tx=0x7f1580009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.004+0000 7f158b527700 1 -- 172.21.15.6:0/3493549415 shutdown_connections 2023-10-14T08:45:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.004+0000 7f158b527700 1 --2- 172.21.15.6:0/3493549415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15840ffcf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.004+0000 7f158b527700 1 -- 172.21.15.6:0/3493549415 >> 172.21.15.6:0/3493549415 conn(0x7f15840fae50 msgr2=0x7f15840fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.005+0000 7f158b527700 1 -- 172.21.15.6:0/3493549415 shutdown_connections 2023-10-14T08:45:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.005+0000 7f158b527700 1 -- 172.21.15.6:0/3493549415 wait complete. 2023-10-14T08:45:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f158b527700 1 Processor -- start 2023-10-14T08:45:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f158b527700 1 -- start start 2023-10-14T08:45:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f158b527700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15841949e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f158b527700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584194f20 con 0x7f15840ff8d0 2023-10-14T08:45:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f15892c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15841949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f15892c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15841949e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58340/0 (socket says 172.21.15.6:58340) 2023-10-14T08:45:17.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f15892c3700 1 -- 172.21.15.6:0/506075347 learned_addr learned my addr 172.21.15.6:0/506075347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f15892c3700 1 -- 172.21.15.6:0/506075347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15800095f0 con 0x7f15840ff8d0 2023-10-14T08:45:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.006+0000 7f15892c3700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15841949e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1580006010 tx=0x7f15800057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.007+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f158001d070 con 0x7f15840ff8d0 2023-10-14T08:45:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.007+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15800044e0 con 0x7f15840ff8d0 2023-10-14T08:45:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.007+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15800039b0 con 0x7f15840ff8d0 2023-10-14T08:45:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.007+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584195120 con 0x7f15840ff8d0 2023-10-14T08:45:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.007+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1584195560 con 0x7f15840ff8d0 2023-10-14T08:45:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.008+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158418e3e0 con 0x7f15840ff8d0 2023-10-14T08:45:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.008+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f158000baf0 con 0x7f15840ff8d0 2023-10-14T08:45:17.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.008+0000 7f15767fc700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1570038910 0x7f157003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.008+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f158004cdd0 con 0x7f15840ff8d0 2023-10-14T08:45:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.008+0000 7f1588ac2700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1570038910 0x7f157003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:17.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.009+0000 7f1588ac2700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1570038910 0x7f157003add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1578006fd0 tx=0x7f1578006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:17.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.013+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f158000e9d0 con 0x7f15840ff8d0 2023-10-14T08:45:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.216+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f158402d160 con 0x7f1570038910 2023-10-14T08:45:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.219+0000 7f15767fc700 1 -- 172.21.15.6:0/506075347 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f158402d160 con 0x7f1570038910 2023-10-14T08:45:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1570038910 msgr2=0x7f157003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1570038910 0x7f157003add0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1578006fd0 tx=0x7f1578006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 msgr2=0x7f15841949e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15841949e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1580006010 tx=0x7f15800057c0 comp rx=0 tx=0).stop 2023-10-14T08:45:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 shutdown_connections 2023-10-14T08:45:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1570038910 0x7f157003add0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 --2- 172.21.15.6:0/506075347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15840ff8d0 0x7f15841949e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 >> 172.21.15.6:0/506075347 conn(0x7f15840fae50 msgr2=0x7f15840fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 shutdown_connections 2023-10-14T08:45:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:17.221+0000 7f158b527700 1 -- 172.21.15.6:0/506075347 wait complete. 2023-10-14T08:45:17.744 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi057 2023-10-14T08:45:17.745 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:45:17.745 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/etc/ceph/ceph.conf 2023-10-14T08:45:17.767 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:45:17.767 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:17.827 INFO:tasks.cephadm:Adding host smithi057 to orchestrator... 2023-10-14T08:45:17.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi057 2023-10-14T08:45:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:18.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:18.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:18.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:18.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:18.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:18.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: Updating smithi006:/etc/ceph/ceph.conf 2023-10-14T08:45:18.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: Updating smithi006:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:18.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:18.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:18 smithi006 ceph-mon[99452]: Updating smithi006:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 -- 172.21.15.6:0/3717408693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 msgr2=0x7f16dc105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 --2- 172.21.15.6:0/3717408693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc105c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009910 tx=0x7f16cc009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 -- 172.21.15.6:0/3717408693 shutdown_connections 2023-10-14T08:45:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 --2- 172.21.15.6:0/3717408693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc105c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 -- 172.21.15.6:0/3717408693 >> 172.21.15.6:0/3717408693 conn(0x7f16dc075370 msgr2=0x7f16dc075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 -- 172.21.15.6:0/3717408693 shutdown_connections 2023-10-14T08:45:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.601+0000 7f16e433a700 1 -- 172.21.15.6:0/3717408693 wait complete. 2023-10-14T08:45:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e433a700 1 Processor -- start 2023-10-14T08:45:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e433a700 1 -- start start 2023-10-14T08:45:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e433a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e433a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc198530 con 0x7f16dc105860 2023-10-14T08:45:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e20d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e20d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58346/0 (socket says 172.21.15.6:58346) 2023-10-14T08:45:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e20d6700 1 -- 172.21.15.6:0/2809737201 learned_addr learned my addr 172.21.15.6:0/2809737201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e20d6700 1 -- 172.21.15.6:0/2809737201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0095f0 con 0x7f16dc105860 2023-10-14T08:45:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.602+0000 7f16e20d6700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc197ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16cc006010 tx=0x7f16cc004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.603+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16cc01d070 con 0x7f16dc105860 2023-10-14T08:45:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.603+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16cc00bbb0 con 0x7f16dc105860 2023-10-14T08:45:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.603+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16cc003930 con 0x7f16dc105860 2023-10-14T08:45:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.603+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc198790 con 0x7f16dc105860 2023-10-14T08:45:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.603+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc198c10 con 0x7f16dc105860 2023-10-14T08:45:19.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.604+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f16cc003b70 con 0x7f16dc105860 2023-10-14T08:45:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.604+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc0624e0 con 0x7f16dc105860 2023-10-14T08:45:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.604+0000 7f16d37fe700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16c80388c0 0x7f16c803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.604+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f16cc04c630 con 0x7f16dc105860 2023-10-14T08:45:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.604+0000 7f16e18d5700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16c80388c0 0x7f16c803ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:19.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.604+0000 7f16e18d5700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16c80388c0 0x7f16c803ad80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f16d8006fd0 tx=0x7f16d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:19.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.609+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f16cc029540 con 0x7f16dc105860 2023-10-14T08:45:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:19.816+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi057", "target": ["mon-mgr", ""]}) v1 -- 0x7f16dc0008d0 con 0x7f16c80388c0 2023-10-14T08:45:20.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:20 smithi006 ceph-mon[99452]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi057", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:22.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:22 smithi006 ceph-mon[99452]: Deploying cephadm binary to smithi057 2023-10-14T08:45:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.802+0000 7f16d37fe700 1 -- 172.21.15.6:0/2809737201 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f16dc0008d0 con 0x7f16c80388c0 2023-10-14T08:45:22.804 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi057' with addr '172.21.15.57' 2023-10-14T08:45:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.804+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16c80388c0 msgr2=0x7f16c803ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.804+0000 7f16e433a700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16c80388c0 0x7f16c803ad80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f16d8006fd0 tx=0x7f16d8006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.804+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 msgr2=0x7f16dc197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.804+0000 7f16e433a700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc197ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16cc006010 tx=0x7f16cc004ff0 comp rx=0 tx=0).stop 2023-10-14T08:45:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.805+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 shutdown_connections 2023-10-14T08:45:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.805+0000 7f16e433a700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16c80388c0 0x7f16c803ad80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.805+0000 7f16e433a700 1 --2- 172.21.15.6:0/2809737201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16dc105860 0x7f16dc197ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.805+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 >> 172.21.15.6:0/2809737201 conn(0x7f16dc075370 msgr2=0x7f16dc0689b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.805+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 shutdown_connections 2023-10-14T08:45:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:22.805+0000 7f16e433a700 1 -- 172.21.15.6:0/2809737201 wait complete. 2023-10-14T08:45:23.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-14T08:45:23.828 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:24.064 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:24.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:23 smithi006 ceph-mon[99452]: Added host smithi057 2023-10-14T08:45:24.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:24.065 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 -- 172.21.15.6:0/1278000381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 msgr2=0x7fb590105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 --2- 172.21.15.6:0/1278000381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590105c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb580009910 tx=0x7fb580009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 -- 172.21.15.6:0/1278000381 shutdown_connections 2023-10-14T08:45:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 --2- 172.21.15.6:0/1278000381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590105c40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 -- 172.21.15.6:0/1278000381 >> 172.21.15.6:0/1278000381 conn(0x7fb590075370 msgr2=0x7fb590075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 -- 172.21.15.6:0/1278000381 shutdown_connections 2023-10-14T08:45:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.038+0000 7fb59508b700 1 -- 172.21.15.6:0/1278000381 wait complete. 2023-10-14T08:45:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.039+0000 7fb59508b700 1 Processor -- start 2023-10-14T08:45:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.039+0000 7fb59508b700 1 -- start start 2023-10-14T08:45:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.039+0000 7fb59508b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.039+0000 7fb59508b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590198540 con 0x7fb590105860 2023-10-14T08:45:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb58ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb58ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58372/0 (socket says 172.21.15.6:58372) 2023-10-14T08:45:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb58ed9d700 1 -- 172.21.15.6:0/2351123090 learned_addr learned my addr 172.21.15.6:0/2351123090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb58ed9d700 1 -- 172.21.15.6:0/2351123090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800095f0 con 0x7fb590105860 2023-10-14T08:45:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb58ed9d700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590198000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb580006010 tx=0x7fb580004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb58001d070 con 0x7fb590105860 2023-10-14T08:45:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb58000bbb0 con 0x7fb590105860 2023-10-14T08:45:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5901987a0 con 0x7fb590105860 2023-10-14T08:45:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb580003930 con 0x7fb590105860 2023-10-14T08:45:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.040+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb590198c20 con 0x7fb590105860 2023-10-14T08:45:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.041+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fb580003b20 con 0x7fb590105860 2023-10-14T08:45:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.041+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5900624e0 con 0x7fb590105860 2023-10-14T08:45:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.041+0000 7fb587fff700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb57c038910 0x7fb57c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.041+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb58004c740 con 0x7fb590105860 2023-10-14T08:45:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.042+0000 7fb58e59c700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb57c038910 0x7fb57c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.042+0000 7fb58e59c700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb57c038910 0x7fb57c03add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb578006fd0 tx=0x7fb578006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.047+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb580029950 con 0x7fb590105860 2023-10-14T08:45:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:24 smithi006 ceph-mon[99452]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:25.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.253+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5900008d0 con 0x7fb57c038910 2023-10-14T08:45:25.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.254+0000 7fb587fff700 1 -- 172.21.15.6:0/2351123090 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7fb5900008d0 con 0x7fb57c038910 2023-10-14T08:45:25.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:25.256 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}] 2023-10-14T08:45:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb57c038910 msgr2=0x7fb57c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb57c038910 0x7fb57c03add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb578006fd0 tx=0x7fb578006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 msgr2=0x7fb590198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590198000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb580006010 tx=0x7fb580004ff0 comp rx=0 tx=0).stop 2023-10-14T08:45:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 shutdown_connections 2023-10-14T08:45:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb57c038910 0x7fb57c03add0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 --2- 172.21.15.6:0/2351123090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb590105860 0x7fb590198000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.256+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 >> 172.21.15.6:0/2351123090 conn(0x7fb590075370 msgr2=0x7fb590068970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.257+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 shutdown_connections 2023-10-14T08:45:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:25.257+0000 7fb59508b700 1 -- 172.21.15.6:0/2351123090 wait complete. 2023-10-14T08:45:25.677 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2023-10-14T08:45:25.678 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:45:25.678 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2023-10-14T08:45:25.699 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:45:25.699 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:25.759 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2023-10-14T08:45:25.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch host add smithi178 2023-10-14T08:45:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:26 smithi006 ceph-mon[99452]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:45:26.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:26 smithi006 ceph-mon[99452]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:27.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 -- 172.21.15.6:0/2009825277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 msgr2=0x7fd6c8105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:27.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 --2- 172.21.15.6:0/2009825277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8105c40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009910 tx=0x7fd6b8009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:27.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 -- 172.21.15.6:0/2009825277 shutdown_connections 2023-10-14T08:45:27.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 --2- 172.21.15.6:0/2009825277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8105c40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 -- 172.21.15.6:0/2009825277 >> 172.21.15.6:0/2009825277 conn(0x7fd6c8075370 msgr2=0x7fd6c8075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 -- 172.21.15.6:0/2009825277 shutdown_connections 2023-10-14T08:45:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.472+0000 7fd6ccb29700 1 -- 172.21.15.6:0/2009825277 wait complete. 2023-10-14T08:45:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6ccb29700 1 Processor -- start 2023-10-14T08:45:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6ccb29700 1 -- start start 2023-10-14T08:45:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6ccb29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8194d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6ccb29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c8195250 con 0x7fd6c8105860 2023-10-14T08:45:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6c659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8194d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6c659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8194d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58378/0 (socket says 172.21.15.6:58378) 2023-10-14T08:45:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.473+0000 7fd6c659c700 1 -- 172.21.15.6:0/869370949 learned_addr learned my addr 172.21.15.6:0/869370949 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6c659c700 1 -- 172.21.15.6:0/869370949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80095f0 con 0x7fd6c8105860 2023-10-14T08:45:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6c659c700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8194d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8004f40 tx=0x7fd6b8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6b801f070 con 0x7fd6c8105860 2023-10-14T08:45:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6b8004370 con 0x7fd6c8105860 2023-10-14T08:45:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c8195450 con 0x7fd6c8105860 2023-10-14T08:45:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c81958d0 con 0x7fd6c8105860 2023-10-14T08:45:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.474+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6b8003970 con 0x7fd6c8105860 2023-10-14T08:45:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.475+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fd6b8003be0 con 0x7fd6c8105860 2023-10-14T08:45:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.475+0000 7fd6bffff700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd6b4038910 0x7fd6b403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.475+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8005320 con 0x7fd6c8105860 2023-10-14T08:45:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.475+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd6b804f770 con 0x7fd6c8105860 2023-10-14T08:45:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.475+0000 7fd6bdd9b700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd6b4038910 0x7fd6b403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.476+0000 7fd6bdd9b700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd6b4038910 0x7fd6b403add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0006fd0 tx=0x7fd6b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.480+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd6b8028070 con 0x7fd6c8105860 2023-10-14T08:45:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:27.683+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6a8000bf0 con 0x7fd6b4038910 2023-10-14T08:45:28.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:28.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:28.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:28.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:28.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:28.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:28.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:28.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:28.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:29 smithi006 ceph-mon[99452]: Updating smithi057:/etc/ceph/ceph.conf 2023-10-14T08:45:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:29 smithi006 ceph-mon[99452]: Deploying cephadm binary to smithi178 2023-10-14T08:45:29.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:29 smithi006 ceph-mon[99452]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:29.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:29 smithi006 ceph-mon[99452]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.680+0000 7fd6bffff700 1 -- 172.21.15.6:0/869370949 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd6a8000bf0 con 0x7fd6b4038910 2023-10-14T08:45:30.682 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi178' with addr '172.21.15.178' 2023-10-14T08:45:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd6b4038910 msgr2=0x7fd6b403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd6b4038910 0x7fd6b403add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0006fd0 tx=0x7fd6b0006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 msgr2=0x7fd6c8194d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8194d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8004f40 tx=0x7fd6b8005020 comp rx=0 tx=0).stop 2023-10-14T08:45:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 shutdown_connections 2023-10-14T08:45:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd6b4038910 0x7fd6b403add0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 --2- 172.21.15.6:0/869370949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6c8105860 0x7fd6c8194d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 >> 172.21.15.6:0/869370949 conn(0x7fd6c8075370 msgr2=0x7fd6c80fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 shutdown_connections 2023-10-14T08:45:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:30.682+0000 7fd6ccb29700 1 -- 172.21.15.6:0/869370949 wait complete. 2023-10-14T08:45:30.707 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:30 smithi006 ceph-mon[99452]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:31.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-14T08:45:31.658 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:31.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:31.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: Added host smithi178 2023-10-14T08:45:31.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:31.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 -- 172.21.15.6:0/3659646373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 msgr2=0x7f999c105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 --2- 172.21.15.6:0/3659646373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c105c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9990009910 tx=0x7f9990009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 -- 172.21.15.6:0/3659646373 shutdown_connections 2023-10-14T08:45:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 --2- 172.21.15.6:0/3659646373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c105c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 -- 172.21.15.6:0/3659646373 >> 172.21.15.6:0/3659646373 conn(0x7f999c075370 msgr2=0x7f999c075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 -- 172.21.15.6:0/3659646373 shutdown_connections 2023-10-14T08:45:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 -- 172.21.15.6:0/3659646373 wait complete. 2023-10-14T08:45:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 Processor -- start 2023-10-14T08:45:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.870+0000 7f99a31c5700 1 -- start start 2023-10-14T08:45:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a31c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a31c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c196360 con 0x7f999c105860 2023-10-14T08:45:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a0f61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a0f61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58404/0 (socket says 172.21.15.6:58404) 2023-10-14T08:45:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a0f61700 1 -- 172.21.15.6:0/2651061110 learned_addr learned my addr 172.21.15.6:0/2651061110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a0f61700 1 -- 172.21.15.6:0/2651061110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99900095f0 con 0x7f999c105860 2023-10-14T08:45:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a0f61700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c195e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9990004f40 tx=0x7f9990005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f999001d070 con 0x7f999c105860 2023-10-14T08:45:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c1965c0 con 0x7f999c105860 2023-10-14T08:45:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9990004370 con 0x7f999c105860 2023-10-14T08:45:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9990003970 con 0x7f999c105860 2023-10-14T08:45:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.871+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c196a40 con 0x7f999c105860 2023-10-14T08:45:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.872+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f9990003c30 con 0x7f999c105860 2023-10-14T08:45:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.872+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c0624e0 con 0x7f999c105860 2023-10-14T08:45:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.872+0000 7f9999ffb700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f998c0388c0 0x7f998c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.873+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f999004c710 con 0x7f999c105860 2023-10-14T08:45:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.873+0000 7f999bfff700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f998c0388c0 0x7f998c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.873+0000 7f999bfff700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f998c0388c0 0x7f998c03ad80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:32.877+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f999002aba0 con 0x7f999c105860 2023-10-14T08:45:32.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:32 smithi006 ceph-mon[99452]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:32.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:33.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.085+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f999c0008d0 con 0x7f998c0388c0 2023-10-14T08:45:33.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.086+0000 7f9999ffb700 1 -- 172.21.15.6:0/2651061110 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f999c0008d0 con 0x7f998c0388c0 2023-10-14T08:45:33.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:45:33.088 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.57", "hostname": "smithi057", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}] 2023-10-14T08:45:33.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f998c0388c0 msgr2=0x7f998c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:33.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f998c0388c0 0x7f998c03ad80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 msgr2=0x7f999c195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c195e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9990004f40 tx=0x7f9990005020 comp rx=0 tx=0).stop 2023-10-14T08:45:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 shutdown_connections 2023-10-14T08:45:33.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f998c0388c0 0x7f998c03ad80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:33.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 --2- 172.21.15.6:0/2651061110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f999c105860 0x7f999c195e20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:33.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 >> 172.21.15.6:0/2651061110 conn(0x7f999c075370 msgr2=0x7f999c103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:33.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 shutdown_connections 2023-10-14T08:45:33.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:33.089+0000 7f99a31c5700 1 -- 172.21.15.6:0/2651061110 wait complete. 2023-10-14T08:45:33.516 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-14T08:45:33.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd crush tunables default 2023-10-14T08:45:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:34 smithi006 ceph-mon[99452]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:45:34.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:35.376 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:35 smithi006 ceph-mon[99452]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 -- 172.21.15.6:0/3754861685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 msgr2=0x7f58a4106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 --2- 172.21.15.6:0/3754861685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4106d40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009910 tx=0x7f58a0009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 -- 172.21.15.6:0/3754861685 shutdown_connections 2023-10-14T08:45:35.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 --2- 172.21.15.6:0/3754861685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4106d40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 -- 172.21.15.6:0/3754861685 >> 172.21.15.6:0/3754861685 conn(0x7f58a40fc470 msgr2=0x7f58a40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 -- 172.21.15.6:0/3754861685 shutdown_connections 2023-10-14T08:45:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.512+0000 7f58abd8f700 1 -- 172.21.15.6:0/3754861685 wait complete. 2023-10-14T08:45:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58abd8f700 1 Processor -- start 2023-10-14T08:45:35.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58abd8f700 1 -- start start 2023-10-14T08:45:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58abd8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58abd8f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4196350 con 0x7f58a4106960 2023-10-14T08:45:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58a9b2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58a9b2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58410/0 (socket says 172.21.15.6:58410) 2023-10-14T08:45:35.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.513+0000 7f58a9b2b700 1 -- 172.21.15.6:0/434919583 learned_addr learned my addr 172.21.15.6:0/434919583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:35.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f58a9b2b700 1 -- 172.21.15.6:0/434919583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00095f0 con 0x7f58a4106960 2023-10-14T08:45:35.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f58a9b2b700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4195e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58a0006010 tx=0x7f58a0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:35.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58a001d070 con 0x7f58a4106960 2023-10-14T08:45:35.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a41965b0 con 0x7f58a4106960 2023-10-14T08:45:35.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58a000bbb0 con 0x7f58a4106960 2023-10-14T08:45:35.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58a0003930 con 0x7f58a4106960 2023-10-14T08:45:35.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.514+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a4196a30 con 0x7f58a4106960 2023-10-14T08:45:35.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.515+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f58a0003b70 con 0x7f58a4106960 2023-10-14T08:45:35.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.515+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a40624e0 con 0x7f58a4106960 2023-10-14T08:45:35.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.515+0000 7f5896ffd700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58900388c0 0x7f589003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:35.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.515+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f58a004c630 con 0x7f58a4106960 2023-10-14T08:45:35.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.515+0000 7f58a932a700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58900388c0 0x7f589003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:35.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.516+0000 7f58a932a700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58900388c0 0x7f589003ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5898006fd0 tx=0x7f5898006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:35.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.521+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f58a0029540 con 0x7f58a4106960 2023-10-14T08:45:35.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:35.724+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f58a40008d0 con 0x7f58a4106960 2023-10-14T08:45:36.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.104+0000 7f5896ffd700 1 -- 172.21.15.6:0/434919583 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f58a0026020 con 0x7f58a4106960 2023-10-14T08:45:36.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58900388c0 msgr2=0x7f589003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:36.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58900388c0 0x7f589003ad80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5898006fd0 tx=0x7f5898006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:36.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 msgr2=0x7f58a4195e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4195e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58a0006010 tx=0x7f58a0004ff0 comp rx=0 tx=0).stop 2023-10-14T08:45:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 shutdown_connections 2023-10-14T08:45:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58900388c0 0x7f589003ad80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:36.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 --2- 172.21.15.6:0/434919583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58a4106960 0x7f58a4195e10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:36.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 >> 172.21.15.6:0/434919583 conn(0x7f58a40fc470 msgr2=0x7f58a4108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:36.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 shutdown_connections 2023-10-14T08:45:36.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:36.106+0000 7f58abd8f700 1 -- 172.21.15.6:0/434919583 wait complete. 2023-10-14T08:45:36.110 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-10-14T08:45:36.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/434919583' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-14T08:45:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:36.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:36.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:36.545 INFO:tasks.cephadm:Adding mon.a on smithi006 2023-10-14T08:45:36.545 INFO:tasks.cephadm:Adding mon.b on smithi057 2023-10-14T08:45:36.546 INFO:tasks.cephadm:Adding mon.c on smithi178 2023-10-14T08:45:36.546 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch apply mon '3;smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c' 2023-10-14T08:45:37.150 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:37.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:37.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: Updating smithi178:/etc/ceph/ceph.conf 2023-10-14T08:45:37.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/434919583' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-14T08:45:37.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:37.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:37.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:37.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:38.381 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 -- 172.21.15.178:0/727684555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 msgr2=0x7f7760105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:38.381 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 --2- 172.21.15.178:0/727684555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760105c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7750009910 tx=0x7f7750009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:38.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 -- 172.21.15.178:0/727684555 shutdown_connections 2023-10-14T08:45:38.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 --2- 172.21.15.178:0/727684555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760105c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:38.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 -- 172.21.15.178:0/727684555 >> 172.21.15.178:0/727684555 conn(0x7f7760075370 msgr2=0x7f7760075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:38.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 -- 172.21.15.178:0/727684555 shutdown_connections 2023-10-14T08:45:38.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.378+0000 7f7768138700 1 -- 172.21.15.178:0/727684555 wait complete. 2023-10-14T08:45:38.383 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7768138700 1 Processor -- start 2023-10-14T08:45:38.383 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7768138700 1 -- start start 2023-10-14T08:45:38.383 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7768138700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:38.383 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7768138700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7760196360 con 0x7f7760105860 2023-10-14T08:45:38.384 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7765ed4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:38.384 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7765ed4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.178:59512/0 (socket says 172.21.15.178:59512) 2023-10-14T08:45:38.384 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7765ed4700 1 -- 172.21.15.178:0/222248345 learned_addr learned my addr 172.21.15.178:0/222248345 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:45:38.384 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.379+0000 7f7765ed4700 1 -- 172.21.15.178:0/222248345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500095f0 con 0x7f7760105860 2023-10-14T08:45:38.385 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.380+0000 7f7765ed4700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760195e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7750004f40 tx=0x7f7750005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:38.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.380+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f775001d070 con 0x7f7760105860 2023-10-14T08:45:38.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.380+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77601965c0 con 0x7f7760105860 2023-10-14T08:45:38.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.380+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7760196a40 con 0x7f7760105860 2023-10-14T08:45:38.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.380+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7750004370 con 0x7f7760105860 2023-10-14T08:45:38.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.380+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77500038c0 con 0x7f7760105860 2023-10-14T08:45:38.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.381+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f775000b6f0 con 0x7f7760105860 2023-10-14T08:45:38.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.381+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7744005320 con 0x7f7760105860 2023-10-14T08:45:38.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.381+0000 7f7756ffd700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f774c0388c0 0x7f774c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:38.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.381+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f775004c5c0 con 0x7f7760105860 2023-10-14T08:45:38.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.381+0000 7f77656d3700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f774c0388c0 0x7f774c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:38.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.382+0000 7f77656d3700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f774c0388c0 0x7f774c03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f775c006fd0 tx=0x7f775c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:38.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.388+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f775002a590 con 0x7f7760105860 2023-10-14T08:45:38.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:38 smithi006 ceph-mon[99452]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:38.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:38 smithi006 ceph-mon[99452]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:38.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:38 smithi006 ceph-mon[99452]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:38.584 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.582+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f7744000ca0 con 0x7f774c0388c0 2023-10-14T08:45:38.592 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.591+0000 7f7756ffd700 1 -- 172.21.15.178:0/222248345 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7744000ca0 con 0x7f774c0388c0 2023-10-14T08:45:38.593 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mon update... 2023-10-14T08:45:38.594 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f774c0388c0 msgr2=0x7f774c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:38.595 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f774c0388c0 0x7f774c03ad80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f775c006fd0 tx=0x7f775c006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:38.595 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 msgr2=0x7f7760195e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:38.595 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760195e20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7750004f40 tx=0x7f7750005020 comp rx=0 tx=0).stop 2023-10-14T08:45:38.595 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 shutdown_connections 2023-10-14T08:45:38.595 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f774c0388c0 0x7f774c03ad80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:38.596 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 --2- 172.21.15.178:0/222248345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7760105860 0x7f7760195e20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:38.596 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.592+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 >> 172.21.15.178:0/222248345 conn(0x7f7760075370 msgr2=0x7f7760103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:38.596 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.593+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 shutdown_connections 2023-10-14T08:45:38.596 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:38.593+0000 7f7768138700 1 -- 172.21.15.178:0/222248345 wait complete. 2023-10-14T08:45:39.111 DEBUG:teuthology.orchestra.run.smithi057:mon.b> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.b.service 2023-10-14T08:45:39.114 DEBUG:teuthology.orchestra.run.smithi178:mon.c> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.c.service 2023-10-14T08:45:39.116 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-14T08:45:39.117 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-14T08:45:39.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:45:39.152 INFO:journalctl@ceph.mon.b.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:45:39.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:39.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:39.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:39.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:39.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:39.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:39.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:39.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:40.043 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:40.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:40 smithi006 ceph-mon[99452]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:40.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:40 smithi006 ceph-mon[99452]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c;count:3 2023-10-14T08:45:40.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:40 smithi006 ceph-mon[99452]: Deploying daemon mon.c on smithi178 2023-10-14T08:45:41.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:41 smithi006 ceph-mon[99452]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:41.831 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 -- 172.21.15.178:0/262832757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 msgr2=0x7f6b1c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:41.832 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 --2- 172.21.15.178:0/262832757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c106d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009910 tx=0x7f6b0c009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:41.832 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 -- 172.21.15.178:0/262832757 shutdown_connections 2023-10-14T08:45:41.832 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 --2- 172.21.15.178:0/262832757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c106d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:41.832 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 -- 172.21.15.178:0/262832757 >> 172.21.15.178:0/262832757 conn(0x7f6b1c0fc470 msgr2=0x7f6b1c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:41.833 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 -- 172.21.15.178:0/262832757 shutdown_connections 2023-10-14T08:45:41.833 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 -- 172.21.15.178:0/262832757 wait complete. 2023-10-14T08:45:41.833 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.829+0000 7f6b21ea1700 1 Processor -- start 2023-10-14T08:45:41.833 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b21ea1700 1 -- start start 2023-10-14T08:45:41.833 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b21ea1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:41.834 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b21ea1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c075130 con 0x7f6b1c106960 2023-10-14T08:45:41.836 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:41.836 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c0731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.178:59518/0 (socket says 172.21.15.178:59518) 2023-10-14T08:45:41.836 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b1b7fe700 1 -- 172.21.15.178:0/458540785 learned_addr learned my addr 172.21.15.178:0/458540785 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:45:41.836 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.830+0000 7f6b1b7fe700 1 -- 172.21.15.178:0/458540785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c0095f0 con 0x7f6b1c106960 2023-10-14T08:45:41.836 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.831+0000 7f6b1b7fe700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c0731b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c004f40 tx=0x7f6b0c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:41.837 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.831+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b0c01d070 con 0x7f6b1c106960 2023-10-14T08:45:41.837 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.831+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c0736f0 con 0x7f6b1c106960 2023-10-14T08:45:41.837 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.831+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b0c004370 con 0x7f6b1c106960 2023-10-14T08:45:41.837 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.831+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b0c0039b0 con 0x7f6b1c106960 2023-10-14T08:45:41.837 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.831+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c073b70 con 0x7f6b1c106960 2023-10-14T08:45:41.838 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.832+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c104c10 con 0x7f6b1c106960 2023-10-14T08:45:41.838 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.832+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f6b0c003c70 con 0x7f6b1c106960 2023-10-14T08:45:41.838 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.832+0000 7f6b18ff9700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6b04038910 0x7f6b0403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:41.838 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.832+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6b0c04cfa0 con 0x7f6b1c106960 2023-10-14T08:45:41.839 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.833+0000 7f6b1affd700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6b04038910 0x7f6b0403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:41.839 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.833+0000 7f6b1affd700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6b04038910 0x7f6b0403add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006fd0 tx=0x7f6b10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:41.839 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:41.838+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b0c015350 con 0x7f6b1c106960 2023-10-14T08:45:42.145 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.142+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6b1c0624e0 con 0x7f6b1c106960 2023-10-14T08:45:42.145 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.143+0000 7f6b18ff9700 1 -- 172.21.15.178:0/458540785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7f6b0c026070 con 0x7f6b1c106960 2023-10-14T08:45:42.146 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:45:42.146 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":1,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","modified":"2023-10-14T08:43:59.372762Z","created":"2023-10-14T08:43:59.372762Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-14T08:45:42.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.145+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6b04038910 msgr2=0x7f6b0403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:42.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.145+0000 7f6b21ea1700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6b04038910 0x7f6b0403add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006fd0 tx=0x7f6b10006e40 comp rx=0 tx=0).stop 2023-10-14T08:45:42.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.145+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 msgr2=0x7f6b1c0731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:42.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.145+0000 7f6b21ea1700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c0731b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c004f40 tx=0x7f6b0c005020 comp rx=0 tx=0).stop 2023-10-14T08:45:42.148 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.146+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 shutdown_connections 2023-10-14T08:45:42.149 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.146+0000 7f6b21ea1700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6b04038910 0x7f6b0403add0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:42.149 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.146+0000 7f6b21ea1700 1 --2- 172.21.15.178:0/458540785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b1c106960 0x7f6b1c0731b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:42.149 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.146+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 >> 172.21.15.178:0/458540785 conn(0x7f6b1c0fc470 msgr2=0x7f6b1c108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:42.149 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.146+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 shutdown_connections 2023-10-14T08:45:42.150 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:42.146+0000 7f6b21ea1700 1 -- 172.21.15.178:0/458540785 wait complete. 2023-10-14T08:45:42.150 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 1 2023-10-14T08:45:42.755 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 podman[103570]: 2023-10-14T08:45:43.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: set uid:gid to 167:167 (ceph:ceph) 2023-10-14T08:45:43.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev), process ceph-mon, pid 7 2023-10-14T08:45:43.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pidfile_write: ignore empty --pid-file 2023-10-14T08:45:43.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: load: jerasure load: lrc 2023-10-14T08:45:43.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: RocksDB version: 7.9.2 2023-10-14T08:45:43.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Git sha 0 2023-10-14T08:45:43.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Compile date 2023-10-13 13:48:46 2023-10-14T08:45:43.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: DB SUMMARY 2023-10-14T08:45:43.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: DB Session ID: 63PN8HD23ZCESLCI9NWQ 2023-10-14T08:45:43.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: CURRENT file: CURRENT 2023-10-14T08:45:43.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: IDENTITY file: IDENTITY 2023-10-14T08:45:43.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-14T08:45:43.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-14T08:45:43.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-14T08:45:43.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.error_if_exists: 0 2023-10-14T08:45:43.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.create_if_missing: 0 2023-10-14T08:45:43.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.paranoid_checks: 1 2023-10-14T08:45:43.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-14T08:45:43.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-14T08:45:43.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-14T08:45:43.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.env: 0x563675a2fda0 2023-10-14T08:45:43.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.fs: PosixFileSystem 2023-10-14T08:45:43.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.info_log: 0x563677e9d5e0 2023-10-14T08:45:43.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_file_opening_threads: 16 2023-10-14T08:45:43.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.statistics: (nil) 2023-10-14T08:45:43.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.use_fsync: 0 2023-10-14T08:45:43.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_log_file_size: 0 2023-10-14T08:45:43.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-14T08:45:43.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-14T08:45:43.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.keep_log_file_num: 1000 2023-10-14T08:45:43.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.recycle_log_file_num: 0 2023-10-14T08:45:43.142 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.allow_fallocate: 1 2023-10-14T08:45:43.142 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.allow_mmap_reads: 0 2023-10-14T08:45:43.142 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.allow_mmap_writes: 0 2023-10-14T08:45:43.142 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.use_direct_reads: 0 2023-10-14T08:45:43.142 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-14T08:45:43.143 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.create_missing_column_families: 0 2023-10-14T08:45:43.143 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.db_log_dir: 2023-10-14T08:45:43.143 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.wal_dir: 2023-10-14T08:45:43.143 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-14T08:45:43.143 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-14T08:45:43.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-14T08:45:43.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-14T08:45:43.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-14T08:45:43.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-14T08:45:43.144 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.advise_random_on_open: 1 2023-10-14T08:45:43.145 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.db_write_buffer_size: 0 2023-10-14T08:45:43.145 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.write_buffer_manager: 0x563677e55360 2023-10-14T08:45:43.145 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-14T08:45:43.145 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-14T08:45:43.146 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-14T08:45:43.146 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.rate_limiter: (nil) 2023-10-14T08:45:43.146 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-14T08:45:43.146 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.wal_recovery_mode: 2 2023-10-14T08:45:43.146 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.enable_thread_tracking: 0 2023-10-14T08:45:43.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.enable_pipelined_write: 0 2023-10-14T08:45:43.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.unordered_write: 0 2023-10-14T08:45:43.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-14T08:45:43.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-14T08:45:43.147 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-14T08:45:43.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-14T08:45:43.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.row_cache: None 2023-10-14T08:45:43.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.wal_filter: None 2023-10-14T08:45:43.148 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-14T08:45:43.149 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.allow_ingest_behind: 0 2023-10-14T08:45:43.149 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.two_write_queues: 0 2023-10-14T08:45:43.149 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.manual_wal_flush: 0 2023-10-14T08:45:43.149 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.wal_compression: 0 2023-10-14T08:45:43.149 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.atomic_flush: 0 2023-10-14T08:45:43.150 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-14T08:45:43.150 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-14T08:45:43.150 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-14T08:45:43.150 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.log_readahead_size: 0 2023-10-14T08:45:43.150 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-14T08:45:43.151 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.best_efforts_recovery: 0 2023-10-14T08:45:43.151 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-14T08:45:43.151 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-14T08:45:43.151 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.allow_data_in_errors: 0 2023-10-14T08:45:43.151 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.db_host_id: __hostname__ 2023-10-14T08:45:43.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-14T08:45:43.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_background_jobs: 2 2023-10-14T08:45:43.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_background_compactions: -1 2023-10-14T08:45:43.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_subcompactions: 1 2023-10-14T08:45:43.152 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-14T08:45:43.153 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-14T08:45:43.153 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-14T08:45:43.153 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_total_wal_size: 0 2023-10-14T08:45:43.153 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-14T08:45:43.154 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-14T08:45:43.154 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-14T08:45:43.154 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-14T08:45:43.154 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_open_files: -1 2023-10-14T08:45:43.155 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bytes_per_sync: 0 2023-10-14T08:45:43.155 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-14T08:45:43.155 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-14T08:45:43.155 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_readahead_size: 0 2023-10-14T08:45:43.156 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_background_flushes: -1 2023-10-14T08:45:43.156 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Compression algorithms supported: 2023-10-14T08:45:43.156 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-14T08:45:43.156 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kZSTD supported: 0 2023-10-14T08:45:43.156 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kXpressCompression supported: 0 2023-10-14T08:45:43.157 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kLZ4HCCompression supported: 1 2023-10-14T08:45:43.157 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kZlibCompression supported: 1 2023-10-14T08:45:43.157 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kSnappyCompression supported: 1 2023-10-14T08:45:43.157 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kLZ4Compression supported: 1 2023-10-14T08:45:43.157 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: kBZip2Compression supported: 0 2023-10-14T08:45:43.158 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-14T08:45:43.158 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-14T08:45:43.158 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-14T08:45:43.158 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-14T08:45:43.158 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-14T08:45:43.159 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.merge_operator: 2023-10-14T08:45:43.159 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_filter: None 2023-10-14T08:45:43.159 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_filter_factory: None 2023-10-14T08:45:43.159 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.sst_partitioner_factory: None 2023-10-14T08:45:43.160 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-14T08:45:43.160 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-14T08:45:43.160 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563677e9d6e0) 2023-10-14T08:45:43.161 INFO:journalctl@ceph.mon.c.smithi178.stdout: cache_index_and_filter_blocks: 1 2023-10-14T08:45:43.161 INFO:journalctl@ceph.mon.c.smithi178.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-14T08:45:43.161 INFO:journalctl@ceph.mon.c.smithi178.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-14T08:45:43.161 INFO:journalctl@ceph.mon.c.smithi178.stdout: pin_top_level_index_and_filter: 1 2023-10-14T08:45:43.161 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_type: 0 2023-10-14T08:45:43.162 INFO:journalctl@ceph.mon.c.smithi178.stdout: data_block_index_type: 0 2023-10-14T08:45:43.162 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_shortening: 1 2023-10-14T08:45:43.162 INFO:journalctl@ceph.mon.c.smithi178.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-14T08:45:43.162 INFO:journalctl@ceph.mon.c.smithi178.stdout: checksum: 4 2023-10-14T08:45:43.163 INFO:journalctl@ceph.mon.c.smithi178.stdout: no_block_cache: 0 2023-10-14T08:45:43.163 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache: 0x563677ef31f0 2023-10-14T08:45:43.163 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_name: BinnedLRUCache 2023-10-14T08:45:43.163 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_options: 2023-10-14T08:45:43.163 INFO:journalctl@ceph.mon.c.smithi178.stdout: capacity : 536870912 2023-10-14T08:45:43.164 INFO:journalctl@ceph.mon.c.smithi178.stdout: num_shard_bits : 4 2023-10-14T08:45:43.164 INFO:journalctl@ceph.mon.c.smithi178.stdout: strict_capacity_limit : 0 2023-10-14T08:45:43.164 INFO:journalctl@ceph.mon.c.smithi178.stdout: high_pri_pool_ratio: 0.000 2023-10-14T08:45:43.164 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_compressed: (nil) 2023-10-14T08:45:43.164 INFO:journalctl@ceph.mon.c.smithi178.stdout: persistent_cache: (nil) 2023-10-14T08:45:43.164 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_size: 4096 2023-10-14T08:45:43.165 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_size_deviation: 10 2023-10-14T08:45:43.165 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_restart_interval: 16 2023-10-14T08:45:43.165 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_block_restart_interval: 1 2023-10-14T08:45:43.165 INFO:journalctl@ceph.mon.c.smithi178.stdout: metadata_block_size: 4096 2023-10-14T08:45:43.166 INFO:journalctl@ceph.mon.c.smithi178.stdout: partition_filters: 0 2023-10-14T08:45:43.166 INFO:journalctl@ceph.mon.c.smithi178.stdout: use_delta_encoding: 1 2023-10-14T08:45:43.166 INFO:journalctl@ceph.mon.c.smithi178.stdout: filter_policy: bloomfilter 2023-10-14T08:45:43.166 INFO:journalctl@ceph.mon.c.smithi178.stdout: whole_key_filtering: 1 2023-10-14T08:45:43.166 INFO:journalctl@ceph.mon.c.smithi178.stdout: verify_compression: 0 2023-10-14T08:45:43.166 INFO:journalctl@ceph.mon.c.smithi178.stdout: read_amp_bytes_per_bit: 0 2023-10-14T08:45:43.167 INFO:journalctl@ceph.mon.c.smithi178.stdout: format_version: 5 2023-10-14T08:45:43.167 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_index_compression: 1 2023-10-14T08:45:43.167 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_align: 0 2023-10-14T08:45:43.167 INFO:journalctl@ceph.mon.c.smithi178.stdout: max_auto_readahead_size: 262144 2023-10-14T08:45:43.167 INFO:journalctl@ceph.mon.c.smithi178.stdout: prepopulate_block_cache: 0 2023-10-14T08:45:43.168 INFO:journalctl@ceph.mon.c.smithi178.stdout: initial_auto_readahead_size: 8192 2023-10-14T08:45:43.168 INFO:journalctl@ceph.mon.c.smithi178.stdout: num_file_reads_for_auto_readahead: 2 2023-10-14T08:45:43.168 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.write_buffer_size: 33554432 2023-10-14T08:45:43.168 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_write_buffer_number: 2 2023-10-14T08:45:43.168 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression: NoCompression 2023-10-14T08:45:43.169 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression: Disabled 2023-10-14T08:45:43.169 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.prefix_extractor: nullptr 2023-10-14T08:45:43.169 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-14T08:45:43.169 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.num_levels: 7 2023-10-14T08:45:43.169 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-14T08:45:43.170 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-14T08:45:43.170 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-14T08:45:43.170 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-14T08:45:43.170 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-14T08:45:43.171 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-14T08:45:43.171 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-14T08:45:43.171 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-14T08:45:43.171 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-14T08:45:43.171 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-14T08:45:43.172 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-14T08:45:43.172 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-14T08:45:43.172 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-14T08:45:43.172 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.level: 32767 2023-10-14T08:45:43.172 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.strategy: 0 2023-10-14T08:45:43.173 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-14T08:45:43.173 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-14T08:45:43.173 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-14T08:45:43.173 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-14T08:45:43.173 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.enabled: false 2023-10-14T08:45:43.174 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-14T08:45:43.174 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-14T08:45:43.174 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-14T08:45:43.174 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-14T08:45:43.174 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.target_file_size_base: 67108864 2023-10-14T08:45:43.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-14T08:45:43.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-14T08:45:43.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-14T08:45:43.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-14T08:45:43.175 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-14T08:45:43.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-14T08:45:43.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-14T08:45:43.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-14T08:45:43.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-14T08:45:43.176 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-14T08:45:43.177 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-14T08:45:43.177 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-14T08:45:43.177 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-14T08:45:43.177 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-14T08:45:43.177 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.arena_block_size: 1048576 2023-10-14T08:45:43.178 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-14T08:45:43.178 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-14T08:45:43.178 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.disable_auto_compactions: 0 2023-10-14T08:45:43.178 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-14T08:45:43.180 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-14T08:45:43.180 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-14T08:45:43.180 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-14T08:45:43.180 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-14T08:45:43.181 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-14T08:45:43.181 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-14T08:45:43.181 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-14T08:45:43.181 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-14T08:45:43.181 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-14T08:45:43.182 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.table_properties_collectors: 2023-10-14T08:45:43.182 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.inplace_update_support: 0 2023-10-14T08:45:43.182 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-14T08:45:43.182 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-14T08:45:43.182 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-14T08:45:43.183 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-14T08:45:43.183 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.bloom_locality: 0 2023-10-14T08:45:43.183 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.max_successive_merges: 0 2023-10-14T08:45:43.183 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-14T08:45:43.183 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.paranoid_file_checks: 0 2023-10-14T08:45:43.184 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.force_consistency_checks: 1 2023-10-14T08:45:43.184 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.report_bg_io_stats: 0 2023-10-14T08:45:43.184 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.ttl: 2592000 2023-10-14T08:45:43.184 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-14T08:45:43.184 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-14T08:45:43.185 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-14T08:45:43.185 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.enable_blob_files: false 2023-10-14T08:45:43.185 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.min_blob_size: 0 2023-10-14T08:45:43.185 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.blob_file_size: 268435456 2023-10-14T08:45:43.185 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-14T08:45:43.186 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-14T08:45:43.186 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-14T08:45:43.186 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-14T08:45:43.186 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-14T08:45:43.186 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.blob_file_starting_level: 0 2023-10-14T08:45:43.187 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-14T08:45:43.187 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-14T08:45:43.187 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-14T08:45:43.187 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9d733716-a03b-4070-bcc6-743f6f429744 2023-10-14T08:45:43.187 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273142834768, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-14T08:45:43.188 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-14T08:45:43.188 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273142835345, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697273142, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9d733716-a03b-4070-bcc6-743f6f429744", "db_session_id": "63PN8HD23ZCESLCI9NWQ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-14T08:45:43.188 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273142835434, "job": 1, "event": "recovery_finished"} 2023-10-14T08:45:43.188 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-14T08:45:43.188 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-14T08:45:43.189 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563677f90000 2023-10-14T08:45:43.189 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: DB pointer 0x563677f7c000 2023-10-14T08:45:43.189 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-14T08:45:43.189 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-14T08:45:43.189 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** DB Stats ** 2023-10-14T08:45:43.190 INFO:journalctl@ceph.mon.c.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-14T08:45:43.190 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-14T08:45:43.190 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-14T08:45:43.190 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-14T08:45:43.191 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-14T08:45:43.191 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-14T08:45:43.191 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-14T08:45:43.191 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2023-10-14T08:45:43.191 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** Compaction Stats [default] ** 2023-10-14T08:45:43.191 INFO:journalctl@ceph.mon.c.smithi178.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-14T08:45:43.192 INFO:journalctl@ceph.mon.c.smithi178.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-14T08:45:43.192 INFO:journalctl@ceph.mon.c.smithi178.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:43.192 INFO:journalctl@ceph.mon.c.smithi178.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:43.192 INFO:journalctl@ceph.mon.c.smithi178.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:43.192 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2023-10-14T08:45:43.193 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** Compaction Stats [default] ** 2023-10-14T08:45:43.193 INFO:journalctl@ceph.mon.c.smithi178.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-14T08:45:43.193 INFO:journalctl@ceph.mon.c.smithi178.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-14T08:45:43.193 INFO:journalctl@ceph.mon.c.smithi178.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:43.193 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2023-10-14T08:45:43.194 INFO:journalctl@ceph.mon.c.smithi178.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-14T08:45:43.194 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2023-10-14T08:45:43.194 INFO:journalctl@ceph.mon.c.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-14T08:45:43.195 INFO:journalctl@ceph.mon.c.smithi178.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-14T08:45:43.195 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-14T08:45:43.195 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-14T08:45:43.195 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-14T08:45:43.195 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-14T08:45:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-14T08:45:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-14T08:45:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-14T08:45:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout: Block cache BinnedLRUCache@0x563677ef31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-14T08:45:43.196 INFO:journalctl@ceph.mon.c.smithi178.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-14T08:45:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2023-10-14T08:45:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-14T08:45:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-14T08:45:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: using public_addr v2:172.21.15.178:0/0 -> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2023-10-14T08:45:43.197 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: starting mon.c rank -1 at public addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] at bind addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:43.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(???) e0 preinit fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:43.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).mds e1 new map 2023-10-14T08:45:43.198 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-14T08:45:43.198 INFO:journalctl@ceph.mon.c.smithi178.stdout: e1 2023-10-14T08:45:43.198 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-14T08:45:43.199 INFO:journalctl@ceph.mon.c.smithi178.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-14T08:45:43.199 INFO:journalctl@ceph.mon.c.smithi178.stdout: legacy client fscid: -1 2023-10-14T08:45:43.199 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2023-10-14T08:45:43.199 INFO:journalctl@ceph.mon.c.smithi178.stdout: No filesystems configured 2023-10-14T08:45:43.199 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-14T08:45:43.200 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-14T08:45:43.200 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-14T08:45:43.200 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-14T08:45:43.200 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-14T08:45:43.200 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-14T08:45:43.201 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-14T08:45:43.201 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:45:43.201 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:45:43.201 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:45:43.201 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.201 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:43.202 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.202 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.202 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.202 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.203 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:43.203 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:43.203 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:43.203 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi057:/etc/ceph/ceph.conf 2023-10-14T08:45:43.203 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Deploying cephadm binary to smithi178 2023-10-14T08:45:43.204 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:43.204 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:43.204 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.204 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:43.204 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.204 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.205 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.205 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.205 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Added host smithi178 2023-10-14T08:45:43.205 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:43.205 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.206 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.206 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.206 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:45:43.206 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.207 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.207 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/434919583' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-14T08:45:43.207 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.207 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.207 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.208 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.208 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:43.208 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:43.208 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:43.208 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.208 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi178:/etc/ceph/ceph.conf 2023-10-14T08:45:43.209 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/434919583' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-14T08:45:43.209 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:43.209 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.209 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.209 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.210 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:43.210 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:43.210 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:43.210 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.210 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.211 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:43.211 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:43.211 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:43.211 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:43.212 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:43.212 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:43.212 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:43.212 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c;count:3 2023-10-14T08:45:43.213 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: Deploying daemon mon.c on smithi178 2023-10-14T08:45:43.213 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:43.213 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-14T08:45:43.213 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-10-14T08:45:43.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expand map: {default=false} 2023-10-14T08:45:43.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta from 'false' to 'false' 2023-10-14T08:45:43.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expanded map: {default=false} 2023-10-14T08:45:43.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expand map: {default=info} 2023-10-14T08:45:43.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta from 'info' to 'info' 2023-10-14T08:45:43.215 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expanded map: {default=info} 2023-10-14T08:45:43.215 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expand map: {default=daemon} 2023-10-14T08:45:43.215 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-14T08:45:43.216 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expanded map: {default=daemon} 2023-10-14T08:45:43.216 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expand map: {default=debug} 2023-10-14T08:45:43.216 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta from 'debug' to 'debug' 2023-10-14T08:45:43.216 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 ceph-mon[103612]: expand_channel_meta expanded map: {default=debug} 2023-10-14T08:45:43.216 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 bash[103570]: 98002c1e3789f98150de3c7a15bb3b38daeab3f0f8cb193ec1491359e6343df3 2023-10-14T08:45:43.217 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:42 smithi178 systemd[1]: Started Ceph mon.c for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:45:43.531 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-14T08:45:43.532 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-14T08:45:44.097 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:45:48.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:48.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: mon.a calling monitor election 2023-10-14T08:45:48.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:48.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: mon.c calling monitor election 2023-10-14T08:45:48.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:48.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-14T08:45:48.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: monmap e2: 2 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:48.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: fsmap 2023-10-14T08:45:48.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:48.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: mgrmap e13: x(active, since 44s) 2023-10-14T08:45:48.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: overall HEALTH_OK 2023-10-14T08:45:48.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:48.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:48.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:48.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:48.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: mon.a calling monitor election 2023-10-14T08:45:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:48.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: mon.c calling monitor election 2023-10-14T08:45:48.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:48.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:48.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-14T08:45:48.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: monmap e2: 2 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:48.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: fsmap 2023-10-14T08:45:48.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:48.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: mgrmap e13: x(active, since 44s) 2023-10-14T08:45:48.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: overall HEALTH_OK 2023-10-14T08:45:48.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:48.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:48.388 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:48.388 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:48.388 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:48.476 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/627385905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 msgr2=0x7f9ca0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:48.476 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/627385905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9ca0005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0073120 tx=0x7f9ca400feb0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/627385905 shutdown_connections 2023-10-14T08:45:48.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/627385905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9ca0005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/627385905 >> 172.21.15.178:0/627385905 conn(0x7f9cb00fc580 msgr2=0x7f9cb00fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:48.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/627385905 shutdown_connections 2023-10-14T08:45:48.477 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.471+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/627385905 wait complete. 2023-10-14T08:45:48.478 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.472+0000 7f9cb6b2b700 1 Processor -- start 2023-10-14T08:45:48.478 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.472+0000 7f9cb6b2b700 1 -- start start 2023-10-14T08:45:48.478 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb6b2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9cb01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:48.478 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb6b2b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:48.479 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb6b2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0198c80 con 0x7f9ca00035c0 2023-10-14T08:45:48.479 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb6b2b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0198df0 con 0x7f9cb01986f0 2023-10-14T08:45:48.479 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:48.479 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41270/0 (socket says 172.21.15.178:41270) 2023-10-14T08:45:48.479 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 -- 172.21.15.178:0/236482838 learned_addr learned my addr 172.21.15.178:0/236482838 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:45:48.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb48c7700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9cb01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:48.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 -- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 msgr2=0x7f9cb019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-14T08:45:48.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 -- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 msgr2=0x7f9cb019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-14T08:45:48.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T08:45:48.480 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9caffff700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:45:48.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb48c7700 1 -- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 msgr2=0x7f9cb019cb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:45:48.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb48c7700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.473+0000 7f9cb48c7700 1 -- 172.21.15.178:0/236482838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca400f900 con 0x7f9ca00035c0 2023-10-14T08:45:48.481 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.474+0000 7f9cb48c7700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9cb01981b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4000c00 tx=0x7f9ca40047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:48.482 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.474+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f9ca4013b00 con 0x7f9ca00035c0 2023-10-14T08:45:48.482 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.474+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb019d100 con 0x7f9ca00035c0 2023-10-14T08:45:48.482 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.474+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ca40044f0 con 0x7f9ca00035c0 2023-10-14T08:45:48.483 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.474+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f9ca4003be0 con 0x7f9ca00035c0 2023-10-14T08:45:48.483 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.474+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb019d650 con 0x7f9ca00035c0 2023-10-14T08:45:48.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.475+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f9ca4011540 con 0x7f9ca00035c0 2023-10-14T08:45:48.485 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.475+0000 7f9cadffb700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c94038740 0x7f9c9403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:48.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.475+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9ca404ed50 con 0x7f9ca00035c0 2023-10-14T08:45:48.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.476+0000 7f9caffff700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c94038740 0x7f9c9403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:48.486 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.476+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb019d980 con 0x7f9ca00035c0 2023-10-14T08:45:48.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.476+0000 7f9caffff700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c94038740 0x7f9c9403ac00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009180 tx=0x7f9c9c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:48.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.482+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ca4024400 con 0x7f9ca00035c0 2023-10-14T08:45:48.756 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.754+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9cb0199650 con 0x7f9ca00035c0 2023-10-14T08:45:48.757 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.755+0000 7f9cadffb700 1 -- 172.21.15.178:0/236482838 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f9ca4023360 con 0x7f9ca00035c0 2023-10-14T08:45:48.757 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:45:48.758 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":2,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","modified":"2023-10-14T08:45:42.861603Z","created":"2023-10-14T08:43:59.372762Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-14T08:45:48.759 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c94038740 msgr2=0x7f9c9403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:48.760 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c94038740 0x7f9c9403ac00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009180 tx=0x7f9c9c008040 comp rx=0 tx=0).stop 2023-10-14T08:45:48.760 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 msgr2=0x7f9cb01981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:48.760 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9cb01981b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4000c00 tx=0x7f9ca40047a0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.760 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 shutdown_connections 2023-10-14T08:45:48.761 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c94038740 0x7f9c9403ac00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.761 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca00035c0 0x7f9cb01981b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.761 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 --2- 172.21.15.178:0/236482838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb01986f0 0x7f9cb019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:48.761 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 >> 172.21.15.178:0/236482838 conn(0x7f9cb00fc580 msgr2=0x7f9cb0104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:48.762 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 shutdown_connections 2023-10-14T08:45:48.762 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:48.757+0000 7f9cb6b2b700 1 -- 172.21.15.178:0/236482838 wait complete. 2023-10-14T08:45:48.762 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 2 2023-10-14T08:45:49.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:48 smithi178 ceph-mon[103612]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:49.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:48 smithi178 ceph-mon[103612]: Deploying daemon mon.b on smithi057 2023-10-14T08:45:49.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:48 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/236482838' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-14T08:45:49.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:49.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:48 smithi006 ceph-mon[99452]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:49.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:48 smithi006 ceph-mon[99452]: Deploying daemon mon.b on smithi057 2023-10-14T08:45:49.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:48 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/236482838' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-14T08:45:49.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:50.158 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-14T08:45:50.158 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph mon dump -f json 2023-10-14T08:45:50.727 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:45:50.902 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:50 smithi057 systemd[1]: Starting Ceph mon.b for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:45:51.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:50 smithi057 podman[103273]: 2023-10-14T08:45:51.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:50 smithi006 ceph-mon[99452]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.237 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:50 smithi178 ceph-mon[103612]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 bash[103273]: 3dd5f3f92137c62de7c054be214ddadea82e499ea4b43cd2b4520da2153db3a8 2023-10-14T08:45:51.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: set uid:gid to 167:167 (ceph:ceph) 2023-10-14T08:45:51.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev), process ceph-mon, pid 7 2023-10-14T08:45:51.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pidfile_write: ignore empty --pid-file 2023-10-14T08:45:51.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: load: jerasure load: lrc 2023-10-14T08:45:51.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: RocksDB version: 7.9.2 2023-10-14T08:45:51.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Git sha 0 2023-10-14T08:45:51.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Compile date 2023-10-13 13:48:46 2023-10-14T08:45:51.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: DB SUMMARY 2023-10-14T08:45:51.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: DB Session ID: 13QPS8U5C0E8OYLAZ696 2023-10-14T08:45:51.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: CURRENT file: CURRENT 2023-10-14T08:45:51.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: IDENTITY file: IDENTITY 2023-10-14T08:45:51.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-14T08:45:51.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-14T08:45:51.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-14T08:45:51.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.error_if_exists: 0 2023-10-14T08:45:51.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.create_if_missing: 0 2023-10-14T08:45:51.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.paranoid_checks: 1 2023-10-14T08:45:51.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-14T08:45:51.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-14T08:45:51.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-14T08:45:51.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.env: 0x55f0b2b84da0 2023-10-14T08:45:51.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.fs: PosixFileSystem 2023-10-14T08:45:51.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.info_log: 0x55f0b442b5e0 2023-10-14T08:45:51.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_file_opening_threads: 16 2023-10-14T08:45:51.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.statistics: (nil) 2023-10-14T08:45:51.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.use_fsync: 0 2023-10-14T08:45:51.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_log_file_size: 0 2023-10-14T08:45:51.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-14T08:45:51.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-14T08:45:51.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.keep_log_file_num: 1000 2023-10-14T08:45:51.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.recycle_log_file_num: 0 2023-10-14T08:45:51.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.allow_fallocate: 1 2023-10-14T08:45:51.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.allow_mmap_reads: 0 2023-10-14T08:45:51.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.allow_mmap_writes: 0 2023-10-14T08:45:51.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.use_direct_reads: 0 2023-10-14T08:45:51.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-14T08:45:51.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.create_missing_column_families: 0 2023-10-14T08:45:51.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.db_log_dir: 2023-10-14T08:45:51.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.wal_dir: 2023-10-14T08:45:51.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-14T08:45:51.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-14T08:45:51.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-14T08:45:51.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-14T08:45:51.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-14T08:45:51.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-14T08:45:51.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.advise_random_on_open: 1 2023-10-14T08:45:51.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.db_write_buffer_size: 0 2023-10-14T08:45:51.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.write_buffer_manager: 0x55f0b43e3360 2023-10-14T08:45:51.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-14T08:45:51.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-14T08:45:51.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-14T08:45:51.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.rate_limiter: (nil) 2023-10-14T08:45:51.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-14T08:45:51.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.wal_recovery_mode: 2 2023-10-14T08:45:51.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.enable_thread_tracking: 0 2023-10-14T08:45:51.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.enable_pipelined_write: 0 2023-10-14T08:45:51.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.unordered_write: 0 2023-10-14T08:45:51.706 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-14T08:45:51.706 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-14T08:45:51.706 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-14T08:45:51.706 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-14T08:45:51.706 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.row_cache: None 2023-10-14T08:45:51.707 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.wal_filter: None 2023-10-14T08:45:51.707 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-14T08:45:51.707 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.allow_ingest_behind: 0 2023-10-14T08:45:51.707 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.two_write_queues: 0 2023-10-14T08:45:51.707 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.manual_wal_flush: 0 2023-10-14T08:45:51.708 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.wal_compression: 0 2023-10-14T08:45:51.708 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.atomic_flush: 0 2023-10-14T08:45:51.708 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-14T08:45:51.708 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-14T08:45:51.708 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-14T08:45:51.708 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.log_readahead_size: 0 2023-10-14T08:45:51.709 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-14T08:45:51.709 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.best_efforts_recovery: 0 2023-10-14T08:45:51.709 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-14T08:45:51.709 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-14T08:45:51.709 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.allow_data_in_errors: 0 2023-10-14T08:45:51.710 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.db_host_id: __hostname__ 2023-10-14T08:45:51.710 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-14T08:45:51.710 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_background_jobs: 2 2023-10-14T08:45:51.710 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_background_compactions: -1 2023-10-14T08:45:51.710 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_subcompactions: 1 2023-10-14T08:45:51.711 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-14T08:45:51.711 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-14T08:45:51.711 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-14T08:45:51.711 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_total_wal_size: 0 2023-10-14T08:45:51.711 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-14T08:45:51.711 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-14T08:45:51.712 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-14T08:45:51.712 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-14T08:45:51.712 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_open_files: -1 2023-10-14T08:45:51.712 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bytes_per_sync: 0 2023-10-14T08:45:51.712 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-14T08:45:51.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-14T08:45:51.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_readahead_size: 0 2023-10-14T08:45:51.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_background_flushes: -1 2023-10-14T08:45:51.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Compression algorithms supported: 2023-10-14T08:45:51.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-14T08:45:51.714 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kZSTD supported: 0 2023-10-14T08:45:51.714 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kXpressCompression supported: 0 2023-10-14T08:45:51.714 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kLZ4HCCompression supported: 1 2023-10-14T08:45:51.714 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kZlibCompression supported: 1 2023-10-14T08:45:51.714 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kSnappyCompression supported: 1 2023-10-14T08:45:51.714 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kLZ4Compression supported: 1 2023-10-14T08:45:51.715 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: kBZip2Compression supported: 0 2023-10-14T08:45:51.715 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-14T08:45:51.715 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-14T08:45:51.715 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-14T08:45:51.715 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-14T08:45:51.716 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-14T08:45:51.716 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.merge_operator: 2023-10-14T08:45:51.716 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_filter: None 2023-10-14T08:45:51.716 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_filter_factory: None 2023-10-14T08:45:51.716 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.sst_partitioner_factory: None 2023-10-14T08:45:51.717 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-14T08:45:51.717 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-14T08:45:51.717 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f0b442b6e0) 2023-10-14T08:45:51.717 INFO:journalctl@ceph.mon.b.smithi057.stdout: cache_index_and_filter_blocks: 1 2023-10-14T08:45:51.717 INFO:journalctl@ceph.mon.b.smithi057.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-14T08:45:51.717 INFO:journalctl@ceph.mon.b.smithi057.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-14T08:45:51.718 INFO:journalctl@ceph.mon.b.smithi057.stdout: pin_top_level_index_and_filter: 1 2023-10-14T08:45:51.718 INFO:journalctl@ceph.mon.b.smithi057.stdout: index_type: 0 2023-10-14T08:45:51.718 INFO:journalctl@ceph.mon.b.smithi057.stdout: data_block_index_type: 0 2023-10-14T08:45:51.718 INFO:journalctl@ceph.mon.b.smithi057.stdout: index_shortening: 1 2023-10-14T08:45:51.718 INFO:journalctl@ceph.mon.b.smithi057.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-14T08:45:51.719 INFO:journalctl@ceph.mon.b.smithi057.stdout: checksum: 4 2023-10-14T08:45:51.719 INFO:journalctl@ceph.mon.b.smithi057.stdout: no_block_cache: 0 2023-10-14T08:45:51.719 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_cache: 0x55f0b44811f0 2023-10-14T08:45:51.719 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_cache_name: BinnedLRUCache 2023-10-14T08:45:51.719 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_cache_options: 2023-10-14T08:45:51.720 INFO:journalctl@ceph.mon.b.smithi057.stdout: capacity : 536870912 2023-10-14T08:45:51.720 INFO:journalctl@ceph.mon.b.smithi057.stdout: num_shard_bits : 4 2023-10-14T08:45:51.720 INFO:journalctl@ceph.mon.b.smithi057.stdout: strict_capacity_limit : 0 2023-10-14T08:45:51.720 INFO:journalctl@ceph.mon.b.smithi057.stdout: high_pri_pool_ratio: 0.000 2023-10-14T08:45:51.720 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_cache_compressed: (nil) 2023-10-14T08:45:51.720 INFO:journalctl@ceph.mon.b.smithi057.stdout: persistent_cache: (nil) 2023-10-14T08:45:51.721 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_size: 4096 2023-10-14T08:45:51.721 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_size_deviation: 10 2023-10-14T08:45:51.721 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_restart_interval: 16 2023-10-14T08:45:51.721 INFO:journalctl@ceph.mon.b.smithi057.stdout: index_block_restart_interval: 1 2023-10-14T08:45:51.721 INFO:journalctl@ceph.mon.b.smithi057.stdout: metadata_block_size: 4096 2023-10-14T08:45:51.722 INFO:journalctl@ceph.mon.b.smithi057.stdout: partition_filters: 0 2023-10-14T08:45:51.722 INFO:journalctl@ceph.mon.b.smithi057.stdout: use_delta_encoding: 1 2023-10-14T08:45:51.722 INFO:journalctl@ceph.mon.b.smithi057.stdout: filter_policy: bloomfilter 2023-10-14T08:45:51.722 INFO:journalctl@ceph.mon.b.smithi057.stdout: whole_key_filtering: 1 2023-10-14T08:45:51.722 INFO:journalctl@ceph.mon.b.smithi057.stdout: verify_compression: 0 2023-10-14T08:45:51.723 INFO:journalctl@ceph.mon.b.smithi057.stdout: read_amp_bytes_per_bit: 0 2023-10-14T08:45:51.723 INFO:journalctl@ceph.mon.b.smithi057.stdout: format_version: 5 2023-10-14T08:45:51.723 INFO:journalctl@ceph.mon.b.smithi057.stdout: enable_index_compression: 1 2023-10-14T08:45:51.723 INFO:journalctl@ceph.mon.b.smithi057.stdout: block_align: 0 2023-10-14T08:45:51.723 INFO:journalctl@ceph.mon.b.smithi057.stdout: max_auto_readahead_size: 262144 2023-10-14T08:45:51.723 INFO:journalctl@ceph.mon.b.smithi057.stdout: prepopulate_block_cache: 0 2023-10-14T08:45:51.724 INFO:journalctl@ceph.mon.b.smithi057.stdout: initial_auto_readahead_size: 8192 2023-10-14T08:45:51.724 INFO:journalctl@ceph.mon.b.smithi057.stdout: num_file_reads_for_auto_readahead: 2 2023-10-14T08:45:51.724 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.write_buffer_size: 33554432 2023-10-14T08:45:51.724 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_write_buffer_number: 2 2023-10-14T08:45:51.724 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression: NoCompression 2023-10-14T08:45:51.725 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression: Disabled 2023-10-14T08:45:51.725 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.prefix_extractor: nullptr 2023-10-14T08:45:51.725 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-14T08:45:51.725 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.num_levels: 7 2023-10-14T08:45:51.725 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-14T08:45:51.725 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-14T08:45:51.726 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-14T08:45:51.726 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-14T08:45:51.726 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-14T08:45:51.726 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-14T08:45:51.728 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-14T08:45:51.728 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-14T08:45:51.728 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-14T08:45:51.728 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-14T08:45:51.729 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-14T08:45:51.729 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-14T08:45:51.729 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-14T08:45:51.729 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.level: 32767 2023-10-14T08:45:51.729 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.strategy: 0 2023-10-14T08:45:51.730 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-14T08:45:51.730 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-14T08:45:51.730 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-14T08:45:51.730 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-14T08:45:51.730 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.enabled: false 2023-10-14T08:45:51.730 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-14T08:45:51.731 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-14T08:45:51.731 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-14T08:45:51.731 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-14T08:45:51.731 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.target_file_size_base: 67108864 2023-10-14T08:45:51.731 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-14T08:45:51.732 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-14T08:45:51.732 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-14T08:45:51.732 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-14T08:45:51.732 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-14T08:45:51.732 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-14T08:45:51.733 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-14T08:45:51.733 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-14T08:45:51.733 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-14T08:45:51.733 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-14T08:45:51.733 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-14T08:45:51.733 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-14T08:45:51.734 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-14T08:45:51.734 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-14T08:45:51.734 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.arena_block_size: 1048576 2023-10-14T08:45:51.734 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-14T08:45:51.734 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-14T08:45:51.735 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.disable_auto_compactions: 0 2023-10-14T08:45:51.735 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-14T08:45:51.735 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-14T08:45:51.735 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-14T08:45:51.735 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-14T08:45:51.736 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-14T08:45:51.736 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-14T08:45:51.736 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-14T08:45:51.736 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-14T08:45:51.736 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-14T08:45:51.736 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-14T08:45:51.737 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.table_properties_collectors: 2023-10-14T08:45:51.737 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.inplace_update_support: 0 2023-10-14T08:45:51.737 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-14T08:45:51.737 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-14T08:45:51.737 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-14T08:45:51.738 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-14T08:45:51.738 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.bloom_locality: 0 2023-10-14T08:45:51.738 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.max_successive_merges: 0 2023-10-14T08:45:51.738 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-14T08:45:51.738 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.paranoid_file_checks: 0 2023-10-14T08:45:51.739 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.force_consistency_checks: 1 2023-10-14T08:45:51.739 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.report_bg_io_stats: 0 2023-10-14T08:45:51.739 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.ttl: 2592000 2023-10-14T08:45:51.739 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-14T08:45:51.739 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-14T08:45:51.739 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-14T08:45:51.740 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.enable_blob_files: false 2023-10-14T08:45:51.740 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.min_blob_size: 0 2023-10-14T08:45:51.740 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.blob_file_size: 268435456 2023-10-14T08:45:51.740 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-14T08:45:51.740 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-14T08:45:51.741 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-14T08:45:51.741 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-14T08:45:51.741 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-14T08:45:51.741 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.blob_file_starting_level: 0 2023-10-14T08:45:51.741 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-14T08:45:51.742 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-14T08:45:51.742 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-14T08:45:51.742 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d2ada32d-dd66-4d32-a3cc-6593f1828bd6 2023-10-14T08:45:51.742 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273151217523, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-14T08:45:51.742 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-14T08:45:51.742 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273151218155, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1697273151, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d2ada32d-dd66-4d32-a3cc-6593f1828bd6", "db_session_id": "13QPS8U5C0E8OYLAZ696", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-14T08:45:51.743 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: EVENT_LOG_v1 {"time_micros": 1697273151218253, "job": 1, "event": "recovery_finished"} 2023-10-14T08:45:51.743 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-14T08:45:51.743 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-14T08:45:51.743 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f0b451e000 2023-10-14T08:45:51.743 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: DB pointer 0x55f0b450a000 2023-10-14T08:45:51.744 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-14T08:45:51.744 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-14T08:45:51.744 INFO:journalctl@ceph.mon.b.smithi057.stdout: ** DB Stats ** 2023-10-14T08:45:51.744 INFO:journalctl@ceph.mon.b.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-14T08:45:51.744 INFO:journalctl@ceph.mon.b.smithi057.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-14T08:45:51.745 INFO:journalctl@ceph.mon.b.smithi057.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-14T08:45:51.745 INFO:journalctl@ceph.mon.b.smithi057.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-14T08:45:51.745 INFO:journalctl@ceph.mon.b.smithi057.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-14T08:45:51.745 INFO:journalctl@ceph.mon.b.smithi057.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-14T08:45:51.745 INFO:journalctl@ceph.mon.b.smithi057.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-14T08:45:51.745 INFO:journalctl@ceph.mon.b.smithi057.stdout: 2023-10-14T08:45:51.746 INFO:journalctl@ceph.mon.b.smithi057.stdout: ** Compaction Stats [default] ** 2023-10-14T08:45:51.746 INFO:journalctl@ceph.mon.b.smithi057.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-14T08:45:51.746 INFO:journalctl@ceph.mon.b.smithi057.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-14T08:45:51.746 INFO:journalctl@ceph.mon.b.smithi057.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:51.746 INFO:journalctl@ceph.mon.b.smithi057.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:51.747 INFO:journalctl@ceph.mon.b.smithi057.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:51.747 INFO:journalctl@ceph.mon.b.smithi057.stdout: 2023-10-14T08:45:51.747 INFO:journalctl@ceph.mon.b.smithi057.stdout: ** Compaction Stats [default] ** 2023-10-14T08:45:51.747 INFO:journalctl@ceph.mon.b.smithi057.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-14T08:45:51.747 INFO:journalctl@ceph.mon.b.smithi057.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-14T08:45:51.748 INFO:journalctl@ceph.mon.b.smithi057.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-14T08:45:51.748 INFO:journalctl@ceph.mon.b.smithi057.stdout: 2023-10-14T08:45:51.748 INFO:journalctl@ceph.mon.b.smithi057.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-14T08:45:51.748 INFO:journalctl@ceph.mon.b.smithi057.stdout: 2023-10-14T08:45:51.748 INFO:journalctl@ceph.mon.b.smithi057.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-14T08:45:51.748 INFO:journalctl@ceph.mon.b.smithi057.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-14T08:45:51.749 INFO:journalctl@ceph.mon.b.smithi057.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-14T08:45:51.749 INFO:journalctl@ceph.mon.b.smithi057.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-14T08:45:51.749 INFO:journalctl@ceph.mon.b.smithi057.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-14T08:45:51.749 INFO:journalctl@ceph.mon.b.smithi057.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-14T08:45:51.749 INFO:journalctl@ceph.mon.b.smithi057.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-14T08:45:51.750 INFO:journalctl@ceph.mon.b.smithi057.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-14T08:45:51.750 INFO:journalctl@ceph.mon.b.smithi057.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-14T08:45:51.750 INFO:journalctl@ceph.mon.b.smithi057.stdout: Block cache BinnedLRUCache@0x55f0b44811f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-14T08:45:51.750 INFO:journalctl@ceph.mon.b.smithi057.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-14T08:45:51.750 INFO:journalctl@ceph.mon.b.smithi057.stdout: 2023-10-14T08:45:51.751 INFO:journalctl@ceph.mon.b.smithi057.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-14T08:45:51.751 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-14T08:45:51.751 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: using public_addr v2:172.21.15.57:0/0 -> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] 2023-10-14T08:45:51.751 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: starting mon.b rank -1 at public addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] at bind addrs [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:51.751 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(???) e0 preinit fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:51.752 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 systemd[1]: Started Ceph mon.b for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:45:51.752 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).mds e1 new map 2023-10-14T08:45:51.752 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-14T08:45:51.752 INFO:journalctl@ceph.mon.b.smithi057.stdout: e1 2023-10-14T08:45:51.752 INFO:journalctl@ceph.mon.b.smithi057.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-14T08:45:51.752 INFO:journalctl@ceph.mon.b.smithi057.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-14T08:45:51.753 INFO:journalctl@ceph.mon.b.smithi057.stdout: legacy client fscid: -1 2023-10-14T08:45:51.753 INFO:journalctl@ceph.mon.b.smithi057.stdout: 2023-10-14T08:45:51.753 INFO:journalctl@ceph.mon.b.smithi057.stdout: No filesystems configured 2023-10-14T08:45:51.753 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-14T08:45:51.753 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-14T08:45:51.754 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-14T08:45:51.754 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-14T08:45:51.754 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-14T08:45:51.754 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-14T08:45:51.754 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-14T08:45:51.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:45:51.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:45:51.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-14T08:45:51.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:51.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.756 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.756 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.756 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.756 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi057", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:51.756 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:51.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:51.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi057:/etc/ceph/ceph.conf 2023-10-14T08:45:51.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Deploying cephadm binary to smithi178 2023-10-14T08:45:51.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:51.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi057:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:51.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.758 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:51.758 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.758 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.758 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.758 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.759 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Added host smithi178 2023-10-14T08:45:51.759 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:51.759 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.759 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.759 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.759 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:45:51.760 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.760 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.760 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/434919583' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-14T08:45:51.760 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.760 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.761 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.761 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.761 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:45:51.761 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:51.761 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:51.762 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.762 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi178:/etc/ceph/ceph.conf 2023-10-14T08:45:51.762 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/434919583' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-14T08:45:51.762 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:51.762 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.762 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.763 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.763 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:45:51.763 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:51.763 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-14T08:45:51.763 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.764 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.764 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:51.764 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:51.764 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:45:51.764 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.765 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:51.765 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:51.765 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:45:51.765 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c;count:3 2023-10-14T08:45:51.765 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Deploying daemon mon.c on smithi178 2023-10-14T08:45:51.765 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.766 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:51.766 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.a calling monitor election 2023-10-14T08:45:51.766 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.766 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.766 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.767 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.767 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.c calling monitor election 2023-10-14T08:45:51.767 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.767 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.769 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.769 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.769 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-14T08:45:51.769 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: monmap e2: 2 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:51.770 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: fsmap 2023-10-14T08:45:51.770 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:51.770 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mgrmap e13: x(active, since 44s) 2023-10-14T08:45:51.770 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: overall HEALTH_OK 2023-10-14T08:45:51.770 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.771 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.771 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:51.771 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:51.771 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:51.771 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.772 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: Deploying daemon mon.b on smithi057 2023-10-14T08:45:51.772 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/236482838' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-14T08:45:51.772 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:51.772 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:51.772 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-14T08:45:51.773 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expand map: {default=false} 2023-10-14T08:45:51.773 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta from 'false' to 'false' 2023-10-14T08:45:51.773 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expanded map: {default=false} 2023-10-14T08:45:51.773 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expand map: {default=info} 2023-10-14T08:45:51.773 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta from 'info' to 'info' 2023-10-14T08:45:51.773 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expanded map: {default=info} 2023-10-14T08:45:51.774 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expand map: {default=daemon} 2023-10-14T08:45:51.774 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta from 'daemon' to 'daemon' 2023-10-14T08:45:51.774 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expanded map: {default=daemon} 2023-10-14T08:45:51.774 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expand map: {default=debug} 2023-10-14T08:45:51.774 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta from 'debug' to 'debug' 2023-10-14T08:45:51.775 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: expand_channel_meta expanded map: {default=debug} 2023-10-14T08:45:51.775 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:51 smithi057 ceph-mon[103313]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-10-14T08:45:56.512 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 -- 172.21.15.178:0/2285196049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 msgr2=0x7f8668005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:56.513 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 --2- 172.21.15.178:0/2285196049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f8668005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f867c077150 tx=0x7f866400fe60 comp rx=0 tx=0).stop 2023-10-14T08:45:56.513 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 -- 172.21.15.178:0/2285196049 shutdown_connections 2023-10-14T08:45:56.513 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 --2- 172.21.15.178:0/2285196049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f8668005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.514 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 -- 172.21.15.178:0/2285196049 >> 172.21.15.178:0/2285196049 conn(0x7f867c0fb050 msgr2=0x7f867c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:56.514 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 -- 172.21.15.178:0/2285196049 shutdown_connections 2023-10-14T08:45:56.514 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.510+0000 7f86821bc700 1 -- 172.21.15.178:0/2285196049 wait complete. 2023-10-14T08:45:56.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 Processor -- start 2023-10-14T08:45:56.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 -- start start 2023-10-14T08:45:56.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f867c196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:56.518 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:56.518 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 0x7f867c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:56.518 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c196ca0 con 0x7f86680035c0 2023-10-14T08:45:56.519 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1a2cd0 con 0x7f867c19af60 2023-10-14T08:45:56.519 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f86821bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1a2e10 con 0x7f867c1965b0 2023-10-14T08:45:56.519 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:56.519 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41298/0 (socket says 172.21.15.178:41298) 2023-10-14T08:45:56.520 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 -- 172.21.15.178:0/751254221 learned_addr learned my addr 172.21.15.178:0/751254221 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:45:56.520 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 msgr2=0x7f867c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-10-14T08:45:56.520 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 msgr2=0x7f867c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-14T08:45:56.520 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T08:45:56.520 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867b7fe700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f867c196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:56.521 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867affd700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:45:56.521 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867bfff700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 0x7f867c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:56.521 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867bfff700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 msgr2=0x7f867c19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-10-14T08:45:56.521 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867bfff700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 msgr2=0x7f867c19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-14T08:45:56.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867bfff700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 0x7f867c19b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T08:45:56.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867bfff700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 0x7f867c19b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T08:45:56.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867b7fe700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 msgr2=0x7f867c19aa20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:45:56.522 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867b7fe700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.523 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867b7fe700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 msgr2=0x7f867c19b410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:45:56.523 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867b7fe700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 0x7f867c19b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.523 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.512+0000 7f867b7fe700 1 -- 172.21.15.178:0/751254221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866400f8b0 con 0x7f86680035c0 2023-10-14T08:45:56.523 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.513+0000 7f867b7fe700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f867c196070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8664015040 tx=0x7f8664012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:56.523 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.513+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664004130 con 0x7f86680035c0 2023-10-14T08:45:56.524 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.513+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8664004290 con 0x7f86680035c0 2023-10-14T08:45:56.524 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.513+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c1a3090 con 0x7f86680035c0 2023-10-14T08:45:56.524 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.513+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640278b0 con 0x7f86680035c0 2023-10-14T08:45:56.524 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.513+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c1a3590 con 0x7f86680035c0 2023-10-14T08:45:56.524 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.514+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f8664024050 con 0x7f86680035c0 2023-10-14T08:45:56.525 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.514+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0624e0 con 0x7f86680035c0 2023-10-14T08:45:56.525 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.514+0000 7f8678ff9700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f865c038d90 0x7f865c03b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:56.525 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.514+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8664000e40 con 0x7f86680035c0 2023-10-14T08:45:56.525 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.514+0000 7f867affd700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f865c038d90 0x7f865c03b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:56.525 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.515+0000 7f867affd700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f865c038d90 0x7f865c03b250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f866c009180 tx=0x7f866c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:56.526 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.521+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8664026730 con 0x7f86680035c0 2023-10-14T08:45:56.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:56.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: mon.a calling monitor election 2023-10-14T08:45:56.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: mon.c calling monitor election 2023-10-14T08:45:56.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:56.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:56.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:56.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:56.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-14T08:45:56.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:56.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: fsmap 2023-10-14T08:45:56.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:56.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: mgrmap e13: x(active, since 52s) 2023-10-14T08:45:56.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-14T08:45:56.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-14T08:45:56.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-14T08:45:56.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: mon.b (rank 2) addr [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] is down (out of quorum) 2023-10-14T08:45:56.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:56.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: mon.a calling monitor election 2023-10-14T08:45:56.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: mon.c calling monitor election 2023-10-14T08:45:56.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:56.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:56.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:56.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:56.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:56.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-14T08:45:56.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: fsmap 2023-10-14T08:45:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: mgrmap e13: x(active, since 52s) 2023-10-14T08:45:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-14T08:45:56.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-14T08:45:56.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-14T08:45:56.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: mon.b (rank 2) addr [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] is down (out of quorum) 2023-10-14T08:45:56.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.737 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:56.805 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.803+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f867c108970 con 0x7f86680035c0 2023-10-14T08:45:56.806 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.804+0000 7f8678ff9700 1 -- 172.21.15.178:0/751254221 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1266 (secure 0 0 0) 0x7f866402b070 con 0x7f86680035c0 2023-10-14T08:45:56.807 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-10-14T08:45:56.807 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":3,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","modified":"2023-10-14T08:45:51.260307Z","created":"2023-10-14T08:43:59.372762Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-14T08:45:56.808 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f865c038d90 msgr2=0x7f865c03b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:56.808 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f865c038d90 0x7f865c03b250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f866c009180 tx=0x7f866c008040 comp rx=0 tx=0).stop 2023-10-14T08:45:56.808 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 msgr2=0x7f867c196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:56.808 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f867c196070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8664015040 tx=0x7f8664012d70 comp rx=0 tx=0).stop 2023-10-14T08:45:56.809 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 shutdown_connections 2023-10-14T08:45:56.809 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f865c038d90 0x7f865c03b250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.809 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f867c19af60 0x7f867c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.809 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86680035c0 0x7f867c196070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.809 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 --2- 172.21.15.178:0/751254221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f867c1965b0 0x7f867c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:56.810 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 >> 172.21.15.178:0/751254221 conn(0x7f867c0fb050 msgr2=0x7f867c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:56.810 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 shutdown_connections 2023-10-14T08:45:56.810 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:45:56.807+0000 7f86821bc700 1 -- 172.21.15.178:0/751254221 wait complete. 2023-10-14T08:45:56.810 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 3 2023-10-14T08:45:57.298 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-14T08:45:57.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-14T08:45:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:57 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:57 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/751254221' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-14T08:45:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:57 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:57 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:57.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:57 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/751254221' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-14T08:45:57.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:57 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:57.886 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:45:58.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:45:58.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: mon.a calling monitor election 2023-10-14T08:45:58.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: mon.c calling monitor election 2023-10-14T08:45:58.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:58.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:45:58.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:58.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:58.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:58.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:58.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:58.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:58.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:45:58.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:58.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-14T08:45:58.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:58.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: fsmap 2023-10-14T08:45:58.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:58.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: mgrmap e13: x(active, since 52s) 2023-10-14T08:45:58.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-14T08:45:58.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-14T08:45:58.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-14T08:45:58.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: mon.b (rank 2) addr [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] is down (out of quorum) 2023-10-14T08:45:58.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:45:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/751254221' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-14T08:45:58.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:45:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.141+0000 7fcba1f85700 1 -- 172.21.15.6:0/3513743776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c0680e0 msgr2=0x7fcb9c0684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.141+0000 7fcba1f85700 1 --2- 172.21.15.6:0/3513743776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c0680e0 0x7fcb9c0684c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009910 tx=0x7fcb8c009c20 comp rx=0 tx=0).stop 2023-10-14T08:45:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.141+0000 7fcba1f85700 1 -- 172.21.15.6:0/3513743776 shutdown_connections 2023-10-14T08:45:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.141+0000 7fcba1f85700 1 --2- 172.21.15.6:0/3513743776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c0680e0 0x7fcb9c0684c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.141+0000 7fcba1f85700 1 -- 172.21.15.6:0/3513743776 >> 172.21.15.6:0/3513743776 conn(0x7fcb9c075370 msgr2=0x7fcb9c075780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.142+0000 7fcba1f85700 1 -- 172.21.15.6:0/3513743776 shutdown_connections 2023-10-14T08:45:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.142+0000 7fcba1f85700 1 -- 172.21.15.6:0/3513743776 wait complete. 2023-10-14T08:45:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.142+0000 7fcba1f85700 1 Processor -- start 2023-10-14T08:45:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.142+0000 7fcba1f85700 1 -- start start 2023-10-14T08:45:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcba1f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9c0680e0 0x7fcb9c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcba1f85700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c198720 0x7fcb9c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcba1f85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 0x7fcb9c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcba1f85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c198e10 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcba1f85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c1a4e40 con 0x7fcb9c0680e0 2023-10-14T08:45:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcba1f85700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c1a4f80 con 0x7fcb9c198720 2023-10-14T08:45:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 0x7fcb9c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 0x7fcb9c19d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58420/0 (socket says 172.21.15.6:58420) 2023-10-14T08:45:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 -- 172.21.15.6:0/1684385857 learned_addr learned my addr 172.21.15.6:0/1684385857 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:45:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9affd700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c198720 0x7fcb9c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9b7fe700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9c0680e0 0x7fcb9c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 -- 172.21.15.6:0/1684385857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c198720 msgr2=0x7fcb9c19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c198720 0x7fcb9c19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 -- 172.21.15.6:0/1684385857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9c0680e0 msgr2=0x7fcb9c1981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9c0680e0 0x7fcb9c1981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 -- 172.21.15.6:0/1684385857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0095f0 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb9bfff700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 0x7fcb9c19d580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400ba50 tx=0x7fcb9400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400c9b0 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.143+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb94014440 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.144+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007590 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.144+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c1a5260 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.144+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c1a5710 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.145+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c0624e0 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.145+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fcb940077b0 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.145+0000 7fcb98ff9700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb84038d40 0x7fcb8403b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:45:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.145+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcb9404ac60 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.145+0000 7fcb9b7fe700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb84038d40 0x7fcb8403b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:45:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.145+0000 7fcb9b7fe700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb84038d40 0x7fcb8403b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c006010 tx=0x7fcb8c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:45:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.150+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcb9401b8b0 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: mon.b calling monitor election 2023-10-14T08:45:59.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: mon.b calling monitor election 2023-10-14T08:45:59.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: mon.a calling monitor election 2023-10-14T08:45:59.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: mon.c calling monitor election 2023-10-14T08:45:59.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-14T08:45:59.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:59.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: fsmap 2023-10-14T08:45:59.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:59.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: mgrmap e13: x(active, since 54s) 2023-10-14T08:45:59.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-14T08:45:59.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: Cluster is now healthy 2023-10-14T08:45:59.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: overall HEALTH_OK 2023-10-14T08:45:59.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:59.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:45:59.237 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:45:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:59.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.356+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fcb9c10d090 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.356+0000 7fcb98ff9700 1 -- 172.21.15.6:0/1684385857 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7fcb94019070 con 0x7fcb9c19d0d0 2023-10-14T08:45:59.359 INFO:teuthology.orchestra.run.smithi006.stdout:# minimal ceph.conf for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:59.359 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-10-14T08:45:59.359 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:45:59.359 INFO:teuthology.orchestra.run.smithi006.stdout: mon_host = [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2023-10-14T08:45:59.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb84038d40 msgr2=0x7fcb8403b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:59.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb84038d40 0x7fcb8403b200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c006010 tx=0x7fcb8c00b540 comp rx=0 tx=0).stop 2023-10-14T08:45:59.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 msgr2=0x7fcb9c19d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:45:59.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 0x7fcb9c19d580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400ba50 tx=0x7fcb9400bd60 comp rx=0 tx=0).stop 2023-10-14T08:45:59.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 shutdown_connections 2023-10-14T08:45:59.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb9c19d0d0 0x7fcb9c19d580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb84038d40 0x7fcb8403b200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb9c0680e0 0x7fcb9c1981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 --2- 172.21.15.6:0/1684385857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb9c198720 0x7fcb9c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:45:59.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 >> 172.21.15.6:0/1684385857 conn(0x7fcb9c075370 msgr2=0x7fcb9c107ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:45:59.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 shutdown_connections 2023-10-14T08:45:59.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:45:59.359+0000 7fcba1f85700 1 -- 172.21.15.6:0/1684385857 wait complete. 2023-10-14T08:45:59.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: mon.b calling monitor election 2023-10-14T08:45:59.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: mon.b calling monitor election 2023-10-14T08:45:59.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: mon.a calling monitor election 2023-10-14T08:45:59.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: mon.c calling monitor election 2023-10-14T08:45:59.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-14T08:45:59.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:59.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: fsmap 2023-10-14T08:45:59.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:59.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: mgrmap e13: x(active, since 54s) 2023-10-14T08:45:59.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-14T08:45:59.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: Cluster is now healthy 2023-10-14T08:45:59.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: overall HEALTH_OK 2023-10-14T08:45:59.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:59.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:45:59.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:45:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: mon.b calling monitor election 2023-10-14T08:45:59.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: mon.b calling monitor election 2023-10-14T08:45:59.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: mon.a calling monitor election 2023-10-14T08:45:59.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: mon.c calling monitor election 2023-10-14T08:45:59.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-14T08:45:59.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0],c=[v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0]} removed_ranks: {} 2023-10-14T08:45:59.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: fsmap 2023-10-14T08:45:59.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: osdmap e4: 0 total, 0 up, 0 in 2023-10-14T08:45:59.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: mgrmap e13: x(active, since 54s) 2023-10-14T08:45:59.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-14T08:45:59.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: Cluster is now healthy 2023-10-14T08:45:59.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: overall HEALTH_OK 2023-10-14T08:45:59.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:45:59.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:45:59.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:45:59.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:45:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:45:59.780 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-14T08:45:59.780 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:45:59.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.conf 2023-10-14T08:45:59.813 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:45:59.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:59.884 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:45:59.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.conf 2023-10-14T08:45:59.922 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:45:59.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:45:59.995 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:45:59.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2023-10-14T08:46:00.033 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:46:00.034 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-14T08:46:00.105 INFO:tasks.cephadm:Adding mgr.x on smithi006 2023-10-14T08:46:00.105 INFO:tasks.cephadm:Adding mgr.y on smithi057 2023-10-14T08:46:00.106 INFO:tasks.cephadm:Adding mgr.z on smithi178 2023-10-14T08:46:00.106 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch apply mgr '3;smithi006=x;smithi057=y;smithi178=z' 2023-10-14T08:46:00.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: Updating smithi006:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.283 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: Reconfiguring mon.a (unknown last config time)... 2023-10-14T08:46:00.284 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: Reconfiguring daemon mon.a on smithi006 2023-10-14T08:46:00.284 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:46:00.284 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:00 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1684385857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:00.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: Updating smithi006:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: Reconfiguring mon.a (unknown last config time)... 2023-10-14T08:46:00.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: Reconfiguring daemon mon.a on smithi006 2023-10-14T08:46:00.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:46:00.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:00 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1684385857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:00.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: Updating smithi006:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: Updating smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: Updating smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/config/ceph.conf 2023-10-14T08:46:00.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: Reconfiguring mon.a (unknown last config time)... 2023-10-14T08:46:00.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: Reconfiguring daemon mon.a on smithi006 2023-10-14T08:46:00.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:46:00.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:00 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1684385857' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:00.702 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:46:01.235 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:01 smithi178 ceph-mon[103612]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:01.235 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:01.236 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:01.236 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:46:01.236 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:46:01.236 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:01.260 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:01 smithi057 ceph-mon[103313]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:01.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:01.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:01.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:46:01.261 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:46:01.262 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:01.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:01 smithi006 ceph-mon[99452]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:46:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:46:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:01.935 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 -- 172.21.15.178:0/3759802668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c101070 msgr2=0x7f694c101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:01.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 --2- 172.21.15.178:0/3759802668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c101070 0x7f694c101490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f693c009910 tx=0x7f693c009c20 comp rx=0 tx=0).stop 2023-10-14T08:46:01.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 -- 172.21.15.178:0/3759802668 shutdown_connections 2023-10-14T08:46:01.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 --2- 172.21.15.178:0/3759802668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c101070 0x7f694c101490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:01.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 -- 172.21.15.178:0/3759802668 >> 172.21.15.178:0/3759802668 conn(0x7f694c0fa6f0 msgr2=0x7f694c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:01.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 -- 172.21.15.178:0/3759802668 shutdown_connections 2023-10-14T08:46:01.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 -- 172.21.15.178:0/3759802668 wait complete. 2023-10-14T08:46:01.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.933+0000 7f69516b2700 1 Processor -- start 2023-10-14T08:46:01.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 -- start start 2023-10-14T08:46:01.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c101070 0x7f694c195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:01.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c196270 0x7f694c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:01.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 0x7f694c19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:01.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c19e010 con 0x7f694c196270 2023-10-14T08:46:01.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c19e180 con 0x7f694c101070 2023-10-14T08:46:01.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f69516b2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c19e340 con 0x7f694c1966f0 2023-10-14T08:46:01.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 0x7f694c19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:01.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 0x7f694c19d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41310/0 (socket says 172.21.15.178:41310) 2023-10-14T08:46:01.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 -- 172.21.15.178:0/3832879590 learned_addr learned my addr 172.21.15.178:0/3832879590 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:46:01.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694a7fc700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c196270 0x7f694c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:01.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694affd700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c101070 0x7f694c195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:01.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 -- 172.21.15.178:0/3832879590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c101070 msgr2=0x7f694c195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:01.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c101070 0x7f694c195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:01.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 -- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c196270 msgr2=0x7f694c19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:01.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c196270 0x7f694c19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:01.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 -- 172.21.15.178:0/3832879590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0095f0 con 0x7f694c1966f0 2023-10-14T08:46:01.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694a7fc700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c196270 0x7f694c19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:46:01.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694affd700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c101070 0x7f694c195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:46:01.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.934+0000 7f694b7fe700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 0x7f694c19d870 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f694400ba50 tx=0x7f694400be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:01.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.935+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694400cab0 con 0x7f694c1966f0 2023-10-14T08:46:01.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.935+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f694400cc10 con 0x7f694c1966f0 2023-10-14T08:46:01.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.935+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69440075b0 con 0x7f694c1966f0 2023-10-14T08:46:01.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.935+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c19e620 con 0x7f694c1966f0 2023-10-14T08:46:01.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.935+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c19eb50 con 0x7f694c1966f0 2023-10-14T08:46:01.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.935+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7f6944007710 con 0x7f694c1966f0 2023-10-14T08:46:01.945 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.936+0000 7f6943fff700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6938038d40 0x7f693803b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:01.945 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.936+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c18f570 con 0x7f694c1966f0 2023-10-14T08:46:01.945 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.936+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f694404aca0 con 0x7f694c1966f0 2023-10-14T08:46:01.945 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.936+0000 7f694affd700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6938038d40 0x7f693803b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:01.945 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.937+0000 7f694affd700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6938038d40 0x7f693803b200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f693c000c00 tx=0x7f693c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:01.946 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:01.942+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6944014b00 con 0x7f694c1966f0 2023-10-14T08:46:02.166 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.164+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi057=y;smithi178=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f694c02d280 con 0x7f6938038d40 2023-10-14T08:46:02.177 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.175+0000 7f6943fff700 1 -- 172.21.15.178:0/3832879590 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f694c02d280 con 0x7f6938038d40 2023-10-14T08:46:02.178 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mgr update... 2023-10-14T08:46:02.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6938038d40 msgr2=0x7f693803b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:02.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6938038d40 0x7f693803b200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f693c000c00 tx=0x7f693c005fb0 comp rx=0 tx=0).stop 2023-10-14T08:46:02.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 msgr2=0x7f694c19d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:02.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 0x7f694c19d870 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f694400ba50 tx=0x7f694400be10 comp rx=0 tx=0).stop 2023-10-14T08:46:02.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 shutdown_connections 2023-10-14T08:46:02.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694c1966f0 0x7f694c19d870 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:02.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6938038d40 0x7f693803b200 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:02.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c101070 0x7f694c195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:02.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 --2- 172.21.15.178:0/3832879590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f694c196270 0x7f694c19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:02.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 >> 172.21.15.178:0/3832879590 conn(0x7f694c0fa6f0 msgr2=0x7f694c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:02.182 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 shutdown_connections 2023-10-14T08:46:02.182 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:02.179+0000 7f69516b2700 1 -- 172.21.15.178:0/3832879590 wait complete. 2023-10-14T08:46:02.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: Reconfiguring mon.b (monmap changed)... 2023-10-14T08:46:02.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: Reconfiguring daemon mon.b on smithi057 2023-10-14T08:46:02.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:02.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:02.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:46:02.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:46:02.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:02.459 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: Reconfiguring mon.b (monmap changed)... 2023-10-14T08:46:02.459 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: Reconfiguring daemon mon.b on smithi057 2023-10-14T08:46:02.459 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:02.459 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:02.460 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:46:02.460 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:46:02.460 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:02.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: Reconfiguring mon.b (monmap changed)... 2023-10-14T08:46:02.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: Reconfiguring daemon mon.b on smithi057 2023-10-14T08:46:02.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:02.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:02.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-14T08:46:02.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-14T08:46:02.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:02.844 DEBUG:teuthology.orchestra.run.smithi057:mgr.y> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.y.service 2023-10-14T08:46:02.847 DEBUG:teuthology.orchestra.run.smithi178:mgr.z> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.z.service 2023-10-14T08:46:02.850 INFO:tasks.cephadm:Deploying OSDs... 2023-10-14T08:46:02.850 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:46:02.850 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T08:46:02.872 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T08:46:02.872 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-10-14T08:46:02.879 INFO:journalctl@ceph.mgr.z.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:46:02.883 INFO:journalctl@ceph.mgr.y.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:46:02.934 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T08:46:02.934 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:02.934 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 389720 Links: 1 2023-10-14T08:46:02.935 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:02.935 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:02.935 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-14 08:45:14.601515463 +0000 2023-10-14T08:46:02.935 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-14 08:39:38.184748820 +0000 2023-10-14T08:46:02.935 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-14 08:39:38.184748820 +0000 2023-10-14T08:46:02.936 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-14T08:46:02.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T08:46:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-14T08:46:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-14T08:46:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000279495 s, 1.8 MB/s 2023-10-14T08:46:03.009 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T08:46:03.070 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-10-14T08:46:03.130 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T08:46:03.130 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:03.130 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 386867 Links: 1 2023-10-14T08:46:03.130 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:03.131 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:03.131 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-14 08:45:14.660514884 +0000 2023-10-14T08:46:03.131 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-14 08:39:38.720743604 +0000 2023-10-14T08:46:03.131 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-14 08:39:38.720743604 +0000 2023-10-14T08:46:03.131 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-14T08:46:03.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T08:46:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-14T08:46:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-14T08:46:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000253267 s, 2.0 MB/s 2023-10-14T08:46:03.201 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T08:46:03.261 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-10-14T08:46:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T08:46:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:03.319 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 391611 Links: 1 2023-10-14T08:46:03.320 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:03.320 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:03.320 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-14 08:45:14.713514364 +0000 2023-10-14T08:46:03.320 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-14 08:39:39.246738486 +0000 2023-10-14T08:46:03.320 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-14 08:39:39.246738486 +0000 2023-10-14T08:46:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-14T08:46:03.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T08:46:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: Reconfiguring mon.c (monmap changed)... 2023-10-14T08:46:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: Reconfiguring daemon mon.c on smithi178 2023-10-14T08:46:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi057=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: Saving service mgr spec with placement smithi006=x;smithi057=y;smithi178=z;count:3 2023-10-14T08:46:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:03.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:03.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:03.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:03.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-14T08:46:03.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:03.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:03.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:03.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: Reconfiguring mon.c (monmap changed)... 2023-10-14T08:46:03.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: Reconfiguring daemon mon.c on smithi178 2023-10-14T08:46:03.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi057=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:03.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: Saving service mgr spec with placement smithi006=x;smithi057=y;smithi178=z;count:3 2023-10-14T08:46:03.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:03.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:03.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:03.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:03.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-14T08:46:03.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:03.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:03.391 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-14T08:46:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-14T08:46:03.392 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000214347 s, 2.4 MB/s 2023-10-14T08:46:03.392 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T08:46:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: Reconfiguring mon.c (monmap changed)... 2023-10-14T08:46:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: Reconfiguring daemon mon.c on smithi178 2023-10-14T08:46:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi057=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: Saving service mgr spec with placement smithi006=x;smithi057=y;smithi178=z;count:3 2023-10-14T08:46:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:03.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:03.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:03.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:03.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:03.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-14T08:46:03.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:03.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:03.450 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-10-14T08:46:03.508 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T08:46:03.508 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:03.508 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 386968 Links: 1 2023-10-14T08:46:03.508 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:03.508 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:03.509 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-10-14 08:45:14.766513844 +0000 2023-10-14T08:46:03.509 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-10-14 08:39:39.748733601 +0000 2023-10-14T08:46:03.509 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-10-14 08:39:39.748733601 +0000 2023-10-14T08:46:03.509 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-10-14T08:46:03.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T08:46:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-10-14T08:46:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-10-14T08:46:03.574 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000185214 s, 2.8 MB/s 2023-10-14T08:46:03.575 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T08:46:03.633 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-14T08:46:03.633 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T08:46:03.655 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T08:46:03.655 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-10-14T08:46:03.716 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T08:46:03.716 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:03.716 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 387868 Links: 1 2023-10-14T08:46:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-14 08:45:50.584659470 +0000 2023-10-14T08:46:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-14 08:39:40.788504861 +0000 2023-10-14T08:46:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-14 08:39:40.788504861 +0000 2023-10-14T08:46:03.718 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-14T08:46:03.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T08:46:03.787 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-14T08:46:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-14T08:46:03.788 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000417001 s, 1.2 MB/s 2023-10-14T08:46:03.789 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T08:46:03.851 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-10-14T08:46:03.911 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T08:46:03.912 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:03.912 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 391613 Links: 1 2023-10-14T08:46:03.912 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:03.912 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:03.913 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-14 08:45:50.584659470 +0000 2023-10-14T08:46:03.913 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-14 08:39:41.329496353 +0000 2023-10-14T08:46:03.913 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-14 08:39:41.329496353 +0000 2023-10-14T08:46:03.913 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-14T08:46:03.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T08:46:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-14T08:46:03.983 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-14T08:46:03.984 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000349195 s, 1.5 MB/s 2023-10-14T08:46:03.985 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T08:46:04.047 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-10-14T08:46:04.108 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T08:46:04.108 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:04.108 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 388084 Links: 1 2023-10-14T08:46:04.108 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:04.109 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:04.109 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-14 08:45:50.584659470 +0000 2023-10-14T08:46:04.109 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-14 08:39:41.845488238 +0000 2023-10-14T08:46:04.109 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-14 08:39:41.845488238 +0000 2023-10-14T08:46:04.109 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-14T08:46:04.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T08:46:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-14T08:46:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-14T08:46:04.183 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.00353496 s, 145 kB/s 2023-10-14T08:46:04.184 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T08:46:04.246 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-10-14T08:46:04.307 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T08:46:04.307 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:04.307 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 396452 Links: 1 2023-10-14T08:46:04.307 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:04.308 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:04.308 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-14 08:45:50.585659454 +0000 2023-10-14T08:46:04.308 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-14 08:39:42.377479871 +0000 2023-10-14T08:46:04.308 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-14 08:39:42.377479871 +0000 2023-10-14T08:46:04.309 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-14T08:46:04.309 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T08:46:04.373 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:04 smithi178 ceph-mon[103612]: Deploying daemon mgr.z on smithi178 2023-10-14T08:46:04.377 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-14T08:46:04.377 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-14T08:46:04.378 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000400539 s, 1.3 MB/s 2023-10-14T08:46:04.379 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T08:46:04.439 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-10-14T08:46:04.440 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T08:46:04.443 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:04 smithi057 ceph-mon[103313]: Deploying daemon mgr.z on smithi178 2023-10-14T08:46:04.457 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T08:46:04.457 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-10-14T08:46:04.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:04 smithi006 ceph-mon[99452]: Deploying daemon mgr.z on smithi178 2023-10-14T08:46:04.516 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T08:46:04.517 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:04.517 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 393265 Links: 1 2023-10-14T08:46:04.517 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:04.518 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:04.518 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-10-14 08:46:04.495498101 +0000 2023-10-14T08:46:04.518 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-10-14 08:39:20.462976510 +0000 2023-10-14T08:46:04.518 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-10-14 08:39:20.462976510 +0000 2023-10-14T08:46:04.519 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-10-14T08:46:04.519 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T08:46:04.668 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-10-14T08:46:04.668 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-10-14T08:46:04.669 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.00012 s, 4.3 MB/s 2023-10-14T08:46:04.670 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T08:46:04.688 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-10-14T08:46:04.747 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T08:46:04.747 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:04.748 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 393339 Links: 1 2023-10-14T08:46:04.748 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:04.748 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:04.748 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-10-14 08:46:04.621498094 +0000 2023-10-14T08:46:04.749 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-10-14 08:39:20.973976704 +0000 2023-10-14T08:46:04.749 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-10-14 08:39:20.973976704 +0000 2023-10-14T08:46:04.749 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-10-14T08:46:04.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T08:46:04.816 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-10-14T08:46:04.817 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-10-14T08:46:04.817 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000108292 s, 4.7 MB/s 2023-10-14T08:46:04.818 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T08:46:04.878 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-10-14T08:46:04.935 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T08:46:04.936 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:04.936 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 395514 Links: 1 2023-10-14T08:46:04.936 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:04.936 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:04.936 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-10-14 08:46:04.621498094 +0000 2023-10-14T08:46:04.937 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-10-14 08:39:21.480976896 +0000 2023-10-14T08:46:04.937 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-10-14 08:39:21.480976896 +0000 2023-10-14T08:46:04.937 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-10-14T08:46:04.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T08:46:04.939 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:04 smithi178 systemd[1]: Starting Ceph mgr.z for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:46:04.965 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-10-14T08:46:04.965 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-10-14T08:46:04.965 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.786e-05 s, 5.2 MB/s 2023-10-14T08:46:04.966 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T08:46:05.024 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-10-14T08:46:05.083 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T08:46:05.083 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T08:46:05.083 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 387800 Links: 1 2023-10-14T08:46:05.084 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T08:46:05.084 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T08:46:05.084 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-10-14 08:46:04.621498094 +0000 2023-10-14T08:46:05.084 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-10-14 08:39:21.999977093 +0000 2023-10-14T08:46:05.084 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-10-14 08:39:21.999977093 +0000 2023-10-14T08:46:05.085 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-10-14T08:46:05.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T08:46:05.148 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-10-14T08:46:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-10-14T08:46:05.149 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.0721e-05 s, 5.6 MB/s 2023-10-14T08:46:05.150 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T08:46:05.190 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:04 smithi178 podman[105576]: 2023-10-14T08:46:05.207 INFO:tasks.cephadm:Deploying osd.0 on smithi006 with /dev/vg_nvme/lv_4... 2023-10-14T08:46:05.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-14T08:46:05.458 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:05 smithi057 ceph-mon[103313]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:05.476 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-mon[103612]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:05.477 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-mgr[105761]: -- 172.21.15.178:0/1533564553 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5624787631e0 con 0x562478739000 2023-10-14T08:46:05.477 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 bash[105576]: b4c9c48384404905df4cea64e250db97ac004cc95012e103525938ea96e09ed1 2023-10-14T08:46:05.477 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 systemd[1]: Started Ceph mgr.z for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:46:05.477 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:05.382+0000 7fecdcb13200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T08:46:05.478 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:05.474+0000 7fecdcb13200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T08:46:05.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:05 smithi006 ceph-mon[99452]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:05.826 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:05.563+0000 7fecdcb13200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T08:46:05.827 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:05.657+0000 7fecdcb13200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T08:46:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:46:06.133 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:05.825+0000 7fecdcb13200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T08:46:06.502 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:06.186+0000 7fecdcb13200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T08:46:06.502 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:06.318+0000 7fecdcb13200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T08:46:06.502 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:06.405+0000 7fecdcb13200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T08:46:06.502 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:06.500+0000 7fecdcb13200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T08:46:06.503 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:06.503 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.503 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.503 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.503 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:06.504 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-14T08:46:06.504 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:06.504 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:06.504 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-mon[103612]: Deploying daemon mgr.y on smithi057 2023-10-14T08:46:06.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:06.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.611 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.612 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.612 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:06.612 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-14T08:46:06.612 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:06.612 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:06.613 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:06 smithi006 ceph-mon[99452]: Deploying daemon mgr.y on smithi057 2023-10-14T08:46:06.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:06.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:06.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:06.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-14T08:46:06.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:06.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:06.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:06 smithi057 ceph-mon[103313]: Deploying daemon mgr.y on smithi057 2023-10-14T08:46:07.194 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:06 smithi057 systemd[1]: Starting Ceph mgr.y for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:46:07.383 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:06.919+0000 7fecdcb13200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T08:46:07.525 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 podman[104756]: 2023-10-14T08:46:07.648 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-14T08:46:07.649 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-14T08:46:07.649 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-10-14T08:46:07.649 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-10-14T08:46:07.649 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0199832 s, 525 MB/s 2023-10-14T08:46:07.649 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-10-14T08:46:07.781 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 bash[104756]: 298526152a1569f66bdce2e1a1dfdf3e43126cfa8074fec8bd2331f4817de01d 2023-10-14T08:46:07.782 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 ceph-mgr[104796]: -- 172.21.15.57:0/3070334936 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e2895371e0 con 0x55e28950cc00 2023-10-14T08:46:07.782 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 systemd[1]: Started Ceph mgr.y for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:46:07.782 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:07.679+0000 7f6180b28200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T08:46:07.782 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:07.780+0000 7f6180b28200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T08:46:07.883 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:07.579+0000 7fecdcb13200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T08:46:07.884 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:07.661+0000 7fecdcb13200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T08:46:08.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi006:vg_nvme/lv_4 2023-10-14T08:46:08.194 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:07.890+0000 7f6180b28200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T08:46:08.194 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:08.005+0000 7f6180b28200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T08:46:08.634 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:08.229+0000 7f6180b28200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T08:46:08.725 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:46:08.732 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:08.458+0000 7fecdcb13200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:46:08.732 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:08.554+0000 7fecdcb13200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T08:46:08.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:08.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:08.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:08.725+0000 7f6180b28200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T08:46:08.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:08.881+0000 7f6180b28200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T08:46:08.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:08.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:08.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.959 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:08.959 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.959 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:08.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:08.960 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:09.030 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:08.729+0000 7fecdcb13200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:46:09.383 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:09.027+0000 7fecdcb13200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T08:46:09.384 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:09.260+0000 7fecdcb13200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T08:46:09.444 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:08.990+0000 7f6180b28200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T08:46:09.444 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:09.110+0000 7f6180b28200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T08:46:09.683 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:09.416+0000 7fecdcb13200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T08:46:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 -- 172.21.15.6:0/216975198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe240100b10 msgr2=0x7fe240100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 --2- 172.21.15.6:0/216975198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe240100b10 0x7fe240100f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe23800b0a0 tx=0x7fe23800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:46:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 -- 172.21.15.6:0/216975198 shutdown_connections 2023-10-14T08:46:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 --2- 172.21.15.6:0/216975198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe240100b10 0x7fe240100f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 --2- 172.21.15.6:0/216975198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2400ff7f0 0x7fe2400ffc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 --2- 172.21.15.6:0/216975198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe240100150 0x7fe2401005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 -- 172.21.15.6:0/216975198 >> 172.21.15.6:0/216975198 conn(0x7fe2400fb3f0 msgr2=0x7fe2400fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 -- 172.21.15.6:0/216975198 shutdown_connections 2023-10-14T08:46:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.912+0000 7fe24495e700 1 -- 172.21.15.6:0/216975198 wait complete. 2023-10-14T08:46:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 Processor -- start 2023-10-14T08:46:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 -- start start 2023-10-14T08:46:09.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 0x7fe240198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe240100150 0x7fe240199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe240100b10 0x7fe2401a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2401a0a60 con 0x7fe2400ff7f0 2023-10-14T08:46:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2401a0ba0 con 0x7fe240100b10 2023-10-14T08:46:09.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe24495e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2401a0d30 con 0x7fe240100150 2023-10-14T08:46:09.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe23e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 0x7fe240198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:09.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe23e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 0x7fe240198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58428/0 (socket says 172.21.15.6:58428) 2023-10-14T08:46:09.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe23e59c700 1 -- 172.21.15.6:0/3896923953 learned_addr learned my addr 172.21.15.6:0/3896923953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:46:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe23ed9d700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe240100b10 0x7fe2401a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.913+0000 7fe23dd9b700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe240100150 0x7fe240199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe23e59c700 1 -- 172.21.15.6:0/3896923953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe240100150 msgr2=0x7fe240199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:09.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe23e59c700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe240100150 0x7fe240199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:09.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe23e59c700 1 -- 172.21.15.6:0/3896923953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe240100b10 msgr2=0x7fe2401a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:09.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe23e59c700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe240100b10 0x7fe2401a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:09.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe23e59c700 1 -- 172.21.15.6:0/3896923953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009d00 con 0x7fe2400ff7f0 2023-10-14T08:46:09.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe23e59c700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 0x7fe240198ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe23000e9d0 tx=0x7fe23000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:09.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230009790 con 0x7fe2400ff7f0 2023-10-14T08:46:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe23000ee70 con 0x7fe2400ff7f0 2023-10-14T08:46:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2401a0fb0 con 0x7fe2400ff7f0 2023-10-14T08:46:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230010ea0 con 0x7fe2400ff7f0 2023-10-14T08:46:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.914+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2401a1470 con 0x7fe2400ff7f0 2023-10-14T08:46:09.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.915+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24010a5d0 con 0x7fe2400ff7f0 2023-10-14T08:46:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.916+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45634+0+0 (secure 0 0 0) 0x7fe23000cbd0 con 0x7fe2400ff7f0 2023-10-14T08:46:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.916+0000 7fe22f7fe700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe228038af0 0x7fe22803afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.916+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe230014070 con 0x7fe2400ff7f0 2023-10-14T08:46:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.916+0000 7fe23dd9b700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe228038af0 0x7fe22803afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:09.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.917+0000 7fe23dd9b700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe228038af0 0x7fe22803afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe234009c60 tx=0x7fe234009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:09.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:09.921+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe230017e30 con 0x7fe2400ff7f0 2023-10-14T08:46:09.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:09.645+0000 7f6180b28200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T08:46:10.133 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:09.682+0000 7fecdcb13200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T08:46:10.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:10.134+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe24002d2f0 con 0x7fe228038af0 2023-10-14T08:46:10.634 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:10.381+0000 7fecdcb13200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T08:46:10.635 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:10.511+0000 7fecdcb13200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T08:46:10.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:10.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:10.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: Reconfiguring mgr.x (unknown last config time)... 2023-10-14T08:46:10.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:10.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:10.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: Reconfiguring daemon mgr.x on smithi006 2023-10-14T08:46:10.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:10.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:10.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:10.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: Reconfiguring mgr.x (unknown last config time)... 2023-10-14T08:46:10.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:10.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:10.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: Reconfiguring daemon mgr.x on smithi006 2023-10-14T08:46:10.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:10.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:10.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:10.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:10.444+0000 7f6180b28200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T08:46:10.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:10.542+0000 7f6180b28200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T08:46:10.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:10.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:10.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:10.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: Reconfiguring mgr.x (unknown last config time)... 2023-10-14T08:46:10.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-14T08:46:10.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-14T08:46:10.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:10.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: Reconfiguring daemon mgr.x on smithi006 2023-10-14T08:46:10.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:10.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:10.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:10.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:11.035 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:10.703+0000 7fecdcb13200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T08:46:11.035 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:10.816+0000 7fecdcb13200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T08:46:11.860 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:11.522+0000 7f6180b28200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:46:11.860 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:11.634+0000 7f6180b28200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T08:46:11.860 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:11.859+0000 7f6180b28200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T08:46:12.225 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:11.034+0000 7fecdcb13200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T08:46:12.226 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 08:46:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z[105675]: 2023-10-14T08:46:11.896+0000 7fecdcb13200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T08:46:12.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:12.296+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 14) v1 ==== 90790+0+0 (secure 0 0 0) 0x7fe23001ed50 con 0x7fe2400ff7f0 2023-10-14T08:46:12.468 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:12.213+0000 7f6180b28200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T08:46:12.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.468 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:12.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:12.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:12.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.469 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:12.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: Standby manager daemon z started 2023-10-14T08:46:12.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-14T08:46:12.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-14T08:46:12.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-14T08:46:12.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-14T08:46:12.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:12.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:12.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:12.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:12.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: Standby manager daemon z started 2023-10-14T08:46:12.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-14T08:46:12.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-14T08:46:12.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-14T08:46:12.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:12 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-14T08:46:12.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:12.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:12.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:12.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:12.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:12.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: Standby manager daemon z started 2023-10-14T08:46:12.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-14T08:46:12.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-14T08:46:12.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-14T08:46:12.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:12 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.178:0/3431620036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-14T08:46:12.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:12.466+0000 7f6180b28200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T08:46:12.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:12.650+0000 7f6180b28200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T08:46:13.296 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:12.984+0000 7f6180b28200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T08:46:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:13 smithi178 ceph-mon[103612]: mgrmap e14: x(active, since 68s), standbys: z 2023-10-14T08:46:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-14T08:46:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/4099093005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ef84fd5-07bb-4e54-aaaa-b818f688ee47"}]: dispatch 2023-10-14T08:46:13.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/4099093005' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ef84fd5-07bb-4e54-aaaa-b818f688ee47"}]': finished 2023-10-14T08:46:13.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:13 smithi178 ceph-mon[103612]: osdmap e5: 1 total, 0 up, 1 in 2023-10-14T08:46:13.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-mon[103313]: mgrmap e14: x(active, since 68s), standbys: z 2023-10-14T08:46:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-14T08:46:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/4099093005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ef84fd5-07bb-4e54-aaaa-b818f688ee47"}]: dispatch 2023-10-14T08:46:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/4099093005' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ef84fd5-07bb-4e54-aaaa-b818f688ee47"}]': finished 2023-10-14T08:46:13.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-mon[103313]: osdmap e5: 1 total, 0 up, 1 in 2023-10-14T08:46:13.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:13 smithi006 ceph-mon[99452]: mgrmap e14: x(active, since 68s), standbys: z 2023-10-14T08:46:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-14T08:46:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4099093005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ef84fd5-07bb-4e54-aaaa-b818f688ee47"}]: dispatch 2023-10-14T08:46:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4099093005' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ef84fd5-07bb-4e54-aaaa-b818f688ee47"}]': finished 2023-10-14T08:46:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:13 smithi006 ceph-mon[99452]: osdmap e5: 1 total, 0 up, 1 in 2023-10-14T08:46:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:14.194 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:13.813+0000 7f6180b28200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T08:46:14.194 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:13.973+0000 7f6180b28200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T08:46:14.633 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:14 smithi057 ceph-mon[103313]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:14.633 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:14 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/444562594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:14.634 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:14.219+0000 7f6180b28200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T08:46:14.634 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:14.356+0000 7f6180b28200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T08:46:14.634 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:14.631+0000 7f6180b28200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T08:46:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:14 smithi178 ceph-mon[103612]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:14 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/444562594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:14.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:14 smithi006 ceph-mon[99452]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:14.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:14 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/444562594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:15.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 08:46:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y[104772]: 2023-10-14T08:46:15.684+0000 7f6180b28200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T08:46:16.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:16.434+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7fe230021cd0 con 0x7fe2400ff7f0 2023-10-14T08:46:16.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:16 smithi057 ceph-mon[103313]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:16.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:16 smithi057 ceph-mon[103313]: Standby manager daemon y started 2023-10-14T08:46:16.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:16 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-14T08:46:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:16 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-14T08:46:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:16 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-14T08:46:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:16 smithi057 ceph-mon[103313]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-14T08:46:16.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:16 smithi006 ceph-mon[99452]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:16.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:16 smithi006 ceph-mon[99452]: Standby manager daemon y started 2023-10-14T08:46:16.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:16 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-14T08:46:16.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:16 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-14T08:46:16.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:16 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-14T08:46:16.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:16 smithi006 ceph-mon[99452]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-14T08:46:16.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:16 smithi178 ceph-mon[103612]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:16.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:16 smithi178 ceph-mon[103612]: Standby manager daemon y started 2023-10-14T08:46:16.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:16 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-14T08:46:16.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:16 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-14T08:46:16.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:16 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-14T08:46:16.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:16 smithi178 ceph-mon[103612]: from='mgr.? 172.21.15.57:0/62953042' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-14T08:46:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:17 smithi057 ceph-mon[103313]: mgrmap e15: x(active, since 73s), standbys: y, z 2023-10-14T08:46:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-14T08:46:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:17 smithi006 ceph-mon[99452]: mgrmap e15: x(active, since 73s), standbys: y, z 2023-10-14T08:46:17.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-14T08:46:17.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:17 smithi178 ceph-mon[103612]: mgrmap e15: x(active, since 73s), standbys: y, z 2023-10-14T08:46:17.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-14T08:46:18.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:18 smithi057 ceph-mon[103313]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:18.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:18 smithi006 ceph-mon[99452]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:18.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:18 smithi178 ceph-mon[103612]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:20.727 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:20 smithi006 ceph-mon[99452]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:20.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:20 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-14T08:46:20.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:20 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:20.728 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:20 smithi006 ceph-mon[99452]: Deploying daemon osd.0 on smithi006 2023-10-14T08:46:20.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:20 smithi178 ceph-mon[103612]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:20.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:20 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-14T08:46:20.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:20 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:20.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:20 smithi178 ceph-mon[103612]: Deploying daemon osd.0 on smithi006 2023-10-14T08:46:20.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:20 smithi057 ceph-mon[103313]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:20.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:20 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-14T08:46:20.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:20 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:20.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:20 smithi057 ceph-mon[103313]: Deploying daemon osd.0 on smithi006 2023-10-14T08:46:23.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:23 smithi006 ceph-mon[99452]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:23.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:23 smithi178 ceph-mon[103612]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:23 smithi057 ceph-mon[103313]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:25 smithi006 ceph-mon[99452]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:25 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:25 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:25 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:25 smithi178 ceph-mon[103612]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:25 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:25 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:25 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:25 smithi057 ceph-mon[103313]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:25 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:25 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:25 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.836+0000 7fe22f7fe700 1 -- 172.21.15.6:0/3896923953 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe24002d2f0 con 0x7fe228038af0 2023-10-14T08:46:26.838 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 0 on host 'smithi006' 2023-10-14T08:46:26.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.838+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe228038af0 msgr2=0x7fe22803afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:26.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.838+0000 7fe24495e700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe228038af0 0x7fe22803afb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe234009c60 tx=0x7fe234009260 comp rx=0 tx=0).stop 2023-10-14T08:46:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 msgr2=0x7fe240198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 0x7fe240198ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe23000e9d0 tx=0x7fe23000ece0 comp rx=0 tx=0).stop 2023-10-14T08:46:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 shutdown_connections 2023-10-14T08:46:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe228038af0 0x7fe22803afb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe240100b10 0x7fe2401a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2400ff7f0 0x7fe240198ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 --2- 172.21.15.6:0/3896923953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe240100150 0x7fe240199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 >> 172.21.15.6:0/3896923953 conn(0x7fe2400fb3f0 msgr2=0x7fe2400fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 shutdown_connections 2023-10-14T08:46:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:46:26.839+0000 7fe24495e700 1 -- 172.21.15.6:0/3896923953 wait complete. 2023-10-14T08:46:27.326 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:27.326 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.327 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.327 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:27.327 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:27.327 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.327 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.328 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.328 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:27.329 DEBUG:teuthology.orchestra.run.smithi006:osd.0> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.0.service 2023-10-14T08:46:27.331 INFO:tasks.cephadm:Deploying osd.1 on smithi057 with /dev/vg_nvme/lv_4... 2023-10-14T08:46:27.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-14T08:46:27.366 INFO:journalctl@ceph.osd.0.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:46:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:27.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:27.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:27.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:27.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:27.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:46:28.381 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:28 smithi057 ceph-mon[103313]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-14T08:46:28.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:28 smithi006 ceph-mon[99452]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-14T08:46:28.482 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:46:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0[118216]: 2023-10-14T08:46:28.060+0000 7f3846d09640 -1 osd.0 0 log_to_monitors true 2023-10-14T08:46:28.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:28 smithi178 ceph-mon[103612]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-14T08:46:29.402 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-14T08:46:29.402 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-14T08:46:29.402 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-10-14T08:46:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-10-14T08:46:29.403 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011151 s, 940 MB/s 2023-10-14T08:46:29.403 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-10-14T08:46:29.437 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:29 smithi057 ceph-mon[103313]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:29.437 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:29 smithi057 ceph-mon[103313]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-14T08:46:29.437 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:29 smithi057 ceph-mon[103313]: osdmap e6: 1 total, 0 up, 1 in 2023-10-14T08:46:29.438 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:29 smithi057 ceph-mon[103313]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:46:29.438 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:29.473 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0[118216]: 2023-10-14T08:46:29.155+0000 7f383bb7f700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T08:46:29.474 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0[118216]: 2023-10-14T08:46:29.159+0000 7f3838175700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:46:29.474 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-mon[99452]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:29.474 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-mon[99452]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-14T08:46:29.475 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-mon[99452]: osdmap e6: 1 total, 0 up, 1 in 2023-10-14T08:46:29.475 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-mon[99452]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:46:29.475 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:29 smithi178 ceph-mon[103612]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:29 smithi178 ceph-mon[103612]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-14T08:46:29.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:29 smithi178 ceph-mon[103612]: osdmap e6: 1 total, 0 up, 1 in 2023-10-14T08:46:29.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:29 smithi178 ceph-mon[103612]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:46:29.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:29.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi057:vg_nvme/lv_4 2023-10-14T08:46:30.307 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:46:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:46:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: osdmap e7: 1 total, 0 up, 1 in 2023-10-14T08:46:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:46:30.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:30.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:30.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:46:30.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: osdmap e7: 1 total, 0 up, 1 in 2023-10-14T08:46:30.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:46:30.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:30.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:30.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:46:30.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: osdmap e7: 1 total, 0 up, 1 in 2023-10-14T08:46:30.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:46:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:30.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:30.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:30.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:31.413 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:46:31.413 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:46:31.413 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:31.414 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi006 2023-10-14T08:46:31.414 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi006 to 17173M 2023-10-14T08:46:31.414 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] boot 2023-10-14T08:46:31.415 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: osdmap e8: 1 total, 1 up, 1 in 2023-10-14T08:46:31.415 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:46:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:46:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi006 2023-10-14T08:46:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi006 to 17173M 2023-10-14T08:46:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] boot 2023-10-14T08:46:31.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: osdmap e8: 1 total, 1 up, 1 in 2023-10-14T08:46:31.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:31.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 -- 172.21.15.57:0/1796408803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4102c70 msgr2=0x7f6be4109520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:31.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1796408803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4102c70 0x7f6be4109520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00b0a0 tx=0x7f6bdc00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:46:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 -- 172.21.15.57:0/1796408803 shutdown_connections 2023-10-14T08:46:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1796408803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4102c70 0x7f6be4109520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1796408803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6be40ff250 0x7f6be40ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1796408803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be41022d0 0x7f6be4102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 -- 172.21.15.57:0/1796408803 >> 172.21.15.57:0/1796408803 conn(0x7f6be40fab70 msgr2=0x7f6be40fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 -- 172.21.15.57:0/1796408803 shutdown_connections 2023-10-14T08:46:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 -- 172.21.15.57:0/1796408803 wait complete. 2023-10-14T08:46:31.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 Processor -- start 2023-10-14T08:46:31.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.609+0000 7f6bea38b700 1 -- start start 2023-10-14T08:46:31.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6bea38b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6be40ff250 0x7f6be4196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:31.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6bea38b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 0x7f6be4197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:31.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6bea38b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be4102c70 0x7f6be419e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:31.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6bea38b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be419e850 con 0x7f6be4102c70 2023-10-14T08:46:31.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6bea38b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be419e990 con 0x7f6be41022d0 2023-10-14T08:46:31.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6bea38b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be419eb50 con 0x7f6be40ff250 2023-10-14T08:46:31.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 0x7f6be4197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:31.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 0x7f6be4197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58776/0 (socket says 172.21.15.57:58776) 2023-10-14T08:46:31.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 -- 172.21.15.57:0/1351204554 learned_addr learned my addr 172.21.15.57:0/1351204554 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-14T08:46:31.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be8928700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be4102c70 0x7f6be419e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:31.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be3fff700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6be40ff250 0x7f6be4196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:31.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 -- 172.21.15.57:0/1351204554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6be40ff250 msgr2=0x7f6be4196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:31.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6be40ff250 0x7f6be4196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:31.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 -- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be4102c70 msgr2=0x7f6be419e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:31.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be4102c70 0x7f6be419e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:31.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 -- 172.21.15.57:0/1351204554 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009d00 con 0x7f6be41022d0 2023-10-14T08:46:31.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.610+0000 7f6be37fe700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 0x7f6be4197240 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800c9b0 tx=0x7f6bd800ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:31.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.611+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8007b00 con 0x7f6be41022d0 2023-10-14T08:46:31.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.611+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bd8007c60 con 0x7f6be41022d0 2023-10-14T08:46:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.611+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8018660 con 0x7f6be41022d0 2023-10-14T08:46:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.611+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be419ee30 con 0x7f6be41022d0 2023-10-14T08:46:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.611+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be419f240 con 0x7f6be41022d0 2023-10-14T08:46:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.612+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be410c830 con 0x7f6be41022d0 2023-10-14T08:46:31.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.613+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f6bd800f450 con 0x7f6be41022d0 2023-10-14T08:46:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.614+0000 7f6be17fa700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6bcc0a1540 0x7f6bcc0a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.614+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f6bd80cb310 con 0x7f6be41022d0 2023-10-14T08:46:31.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.614+0000 7f6be3fff700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6bcc0a1540 0x7f6bcc0a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:31.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.614+0000 7f6be3fff700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6bcc0a1540 0x7f6bcc0a3a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4005950 tx=0x7f6bd40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:31.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.617+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6bd80965d0 con 0x7f6be41022d0 2023-10-14T08:46:31.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:46:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:46:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-14T08:46:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi006 2023-10-14T08:46:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi006 to 17173M 2023-10-14T08:46:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: osd.0 [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] boot 2023-10-14T08:46:31.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: osdmap e8: 1 total, 1 up, 1 in 2023-10-14T08:46:31.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-14T08:46:31.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:31.829+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6be40612f0 con 0x7f6bcc0a1540 2023-10-14T08:46:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:32.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:32.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:32 smithi057 ceph-mon[103313]: osdmap e9: 1 total, 1 up, 1 in 2023-10-14T08:46:32.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:32 smithi006 ceph-mon[99452]: osdmap e9: 1 total, 1 up, 1 in 2023-10-14T08:46:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:32.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:32 smithi178 ceph-mon[103612]: osdmap e9: 1 total, 1 up, 1 in 2023-10-14T08:46:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:33 smithi057 ceph-mon[103313]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:33 smithi057 ceph-mon[103313]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:33 smithi006 ceph-mon[99452]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:33 smithi006 ceph-mon[99452]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:33 smithi178 ceph-mon[103612]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:33 smithi178 ceph-mon[103612]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:35.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/2274392325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]: dispatch 2023-10-14T08:46:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]: dispatch 2023-10-14T08:46:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]': finished 2023-10-14T08:46:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: osdmap e10: 2 total, 1 up, 2 in 2023-10-14T08:46:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:35 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/574770225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/2274392325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]: dispatch 2023-10-14T08:46:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]: dispatch 2023-10-14T08:46:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]': finished 2023-10-14T08:46:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: osdmap e10: 2 total, 1 up, 2 in 2023-10-14T08:46:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:35 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/574770225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/2274392325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]: dispatch 2023-10-14T08:46:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]: dispatch 2023-10-14T08:46:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b566713f-39eb-446e-b9e4-e730ef64ecd0"}]': finished 2023-10-14T08:46:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: osdmap e10: 2 total, 1 up, 2 in 2023-10-14T08:46:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:35.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:35 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/574770225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:37.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:37 smithi178 ceph-mon[103612]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:37 smithi057 ceph-mon[103313]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:37.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:37 smithi006 ceph-mon[99452]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:39.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:39 smithi178 ceph-mon[103612]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:39.413 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:39 smithi057 ceph-mon[103313]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:39.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:39 smithi006 ceph-mon[99452]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:41.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:41 smithi178 ceph-mon[103612]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:41.420 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:41 smithi057 ceph-mon[103313]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:41.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:41 smithi006 ceph-mon[99452]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:43 smithi178 ceph-mon[103612]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-14T08:46:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:43 smithi057 ceph-mon[103313]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-14T08:46:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:43.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:43 smithi006 ceph-mon[99452]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:43.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-14T08:46:43.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:44.298 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:44 smithi057 ceph-mon[103313]: Deploying daemon osd.1 on smithi057 2023-10-14T08:46:44.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:44 smithi006 ceph-mon[99452]: Deploying daemon osd.1 on smithi057 2023-10-14T08:46:44.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:44 smithi178 ceph-mon[103612]: Deploying daemon osd.1 on smithi057 2023-10-14T08:46:45.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:45 smithi057 ceph-mon[103313]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:45 smithi006 ceph-mon[99452]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:45.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:45 smithi178 ceph-mon[103612]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:47.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:47 smithi057 ceph-mon[103313]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:47.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:47.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:47.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:47 smithi006 ceph-mon[99452]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:47.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:47.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:47.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:47 smithi178 ceph-mon[103612]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:49 smithi057 ceph-mon[103313]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:49.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:49.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:49 smithi006 ceph-mon[99452]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:49.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:49.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.551 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 1 on host 'smithi057' 2023-10-14T08:46:49.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.549+0000 7f6be17fa700 1 -- 172.21.15.57:0/1351204554 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6be40612f0 con 0x7f6bcc0a1540 2023-10-14T08:46:49.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6bcc0a1540 msgr2=0x7f6bcc0a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:49.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6bcc0a1540 0x7f6bcc0a3a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4005950 tx=0x7f6bd40058e0 comp rx=0 tx=0).stop 2023-10-14T08:46:49.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 msgr2=0x7f6be4197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:49.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 0x7f6be4197240 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800c9b0 tx=0x7f6bd800ccc0 comp rx=0 tx=0).stop 2023-10-14T08:46:49.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 shutdown_connections 2023-10-14T08:46:49.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be4102c70 0x7f6be419e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:49.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6be40ff250 0x7f6be4196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:49.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6bcc0a1540 0x7f6bcc0a3a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:49.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 --2- 172.21.15.57:0/1351204554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be41022d0 0x7f6be4197240 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:49.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 >> 172.21.15.57:0/1351204554 conn(0x7f6be40fab70 msgr2=0x7f6be40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:49.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 shutdown_connections 2023-10-14T08:46:49.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:46:49.551+0000 7f6bea38b700 1 -- 172.21.15.57:0/1351204554 wait complete. 2023-10-14T08:46:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:49 smithi178 ceph-mon[103612]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:49.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:49.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:49.917 DEBUG:teuthology.orchestra.run.smithi057:osd.1> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.1.service 2023-10-14T08:46:49.920 INFO:tasks.cephadm:Deploying osd.2 on smithi178 with /dev/vg_nvme/lv_4... 2023-10-14T08:46:49.920 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-14T08:46:49.954 INFO:journalctl@ceph.osd.1.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:46:50.486 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:46:50.676 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:50 smithi057 ceph-mon[103313]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:50.676 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:50.676 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:50.676 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:50.746 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:50 smithi178 ceph-mon[103612]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:50.746 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:50.747 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:50.747 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:50.928 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:46:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1[108392]: 2023-10-14T08:46:50.672+0000 7f5976e95640 -1 osd.1 0 log_to_monitors true 2023-10-14T08:46:50.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:50 smithi006 ceph-mon[99452]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:46:51.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:51 smithi178 ceph-mon[103612]: from='osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-14T08:46:51.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:51 smithi178 ceph-mon[103612]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-14T08:46:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:51 smithi057 ceph-mon[103313]: from='osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-14T08:46:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:51 smithi057 ceph-mon[103313]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-14T08:46:51.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:51 smithi006 ceph-mon[99452]: from='osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-14T08:46:51.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:51 smithi006 ceph-mon[99452]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-14T08:46:52.008 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-14T08:46:52.009 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-14T08:46:52.009 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-10-14T08:46:52.009 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-10-14T08:46:52.009 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00831333 s, 1.3 GB/s 2023-10-14T08:46:52.009 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-10-14T08:46:52.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2023-10-14T08:46:52.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:52 smithi178 ceph-mon[103612]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:52 smithi178 ceph-mon[103612]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-14T08:46:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:52 smithi178 ceph-mon[103612]: from='osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:46:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:52 smithi178 ceph-mon[103612]: osdmap e11: 2 total, 1 up, 2 in 2023-10-14T08:46:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:52.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:52 smithi178 ceph-mon[103612]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:46:52.944 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1[108392]: 2023-10-14T08:46:52.508+0000 7f596bd0b700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T08:46:52.944 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1[108392]: 2023-10-14T08:46:52.515+0000 7f5968301700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:46:52.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-mon[103313]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:52.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-mon[103313]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-14T08:46:52.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-mon[103313]: from='osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:46:52.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-mon[103313]: osdmap e11: 2 total, 1 up, 2 in 2023-10-14T08:46:52.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:52.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:52 smithi057 ceph-mon[103313]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:46:52.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:52 smithi006 ceph-mon[99452]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:52.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:52 smithi006 ceph-mon[99452]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-14T08:46:52.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:52 smithi006 ceph-mon[99452]: from='osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:46:52.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:52 smithi006 ceph-mon[99452]: osdmap e11: 2 total, 1 up, 2 in 2023-10-14T08:46:52.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:52.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:52 smithi006 ceph-mon[99452]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:46:52.999 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:46:53.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:46:53.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: osdmap e12: 2 total, 1 up, 2 in 2023-10-14T08:46:53.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:53.786 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi057 2023-10-14T08:46:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.787 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:46:53.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi057 to 17173M 2023-10-14T08:46:53.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:53.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:53.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:53 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:46:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: osdmap e12: 2 total, 1 up, 2 in 2023-10-14T08:46:53.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:53.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:53.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi057 2023-10-14T08:46:53.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:46:53.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi057 to 17173M 2023-10-14T08:46:53.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:53.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:53.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:53 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:46:53.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: osdmap e12: 2 total, 1 up, 2 in 2023-10-14T08:46:53.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:53.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:53.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi057 2023-10-14T08:46:53.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:46:53.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi057 to 17173M 2023-10-14T08:46:53.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:53.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:53.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:46:53.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:53 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:46:54.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/2211417874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd8100fd0 msgr2=0x7f3dd8101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:54.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/2211417874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8101450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009990 tx=0x7f3dcc009ca0 comp rx=0 tx=0).stop 2023-10-14T08:46:54.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/2211417874 shutdown_connections 2023-10-14T08:46:54.331 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/2211417874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 0x7f3dd81082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:54.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/2211417874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:54.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/2211417874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8101450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:54.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/2211417874 >> 172.21.15.178:0/2211417874 conn(0x7f3dd80fb3f0 msgr2=0x7f3dd80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:46:54.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/2211417874 shutdown_connections 2023-10-14T08:46:54.332 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.327+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/2211417874 wait complete. 2023-10-14T08:46:54.333 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 Processor -- start 2023-10-14T08:46:54.333 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 -- start start 2023-10-14T08:46:54.333 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:54.333 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:54.333 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 0x7f3dd81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:54.333 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81a09d0 con 0x7f3dd8101990 2023-10-14T08:46:54.334 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81a0b10 con 0x7f3dd8100fd0 2023-10-14T08:46:54.334 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddfb5a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81a0ca0 con 0x7f3dd80ffe70 2023-10-14T08:46:54.334 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:54.334 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41336/0 (socket says 172.21.15.178:41336) 2023-10-14T08:46:54.335 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 -- 172.21.15.178:0/4133496774 learned_addr learned my addr 172.21.15.178:0/4133496774 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:46:54.335 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd0f5700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:54.335 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3dde0f7700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 0x7f3dd81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:54.335 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 -- 172.21.15.178:0/4133496774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd8100fd0 msgr2=0x7f3dd8199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:54.335 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:54.336 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 -- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 msgr2=0x7f3dd81a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:46:54.336 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 0x7f3dd81a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:46:54.336 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd8f6700 1 -- 172.21.15.178:0/4133496774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0095f0 con 0x7f3dd80ffe70 2023-10-14T08:46:54.336 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.328+0000 7f3ddd0f5700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:46:54.336 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3dde0f7700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 0x7f3dd81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:46:54.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3ddd8f6700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8198e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400d980 tx=0x7f3dd400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:54.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4009b40 con 0x7f3dd80ffe70 2023-10-14T08:46:54.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dd400b6e0 con 0x7f3dd80ffe70 2023-10-14T08:46:54.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd81a0f80 con 0x7f3dd80ffe70 2023-10-14T08:46:54.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400f620 con 0x7f3dd80ffe70 2023-10-14T08:46:54.337 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.329+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd81a13a0 con 0x7f3dd80ffe70 2023-10-14T08:46:54.338 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.330+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd81935e0 con 0x7f3dd80ffe70 2023-10-14T08:46:54.339 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.331+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3dd4010460 con 0x7f3dd80ffe70 2023-10-14T08:46:54.339 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.331+0000 7f3dcaffd700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3dc40a1470 0x7f3dc40a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:46:54.339 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.331+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f3dd40cb2c0 con 0x7f3dd80ffe70 2023-10-14T08:46:54.339 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.332+0000 7f3ddd0f5700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3dc40a1470 0x7f3dc40a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:46:54.340 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.332+0000 7f3ddd0f5700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3dc40a1470 0x7f3dc40a3930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00b5c0 tx=0x7f3dcc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:46:54.340 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.336+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3dd4096170 con 0x7f3dd80ffe70 2023-10-14T08:46:54.535 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:46:54.534+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dd802d390 con 0x7f3dc40a1470 2023-10-14T08:46:54.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:46:54.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:46:54.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:54.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:54.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] boot 2023-10-14T08:46:54.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: osdmap e13: 2 total, 2 up, 2 in 2023-10-14T08:46:54.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:54.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:46:54.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:46:54.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:54.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:54.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] boot 2023-10-14T08:46:54.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: osdmap e13: 2 total, 2 up, 2 in 2023-10-14T08:46:54.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:54.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:46:54.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:46:54.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-14T08:46:54.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:54.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: osd.1 [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] boot 2023-10-14T08:46:54.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: osdmap e13: 2 total, 2 up, 2 in 2023-10-14T08:46:54.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-14T08:46:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:55 smithi178 ceph-mon[103612]: osdmap e14: 2 total, 2 up, 2 in 2023-10-14T08:46:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:55 smithi178 ceph-mon[103612]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:55 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:55.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:55 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:55.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:55 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:55 smithi057 ceph-mon[103313]: osdmap e14: 2 total, 2 up, 2 in 2023-10-14T08:46:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:55 smithi057 ceph-mon[103313]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:55.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:55 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:55.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:55 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:55.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:55 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:55.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:55 smithi006 ceph-mon[99452]: osdmap e14: 2 total, 2 up, 2 in 2023-10-14T08:46:55.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:55 smithi006 ceph-mon[99452]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:46:55.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:55 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:46:55.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:55 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:46:55.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:55 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:46:57.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:57 smithi178 ceph-mon[103612]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:46:57.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:57 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/4272727231' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]: dispatch 2023-10-14T08:46:57.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:57 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]: dispatch 2023-10-14T08:46:57.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:57 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]': finished 2023-10-14T08:46:57.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:57 smithi178 ceph-mon[103612]: osdmap e15: 3 total, 2 up, 3 in 2023-10-14T08:46:57.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:57 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:46:57.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:57 smithi057 ceph-mon[103313]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:46:57.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:57 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/4272727231' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]: dispatch 2023-10-14T08:46:57.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:57 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]: dispatch 2023-10-14T08:46:57.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:57 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]': finished 2023-10-14T08:46:57.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:57 smithi057 ceph-mon[103313]: osdmap e15: 3 total, 2 up, 3 in 2023-10-14T08:46:57.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:57 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:46:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:57 smithi006 ceph-mon[99452]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:46:57.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:57 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/4272727231' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]: dispatch 2023-10-14T08:46:57.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:57 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]: dispatch 2023-10-14T08:46:57.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:57 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ced53ca-e0e9-427a-9b59-8647d5cf2525"}]': finished 2023-10-14T08:46:57.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:57 smithi006 ceph-mon[99452]: osdmap e15: 3 total, 2 up, 3 in 2023-10-14T08:46:57.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:57 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:46:58.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:58 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/855404834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:58.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:58 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/855404834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:58.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:58 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/855404834' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:46:59.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:46:59 smithi178 ceph-mon[103612]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:46:59.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:46:59 smithi057 ceph-mon[103313]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:46:59.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:46:59 smithi006 ceph-mon[99452]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:01.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:01 smithi178 ceph-mon[103612]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:01.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:01 smithi057 ceph-mon[103313]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:01.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:01 smithi006 ceph-mon[99452]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:03.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:03 smithi178 ceph-mon[103612]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:03 smithi057 ceph-mon[103313]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:03 smithi006 ceph-mon[99452]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:04.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-14T08:47:04.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:04.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-14T08:47:04.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:04.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-14T08:47:04.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:05.179 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:05 smithi178 ceph-mon[103612]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:05.179 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:05 smithi178 ceph-mon[103612]: Deploying daemon osd.2 on smithi178 2023-10-14T08:47:05.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:05 smithi057 ceph-mon[103313]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:05.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:05 smithi057 ceph-mon[103313]: Deploying daemon osd.2 on smithi178 2023-10-14T08:47:05.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:05 smithi006 ceph-mon[99452]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:05.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:05 smithi006 ceph-mon[99452]: Deploying daemon osd.2 on smithi178 2023-10-14T08:47:07.370 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:07 smithi178 ceph-mon[103612]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:07.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:07 smithi057 ceph-mon[103313]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:07 smithi006 ceph-mon[99452]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:09 smithi178 ceph-mon[103612]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:09 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:09 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:09.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:09 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:09 smithi057 ceph-mon[103313]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:09 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:09 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:09.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:09 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:09 smithi006 ceph-mon[99452]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:09 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:09.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:09 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:09.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:09 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:11.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:11 smithi178 ceph-mon[103612]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:11.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:11.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:11.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.250 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 2 on host 'smithi178' 2023-10-14T08:47:11.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.249+0000 7f3dcaffd700 1 -- 172.21.15.178:0/4133496774 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3dd802d390 con 0x7f3dc40a1470 2023-10-14T08:47:11.252 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3dc40a1470 msgr2=0x7f3dc40a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:11.252 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3dc40a1470 0x7f3dc40a3930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00b5c0 tx=0x7f3dcc005fb0 comp rx=0 tx=0).stop 2023-10-14T08:47:11.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 msgr2=0x7f3dd8198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:11.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8198e40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400d980 tx=0x7f3dd400dd40 comp rx=0 tx=0).stop 2023-10-14T08:47:11.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 shutdown_connections 2023-10-14T08:47:11.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dd8101990 0x7f3dd81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:11.253 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80ffe70 0x7f3dd8198e40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:11.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3dc40a1470 0x7f3dc40a3930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:11.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 --2- 172.21.15.178:0/4133496774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dd8100fd0 0x7f3dd8199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:11.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 >> 172.21.15.178:0/4133496774 conn(0x7f3dd80fb3f0 msgr2=0x7f3dd8106960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:47:11.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 shutdown_connections 2023-10-14T08:47:11.255 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:47:11.251+0000 7f3ddfb5a700 1 -- 172.21.15.178:0/4133496774 wait complete. 2023-10-14T08:47:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:11 smithi057 ceph-mon[103313]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:11 smithi006 ceph-mon[99452]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:11.690 DEBUG:teuthology.orchestra.run.smithi178:osd.2> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.2.service 2023-10-14T08:47:11.693 INFO:tasks.cephadm:Deploying osd.3 on smithi006 with /dev/vg_nvme/lv_3... 2023-10-14T08:47:11.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-14T08:47:11.723 INFO:journalctl@ceph.osd.2.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:47:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:47:12.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:12.460 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:12.461 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:12.480 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:12.480 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:12.480 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:12.481 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2[109415]: 2023-10-14T08:47:12.261+0000 7fd2fc97f640 -1 osd.2 0 log_to_monitors true 2023-10-14T08:47:12.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:12.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:12.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:13.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:13 smithi178 ceph-mon[103612]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:13.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:13 smithi178 ceph-mon[103612]: from='osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-14T08:47:13.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:13 smithi178 ceph-mon[103612]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-14T08:47:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:13 smithi057 ceph-mon[103313]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:13 smithi057 ceph-mon[103313]: from='osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-14T08:47:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:13 smithi057 ceph-mon[103313]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-14T08:47:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:13 smithi006 ceph-mon[99452]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:13 smithi006 ceph-mon[99452]: from='osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-14T08:47:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:13 smithi006 ceph-mon[99452]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-14T08:47:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-14T08:47:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-14T08:47:13.801 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-10-14T08:47:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-10-14T08:47:13.801 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151717 s, 691 MB/s 2023-10-14T08:47:13.801 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-10-14T08:47:14.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi006:vg_nvme/lv_3 2023-10-14T08:47:14.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:14 smithi006 ceph-mon[99452]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-14T08:47:14.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:14 smithi006 ceph-mon[99452]: osdmap e16: 3 total, 2 up, 3 in 2023-10-14T08:47:14.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:14.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:14 smithi006 ceph-mon[99452]: from='osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:47:14.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:14 smithi006 ceph-mon[99452]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:47:14.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:14 smithi006 ceph-mon[99452]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:14.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2[109415]: 2023-10-14T08:47:14.217+0000 7fd2f17f5700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T08:47:14.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2[109415]: 2023-10-14T08:47:14.221+0000 7fd2ec5e8700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:47:14.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-mon[103612]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-14T08:47:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-mon[103612]: osdmap e16: 3 total, 2 up, 3 in 2023-10-14T08:47:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-mon[103612]: from='osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:47:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-mon[103612]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:47:14.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:14 smithi178 ceph-mon[103612]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:14.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:14 smithi057 ceph-mon[103313]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-14T08:47:14.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:14 smithi057 ceph-mon[103313]: osdmap e16: 3 total, 2 up, 3 in 2023-10-14T08:47:14.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:14 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:14.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:14 smithi057 ceph-mon[103313]: from='osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:47:14.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:14 smithi057 ceph-mon[103313]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:47:14.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:14 smithi057 ceph-mon[103313]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-14T08:47:14.891 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:47:15.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:47:15.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: osdmap e17: 3 total, 2 up, 3 in 2023-10-14T08:47:15.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:15.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:15.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi178 2023-10-14T08:47:15.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:15.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi178 to 17168M 2023-10-14T08:47:15.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:15.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:15.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:47:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: osdmap e17: 3 total, 2 up, 3 in 2023-10-14T08:47:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:15.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:15.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi178 2023-10-14T08:47:15.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:15.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi178 to 17168M 2023-10-14T08:47:15.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:15.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:15.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:47:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: osdmap e17: 3 total, 2 up, 3 in 2023-10-14T08:47:15.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:15.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:15.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi178 2023-10-14T08:47:15.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:15.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi178 to 17168M 2023-10-14T08:47:15.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:15.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:15.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:15.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:16.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.343+0000 7f3dd395a700 1 -- 172.21.15.6:0/3420214772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 msgr2=0x7f3dcc1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:16.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.343+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3420214772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc1082b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b0a0 tx=0x7f3dc400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:47:16.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.343+0000 7f3dd395a700 1 -- 172.21.15.6:0/3420214772 shutdown_connections 2023-10-14T08:47:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.343+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3420214772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc1082b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3420214772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dcc0ffe70 0x7f3dcc100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3420214772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc100fd0 0x7f3dcc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- 172.21.15.6:0/3420214772 >> 172.21.15.6:0/3420214772 conn(0x7f3dcc0fb3f0 msgr2=0x7f3dcc0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:47:16.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- 172.21.15.6:0/3420214772 shutdown_connections 2023-10-14T08:47:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- 172.21.15.6:0/3420214772 wait complete. 2023-10-14T08:47:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 Processor -- start 2023-10-14T08:47:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- start start 2023-10-14T08:47:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc0ffe70 0x7f3dcc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:16.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dcc100fd0 0x7f3dcc19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:16.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:16.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc19e880 con 0x7f3dcc101990 2023-10-14T08:47:16.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc19e9f0 con 0x7f3dcc100fd0 2023-10-14T08:47:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.344+0000 7f3dd395a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc19ebb0 con 0x7f3dcc0ffe70 2023-10-14T08:47:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc19e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58506/0 (socket says 172.21.15.6:58506) 2023-10-14T08:47:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 -- 172.21.15.6:0/3711774160 learned_addr learned my addr 172.21.15.6:0/3711774160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:47:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd0ef5700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dcc100fd0 0x7f3dcc19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd16f6700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc0ffe70 0x7f3dcc069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 -- 172.21.15.6:0/3711774160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc0ffe70 msgr2=0x7f3dcc069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc0ffe70 0x7f3dcc069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 -- 172.21.15.6:0/3711774160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dcc100fd0 msgr2=0x7f3dcc19baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dcc100fd0 0x7f3dcc19baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 -- 172.21.15.6:0/3711774160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4009d00 con 0x7f3dcc101990 2023-10-14T08:47:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd16f6700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc0ffe70 0x7f3dcc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:47:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd1ef7700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc19e0e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b830 tx=0x7f3dc4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:47:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400e040 con 0x7f3dcc101990 2023-10-14T08:47:16.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc19ee30 con 0x7f3dcc101990 2023-10-14T08:47:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dc401db50 con 0x7f3dcc101990 2023-10-14T08:47:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc401bbd0 con 0x7f3dcc101990 2023-10-14T08:47:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.345+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc19f2a0 con 0x7f3dcc101990 2023-10-14T08:47:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.346+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc107420 con 0x7f3dcc101990 2023-10-14T08:47:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.347+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) v1 ==== 135946+0+0 (secure 0 0 0) 0x7f3dc401dcc0 con 0x7f3dcc101990 2023-10-14T08:47:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.348+0000 7f3dc27fc700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3db80a13f0 0x7f3db80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.348+0000 7f3dd16f6700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3db80a13f0 0x7f3db80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.348+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f3dc40cda10 con 0x7f3dcc101990 2023-10-14T08:47:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.349+0000 7f3dd16f6700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3db80a13f0 0x7f3db80a38b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8005950 tx=0x7f3dc8005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:47:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.352+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3dc40985c0 con 0x7f3dcc101990 2023-10-14T08:47:16.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:47:16.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:47:16.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] boot 2023-10-14T08:47:16.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: osdmap e18: 3 total, 3 up, 3 in 2023-10-14T08:47:16.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:16.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:16.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:16 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-14T08:47:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:16.560+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dcc02d270 con 0x7f3db80a13f0 2023-10-14T08:47:16.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:47:16.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:47:16.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] boot 2023-10-14T08:47:16.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: osdmap e18: 3 total, 3 up, 3 in 2023-10-14T08:47:16.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:16.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:16.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:16 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-14T08:47:16.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:47:16.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:47:16.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: osd.2 [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] boot 2023-10-14T08:47:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: osdmap e18: 3 total, 3 up, 3 in 2023-10-14T08:47:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-14T08:47:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:16.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:16 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-14T08:47:17.559 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-14T08:47:17.559 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: osdmap e19: 3 total, 3 up, 3 in 2023-10-14T08:47:17.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-14T08:47:17.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:47:17.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:47:17.560 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:47:17.561 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-14T08:47:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: osdmap e19: 3 total, 3 up, 3 in 2023-10-14T08:47:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-14T08:47:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:47:17.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:47:17.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:47:17.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-14T08:47:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: osdmap e19: 3 total, 3 up, 3 in 2023-10-14T08:47:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-14T08:47:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:47:17.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:47:17.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:47:17.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:17.950 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:17 smithi006 sudo[123818]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-14T08:47:17.950 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:17 smithi006 sudo[123818]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:17.950 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:17 smithi006 sudo[123818]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:17.951 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:17 smithi006 sudo[123818]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:18.256+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3dc401bd30 con 0x7f3dcc101990 2023-10-14T08:47:18.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-14T08:47:18.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:18 smithi178 ceph-mon[103612]: osdmap e20: 3 total, 3 up, 3 in 2023-10-14T08:47:18.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:18 smithi178 ceph-mon[103612]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:18.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-14T08:47:18.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:18 smithi057 ceph-mon[103313]: osdmap e20: 3 total, 3 up, 3 in 2023-10-14T08:47:18.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:18 smithi057 ceph-mon[103313]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:18.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-14T08:47:18.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:18 smithi006 ceph-mon[99452]: osdmap e20: 3 total, 3 up, 3 in 2023-10-14T08:47:18.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:18 smithi006 ceph-mon[99452]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:18.732 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:18 smithi006 sudo[123845]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-14T08:47:18.733 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:18 smithi006 sudo[123845]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:18.733 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:18 smithi006 sudo[123845]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:18.733 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 08:47:18 smithi006 sudo[123845]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:19.187 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:18 smithi057 sudo[113740]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-14T08:47:19.187 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:18 smithi057 sudo[113740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:19.187 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:18 smithi057 sudo[113740]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:19.188 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:18 smithi057 sudo[113740]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:19.444 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:19 smithi057 sudo[113743]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-14T08:47:19.444 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:19 smithi057 sudo[113743]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:19.444 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:19 smithi057 sudo[113743]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:19.445 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 08:47:19 smithi057 sudo[113743]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:19.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: osdmap e21: 3 total, 3 up, 3 in 2023-10-14T08:47:19.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-14T08:47:19.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:19.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/434850976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5d6f475-b22e-4032-8ec3-a0f06769ba76"}]: dispatch 2023-10-14T08:47:19.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/434850976' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5d6f475-b22e-4032-8ec3-a0f06769ba76"}]': finished 2023-10-14T08:47:19.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: osdmap e22: 4 total, 3 up, 4 in 2023-10-14T08:47:19.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:19.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:19 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:19.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114081]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-14T08:47:19.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114081]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:19.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114081]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:19.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114081]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:19.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: osdmap e21: 3 total, 3 up, 3 in 2023-10-14T08:47:19.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-14T08:47:19.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:19.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/434850976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5d6f475-b22e-4032-8ec3-a0f06769ba76"}]: dispatch 2023-10-14T08:47:19.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/434850976' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5d6f475-b22e-4032-8ec3-a0f06769ba76"}]': finished 2023-10-14T08:47:19.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: osdmap e22: 4 total, 3 up, 4 in 2023-10-14T08:47:19.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:19.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:19 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: osdmap e21: 3 total, 3 up, 3 in 2023-10-14T08:47:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: mgrmap e16: x(active, since 2m), standbys: y, z 2023-10-14T08:47:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/434850976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c5d6f475-b22e-4032-8ec3-a0f06769ba76"}]: dispatch 2023-10-14T08:47:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/434850976' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5d6f475-b22e-4032-8ec3-a0f06769ba76"}]': finished 2023-10-14T08:47:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: osdmap e22: 4 total, 3 up, 4 in 2023-10-14T08:47:19.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:19.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:20.134 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114084]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-14T08:47:20.134 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114084]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:20.134 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114084]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:20.134 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 08:47:19 smithi178 sudo[114084]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:20.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123946]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-14T08:47:20.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123946]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:20.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123946]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:20.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123946]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:20.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123949]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-14T08:47:20.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123949]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:20.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123949]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:20.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:20 smithi006 sudo[123949]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:21.130 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:20 smithi178 sudo[114087]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-14T08:47:21.130 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:20 smithi178 sudo[114087]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:21.131 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:20 smithi178 sudo[114087]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:21.131 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:20 smithi178 sudo[114087]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 sudo[114090]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-14T08:47:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 sudo[114090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 sudo[114090]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 sudo[114090]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/334622393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:47:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:21.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:21.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/334622393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:47:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:21.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:21.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:21.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/334622393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:21.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 sudo[113746]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-14T08:47:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 sudo[113746]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 sudo[113746]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:21.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:21 smithi057 sudo[113746]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:22.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 sudo[113749]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-14T08:47:22.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 sudo[113749]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-14T08:47:22.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 sudo[113749]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-14T08:47:22.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 sudo[113749]: pam_unix(sudo:session): session closed for user root 2023-10-14T08:47:22.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:22.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:22.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:22.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:22.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:22.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:22.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:22 smithi057 ceph-mon[103313]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:22.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:22.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:22 smithi006 ceph-mon[99452]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:22.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-14T08:47:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-14T08:47:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-14T08:47:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-14T08:47:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:22 smithi178 ceph-mon[103612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-14T08:47:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:23 smithi057 ceph-mon[103313]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:23.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:23 smithi006 ceph-mon[99452]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:23 smithi178 ceph-mon[103612]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:25 smithi057 ceph-mon[103313]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:25.468 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:25 smithi006 ceph-mon[99452]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:25.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:25 smithi178 ceph-mon[103612]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:27.424 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:27 smithi006 ceph-mon[99452]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-10-14T08:47:27.424 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-14T08:47:27.424 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:27 smithi057 ceph-mon[103313]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-10-14T08:47:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-14T08:47:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:27 smithi178 ceph-mon[103612]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2023-10-14T08:47:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-14T08:47:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:28 smithi057 ceph-mon[103313]: Deploying daemon osd.3 on smithi006 2023-10-14T08:47:28.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:28 smithi006 ceph-mon[99452]: Deploying daemon osd.3 on smithi006 2023-10-14T08:47:28.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:28 smithi178 ceph-mon[103612]: Deploying daemon osd.3 on smithi006 2023-10-14T08:47:29.326 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:29 smithi006 ceph-mon[99452]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-14T08:47:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:29 smithi057 ceph-mon[103313]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-14T08:47:29.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:29 smithi178 ceph-mon[103612]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-10-14T08:47:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:31 smithi057 ceph-mon[103313]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-10-14T08:47:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:31 smithi006 ceph-mon[99452]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-10-14T08:47:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:31 smithi178 ceph-mon[103612]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-10-14T08:47:32.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:32.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:32.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:32.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:32 smithi006 ceph-mon[99452]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-10-14T08:47:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:32 smithi178 ceph-mon[103612]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-10-14T08:47:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:32.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:32 smithi057 ceph-mon[103313]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-10-14T08:47:33.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.923+0000 7f3dc27fc700 1 -- 172.21.15.6:0/3711774160 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3dcc02d270 con 0x7f3db80a13f0 2023-10-14T08:47:33.925 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 3 on host 'smithi006' 2023-10-14T08:47:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3db80a13f0 msgr2=0x7f3db80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3db80a13f0 0x7f3db80a38b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8005950 tx=0x7f3dc8005f50 comp rx=0 tx=0).stop 2023-10-14T08:47:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 msgr2=0x7f3dcc19e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc19e0e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b830 tx=0x7f3dc4004c80 comp rx=0 tx=0).stop 2023-10-14T08:47:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 shutdown_connections 2023-10-14T08:47:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3dcc101990 0x7f3dcc19e0e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dcc0ffe70 0x7f3dcc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3db80a13f0 0x7f3db80a38b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 --2- 172.21.15.6:0/3711774160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dcc100fd0 0x7f3dcc19baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 >> 172.21.15.6:0/3711774160 conn(0x7f3dcc0fb3f0 msgr2=0x7f3dcc104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:47:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 shutdown_connections 2023-10-14T08:47:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:47:33.925+0000 7f3dd395a700 1 -- 172.21.15.6:0/3711774160 wait complete. 2023-10-14T08:47:34.399 DEBUG:teuthology.orchestra.run.smithi006:osd.3> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.3.service 2023-10-14T08:47:34.401 INFO:tasks.cephadm:Deploying osd.4 on smithi057 with /dev/vg_nvme/lv_3... 2023-10-14T08:47:34.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-14T08:47:34.441 INFO:journalctl@ceph.osd.3.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:47:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-14T08:47:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:34.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-14T08:47:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:34.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:34.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-14T08:47:34.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:34.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:34.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:34.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:34.979 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:47:35.481 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 08:47:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T08:47:35.229+0000 7f287d1e8640 -1 osd.3 0 log_to_monitors true 2023-10-14T08:47:35.764 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:35 smithi057 ceph-mon[103313]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-14T08:47:35.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:35 smithi178 ceph-mon[103612]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-14T08:47:35.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:35 smithi006 ceph-mon[99452]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-14T08:47:36.502 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-14T08:47:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-14T08:47:36.503 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-10-14T08:47:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-10-14T08:47:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00884394 s, 1.2 GB/s 2023-10-14T08:47:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-10-14T08:47:36.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:36 smithi178 ceph-mon[103612]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-14T08:47:36.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:36 smithi178 ceph-mon[103612]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-14T08:47:36.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:36 smithi178 ceph-mon[103612]: osdmap e23: 4 total, 3 up, 4 in 2023-10-14T08:47:36.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:36 smithi178 ceph-mon[103612]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:47:36.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:36.892 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T08:47:36.563+0000 7f287205e700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T08:47:36.892 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T08:47:36.569+0000 7f286c650700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:47:36.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-mon[99452]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-14T08:47:36.892 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-mon[99452]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-14T08:47:36.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-mon[99452]: osdmap e23: 4 total, 3 up, 4 in 2023-10-14T08:47:36.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-mon[99452]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:47:36.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:36.907 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:36 smithi057 ceph-mon[103313]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-10-14T08:47:36.908 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:36 smithi057 ceph-mon[103313]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-14T08:47:36.908 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:36 smithi057 ceph-mon[103313]: osdmap e23: 4 total, 3 up, 4 in 2023-10-14T08:47:36.908 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:36 smithi057 ceph-mon[103313]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:47:36.908 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:36.931 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi057:vg_nvme/lv_3 2023-10-14T08:47:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:47:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:47:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: osdmap e24: 4 total, 3 up, 4 in 2023-10-14T08:47:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:37.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi006 2023-10-14T08:47:37.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:37.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:37.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi006 to 8586M 2023-10-14T08:47:37.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:37.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:37.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.887 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:47:37.887 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: osdmap e24: 4 total, 3 up, 4 in 2023-10-14T08:47:37.887 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:37.888 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:37.888 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi006 2023-10-14T08:47:37.888 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.888 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.888 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:37.889 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:37.889 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi006 to 8586M 2023-10-14T08:47:37.889 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.889 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:37.889 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:37.889 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:47:37.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: osdmap e24: 4 total, 3 up, 4 in 2023-10-14T08:47:37.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:37.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:37.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi006 2023-10-14T08:47:37.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:37.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:37.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi006 to 8586M 2023-10-14T08:47:37.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:37.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:37.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:37.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:38.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 -- 172.21.15.57:0/2075682672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 msgr2=0x7f0a54101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:38.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 --2- 172.21.15.57:0/2075682672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a54101450 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009990 tx=0x7f0a50009ca0 comp rx=0 tx=0).stop 2023-10-14T08:47:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 -- 172.21.15.57:0/2075682672 shutdown_connections 2023-10-14T08:47:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 --2- 172.21.15.57:0/2075682672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a54101990 0x7f0a541082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 --2- 172.21.15.57:0/2075682672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a540ffe70 0x7f0a54100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 --2- 172.21.15.57:0/2075682672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a54101450 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:38.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 -- 172.21.15.57:0/2075682672 >> 172.21.15.57:0/2075682672 conn(0x7f0a540fb3f0 msgr2=0x7f0a540fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:47:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 -- 172.21.15.57:0/2075682672 shutdown_connections 2023-10-14T08:47:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.735+0000 7f0a5c167700 1 -- 172.21.15.57:0/2075682672 wait complete. 2023-10-14T08:47:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 Processor -- start 2023-10-14T08:47:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 -- start start 2023-10-14T08:47:38.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a540ffe70 0x7f0a54069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:38.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a5419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:38.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54101990 0x7f0a541a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:38.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a541a0a40 con 0x7f0a540ffe70 2023-10-14T08:47:38.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a541a0bb0 con 0x7f0a54100fd0 2023-10-14T08:47:38.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5c167700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a541a0d70 con 0x7f0a54101990 2023-10-14T08:47:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a5419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a5419de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58860/0 (socket says 172.21.15.57:58860) 2023-10-14T08:47:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 -- 172.21.15.57:0/3425567679 learned_addr learned my addr 172.21.15.57:0/3425567679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-14T08:47:38.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59f03700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a540ffe70 0x7f0a54069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 -- 172.21.15.57:0/3425567679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54101990 msgr2=0x7f0a541a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5a704700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54101990 0x7f0a541a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54101990 0x7f0a541a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 -- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a540ffe70 msgr2=0x7f0a54069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:38.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a540ffe70 0x7f0a54069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 -- 172.21.15.57:0/3425567679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500095f0 con 0x7f0a54100fd0 2023-10-14T08:47:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a5a704700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54101990 0x7f0a541a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:47:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.736+0000 7f0a59702700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a5419de40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0a50005910 tx=0x7f0a50004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:47:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.737+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5001d070 con 0x7f0a54100fd0 2023-10-14T08:47:38.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.737+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a50003f60 con 0x7f0a54100fd0 2023-10-14T08:47:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.737+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a541a0ff0 con 0x7f0a54100fd0 2023-10-14T08:47:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.737+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50022da0 con 0x7f0a54100fd0 2023-10-14T08:47:38.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.737+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a541a1420 con 0x7f0a54100fd0 2023-10-14T08:47:38.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.737+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a54107460 con 0x7f0a54100fd0 2023-10-14T08:47:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.739+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0a500040d0 con 0x7f0a54100fd0 2023-10-14T08:47:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.740+0000 7f0a4affd700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0a400a1480 0x7f0a400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:47:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.740+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f0a500cd7e0 con 0x7f0a54100fd0 2023-10-14T08:47:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.741+0000 7f0a59f03700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0a400a1480 0x7f0a400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:47:38.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.741+0000 7f0a59f03700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0a400a1480 0x7f0a400a3940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009a10 tx=0x7f0a44009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:47:38.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.744+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0a500980d0 con 0x7f0a54100fd0 2023-10-14T08:47:38.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:47:38.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:47:38.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:38.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:38.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] boot 2023-10-14T08:47:38.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: osdmap e25: 4 total, 4 up, 4 in 2023-10-14T08:47:38.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:38 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:38.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:47:38.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:47:38.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:38.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:38.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] boot 2023-10-14T08:47:38.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: osdmap e25: 4 total, 4 up, 4 in 2023-10-14T08:47:38.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:38 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:38.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:38.956+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a5402d1f0 con 0x7f0a400a1480 2023-10-14T08:47:38.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:47:38.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:47:38.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-10-14T08:47:38.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:38.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: osd.3 [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] boot 2023-10-14T08:47:38.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: osdmap e25: 4 total, 4 up, 4 in 2023-10-14T08:47:38.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:38 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-14T08:47:39.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:39 smithi178 ceph-mon[103612]: osdmap e26: 4 total, 4 up, 4 in 2023-10-14T08:47:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:39 smithi178 ceph-mon[103612]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:47:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:47:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:47:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:39.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:39 smithi057 ceph-mon[103313]: osdmap e26: 4 total, 4 up, 4 in 2023-10-14T08:47:39.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:39 smithi057 ceph-mon[103313]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:47:39.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:47:39.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:47:39.934 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:39.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:39 smithi006 ceph-mon[99452]: osdmap e26: 4 total, 4 up, 4 in 2023-10-14T08:47:39.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:39 smithi006 ceph-mon[99452]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:47:39.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:47:39.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:47:39.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:40.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:40 smithi178 ceph-mon[103612]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:40.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:40 smithi178 ceph-mon[103612]: osdmap e27: 4 total, 4 up, 4 in 2023-10-14T08:47:40.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:40 smithi057 ceph-mon[103313]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:40.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:40 smithi057 ceph-mon[103313]: osdmap e27: 4 total, 4 up, 4 in 2023-10-14T08:47:40.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:40 smithi006 ceph-mon[99452]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:40.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:40 smithi006 ceph-mon[99452]: osdmap e27: 4 total, 4 up, 4 in 2023-10-14T08:47:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:41 smithi178 ceph-mon[103612]: osdmap e28: 4 total, 4 up, 4 in 2023-10-14T08:47:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:41 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/1374553269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]: dispatch 2023-10-14T08:47:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:41 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]: dispatch 2023-10-14T08:47:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:41 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]': finished 2023-10-14T08:47:41.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:41 smithi178 ceph-mon[103612]: osdmap e29: 5 total, 4 up, 5 in 2023-10-14T08:47:41.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:41 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:41.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:41 smithi057 ceph-mon[103313]: osdmap e28: 4 total, 4 up, 4 in 2023-10-14T08:47:41.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:41 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/1374553269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]: dispatch 2023-10-14T08:47:41.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:41 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]: dispatch 2023-10-14T08:47:41.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:41 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]': finished 2023-10-14T08:47:41.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:41 smithi057 ceph-mon[103313]: osdmap e29: 5 total, 4 up, 5 in 2023-10-14T08:47:41.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:41 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:41.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:41 smithi006 ceph-mon[99452]: osdmap e28: 4 total, 4 up, 4 in 2023-10-14T08:47:41.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:41 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/1374553269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]: dispatch 2023-10-14T08:47:41.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:41 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]: dispatch 2023-10-14T08:47:41.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:41 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b0fd0d1-1684-4766-9608-c2922016f050"}]': finished 2023-10-14T08:47:41.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:41 smithi006 ceph-mon[99452]: osdmap e29: 5 total, 4 up, 5 in 2023-10-14T08:47:41.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:41 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:42.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:42 smithi006 ceph-mon[99452]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:42.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:42 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/919310083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:47:43.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:42 smithi178 ceph-mon[103612]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:43.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/919310083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:47:43.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:42 smithi057 ceph-mon[103313]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:43.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:42 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/919310083' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:47:44.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:44 smithi057 ceph-mon[103313]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:44.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:44 smithi006 ceph-mon[99452]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:45.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:44 smithi178 ceph-mon[103612]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:47.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:47 smithi178 ceph-mon[103612]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:47:47.442 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:47 smithi057 ceph-mon[103313]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:47:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:47 smithi006 ceph-mon[99452]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:47:49.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:49 smithi178 ceph-mon[103612]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-10-14T08:47:49.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-14T08:47:49.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:49 smithi057 ceph-mon[103313]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-10-14T08:47:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-14T08:47:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:49 smithi006 ceph-mon[99452]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2023-10-14T08:47:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-14T08:47:49.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:50.180 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:50 smithi057 ceph-mon[103313]: Deploying daemon osd.4 on smithi057 2023-10-14T08:47:50.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:50 smithi178 ceph-mon[103612]: Deploying daemon osd.4 on smithi057 2023-10-14T08:47:50.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:50 smithi006 ceph-mon[99452]: Deploying daemon osd.4 on smithi057 2023-10-14T08:47:51.155 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:51 smithi057 ceph-mon[103313]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-14T08:47:51.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:51 smithi178 ceph-mon[103612]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-14T08:47:51.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:51 smithi006 ceph-mon[99452]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2023-10-14T08:47:53.362 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:53 smithi057 ceph-mon[103313]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-14T08:47:53.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:53 smithi178 ceph-mon[103612]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-14T08:47:53.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:53 smithi006 ceph-mon[99452]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-14T08:47:54.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:54 smithi057 ceph-mon[103313]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-14T08:47:54.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:54.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:54.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:54.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:54 smithi178 ceph-mon[103612]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-14T08:47:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:54.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:54 smithi006 ceph-mon[99452]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-14T08:47:54.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:54.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:54.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:56.328 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 4 on host 'smithi057' 2023-10-14T08:47:56.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.325+0000 7f0a4affd700 1 -- 172.21.15.57:0/3425567679 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0a5402d1f0 con 0x7f0a400a1480 2023-10-14T08:47:56.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0a400a1480 msgr2=0x7f0a400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0a400a1480 0x7f0a400a3940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009a10 tx=0x7f0a44009190 comp rx=0 tx=0).stop 2023-10-14T08:47:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 msgr2=0x7f0a5419de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:47:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a5419de40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0a50005910 tx=0x7f0a50004730 comp rx=0 tx=0).stop 2023-10-14T08:47:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 shutdown_connections 2023-10-14T08:47:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54101990 0x7f0a541a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a540ffe70 0x7f0a54069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0a400a1480 0x7f0a400a3940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 --2- 172.21.15.57:0/3425567679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a54100fd0 0x7f0a5419de40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:47:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 >> 172.21.15.57:0/3425567679 conn(0x7f0a540fb3f0 msgr2=0x7f0a541045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:47:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 shutdown_connections 2023-10-14T08:47:56.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:47:56.327+0000 7f0a5c167700 1 -- 172.21.15.57:0/3425567679 wait complete. 2023-10-14T08:47:56.698 DEBUG:teuthology.orchestra.run.smithi057:osd.4> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.4.service 2023-10-14T08:47:56.701 INFO:tasks.cephadm:Deploying osd.5 on smithi178 with /dev/vg_nvme/lv_3... 2023-10-14T08:47:56.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-14T08:47:56.736 INFO:journalctl@ceph.osd.4.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:47:56.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-14T08:47:56.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:56.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:56.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:56.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:56.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:56.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:56.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:56.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-14T08:47:57.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:57.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:57.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:57.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.190 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-14T08:47:57.191 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.191 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.191 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:57.191 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:57.191 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.191 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.192 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:47:57.192 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:57.270 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:47:57.813 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:57 smithi178 ceph-mon[103612]: from='osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-14T08:47:57.813 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:57 smithi178 ceph-mon[103612]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-14T08:47:57.944 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 08:47:57 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4[116945]: 2023-10-14T08:47:57.502+0000 7f9bfea86640 -1 osd.4 0 log_to_monitors true 2023-10-14T08:47:57.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:57 smithi057 ceph-mon[103313]: from='osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-14T08:47:57.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:57 smithi057 ceph-mon[103313]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-14T08:47:57.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:57 smithi006 ceph-mon[99452]: from='osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-14T08:47:57.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:57 smithi006 ceph-mon[99452]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-14T08:47:58.875 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-14T08:47:58.876 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-14T08:47:58.876 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-10-14T08:47:58.876 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-10-14T08:47:58.876 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00855202 s, 1.2 GB/s 2023-10-14T08:47:58.877 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-10-14T08:47:58.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:58 smithi006 ceph-mon[99452]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:58.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:58 smithi006 ceph-mon[99452]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-14T08:47:58.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:58 smithi006 ceph-mon[99452]: osdmap e30: 5 total, 4 up, 5 in 2023-10-14T08:47:58.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:58.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:58 smithi006 ceph-mon[99452]: from='osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:47:58.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:58 smithi006 ceph-mon[99452]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:47:59.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:58 smithi178 ceph-mon[103612]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:59.046 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:58 smithi178 ceph-mon[103612]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-14T08:47:59.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:58 smithi178 ceph-mon[103612]: osdmap e30: 5 total, 4 up, 5 in 2023-10-14T08:47:59.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:59.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:58 smithi178 ceph-mon[103612]: from='osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:47:59.047 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:58 smithi178 ceph-mon[103612]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:47:59.194 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4[116945]: 2023-10-14T08:47:58.716+0000 7f9bf38fc700 -1 osd.4 0 waiting for initial osdmap 2023-10-14T08:47:59.194 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4[116945]: 2023-10-14T08:47:58.722+0000 7f9beeef0700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:47:59.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-mon[103313]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:47:59.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-mon[103313]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-14T08:47:59.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-mon[103313]: osdmap e30: 5 total, 4 up, 5 in 2023-10-14T08:47:59.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:59.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-mon[103313]: from='osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:47:59.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:58 smithi057 ceph-mon[103313]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:47:59.324 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2023-10-14T08:47:59.888 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:47:59.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:47:59.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: osdmap e31: 5 total, 4 up, 5 in 2023-10-14T08:47:59.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:59.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:47:59.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:59.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:59.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:59.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:47:59.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:47:59.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:47:59.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:47:59.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:47:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:48:00.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: osdmap e31: 5 total, 4 up, 5 in 2023-10-14T08:48:00.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:00.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:00.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:00.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:00.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:00.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:00.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:47:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:48:00.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: osdmap e31: 5 total, 4 up, 5 in 2023-10-14T08:48:00.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:00.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:00.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:00.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:00.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:00.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:00.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:47:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:00.762 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:48:00.762 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:48:00.763 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi057 2023-10-14T08:48:00.763 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi057 to 8586M 2023-10-14T08:48:00.763 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:48:00.763 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] boot 2023-10-14T08:48:00.764 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: osdmap e32: 5 total, 5 up, 5 in 2023-10-14T08:48:00.764 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:00 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:00.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:48:00.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:48:00.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi057 2023-10-14T08:48:00.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi057 to 8586M 2023-10-14T08:48:00.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:48:00.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] boot 2023-10-14T08:48:00.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: osdmap e32: 5 total, 5 up, 5 in 2023-10-14T08:48:00.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:00 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:01.175 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 -- 172.21.15.178:0/438358038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c0ffe70 msgr2=0x7f630c100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:01.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 --2- 172.21.15.178:0/438358038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c0ffe70 0x7f630c100290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009990 tx=0x7f62fc009ca0 comp rx=0 tx=0).stop 2023-10-14T08:48:01.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 -- 172.21.15.178:0/438358038 shutdown_connections 2023-10-14T08:48:01.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 --2- 172.21.15.178:0/438358038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c101990 0x7f630c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:01.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 --2- 172.21.15.178:0/438358038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c0ffe70 0x7f630c100290 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:01.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 --2- 172.21.15.178:0/438358038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c100fd0 0x7f630c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:01.177 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 -- 172.21.15.178:0/438358038 >> 172.21.15.178:0/438358038 conn(0x7f630c0fb3f0 msgr2=0x7f630c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:48:01.177 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 -- 172.21.15.178:0/438358038 shutdown_connections 2023-10-14T08:48:01.177 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.174+0000 7f631255a700 1 -- 172.21.15.178:0/438358038 wait complete. 2023-10-14T08:48:01.177 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 Processor -- start 2023-10-14T08:48:01.177 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 -- start start 2023-10-14T08:48:01.179 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c0ffe70 0x7f630c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:01.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 0x7f630c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:01.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c101990 0x7f630c19df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:01.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c19e720 con 0x7f630c101990 2023-10-14T08:48:01.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c19e890 con 0x7f630c0ffe70 2023-10-14T08:48:01.180 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f631255a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c19ea50 con 0x7f630c100fd0 2023-10-14T08:48:01.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f630b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 0x7f630c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:01.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f630b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 0x7f630c19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41418/0 (socket says 172.21.15.178:41418) 2023-10-14T08:48:01.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f630b7fe700 1 -- 172.21.15.178:0/13187028 learned_addr learned my addr 172.21.15.178:0/13187028 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:48:01.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f630bfff700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c0ffe70 0x7f630c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:01.181 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.175+0000 7f6310af7700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c101990 0x7f630c19df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:01.182 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f630b7fe700 1 -- 172.21.15.178:0/13187028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c0ffe70 msgr2=0x7f630c069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:01.182 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f630b7fe700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c0ffe70 0x7f630c069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:01.182 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f630b7fe700 1 -- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c101990 msgr2=0x7f630c19df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:01.182 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f630b7fe700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c101990 0x7f630c19df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:01.183 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f630b7fe700 1 -- 172.21.15.178:0/13187028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0095f0 con 0x7f630c100fd0 2023-10-14T08:48:01.183 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f630b7fe700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 0x7f630c19b940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62f400d950 tx=0x7f62f400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:48:01.183 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400f890 con 0x7f630c100fd0 2023-10-14T08:48:01.183 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c19ed30 con 0x7f630c100fd0 2023-10-14T08:48:01.183 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62f4010460 con 0x7f630c100fd0 2023-10-14T08:48:01.184 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400e610 con 0x7f630c100fd0 2023-10-14T08:48:01.184 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.176+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c19f1d0 con 0x7f630c100fd0 2023-10-14T08:48:01.184 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.177+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c107480 con 0x7f630c100fd0 2023-10-14T08:48:01.184 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.178+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f62f40108d0 con 0x7f630c100fd0 2023-10-14T08:48:01.184 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.178+0000 7f63097fa700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f80a1480 0x7f62f80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:01.185 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.179+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f62f40cba10 con 0x7f630c100fd0 2023-10-14T08:48:01.185 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.179+0000 7f630bfff700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f80a1480 0x7f62f80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:01.185 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.179+0000 7f630bfff700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f80a1480 0x7f62f80a3940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b5c0 tx=0x7f62fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:48:01.186 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.182+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62f40960e0 con 0x7f630c100fd0 2023-10-14T08:48:01.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:48:01.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:48:01.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi057 2023-10-14T08:48:01.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi057 to 8586M 2023-10-14T08:48:01.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-14T08:48:01.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: osd.4 [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] boot 2023-10-14T08:48:01.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: osdmap e32: 5 total, 5 up, 5 in 2023-10-14T08:48:01.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:00 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-14T08:48:01.381 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:01.380+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f630c02d2b0 con 0x7f62f80a1480 2023-10-14T08:48:02.571 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:02 smithi178 ceph-mon[103612]: osdmap e33: 5 total, 5 up, 5 in 2023-10-14T08:48:02.571 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:02 smithi178 ceph-mon[103612]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:02.571 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:02.571 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:02 smithi178 ceph-mon[103612]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:02.572 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:02.572 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:02.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:02 smithi057 ceph-mon[103313]: osdmap e33: 5 total, 5 up, 5 in 2023-10-14T08:48:02.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:02 smithi057 ceph-mon[103313]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:02.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:02.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:02 smithi057 ceph-mon[103313]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:02.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:02.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:02.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:02 smithi006 ceph-mon[99452]: osdmap e33: 5 total, 5 up, 5 in 2023-10-14T08:48:02.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:02 smithi006 ceph-mon[99452]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:02.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:02.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:02 smithi006 ceph-mon[99452]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:02.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:02.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:04.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:04 smithi006 ceph-mon[99452]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:04 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/866001443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]: dispatch 2023-10-14T08:48:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:04 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]: dispatch 2023-10-14T08:48:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:04 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]': finished 2023-10-14T08:48:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:04 smithi006 ceph-mon[99452]: osdmap e34: 6 total, 5 up, 6 in 2023-10-14T08:48:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:04.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:04 smithi178 ceph-mon[103612]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:04.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:04 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/866001443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]: dispatch 2023-10-14T08:48:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:04 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]: dispatch 2023-10-14T08:48:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:04 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]': finished 2023-10-14T08:48:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:04 smithi178 ceph-mon[103612]: osdmap e34: 6 total, 5 up, 6 in 2023-10-14T08:48:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:04 smithi057 ceph-mon[103313]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:04 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/866001443' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]: dispatch 2023-10-14T08:48:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:04 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]: dispatch 2023-10-14T08:48:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:04 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd"}]': finished 2023-10-14T08:48:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:04 smithi057 ceph-mon[103313]: osdmap e34: 6 total, 5 up, 6 in 2023-10-14T08:48:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:05.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:05 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/3362703851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:05.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:05 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/3362703851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:05.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:05 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/3362703851' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:07.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:07 smithi178 ceph-mon[103612]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:07.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:07 smithi057 ceph-mon[103313]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:07 smithi006 ceph-mon[99452]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:09 smithi178 ceph-mon[103612]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:09 smithi057 ceph-mon[103313]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:09 smithi006 ceph-mon[99452]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:11.327 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:11 smithi178 ceph-mon[103612]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:11.327 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-14T08:48:11.328 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:11 smithi057 ceph-mon[103313]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-14T08:48:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:11 smithi006 ceph-mon[99452]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-14T08:48:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:12.319 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:12 smithi178 ceph-mon[103612]: Deploying daemon osd.5 on smithi178 2023-10-14T08:48:12.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:12 smithi057 ceph-mon[103313]: Deploying daemon osd.5 on smithi178 2023-10-14T08:48:12.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:12 smithi006 ceph-mon[99452]: Deploying daemon osd.5 on smithi178 2023-10-14T08:48:13.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:13 smithi178 ceph-mon[103612]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:13 smithi057 ceph-mon[103313]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:13.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:13 smithi006 ceph-mon[99452]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:15.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:15 smithi178 ceph-mon[103612]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:15.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:15.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:15.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:15 smithi057 ceph-mon[103313]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:15.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:15 smithi006 ceph-mon[99452]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:15.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:15.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:15.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:17.351 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:17 smithi178 ceph-mon[103612]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:17.352 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.352 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.352 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:17.352 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:17.353 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:17 smithi057 ceph-mon[103313]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:17.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:17.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:17 smithi006 ceph-mon[99452]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:17.649 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 5 on host 'smithi178' 2023-10-14T08:48:17.649 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.647+0000 7f63097fa700 1 -- 172.21.15.178:0/13187028 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f630c02d2b0 con 0x7f62f80a1480 2023-10-14T08:48:17.650 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.649+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f80a1480 msgr2=0x7f62f80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:17.651 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.649+0000 7f631255a700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f80a1480 0x7f62f80a3940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b5c0 tx=0x7f62fc0058e0 comp rx=0 tx=0).stop 2023-10-14T08:48:17.651 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 msgr2=0x7f630c19b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:17.651 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 0x7f630c19b940 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f62f400d950 tx=0x7f62f400dc60 comp rx=0 tx=0).stop 2023-10-14T08:48:17.651 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 shutdown_connections 2023-10-14T08:48:17.652 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c101990 0x7f630c19df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:17.652 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f80a1480 0x7f62f80a3940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:17.652 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c0ffe70 0x7f630c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:17.652 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 --2- 172.21.15.178:0/13187028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c100fd0 0x7f630c19b940 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:17.652 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 >> 172.21.15.178:0/13187028 conn(0x7f630c0fb3f0 msgr2=0x7f630c1045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:48:17.653 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 shutdown_connections 2023-10-14T08:48:17.653 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:48:17.650+0000 7f631255a700 1 -- 172.21.15.178:0/13187028 wait complete. 2023-10-14T08:48:18.069 DEBUG:teuthology.orchestra.run.smithi178:osd.5> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.5.service 2023-10-14T08:48:18.071 INFO:tasks.cephadm:Deploying osd.6 on smithi006 with /dev/vg_nvme/lv_2... 2023-10-14T08:48:18.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-14T08:48:18.115 INFO:journalctl@ceph.osd.5.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:48:18.666 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:48:18.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:18 smithi178 ceph-mon[103612]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:18.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:18.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:18.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:18.885 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 08:48:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T08:48:18.768+0000 7f171277a640 -1 osd.5 0 log_to_monitors true 2023-10-14T08:48:18.894 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:18 smithi006 ceph-mon[99452]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:18.895 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:18.895 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:18.895 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:18.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:18 smithi057 ceph-mon[103313]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:18.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:18.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:18.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:19.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:19 smithi178 ceph-mon[103612]: from='osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-14T08:48:19.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:19 smithi178 ceph-mon[103612]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-14T08:48:19.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:19 smithi006 ceph-mon[99452]: from='osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-14T08:48:19.893 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:19 smithi006 ceph-mon[99452]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-14T08:48:19.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:19 smithi057 ceph-mon[103313]: from='osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-14T08:48:19.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:19 smithi057 ceph-mon[103313]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-14T08:48:20.436 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-14T08:48:20.437 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-14T08:48:20.437 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-10-14T08:48:20.437 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-10-14T08:48:20.437 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107779 s, 973 MB/s 2023-10-14T08:48:20.438 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-10-14T08:48:20.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:20 smithi006 ceph-mon[99452]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:20.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:20 smithi006 ceph-mon[99452]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-14T08:48:20.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:20 smithi006 ceph-mon[99452]: osdmap e35: 6 total, 5 up, 6 in 2023-10-14T08:48:20.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:20 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:20.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:20 smithi006 ceph-mon[99452]: from='osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:48:20.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:20 smithi006 ceph-mon[99452]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:48:20.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi006:vg_nvme/lv_2 2023-10-14T08:48:20.882 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T08:48:20.651+0000 7f17075f0700 -1 osd.5 0 waiting for initial osdmap 2023-10-14T08:48:20.882 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T08:48:20.658+0000 7f17023e3700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:48:20.882 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-mon[103612]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:20.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-mon[103612]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-14T08:48:20.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-mon[103612]: osdmap e35: 6 total, 5 up, 6 in 2023-10-14T08:48:20.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:20.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-mon[103612]: from='osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:48:20.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:20 smithi178 ceph-mon[103612]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:48:20.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:20 smithi057 ceph-mon[103313]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:20.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:20 smithi057 ceph-mon[103313]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-14T08:48:20.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:20 smithi057 ceph-mon[103313]: osdmap e35: 6 total, 5 up, 6 in 2023-10-14T08:48:20.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:20 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:20.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:20 smithi057 ceph-mon[103313]: from='osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:48:20.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:20 smithi057 ceph-mon[103313]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:48:21.400 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:48:21.928 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:48:21.929 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: osdmap e36: 6 total, 5 up, 6 in 2023-10-14T08:48:21.929 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:21.929 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:21.929 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi178 2023-10-14T08:48:21.929 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:21.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:21.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi178 to 8584M 2023-10-14T08:48:21.930 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:21.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:21.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] boot 2023-10-14T08:48:21.931 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: osdmap e37: 6 total, 6 up, 6 in 2023-10-14T08:48:21.932 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:21 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:48:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: osdmap e36: 6 total, 5 up, 6 in 2023-10-14T08:48:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:21.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:21.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi178 2023-10-14T08:48:21.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:21.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:21.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi178 to 8584M 2023-10-14T08:48:21.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:21.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:21.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:21.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] boot 2023-10-14T08:48:21.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: osdmap e37: 6 total, 6 up, 6 in 2023-10-14T08:48:21.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:21 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:22.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:48:22.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: osdmap e36: 6 total, 5 up, 6 in 2023-10-14T08:48:22.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:22.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:22.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi178 2023-10-14T08:48:22.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:22.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:22.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:22.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:22.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi178 to 8584M 2023-10-14T08:48:22.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:22.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:22.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:22.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:22.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: osd.5 [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] boot 2023-10-14T08:48:22.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: osdmap e37: 6 total, 6 up, 6 in 2023-10-14T08:48:22.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:21 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-14T08:48:22.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 -- 172.21.15.6:0/4048989621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934100fd0 msgr2=0x7f2934101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:22.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 --2- 172.21.15.6:0/4048989621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934100fd0 0x7f2934101450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2920009990 tx=0x7f2920009ca0 comp rx=0 tx=0).stop 2023-10-14T08:48:22.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 -- 172.21.15.6:0/4048989621 shutdown_connections 2023-10-14T08:48:22.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 --2- 172.21.15.6:0/4048989621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2934101990 0x7f29341082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 --2- 172.21.15.6:0/4048989621 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29340ffe70 0x7f2934100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 --2- 172.21.15.6:0/4048989621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934100fd0 0x7f2934101450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 -- 172.21.15.6:0/4048989621 >> 172.21.15.6:0/4048989621 conn(0x7f29340fb3f0 msgr2=0x7f29340fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:48:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 -- 172.21.15.6:0/4048989621 shutdown_connections 2023-10-14T08:48:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 -- 172.21.15.6:0/4048989621 wait complete. 2023-10-14T08:48:22.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 Processor -- start 2023-10-14T08:48:22.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.627+0000 7f293b0d1700 1 -- start start 2023-10-14T08:48:22.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340ffe70 0x7f2934103df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:22.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2934100fd0 0x7f2934102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:22.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 0x7f2934102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:22.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934103100 con 0x7f2934101990 2023-10-14T08:48:22.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934103270 con 0x7f2934100fd0 2023-10-14T08:48:22.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341a0c70 con 0x7f29340ffe70 2023-10-14T08:48:22.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 0x7f2934102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:22.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 0x7f2934102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58636/0 (socket says 172.21.15.6:58636) 2023-10-14T08:48:22.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 -- 172.21.15.6:0/2400090410 learned_addr learned my addr 172.21.15.6:0/2400090410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:48:22.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f2938e6d700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340ffe70 0x7f2934103df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:22.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f2933fff700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2934100fd0 0x7f2934102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:22.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 -- 172.21.15.6:0/2400090410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340ffe70 msgr2=0x7f2934103df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:22.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340ffe70 0x7f2934103df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:22.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 -- 172.21.15.6:0/2400090410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2934100fd0 msgr2=0x7f2934102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:22.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2934100fd0 0x7f2934102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:22.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 -- 172.21.15.6:0/2400090410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200095f0 con 0x7f2934101990 2023-10-14T08:48:22.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f2938e6d700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340ffe70 0x7f2934103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:48:22.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293966e700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 0x7f2934102980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f292c00ef30 tx=0x7f292c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:48:22.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c018070 con 0x7f2934101990 2023-10-14T08:48:22.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f292c00f040 con 0x7f2934101990 2023-10-14T08:48:22.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.628+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29341a0ef0 con 0x7f2934101990 2023-10-14T08:48:22.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.629+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c003dc0 con 0x7f2934101990 2023-10-14T08:48:22.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.629+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29341a1360 con 0x7f2934101990 2023-10-14T08:48:22.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.630+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293410b680 con 0x7f2934101990 2023-10-14T08:48:22.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.631+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f292c00caa0 con 0x7f2934101990 2023-10-14T08:48:22.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.631+0000 7f2931ffb700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f29240a1480 0x7f29240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:22.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.631+0000 7f2938e6d700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f29240a1480 0x7f29240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:22.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.631+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f292c0cbab0 con 0x7f2934101990 2023-10-14T08:48:22.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.632+0000 7f2938e6d700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f29240a1480 0x7f29240a3940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2928005950 tx=0x7f29280058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:48:22.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.636+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f292c096040 con 0x7f2934101990 2023-10-14T08:48:22.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:22 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:48:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:22 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:48:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:22 smithi006 ceph-mon[99452]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:22 smithi006 ceph-mon[99452]: osdmap e38: 6 total, 6 up, 6 in 2023-10-14T08:48:22.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:22.850+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2934069170 con 0x7f29240a1480 2023-10-14T08:48:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:22 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:48:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:22 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:48:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:22 smithi057 ceph-mon[103313]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:22 smithi057 ceph-mon[103313]: osdmap e38: 6 total, 6 up, 6 in 2023-10-14T08:48:23.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:22 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:48:23.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:22 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:48:23.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:22 smithi178 ceph-mon[103612]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-14T08:48:23.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:22 smithi178 ceph-mon[103612]: osdmap e38: 6 total, 6 up, 6 in 2023-10-14T08:48:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:23 smithi057 ceph-mon[103313]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:23.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:23 smithi057 ceph-mon[103313]: osdmap e39: 6 total, 6 up, 6 in 2023-10-14T08:48:23.978 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:23 smithi006 ceph-mon[99452]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:23.979 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:23.979 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:23.979 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:23.979 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:23 smithi006 ceph-mon[99452]: osdmap e39: 6 total, 6 up, 6 in 2023-10-14T08:48:24.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:23 smithi178 ceph-mon[103612]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:24.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:24.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:24.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:24.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:23 smithi178 ceph-mon[103612]: osdmap e39: 6 total, 6 up, 6 in 2023-10-14T08:48:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:25 smithi178 ceph-mon[103612]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:25 smithi178 ceph-mon[103612]: osdmap e40: 6 total, 6 up, 6 in 2023-10-14T08:48:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:25 smithi057 ceph-mon[103313]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:25 smithi057 ceph-mon[103313]: osdmap e40: 6 total, 6 up, 6 in 2023-10-14T08:48:25.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:25 smithi006 ceph-mon[99452]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:25.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:25 smithi006 ceph-mon[99452]: osdmap e40: 6 total, 6 up, 6 in 2023-10-14T08:48:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:26 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/959076845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82017fe0-ae29-42fc-be07-a8a180d4d969"}]: dispatch 2023-10-14T08:48:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:26 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/959076845' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82017fe0-ae29-42fc-be07-a8a180d4d969"}]': finished 2023-10-14T08:48:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:26 smithi178 ceph-mon[103612]: osdmap e41: 7 total, 6 up, 7 in 2023-10-14T08:48:26.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:26 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:26.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:26 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/959076845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82017fe0-ae29-42fc-be07-a8a180d4d969"}]: dispatch 2023-10-14T08:48:26.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:26 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/959076845' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82017fe0-ae29-42fc-be07-a8a180d4d969"}]': finished 2023-10-14T08:48:26.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:26 smithi057 ceph-mon[103313]: osdmap e41: 7 total, 6 up, 7 in 2023-10-14T08:48:26.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:26 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:26 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/959076845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "82017fe0-ae29-42fc-be07-a8a180d4d969"}]: dispatch 2023-10-14T08:48:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:26 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/959076845' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "82017fe0-ae29-42fc-be07-a8a180d4d969"}]': finished 2023-10-14T08:48:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:26 smithi006 ceph-mon[99452]: osdmap e41: 7 total, 6 up, 7 in 2023-10-14T08:48:26.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:27.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:27 smithi178 ceph-mon[103612]: pgmap v131: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-14T08:48:27.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:27 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1794466614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:27 smithi057 ceph-mon[103313]: pgmap v131: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-14T08:48:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:27 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1794466614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:27.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:27 smithi006 ceph-mon[99452]: pgmap v131: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-10-14T08:48:27.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:27 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1794466614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:29.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:29 smithi178 ceph-mon[103612]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-14T08:48:29.430 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:29 smithi006 ceph-mon[99452]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-14T08:48:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:29 smithi057 ceph-mon[103313]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-10-14T08:48:31.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:31 smithi178 ceph-mon[103612]: pgmap v134: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-14T08:48:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:31 smithi057 ceph-mon[103313]: pgmap v134: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-14T08:48:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:31 smithi006 ceph-mon[99452]: pgmap v134: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-10-14T08:48:33.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:33 smithi178 ceph-mon[103612]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-14T08:48:33.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-14T08:48:33.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:33.421 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:33 smithi006 ceph-mon[99452]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-14T08:48:33.421 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-14T08:48:33.421 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:33 smithi057 ceph-mon[103313]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-14T08:48:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-14T08:48:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:34.150 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:34 smithi006 ceph-mon[99452]: Deploying daemon osd.6 on smithi006 2023-10-14T08:48:34.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:34 smithi178 ceph-mon[103612]: Deploying daemon osd.6 on smithi006 2023-10-14T08:48:34.443 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:34 smithi057 ceph-mon[103313]: Deploying daemon osd.6 on smithi006 2023-10-14T08:48:35.281 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:35 smithi006 ceph-mon[99452]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:35.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:35 smithi178 ceph-mon[103612]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:35.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:35 smithi057 ceph-mon[103313]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:37.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:37 smithi006 ceph-mon[99452]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:37.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:37.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:37.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:37 smithi178 ceph-mon[103612]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:37.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:37.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:37 smithi057 ceph-mon[103313]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:38.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:38 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:38.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:38 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:38.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:38 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:39.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:39 smithi006 ceph-mon[99452]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:39.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:39 smithi178 ceph-mon[103612]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:39 smithi057 ceph-mon[103313]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:39.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.755+0000 7f2931ffb700 1 -- 172.21.15.6:0/2400090410 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2934069170 con 0x7f29240a1480 2023-10-14T08:48:39.757 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 6 on host 'smithi006' 2023-10-14T08:48:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f29240a1480 msgr2=0x7f29240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f29240a1480 0x7f29240a3940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2928005950 tx=0x7f29280058e0 comp rx=0 tx=0).stop 2023-10-14T08:48:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 msgr2=0x7f2934102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 0x7f2934102980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f292c00ef30 tx=0x7f292c00c450 comp rx=0 tx=0).stop 2023-10-14T08:48:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 shutdown_connections 2023-10-14T08:48:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2934101990 0x7f2934102980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340ffe70 0x7f2934103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f29240a1480 0x7f29240a3940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 --2- 172.21.15.6:0/2400090410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2934100fd0 0x7f2934102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 >> 172.21.15.6:0/2400090410 conn(0x7f29340fb3f0 msgr2=0x7f2934068a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:48:39.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 shutdown_connections 2023-10-14T08:48:39.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:48:39.758+0000 7f293b0d1700 1 -- 172.21.15.6:0/2400090410 wait complete. 2023-10-14T08:48:40.204 DEBUG:teuthology.orchestra.run.smithi006:osd.6> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.6.service 2023-10-14T08:48:40.206 INFO:tasks.cephadm:Deploying osd.7 on smithi057 with /dev/vg_nvme/lv_2... 2023-10-14T08:48:40.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-14T08:48:40.237 INFO:journalctl@ceph.osd.6.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:48:40.798 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:48:40.868 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:40.869 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:40.870 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:40 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:40.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:40.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:40.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:40.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:40 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:40.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:40.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:40.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:40.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:48:40.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:40 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:41.215 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 08:48:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T08:48:41.079+0000 7f1b7d815640 -1 osd.6 0 log_to_monitors true 2023-10-14T08:48:42.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:42 smithi006 ceph-mon[99452]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-14T08:48:42.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:42 smithi178 ceph-mon[103612]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-14T08:48:42.400 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-14T08:48:42.400 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-14T08:48:42.400 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-10-14T08:48:42.400 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-10-14T08:48:42.400 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102848 s, 1.0 GB/s 2023-10-14T08:48:42.401 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-10-14T08:48:42.432 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:42 smithi057 ceph-mon[103313]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-14T08:48:42.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi057:vg_nvme/lv_2 2023-10-14T08:48:43.333 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:48:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-14T08:48:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: osdmap e42: 7 total, 6 up, 7 in 2023-10-14T08:48:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:48:43.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:43.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:43.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:43.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-14T08:48:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: osdmap e42: 7 total, 6 up, 7 in 2023-10-14T08:48:43.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:48:43.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:43.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:43.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:43.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.481 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T08:48:43.070+0000 7f1b7268b700 -1 osd.6 0 waiting for initial osdmap 2023-10-14T08:48:43.482 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T08:48:43.081+0000 7f1b6d47e700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:48:43.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:43.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-14T08:48:43.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: osdmap e42: 7 total, 6 up, 7 in 2023-10-14T08:48:43.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:48:43.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:43.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:48:43.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:43.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:43.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:48:43.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:48:44.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:44 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi006 2023-10-14T08:48:44.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:44 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi006 to 5724M 2023-10-14T08:48:44.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:44 smithi178 ceph-mon[103612]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:48:44.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:44 smithi178 ceph-mon[103612]: osdmap e43: 7 total, 6 up, 7 in 2023-10-14T08:48:44.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:44 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:44.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:44 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:44.434 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:44 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi006 2023-10-14T08:48:44.435 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:44 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi006 to 5724M 2023-10-14T08:48:44.435 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:44 smithi057 ceph-mon[103313]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:48:44.435 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:44 smithi057 ceph-mon[103313]: osdmap e43: 7 total, 6 up, 7 in 2023-10-14T08:48:44.435 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:44 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:44.435 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:44 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:44.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:44 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi006 2023-10-14T08:48:44.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:44 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi006 to 5724M 2023-10-14T08:48:44.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:44 smithi006 ceph-mon[99452]: from='osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:48:44.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:44 smithi006 ceph-mon[99452]: osdmap e43: 7 total, 6 up, 7 in 2023-10-14T08:48:44.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:44 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:44.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:44 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:44.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 -- 172.21.15.57:0/2394670336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 msgr2=0x7f7520101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:44.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 --2- 172.21.15.57:0/2394670336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f7520101450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7510009990 tx=0x7f7510009ca0 comp rx=0 tx=0).stop 2023-10-14T08:48:44.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 -- 172.21.15.57:0/2394670336 shutdown_connections 2023-10-14T08:48:44.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 --2- 172.21.15.57:0/2394670336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520101990 0x7f75201082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:44.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 --2- 172.21.15.57:0/2394670336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75200ffe70 0x7f7520100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:44.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 --2- 172.21.15.57:0/2394670336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f7520101450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:44.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 -- 172.21.15.57:0/2394670336 >> 172.21.15.57:0/2394670336 conn(0x7f75200fb3f0 msgr2=0x7f75200fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:48:44.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 -- 172.21.15.57:0/2394670336 shutdown_connections 2023-10-14T08:48:44.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 -- 172.21.15.57:0/2394670336 wait complete. 2023-10-14T08:48:44.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.653+0000 7f752822d700 1 Processor -- start 2023-10-14T08:48:44.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 -- start start 2023-10-14T08:48:44.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75200ffe70 0x7f7520069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:44.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f752019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520101990 0x7f752019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752019e760 con 0x7f7520101990 2023-10-14T08:48:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752019e8d0 con 0x7f7520100fd0 2023-10-14T08:48:44.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f752822d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752019ea90 con 0x7f75200ffe70 2023-10-14T08:48:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f752019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f7525fc9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75200ffe70 0x7f7520069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f752019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58966/0 (socket says 172.21.15.57:58966) 2023-10-14T08:48:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 -- 172.21.15.57:0/3258489702 learned_addr learned my addr 172.21.15.57:0/3258489702 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-14T08:48:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75267ca700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520101990 0x7f752019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 -- 172.21.15.57:0/3258489702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75200ffe70 msgr2=0x7f7520069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75200ffe70 0x7f7520069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 -- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520101990 msgr2=0x7f752019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:48:44.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520101990 0x7f752019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:48:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.654+0000 7f75257c8700 1 -- 172.21.15.57:0/3258489702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100095f0 con 0x7f7520100fd0 2023-10-14T08:48:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.655+0000 7f75257c8700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f752019b930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7510004760 tx=0x7f7510004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:48:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.655+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751001d070 con 0x7f7520100fd0 2023-10-14T08:48:44.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.655+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752019ed10 con 0x7f7520100fd0 2023-10-14T08:48:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.655+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7510004cf0 con 0x7f7520100fd0 2023-10-14T08:48:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.655+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510003d00 con 0x7f7520100fd0 2023-10-14T08:48:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.655+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752019f1a0 con 0x7f7520100fd0 2023-10-14T08:48:44.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.656+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752010b6f0 con 0x7f7520100fd0 2023-10-14T08:48:44.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.657+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7510004800 con 0x7f7520100fd0 2023-10-14T08:48:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.657+0000 7f7516ffd700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f750c0a1480 0x7f750c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:48:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.658+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f75100cd080 con 0x7f7520100fd0 2023-10-14T08:48:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.658+0000 7f7525fc9700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f750c0a1480 0x7f750c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:48:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.658+0000 7f7525fc9700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f750c0a1480 0x7f750c0a3940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f751c005950 tx=0x7f751c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:48:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.662+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f751005c100 con 0x7f7520100fd0 2023-10-14T08:48:44.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:48:44.870+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f75200612f0 con 0x7f750c0a1480 2023-10-14T08:48:45.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:48:45.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:48:45.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:45.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:45.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] boot 2023-10-14T08:48:45.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: osdmap e44: 7 total, 7 up, 7 in 2023-10-14T08:48:45.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:45.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:45.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:45.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:48:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:48:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] boot 2023-10-14T08:48:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: osdmap e44: 7 total, 7 up, 7 in 2023-10-14T08:48:45.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:45.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:45.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:45.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:48:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:48:45.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-14T08:48:45.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:45.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: osd.6 [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] boot 2023-10-14T08:48:45.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: osdmap e44: 7 total, 7 up, 7 in 2023-10-14T08:48:45.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-14T08:48:45.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:48:45.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:48:45.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:46.367 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:46 smithi057 ceph-mon[103313]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:46.367 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:46 smithi057 ceph-mon[103313]: osdmap e45: 7 total, 7 up, 7 in 2023-10-14T08:48:46.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:46 smithi178 ceph-mon[103612]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:46.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:46 smithi178 ceph-mon[103612]: osdmap e45: 7 total, 7 up, 7 in 2023-10-14T08:48:46.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:46 smithi006 ceph-mon[99452]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:48:46.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:46 smithi006 ceph-mon[99452]: osdmap e45: 7 total, 7 up, 7 in 2023-10-14T08:48:47.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:47 smithi178 ceph-mon[103612]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:47.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:47 smithi057 ceph-mon[103313]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:47 smithi006 ceph-mon[99452]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:48.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:48 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/1988143618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]: dispatch 2023-10-14T08:48:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:48 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]: dispatch 2023-10-14T08:48:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:48 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]': finished 2023-10-14T08:48:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:48 smithi178 ceph-mon[103612]: osdmap e46: 8 total, 7 up, 8 in 2023-10-14T08:48:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:48:48.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:48 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/1988143618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]: dispatch 2023-10-14T08:48:48.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:48 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]: dispatch 2023-10-14T08:48:48.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:48 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]': finished 2023-10-14T08:48:48.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:48 smithi057 ceph-mon[103313]: osdmap e46: 8 total, 7 up, 8 in 2023-10-14T08:48:48.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:48:48.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:48 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/1988143618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]: dispatch 2023-10-14T08:48:48.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:48 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]: dispatch 2023-10-14T08:48:48.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:48 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f93b9770-08f4-4f9b-8141-317e455fd3a0"}]': finished 2023-10-14T08:48:48.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:48 smithi006 ceph-mon[99452]: osdmap e46: 8 total, 7 up, 8 in 2023-10-14T08:48:48.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:48:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:49 smithi006 ceph-mon[99452]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:49.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:49 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/3772851424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:49.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:49 smithi178 ceph-mon[103612]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:49 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/3772851424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:49 smithi057 ceph-mon[103313]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:49 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/3772851424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:48:51.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:51 smithi057 ceph-mon[103313]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:51.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:51 smithi006 ceph-mon[99452]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:51 smithi178 ceph-mon[103612]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:53.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:53 smithi057 ceph-mon[103313]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:53.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:53 smithi006 ceph-mon[99452]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:53.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:53 smithi178 ceph-mon[103612]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:55.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:55 smithi057 ceph-mon[103313]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:55.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:55 smithi006 ceph-mon[99452]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:55.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:55 smithi178 ceph-mon[103612]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:56.409 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-14T08:48:56.409 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:56.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-14T08:48:56.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:56.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-14T08:48:56.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:48:57.338 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:57 smithi057 ceph-mon[103313]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:57.339 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:57 smithi057 ceph-mon[103313]: Deploying daemon osd.7 on smithi057 2023-10-14T08:48:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:57 smithi006 ceph-mon[99452]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:57 smithi006 ceph-mon[99452]: Deploying daemon osd.7 on smithi057 2023-10-14T08:48:57.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:57 smithi178 ceph-mon[103612]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:57 smithi178 ceph-mon[103612]: Deploying daemon osd.7 on smithi057 2023-10-14T08:48:59.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:48:59 smithi057 ceph-mon[103313]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:59.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:48:59 smithi006 ceph-mon[99452]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:48:59.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:48:59 smithi178 ceph-mon[103612]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:01.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:00 smithi057 ceph-mon[103313]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:01.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:00 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:01.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:00 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:01.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:00 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:01.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:00 smithi178 ceph-mon[103612]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:01.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:00 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:01.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:00 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:01.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:00 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:01.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:00 smithi006 ceph-mon[99452]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:01.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:00 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:00 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:00 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:02.696 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 7 on host 'smithi057' 2023-10-14T08:49:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.694+0000 7f7516ffd700 1 -- 172.21.15.57:0/3258489702 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f75200612f0 con 0x7f750c0a1480 2023-10-14T08:49:02.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f750c0a1480 msgr2=0x7f750c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:02.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f750c0a1480 0x7f750c0a3940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f751c005950 tx=0x7f751c00b410 comp rx=0 tx=0).stop 2023-10-14T08:49:02.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 msgr2=0x7f752019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:02.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f752019b930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7510004760 tx=0x7f7510004790 comp rx=0 tx=0).stop 2023-10-14T08:49:02.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 shutdown_connections 2023-10-14T08:49:02.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520101990 0x7f752019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:02.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75200ffe70 0x7f7520069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:02.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f750c0a1480 0x7f750c0a3940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:02.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 --2- 172.21.15.57:0/3258489702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7520100fd0 0x7f752019b930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:02.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 >> 172.21.15.57:0/3258489702 conn(0x7f75200fb3f0 msgr2=0x7f75200fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:49:02.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 shutdown_connections 2023-10-14T08:49:02.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:02.696+0000 7f752822d700 1 -- 172.21.15.57:0/3258489702 wait complete. 2023-10-14T08:49:03.138 DEBUG:teuthology.orchestra.run.smithi057:osd.7> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.7.service 2023-10-14T08:49:03.141 INFO:tasks.cephadm:Deploying osd.8 on smithi178 with /dev/vg_nvme/lv_2... 2023-10-14T08:49:03.141 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-14T08:49:03.175 INFO:journalctl@ceph.osd.7.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:49:03.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:03.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:03.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:03.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:03.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:03.712 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:49:04.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:04 smithi057 ceph-mon[103313]: from='osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-14T08:49:04.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:04 smithi057 ceph-mon[103313]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-14T08:49:04.195 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 08:49:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T08:49:03.924+0000 7fb14ad65640 -1 osd.7 0 log_to_monitors true 2023-10-14T08:49:04.301 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:04 smithi178 ceph-mon[103612]: from='osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-14T08:49:04.301 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:04 smithi178 ceph-mon[103612]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-14T08:49:04.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:04 smithi006 ceph-mon[99452]: from='osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-14T08:49:04.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:04 smithi006 ceph-mon[99452]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-14T08:49:05.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:05 smithi178 ceph-mon[103612]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:05.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:05 smithi178 ceph-mon[103612]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-14T08:49:05.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:05 smithi178 ceph-mon[103612]: osdmap e47: 8 total, 7 up, 8 in 2023-10-14T08:49:05.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:05 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:05.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:05 smithi178 ceph-mon[103612]: from='osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:49:05.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:05 smithi178 ceph-mon[103612]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:49:05.334 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-14T08:49:05.334 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-14T08:49:05.334 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-10-14T08:49:05.335 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-10-14T08:49:05.335 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00833606 s, 1.3 GB/s 2023-10-14T08:49:05.335 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 2023-10-14T08:49:05.335 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-10-14T08:49:05.386 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T08:49:05.080+0000 7fb13fbdb700 -1 osd.7 0 waiting for initial osdmap 2023-10-14T08:49:05.387 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T08:49:05.089+0000 7fb13b9d0700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:49:05.387 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-mon[103313]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:05.387 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-mon[103313]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-14T08:49:05.388 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-mon[103313]: osdmap e47: 8 total, 7 up, 8 in 2023-10-14T08:49:05.388 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:05.388 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-mon[103313]: from='osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:49:05.388 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:05 smithi057 ceph-mon[103313]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:49:05.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:05 smithi006 ceph-mon[99452]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:05.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:05 smithi006 ceph-mon[99452]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-14T08:49:05.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:05 smithi006 ceph-mon[99452]: osdmap e47: 8 total, 7 up, 8 in 2023-10-14T08:49:05.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:05 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:05.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:05 smithi006 ceph-mon[99452]: from='osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:49:05.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:05 smithi006 ceph-mon[99452]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:49:05.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2023-10-14T08:49:06.319 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:49:06.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:49:06.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: osdmap e48: 8 total, 7 up, 8 in 2023-10-14T08:49:06.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] boot 2023-10-14T08:49:06.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: osdmap e49: 8 total, 8 up, 8 in 2023-10-14T08:49:06.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:49:06.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: osdmap e48: 8 total, 7 up, 8 in 2023-10-14T08:49:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:06.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] boot 2023-10-14T08:49:06.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: osdmap e49: 8 total, 8 up, 8 in 2023-10-14T08:49:06.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:49:06.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: osdmap e48: 8 total, 7 up, 8 in 2023-10-14T08:49:06.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:06.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:06.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:06.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:06.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:06.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: osd.7 [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] boot 2023-10-14T08:49:06.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: osdmap e49: 8 total, 8 up, 8 in 2023-10-14T08:49:06.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-14T08:49:07.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:07 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:49:07.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:07 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:49:07.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:07 smithi178 ceph-mon[103612]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:07.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:07 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi057 2023-10-14T08:49:07.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:07 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi057 to 5724M 2023-10-14T08:49:07.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:07 smithi178 ceph-mon[103612]: osdmap e50: 8 total, 8 up, 8 in 2023-10-14T08:49:07.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:07 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:49:07.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:07 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:49:07.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:07 smithi057 ceph-mon[103313]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:07.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:07 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi057 2023-10-14T08:49:07.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:07 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi057 to 5724M 2023-10-14T08:49:07.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:07 smithi057 ceph-mon[103313]: osdmap e50: 8 total, 8 up, 8 in 2023-10-14T08:49:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:07 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:49:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:07 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:49:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:07 smithi006 ceph-mon[99452]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-14T08:49:07.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:07 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi057 2023-10-14T08:49:07.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:07 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi057 to 5724M 2023-10-14T08:49:07.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:07 smithi006 ceph-mon[99452]: osdmap e50: 8 total, 8 up, 8 in 2023-10-14T08:49:07.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 -- 172.21.15.178:0/559114357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c106c60 msgr2=0x7f960c1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:07.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 --2- 172.21.15.178:0/559114357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c106c60 0x7f960c1090d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f960400b0a0 tx=0x7f960400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:49:07.764 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 -- 172.21.15.178:0/559114357 shutdown_connections 2023-10-14T08:49:07.764 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 --2- 172.21.15.178:0/559114357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c106c60 0x7f960c1090d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:07.764 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 --2- 172.21.15.178:0/559114357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f960c101a00 0x7f960c103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:07.764 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 --2- 172.21.15.178:0/559114357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c104330 0x7f960c106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:07.764 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 -- 172.21.15.178:0/559114357 >> 172.21.15.178:0/559114357 conn(0x7f960c0fb3f0 msgr2=0x7f960c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:49:07.765 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 -- 172.21.15.178:0/559114357 shutdown_connections 2023-10-14T08:49:07.765 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.762+0000 7f9614553700 1 -- 172.21.15.178:0/559114357 wait complete. 2023-10-14T08:49:07.768 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 Processor -- start 2023-10-14T08:49:07.768 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 -- start start 2023-10-14T08:49:07.768 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c101a00 0x7f960c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:07.768 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 0x7f960c1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:07.769 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f960c106c60 0x7f960c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:07.769 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1a0c40 con 0x7f960c101a00 2023-10-14T08:49:07.769 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1a0d80 con 0x7f960c106c60 2023-10-14T08:49:07.769 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9614553700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1a0f10 con 0x7f960c104330 2023-10-14T08:49:07.769 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 0x7f960c1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:07.770 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 0x7f960c1995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41532/0 (socket says 172.21.15.178:41532) 2023-10-14T08:49:07.770 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 -- 172.21.15.178:0/538986086 learned_addr learned my addr 172.21.15.178:0/538986086 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:49:07.770 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9612af0700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f960c106c60 0x7f960c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:07.770 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 -- 172.21.15.178:0/538986086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f960c106c60 msgr2=0x7f960c1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:07.770 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f960c106c60 0x7f960c1a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:07.771 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f96122ef700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c101a00 0x7f960c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:07.771 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 -- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c101a00 msgr2=0x7f960c1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:07.771 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c101a00 0x7f960c1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:07.771 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 -- 172.21.15.178:0/538986086 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009d00 con 0x7f960c104330 2023-10-14T08:49:07.771 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f96122ef700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c101a00 0x7f960c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:49:07.772 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.763+0000 7f9611aee700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 0x7f960c1995f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f960800b560 tx=0x7f960800b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:49:07.772 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.764+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011830 con 0x7f960c104330 2023-10-14T08:49:07.772 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.764+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9608011e50 con 0x7f960c104330 2023-10-14T08:49:07.772 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.764+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c1a11f0 con 0x7f960c104330 2023-10-14T08:49:07.772 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.764+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800f2e0 con 0x7f960c104330 2023-10-14T08:49:07.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.764+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c1a1770 con 0x7f960c104330 2023-10-14T08:49:07.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.765+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c1087e0 con 0x7f960c104330 2023-10-14T08:49:07.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.766+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9608011990 con 0x7f960c104330 2023-10-14T08:49:07.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.766+0000 7f96037fe700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95f80a1500 0x7f95f80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:07.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.766+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f96080cc2a0 con 0x7f960c104330 2023-10-14T08:49:07.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.766+0000 7f96122ef700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95f80a1500 0x7f95f80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:07.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.767+0000 7f96122ef700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95f80a1500 0x7f95f80a39c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95fc007900 tx=0x7f95fc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:49:07.774 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.770+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9608096440 con 0x7f960c104330 2023-10-14T08:49:07.965 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:07.965+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f960c02d1a0 con 0x7f95f80a1500 2023-10-14T08:49:08.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:08.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:08.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:08.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:08 smithi178 ceph-mon[103612]: osdmap e51: 8 total, 8 up, 8 in 2023-10-14T08:49:08.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:08.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:08.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:08.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:08 smithi057 ceph-mon[103313]: osdmap e51: 8 total, 8 up, 8 in 2023-10-14T08:49:08.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:08.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:08.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:08.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:08 smithi006 ceph-mon[99452]: osdmap e51: 8 total, 8 up, 8 in 2023-10-14T08:49:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:09 smithi178 ceph-mon[103612]: pgmap v162: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:09 smithi178 ceph-mon[103612]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:09 smithi178 ceph-mon[103612]: osdmap e52: 8 total, 8 up, 8 in 2023-10-14T08:49:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:09 smithi057 ceph-mon[103313]: pgmap v162: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:09 smithi057 ceph-mon[103313]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:09 smithi057 ceph-mon[103313]: osdmap e52: 8 total, 8 up, 8 in 2023-10-14T08:49:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:09 smithi006 ceph-mon[99452]: pgmap v162: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:09 smithi006 ceph-mon[99452]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:09.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:09 smithi006 ceph-mon[99452]: osdmap e52: 8 total, 8 up, 8 in 2023-10-14T08:49:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: pgmap v165: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: osdmap e53: 8 total, 8 up, 8 in 2023-10-14T08:49:11.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/153421585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]: dispatch 2023-10-14T08:49:11.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]: dispatch 2023-10-14T08:49:11.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]': finished 2023-10-14T08:49:11.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: osdmap e54: 9 total, 8 up, 9 in 2023-10-14T08:49:11.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: pgmap v165: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: osdmap e53: 8 total, 8 up, 8 in 2023-10-14T08:49:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/153421585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]: dispatch 2023-10-14T08:49:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]: dispatch 2023-10-14T08:49:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]': finished 2023-10-14T08:49:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: osdmap e54: 9 total, 8 up, 9 in 2023-10-14T08:49:11.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: pgmap v165: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: osdmap e53: 8 total, 8 up, 8 in 2023-10-14T08:49:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/153421585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]: dispatch 2023-10-14T08:49:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]: dispatch 2023-10-14T08:49:11.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea8d4216-d791-4f3f-9448-c81af655c2ba"}]': finished 2023-10-14T08:49:11.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: osdmap e54: 9 total, 8 up, 9 in 2023-10-14T08:49:11.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:12.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:12 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/4216093746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:12.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:12 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/4216093746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:12.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/4216093746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:13.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:13 smithi178 ceph-mon[103612]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:13 smithi057 ceph-mon[103313]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:13.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:13 smithi006 ceph-mon[99452]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:15.346 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:15 smithi178 ceph-mon[103612]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:15 smithi057 ceph-mon[103313]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:15.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:15 smithi006 ceph-mon[99452]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:17.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:17 smithi178 ceph-mon[103612]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:17.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-14T08:49:17.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:17 smithi057 ceph-mon[103313]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-14T08:49:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:17 smithi006 ceph-mon[99452]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-14T08:49:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:18.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:18 smithi178 ceph-mon[103612]: Deploying daemon osd.8 on smithi178 2023-10-14T08:49:18.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:18 smithi057 ceph-mon[103313]: Deploying daemon osd.8 on smithi178 2023-10-14T08:49:18.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:18 smithi006 ceph-mon[99452]: Deploying daemon osd.8 on smithi178 2023-10-14T08:49:19.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:19 smithi178 ceph-mon[103612]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:19.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:19 smithi057 ceph-mon[103313]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:19.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:19 smithi006 ceph-mon[99452]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:21 smithi178 ceph-mon[103612]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:21 smithi057 ceph-mon[103313]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:21.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:21 smithi006 ceph-mon[99452]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:22.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:22 smithi178 ceph-mon[103612]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:22 smithi057 ceph-mon[103313]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:22.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:22 smithi006 ceph-mon[99452]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:22.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:22.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:22.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:24.386 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 8 on host 'smithi178' 2023-10-14T08:49:24.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.384+0000 7f96037fe700 1 -- 172.21.15.178:0/538986086 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f960c02d1a0 con 0x7f95f80a1500 2023-10-14T08:49:24.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95f80a1500 msgr2=0x7f95f80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:24.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95f80a1500 0x7f95f80a39c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95fc007900 tx=0x7f95fc008040 comp rx=0 tx=0).stop 2023-10-14T08:49:24.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 msgr2=0x7f960c1995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:24.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 0x7f960c1995f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f960800b560 tx=0x7f960800b920 comp rx=0 tx=0).stop 2023-10-14T08:49:24.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 shutdown_connections 2023-10-14T08:49:24.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95f80a1500 0x7f95f80a39c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:24.389 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f960c106c60 0x7f960c1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:24.389 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c101a00 0x7f960c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:24.389 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 --2- 172.21.15.178:0/538986086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c104330 0x7f960c1995f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:24.389 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 >> 172.21.15.178:0/538986086 conn(0x7f960c0fb3f0 msgr2=0x7f960c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:49:24.390 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.386+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 shutdown_connections 2023-10-14T08:49:24.390 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:49:24.387+0000 7f9614553700 1 -- 172.21.15.178:0/538986086 wait complete. 2023-10-14T08:49:24.901 DEBUG:teuthology.orchestra.run.smithi178:osd.8> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.8.service 2023-10-14T08:49:24.904 INFO:tasks.cephadm:Deploying osd.9 on smithi006 with /dev/vg_nvme/lv_1... 2023-10-14T08:49:24.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-14T08:49:24.933 INFO:journalctl@ceph.osd.8.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:49:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:25.328 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:25.329 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.329 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.329 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:25.330 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:25.330 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.330 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.330 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.330 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:25.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:25.487 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:49:25.633 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 08:49:25 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T08:49:25.398+0000 7ff6d73fe640 -1 osd.8 0 log_to_monitors true 2023-10-14T08:49:25.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:25 smithi006 ceph-mon[99452]: from='osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-14T08:49:25.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:25 smithi006 ceph-mon[99452]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-14T08:49:26.230 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:25 smithi178 ceph-mon[103612]: from='osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-14T08:49:26.230 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:25 smithi178 ceph-mon[103612]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-14T08:49:26.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:25 smithi057 ceph-mon[103313]: from='osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-14T08:49:26.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:25 smithi057 ceph-mon[103313]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-14T08:49:27.094 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-14T08:49:27.095 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-14T08:49:27.095 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-10-14T08:49:27.095 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-10-14T08:49:27.096 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108941 s, 963 MB/s 2023-10-14T08:49:27.096 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-10-14T08:49:27.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:26 smithi006 ceph-mon[99452]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:27.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:26 smithi006 ceph-mon[99452]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-14T08:49:27.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:26 smithi006 ceph-mon[99452]: osdmap e55: 9 total, 8 up, 9 in 2023-10-14T08:49:27.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:27.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:26 smithi006 ceph-mon[99452]: from='osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:49:27.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:26 smithi006 ceph-mon[99452]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:49:27.296 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T08:49:26.981+0000 7ff6cc274700 -1 osd.8 0 waiting for initial osdmap 2023-10-14T08:49:27.297 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T08:49:26.996+0000 7ff6c6065700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:49:27.297 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-mon[103612]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:27.297 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-mon[103612]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-14T08:49:27.297 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-mon[103612]: osdmap e55: 9 total, 8 up, 9 in 2023-10-14T08:49:27.298 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:27.298 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-mon[103612]: from='osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:49:27.299 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:26 smithi178 ceph-mon[103612]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:49:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:26 smithi057 ceph-mon[103313]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:26 smithi057 ceph-mon[103313]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-14T08:49:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:26 smithi057 ceph-mon[103313]: osdmap e55: 9 total, 8 up, 9 in 2023-10-14T08:49:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:26 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:27.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:26 smithi057 ceph-mon[103313]: from='osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:49:27.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:26 smithi057 ceph-mon[103313]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:49:27.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi006:vg_nvme/lv_1 2023-10-14T08:49:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:49:28.250 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:49:28.250 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: osdmap e56: 9 total, 8 up, 9 in 2023-10-14T08:49:28.250 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:28.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:28.253 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.253 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:49:28.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: osdmap e56: 9 total, 8 up, 9 in 2023-10-14T08:49:28.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:28.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:28.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:49:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: osdmap e56: 9 total, 8 up, 9 in 2023-10-14T08:49:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:28.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:28.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:28.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:28.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:28.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:29.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 -- 172.21.15.6:0/1274269767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8104330 msgr2=0x7f32b8106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 --2- 172.21.15.6:0/1274269767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8104330 0x7f32b8106720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009990 tx=0x7f32a8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:49:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 -- 172.21.15.6:0/1274269767 shutdown_connections 2023-10-14T08:49:29.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 --2- 172.21.15.6:0/1274269767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32b8106c60 0x7f32b81090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 --2- 172.21.15.6:0/1274269767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8101a00 0x7f32b8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 --2- 172.21.15.6:0/1274269767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8104330 0x7f32b8106720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.202+0000 7f32bce69700 1 -- 172.21.15.6:0/1274269767 >> 172.21.15.6:0/1274269767 conn(0x7f32b80fb3f0 msgr2=0x7f32b80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:49:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.203+0000 7f32bce69700 1 -- 172.21.15.6:0/1274269767 shutdown_connections 2023-10-14T08:49:29.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.203+0000 7f32bce69700 1 -- 172.21.15.6:0/1274269767 wait complete. 2023-10-14T08:49:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 Processor -- start 2023-10-14T08:49:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 -- start start 2023-10-14T08:49:29.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 0x7f32b8198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32b8104330 0x7f32b8199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8106c60 0x7f32b81a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81a0a70 con 0x7f32b8101a00 2023-10-14T08:49:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81a0bb0 con 0x7f32b8104330 2023-10-14T08:49:29.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32bce69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b81a0d40 con 0x7f32b8106c60 2023-10-14T08:49:29.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 0x7f32b8198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:29.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 0x7f32b8198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58774/0 (socket says 172.21.15.6:58774) 2023-10-14T08:49:29.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 -- 172.21.15.6:0/50889427 learned_addr learned my addr 172.21.15.6:0/50889427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:49:29.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b5d9b700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32b8104330 0x7f32b8199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:29.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b6d9d700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8106c60 0x7f32b81a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 -- 172.21.15.6:0/50889427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8106c60 msgr2=0x7f32b81a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8106c60 0x7f32b81a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 -- 172.21.15.6:0/50889427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32b8104330 msgr2=0x7f32b8199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32b8104330 0x7f32b8199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.204+0000 7f32b659c700 1 -- 172.21.15.6:0/50889427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80095f0 con 0x7f32b8101a00 2023-10-14T08:49:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.205+0000 7f32b659c700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 0x7f32b8198ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b560 tx=0x7f32ac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:49:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.205+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac011830 con 0x7f32b8101a00 2023-10-14T08:49:29.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.205+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32ac011e50 con 0x7f32b8101a00 2023-10-14T08:49:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.205+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b81a0fc0 con 0x7f32b8101a00 2023-10-14T08:49:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.205+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00f2e0 con 0x7f32b8101a00 2023-10-14T08:49:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.205+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b81a1430 con 0x7f32b8101a00 2023-10-14T08:49:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.206+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b8108830 con 0x7f32b8101a00 2023-10-14T08:49:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.207+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f32ac010580 con 0x7f32b8101a00 2023-10-14T08:49:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.208+0000 7f32a77fe700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32a00a1480 0x7f32a00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.208+0000 7f32b5d9b700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32a00a1480 0x7f32a00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.208+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f32ac0cc300 con 0x7f32b8101a00 2023-10-14T08:49:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.208+0000 7f32b5d9b700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32a00a1480 0x7f32a00a3940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32a800b5c0 tx=0x7f32a8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:49:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.211+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32ac0962f0 con 0x7f32b8101a00 2023-10-14T08:49:29.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:49:29.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:49:29.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:29.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi178 2023-10-14T08:49:29.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi178 to 5722M 2023-10-14T08:49:29.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] boot 2023-10-14T08:49:29.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: osdmap e57: 9 total, 9 up, 9 in 2023-10-14T08:49:29.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:28 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:29.422+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b802d2d0 con 0x7f32a00a1480 2023-10-14T08:49:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:49:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:49:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi178 2023-10-14T08:49:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi178 to 5722M 2023-10-14T08:49:29.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] boot 2023-10-14T08:49:29.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: osdmap e57: 9 total, 9 up, 9 in 2023-10-14T08:49:29.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:28 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:49:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:49:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-14T08:49:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi178 2023-10-14T08:49:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi178 to 5722M 2023-10-14T08:49:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: osd.8 [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] boot 2023-10-14T08:49:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: osdmap e57: 9 total, 9 up, 9 in 2023-10-14T08:49:29.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-14T08:49:30.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:30 smithi006 ceph-mon[99452]: osdmap e58: 9 total, 9 up, 9 in 2023-10-14T08:49:30.268 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:30.268 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:30.268 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:30.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:30 smithi178 ceph-mon[103612]: osdmap e58: 9 total, 9 up, 9 in 2023-10-14T08:49:30.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:30.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:30.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:30 smithi057 ceph-mon[103313]: osdmap e58: 9 total, 9 up, 9 in 2023-10-14T08:49:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:31.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:31 smithi178 ceph-mon[103612]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:31.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:31 smithi178 ceph-mon[103612]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:31.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:31 smithi178 ceph-mon[103612]: osdmap e59: 9 total, 9 up, 9 in 2023-10-14T08:49:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:31 smithi057 ceph-mon[103313]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:31 smithi057 ceph-mon[103313]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:31 smithi057 ceph-mon[103313]: osdmap e59: 9 total, 9 up, 9 in 2023-10-14T08:49:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:31 smithi006 ceph-mon[99452]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:31 smithi006 ceph-mon[99452]: from='client.14400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:31 smithi006 ceph-mon[99452]: osdmap e59: 9 total, 9 up, 9 in 2023-10-14T08:49:32.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:32 smithi178 ceph-mon[103612]: osdmap e60: 9 total, 9 up, 9 in 2023-10-14T08:49:32.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:32 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1336383960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b54f460-3337-4f4a-8d74-02a945a81158"}]: dispatch 2023-10-14T08:49:32.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:32 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1336383960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b54f460-3337-4f4a-8d74-02a945a81158"}]': finished 2023-10-14T08:49:32.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:32 smithi178 ceph-mon[103612]: osdmap e61: 10 total, 9 up, 10 in 2023-10-14T08:49:32.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:32 smithi057 ceph-mon[103313]: osdmap e60: 9 total, 9 up, 9 in 2023-10-14T08:49:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:32 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1336383960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b54f460-3337-4f4a-8d74-02a945a81158"}]: dispatch 2023-10-14T08:49:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:32 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1336383960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b54f460-3337-4f4a-8d74-02a945a81158"}]': finished 2023-10-14T08:49:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:32 smithi057 ceph-mon[103313]: osdmap e61: 10 total, 9 up, 10 in 2023-10-14T08:49:32.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:32.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:32 smithi006 ceph-mon[99452]: osdmap e60: 9 total, 9 up, 9 in 2023-10-14T08:49:32.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:32 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1336383960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b54f460-3337-4f4a-8d74-02a945a81158"}]: dispatch 2023-10-14T08:49:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:32 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1336383960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b54f460-3337-4f4a-8d74-02a945a81158"}]': finished 2023-10-14T08:49:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:32 smithi006 ceph-mon[99452]: osdmap e61: 10 total, 9 up, 10 in 2023-10-14T08:49:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:33.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:33 smithi178 ceph-mon[103612]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-14T08:49:33.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:33 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1610355783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:33 smithi057 ceph-mon[103313]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-14T08:49:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:33 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1610355783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:33 smithi006 ceph-mon[99452]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-14T08:49:33.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:33 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1610355783' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:35.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:35 smithi178 ceph-mon[103612]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-10-14T08:49:35.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:35 smithi057 ceph-mon[103313]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-10-14T08:49:35.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:35 smithi006 ceph-mon[99452]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-10-14T08:49:37.219 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:37 smithi006 ceph-mon[99452]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:49:37.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:37 smithi178 ceph-mon[103612]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:49:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:37 smithi057 ceph-mon[103313]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:49:39.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:39 smithi006 ceph-mon[99452]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-14T08:49:39.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-14T08:49:39.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:39.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:39 smithi178 ceph-mon[103612]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-14T08:49:39.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-14T08:49:39.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:39 smithi057 ceph-mon[103313]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-10-14T08:49:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-14T08:49:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:40.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:40 smithi006 ceph-mon[99452]: Deploying daemon osd.9 on smithi006 2023-10-14T08:49:40.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:40 smithi178 ceph-mon[103612]: Deploying daemon osd.9 on smithi006 2023-10-14T08:49:40.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:40 smithi057 ceph-mon[103313]: Deploying daemon osd.9 on smithi006 2023-10-14T08:49:41.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:41 smithi178 ceph-mon[103612]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-14T08:49:41.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:41 smithi057 ceph-mon[103313]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-14T08:49:41.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:41 smithi006 ceph-mon[99452]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-10-14T08:49:43.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:43 smithi178 ceph-mon[103612]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:43.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:43.443 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:43 smithi057 ceph-mon[103313]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:43.450 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:43 smithi006 ceph-mon[99452]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:43.450 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:43.450 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:43.451 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:45.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:45 smithi006 ceph-mon[99452]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:45.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:45 smithi178 ceph-mon[103612]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:45 smithi057 ceph-mon[103313]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.631+0000 7f32a77fe700 1 -- 172.21.15.6:0/50889427 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f32b802d2d0 con 0x7f32a00a1480 2023-10-14T08:49:45.633 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 9 on host 'smithi006' 2023-10-14T08:49:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32a00a1480 msgr2=0x7f32a00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32a00a1480 0x7f32a00a3940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f32a800b5c0 tx=0x7f32a8005fb0 comp rx=0 tx=0).stop 2023-10-14T08:49:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 msgr2=0x7f32b8198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 0x7f32b8198ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b560 tx=0x7f32ac00b870 comp rx=0 tx=0).stop 2023-10-14T08:49:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 shutdown_connections 2023-10-14T08:49:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8106c60 0x7f32b81a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32b8101a00 0x7f32b8198ee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32a00a1480 0x7f32a00a3940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 --2- 172.21.15.6:0/50889427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32b8104330 0x7f32b8199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 >> 172.21.15.6:0/50889427 conn(0x7f32b80fb3f0 msgr2=0x7f32b8100100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:49:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 shutdown_connections 2023-10-14T08:49:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:49:45.633+0000 7f32bce69700 1 -- 172.21.15.6:0/50889427 wait complete. 2023-10-14T08:49:46.124 DEBUG:teuthology.orchestra.run.smithi006:osd.9> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.9.service 2023-10-14T08:49:46.126 INFO:tasks.cephadm:Deploying osd.10 on smithi057 with /dev/vg_nvme/lv_1... 2023-10-14T08:49:46.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-14T08:49:46.157 INFO:journalctl@ceph.osd.9.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:49:46.707 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:49:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:46 smithi178 ceph-mon[103612]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.885 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:46 smithi006 ceph-mon[99452]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:46.886 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.886 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.886 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.886 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:46 smithi057 ceph-mon[103313]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:46.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:47.187 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 08:49:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T08:49:47.007+0000 7f8ffd0e5640 -1 osd.9 0 log_to_monitors true 2023-10-14T08:49:47.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:47 smithi178 ceph-mon[103612]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-14T08:49:47.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:47 smithi057 ceph-mon[103313]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-14T08:49:47.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:47 smithi006 ceph-mon[99452]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-14T08:49:48.439 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-14T08:49:48.439 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-14T08:49:48.440 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2023-10-14T08:49:48.440 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2023-10-14T08:49:48.440 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131139 s, 800 MB/s 2023-10-14T08:49:48.440 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2023-10-14T08:49:48.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-mon[99452]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:48.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-mon[99452]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-14T08:49:48.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-mon[99452]: osdmap e62: 10 total, 9 up, 10 in 2023-10-14T08:49:48.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-mon[99452]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:49:48.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:48.733 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T08:49:48.630+0000 7f8ff1f5b700 -1 osd.9 0 waiting for initial osdmap 2023-10-14T08:49:48.733 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 08:49:48 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T08:49:48.645+0000 7f8fec54d700 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:49:48.795 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:48 smithi057 ceph-mon[103313]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:48.795 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:48 smithi057 ceph-mon[103313]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-14T08:49:48.796 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:48 smithi057 ceph-mon[103313]: osdmap e62: 10 total, 9 up, 10 in 2023-10-14T08:49:48.796 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:48 smithi057 ceph-mon[103313]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:49:48.796 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:48.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi057:vg_nvme/lv_1 2023-10-14T08:49:48.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:48 smithi178 ceph-mon[103612]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:48.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:48 smithi178 ceph-mon[103612]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-14T08:49:48.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:48 smithi178 ceph-mon[103612]: osdmap e62: 10 total, 9 up, 10 in 2023-10-14T08:49:48.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:48 smithi178 ceph-mon[103612]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-10-14T08:49:48.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:49.432 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T08:49:49.901 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:49:49.902 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: osdmap e63: 10 total, 9 up, 10 in 2023-10-14T08:49:49.902 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:49.902 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:49.902 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi006 2023-10-14T08:49:49.902 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.903 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.904 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi006 to 4293M 2023-10-14T08:49:49.904 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.904 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:49.904 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:49.904 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.905 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:49.905 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:49.905 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:49.905 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:49:49.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: osdmap e63: 10 total, 9 up, 10 in 2023-10-14T08:49:49.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:49.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:49.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi006 2023-10-14T08:49:49.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:49.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi006 to 4293M 2023-10-14T08:49:49.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:49.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:49.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:49.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:49.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:49.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:49.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:50.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-10-14T08:49:50.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: osdmap e63: 10 total, 9 up, 10 in 2023-10-14T08:49:50.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:50.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:50.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi006 2023-10-14T08:49:50.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:50.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:50.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:50.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:50.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:50.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:49:50.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi006 to 4293M 2023-10-14T08:49:50.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:50.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:50.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:50.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:50.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:49:50.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:50.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:49:50.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:49:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 -- 172.21.15.57:0/2758722868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 msgr2=0x7fd3ec1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2758722868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec1082b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b0a0 tx=0x7fd3e400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:49:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 -- 172.21.15.57:0/2758722868 shutdown_connections 2023-10-14T08:49:50.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2758722868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec1082b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:50.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2758722868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec0ffe70 0x7fd3ec100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:50.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2758722868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3ec100fd0 0x7fd3ec101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:50.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 -- 172.21.15.57:0/2758722868 >> 172.21.15.57:0/2758722868 conn(0x7fd3ec0fb3f0 msgr2=0x7fd3ec0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:49:50.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.724+0000 7fd3f475b700 1 -- 172.21.15.57:0/2758722868 shutdown_connections 2023-10-14T08:49:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 -- 172.21.15.57:0/2758722868 wait complete. 2023-10-14T08:49:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 Processor -- start 2023-10-14T08:49:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 -- start start 2023-10-14T08:49:50.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3ec0ffe70 0x7fd3ec196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:50.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec100fd0 0x7fd3ec1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec19e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19e8c0 con 0x7fd3ec100fd0 2023-10-14T08:49:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19ea00 con 0x7fd3ec101990 2023-10-14T08:49:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f475b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec19eb90 con 0x7fd3ec0ffe70 2023-10-14T08:49:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.725+0000 7fd3f2cf8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec19e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec19e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59114/0 (socket says 172.21.15.57:59114) 2023-10-14T08:49:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 -- 172.21.15.57:0/2599072783 learned_addr learned my addr 172.21.15.57:0/2599072783 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-14T08:49:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f24f7700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3ec0ffe70 0x7fd3ec196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f1cf6700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec100fd0 0x7fd3ec1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 -- 172.21.15.57:0/2599072783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3ec0ffe70 msgr2=0x7fd3ec196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:50.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3ec0ffe70 0x7fd3ec196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:50.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 -- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec100fd0 msgr2=0x7fd3ec1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:49:50.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec100fd0 0x7fd3ec1972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:49:50.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 -- 172.21.15.57:0/2599072783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4009d00 con 0x7fd3ec101990 2023-10-14T08:49:50.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f2cf8700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec19e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b830 tx=0x7fd3e4004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:49:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400e040 con 0x7fd3ec101990 2023-10-14T08:49:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec19ee10 con 0x7fd3ec101990 2023-10-14T08:49:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3e401db50 con 0x7fd3ec101990 2023-10-14T08:49:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401bb50 con 0x7fd3ec101990 2023-10-14T08:49:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.726+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec19f220 con 0x7fd3ec101990 2023-10-14T08:49:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.727+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec10b700 con 0x7fd3ec101990 2023-10-14T08:49:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.728+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd3e401dcc0 con 0x7fd3ec101990 2023-10-14T08:49:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.729+0000 7fd3e37fe700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3d80a1480 0x7fd3d80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:49:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.729+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fd3e40ce390 con 0x7fd3ec101990 2023-10-14T08:49:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.729+0000 7fd3f24f7700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3d80a1480 0x7fd3d80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:49:50.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.730+0000 7fd3f24f7700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3d80a1480 0x7fd3d80a3940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8007c60 tx=0x7fd3e80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:49:50.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.733+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3e40981e0 con 0x7fd3ec101990 2023-10-14T08:49:50.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:49:50.941+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3ec069110 con 0x7fd3d80a1480 2023-10-14T08:49:50.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:49:50.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:49:50.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:50.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:50.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] boot 2023-10-14T08:49:50.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: osdmap e64: 10 total, 10 up, 10 in 2023-10-14T08:49:50.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:50.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:49:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:49:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] boot 2023-10-14T08:49:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: osdmap e64: 10 total, 10 up, 10 in 2023-10-14T08:49:50.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:51.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:49:51.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:49:51.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-14T08:49:51.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:51.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: osd.9 [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] boot 2023-10-14T08:49:51.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: osdmap e64: 10 total, 10 up, 10 in 2023-10-14T08:49:51.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-14T08:49:51.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:51 smithi057 ceph-mon[103313]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:51.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:51.933 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:51.934 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:51 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:51.934 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:51 smithi057 ceph-mon[103313]: osdmap e65: 10 total, 10 up, 10 in 2023-10-14T08:49:51.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:51 smithi006 ceph-mon[99452]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:51.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:51 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:51.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:51 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:51.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:51 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:51.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:51 smithi006 ceph-mon[99452]: osdmap e65: 10 total, 10 up, 10 in 2023-10-14T08:49:52.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:51 smithi178 ceph-mon[103612]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:49:52.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:51 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:49:52.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:51 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:49:52.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:51 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:49:52.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:51 smithi178 ceph-mon[103612]: osdmap e65: 10 total, 10 up, 10 in 2023-10-14T08:49:53.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:53 smithi178 ceph-mon[103612]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:53.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:53 smithi057 ceph-mon[103313]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:53.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:53 smithi006 ceph-mon[99452]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:54.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:54 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/1737166089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]: dispatch 2023-10-14T08:49:54.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:54 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]: dispatch 2023-10-14T08:49:54.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:54 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]': finished 2023-10-14T08:49:54.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:54 smithi178 ceph-mon[103612]: osdmap e66: 11 total, 10 up, 11 in 2023-10-14T08:49:54.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:49:54.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:54 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/1737166089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]: dispatch 2023-10-14T08:49:54.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:54 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]: dispatch 2023-10-14T08:49:54.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:54 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]': finished 2023-10-14T08:49:54.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:54 smithi057 ceph-mon[103313]: osdmap e66: 11 total, 10 up, 11 in 2023-10-14T08:49:54.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:49:54.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:54 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/1737166089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]: dispatch 2023-10-14T08:49:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:54 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]: dispatch 2023-10-14T08:49:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:54 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a907667-59dc-4633-8f3d-735c2ed0fb6b"}]': finished 2023-10-14T08:49:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:54 smithi006 ceph-mon[99452]: osdmap e66: 11 total, 10 up, 11 in 2023-10-14T08:49:54.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:49:55.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:55 smithi006 ceph-mon[99452]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:55.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:55 smithi006 ceph-mon[99452]: from='client.? 172.21.15.57:0/3426977334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:55.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:55 smithi178 ceph-mon[103612]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:55 smithi178 ceph-mon[103612]: from='client.? 172.21.15.57:0/3426977334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:55 smithi057 ceph-mon[103313]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:55 smithi057 ceph-mon[103313]: from='client.? 172.21.15.57:0/3426977334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:49:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:57 smithi006 ceph-mon[99452]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:57.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:57 smithi178 ceph-mon[103612]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:57 smithi057 ceph-mon[103313]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:59.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:49:59 smithi006 ceph-mon[99452]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:59.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:49:59 smithi178 ceph-mon[103612]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:49:59.638 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:49:59 smithi057 ceph-mon[103313]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:00.431 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:00 smithi057 ceph-mon[103313]: overall HEALTH_OK 2023-10-14T08:50:00.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:00 smithi006 ceph-mon[99452]: overall HEALTH_OK 2023-10-14T08:50:00.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:00 smithi178 ceph-mon[103612]: overall HEALTH_OK 2023-10-14T08:50:01.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:01 smithi006 ceph-mon[99452]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:01.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:01 smithi178 ceph-mon[103612]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:01.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:01 smithi057 ceph-mon[103313]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:02.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-14T08:50:02.470 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:02 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:02.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-14T08:50:02.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:02 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:02.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-14T08:50:02.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:02 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:03.439 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:03 smithi057 ceph-mon[103313]: Deploying daemon osd.10 on smithi057 2023-10-14T08:50:03.440 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:03 smithi057 ceph-mon[103313]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:03 smithi006 ceph-mon[99452]: Deploying daemon osd.10 on smithi057 2023-10-14T08:50:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:03 smithi006 ceph-mon[99452]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:03.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:03 smithi178 ceph-mon[103612]: Deploying daemon osd.10 on smithi057 2023-10-14T08:50:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:03 smithi178 ceph-mon[103612]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:05.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:05 smithi006 ceph-mon[99452]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:05.490 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:05 smithi057 ceph-mon[103313]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:05.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:05 smithi178 ceph-mon[103612]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:06.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:06 smithi006 ceph-mon[99452]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:06.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:06.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:06.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:07.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:06 smithi178 ceph-mon[103612]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:07.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:07.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:07.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:07.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:06 smithi057 ceph-mon[103313]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:07.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:07.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:07.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:08.754 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:08 smithi057 ceph-mon[103313]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:08.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:08.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:08.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:08.755 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:08.756 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:08.869 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 10 on host 'smithi057' 2023-10-14T08:50:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.864+0000 7fd3e37fe700 1 -- 172.21.15.57:0/2599072783 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fd3ec069110 con 0x7fd3d80a1480 2023-10-14T08:50:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3d80a1480 msgr2=0x7fd3d80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3d80a1480 0x7fd3d80a3940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8007c60 tx=0x7fd3e80073d0 comp rx=0 tx=0).stop 2023-10-14T08:50:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 msgr2=0x7fd3ec19e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec19e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400b830 tx=0x7fd3e4004c80 comp rx=0 tx=0).stop 2023-10-14T08:50:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 shutdown_connections 2023-10-14T08:50:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3d80a1480 0x7fd3d80a3940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3ec101990 0x7fd3ec19e2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3ec0ffe70 0x7fd3ec196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 --2- 172.21.15.57:0/2599072783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec100fd0 0x7fd3ec1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 >> 172.21.15.57:0/2599072783 conn(0x7fd3ec0fb3f0 msgr2=0x7fd3ec068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 shutdown_connections 2023-10-14T08:50:08.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-14T08:50:08.866+0000 7fd3f475b700 1 -- 172.21.15.57:0/2599072783 wait complete. 2023-10-14T08:50:08.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:08 smithi006 ceph-mon[99452]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:08.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:08.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:08.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:08.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:08.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:09.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:08 smithi178 ceph-mon[103612]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:09.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:09.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:09.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:09.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:09.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:09.331 DEBUG:teuthology.orchestra.run.smithi057:osd.10> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.10.service 2023-10-14T08:50:09.333 INFO:tasks.cephadm:Deploying osd.11 on smithi178 with /dev/vg_nvme/lv_1... 2023-10-14T08:50:09.333 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-14T08:50:09.367 INFO:journalctl@ceph.osd.10.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:50:09.904 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:50:10.015 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 08:50:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T08:50:09.698+0000 7f93f5d6a640 -1 osd.10 0 log_to_monitors true 2023-10-14T08:50:10.015 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:09 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:10.016 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:09 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:10.016 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:09 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:10.016 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:09 smithi057 ceph-mon[103313]: from='osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-14T08:50:10.016 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:09 smithi057 ceph-mon[103313]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-14T08:50:10.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:09 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:10.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:09 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:10.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:09 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:10.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:09 smithi178 ceph-mon[103612]: from='osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-14T08:50:10.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:09 smithi178 ceph-mon[103612]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-14T08:50:10.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:09 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:10.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:09 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:10.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:09 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:10.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:09 smithi006 ceph-mon[99452]: from='osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-14T08:50:10.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:09 smithi006 ceph-mon[99452]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-14T08:50:11.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:10 smithi178 ceph-mon[103612]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:11.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:10 smithi178 ceph-mon[103612]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-14T08:50:11.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:10 smithi178 ceph-mon[103612]: osdmap e67: 11 total, 10 up, 11 in 2023-10-14T08:50:11.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:11.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:10 smithi178 ceph-mon[103612]: from='osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:50:11.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:10 smithi178 ceph-mon[103612]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:50:11.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T08:50:10.838+0000 7f93eabe0700 -1 osd.10 0 waiting for initial osdmap 2023-10-14T08:50:11.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T08:50:10.852+0000 7f93e59d3700 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:50:11.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-mon[103313]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:11.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-mon[103313]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-14T08:50:11.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-mon[103313]: osdmap e67: 11 total, 10 up, 11 in 2023-10-14T08:50:11.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:11.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-mon[103313]: from='osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:50:11.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:10 smithi057 ceph-mon[103313]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:50:11.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:10 smithi006 ceph-mon[99452]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:11.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:10 smithi006 ceph-mon[99452]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-14T08:50:11.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:10 smithi006 ceph-mon[99452]: osdmap e67: 11 total, 10 up, 11 in 2023-10-14T08:50:11.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:11.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:10 smithi006 ceph-mon[99452]: from='osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:50:11.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:10 smithi006 ceph-mon[99452]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2023-10-14T08:50:11.467 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-14T08:50:11.467 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-14T08:50:11.468 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2023-10-14T08:50:11.468 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2023-10-14T08:50:11.468 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0084136 s, 1.2 GB/s 2023-10-14T08:50:11.468 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 2023-10-14T08:50:11.469 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2023-10-14T08:50:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:50:11.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: osdmap e68: 11 total, 10 up, 11 in 2023-10-14T08:50:11.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:11.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:11.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] boot 2023-10-14T08:50:11.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: osdmap e69: 11 total, 11 up, 11 in 2023-10-14T08:50:11.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:11 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:11.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2023-10-14T08:50:12.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:50:12.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: osdmap e68: 11 total, 10 up, 11 in 2023-10-14T08:50:12.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:12.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:12.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] boot 2023-10-14T08:50:12.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: osdmap e69: 11 total, 11 up, 11 in 2023-10-14T08:50:12.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:11 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:12.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2023-10-14T08:50:12.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: osdmap e68: 11 total, 10 up, 11 in 2023-10-14T08:50:12.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:12.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:12.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: osd.10 [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] boot 2023-10-14T08:50:12.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: osdmap e69: 11 total, 11 up, 11 in 2023-10-14T08:50:12.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:11 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-14T08:50:12.506 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:50:13.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:50:13.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:50:13.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:13.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: osdmap e70: 11 total, 11 up, 11 in 2023-10-14T08:50:13.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi057 2023-10-14T08:50:13.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi057 to 4293M 2023-10-14T08:50:13.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:13.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:13.387 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:50:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:50:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:13.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: osdmap e70: 11 total, 11 up, 11 in 2023-10-14T08:50:13.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi057 2023-10-14T08:50:13.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi057 to 4293M 2023-10-14T08:50:13.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:13.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:13.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:50:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:50:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: pgmap v213: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-14T08:50:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: osdmap e70: 11 total, 11 up, 11 in 2023-10-14T08:50:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi057 2023-10-14T08:50:13.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:13.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi057 to 4293M 2023-10-14T08:50:13.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:13.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:13.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:13.811 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 -- 172.21.15.178:0/3579424247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a8101990 msgr2=0x7fc8a81082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:13.811 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3579424247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a8101990 0x7fc8a81082b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000b0a0 tx=0x7fc8a000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:50:13.812 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 -- 172.21.15.178:0/3579424247 shutdown_connections 2023-10-14T08:50:13.812 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3579424247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a8101990 0x7fc8a81082b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:13.812 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3579424247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:13.812 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3579424247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 0x7fc8a8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:13.812 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 -- 172.21.15.178:0/3579424247 >> 172.21.15.178:0/3579424247 conn(0x7fc8a80fb3f0 msgr2=0x7fc8a80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:13.813 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 -- 172.21.15.178:0/3579424247 shutdown_connections 2023-10-14T08:50:13.813 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 -- 172.21.15.178:0/3579424247 wait complete. 2023-10-14T08:50:13.813 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 Processor -- start 2023-10-14T08:50:13.813 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 -- start start 2023-10-14T08:50:13.813 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.808+0000 7fc8aea72700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:13.814 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8aea72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 0x7fc8a8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:13.814 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8aea72700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a8101990 0x7fc8a81a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:13.814 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8aea72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81a0840 con 0x7fc8a8100fd0 2023-10-14T08:50:13.814 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8aea72700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81a0980 con 0x7fc8a8101990 2023-10-14T08:50:13.814 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8aea72700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81a0b40 con 0x7fc8a80ffe70 2023-10-14T08:50:13.815 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:13.815 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41666/0 (socket says 172.21.15.178:41666) 2023-10-14T08:50:13.815 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 -- 172.21.15.178:0/3016630217 learned_addr learned my addr 172.21.15.178:0/3016630217 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:50:13.815 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8a7fff700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 0x7fc8a8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:13.816 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ad00f700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a8101990 0x7fc8a81a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:13.816 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 -- 172.21.15.178:0/3016630217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a8101990 msgr2=0x7fc8a81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:13.816 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a8101990 0x7fc8a81a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:13.816 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 -- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 msgr2=0x7fc8a8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:13.816 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 0x7fc8a8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:13.817 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 -- 172.21.15.178:0/3016630217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0009d00 con 0x7fc8a80ffe70 2023-10-14T08:50:13.817 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ad00f700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a8101990 0x7fc8a81a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:50:13.817 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8a7fff700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 0x7fc8a8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:50:13.817 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8ac80e700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8198cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00c920 tx=0x7fc89c00cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:13.817 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c007b00 con 0x7fc8a80ffe70 2023-10-14T08:50:13.818 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc89c004cf0 con 0x7fc8a80ffe70 2023-10-14T08:50:13.818 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a81a0e20 con 0x7fc8a80ffe70 2023-10-14T08:50:13.818 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.809+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c005610 con 0x7fc8a80ffe70 2023-10-14T08:50:13.818 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.810+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a81a1230 con 0x7fc8a80ffe70 2023-10-14T08:50:13.818 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.810+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a810b630 con 0x7fc8a80ffe70 2023-10-14T08:50:13.819 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.811+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc89c004750 con 0x7fc8a80ffe70 2023-10-14T08:50:13.820 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.812+0000 7fc8a5ffb700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc8980a1480 0x7fc8980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:13.820 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.812+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fc89c0cc670 con 0x7fc8a80ffe70 2023-10-14T08:50:13.820 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.812+0000 7fc8a7fff700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc8980a1480 0x7fc8980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:13.820 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.813+0000 7fc8a7fff700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc8980a1480 0x7fc8980a3940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc894005950 tx=0x7fc8940058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:13.820 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:13.816+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc89c096300 con 0x7fc8a80ffe70 2023-10-14T08:50:14.015 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:14.014+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8a8069130 con 0x7fc8980a1480 2023-10-14T08:50:14.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:14 smithi178 ceph-mon[103612]: osdmap e71: 11 total, 11 up, 11 in 2023-10-14T08:50:14.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:14 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:50:14.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:14 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:50:14.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:14 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:14.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:14 smithi057 ceph-mon[103313]: osdmap e71: 11 total, 11 up, 11 in 2023-10-14T08:50:14.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:14 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:50:14.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:14 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:50:14.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:14 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:14.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:14 smithi006 ceph-mon[99452]: osdmap e71: 11 total, 11 up, 11 in 2023-10-14T08:50:14.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-14T08:50:14.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-14T08:50:14.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:14 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:15.221 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:15 smithi178 ceph-mon[103612]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:15.221 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:15 smithi178 ceph-mon[103612]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:50:15.222 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:15 smithi178 ceph-mon[103612]: osdmap e72: 11 total, 11 up, 11 in 2023-10-14T08:50:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:15 smithi057 ceph-mon[103313]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:15 smithi057 ceph-mon[103313]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:50:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:15 smithi057 ceph-mon[103313]: osdmap e72: 11 total, 11 up, 11 in 2023-10-14T08:50:15.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:15 smithi006 ceph-mon[99452]: pgmap v216: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:15.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:15 smithi006 ceph-mon[99452]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:50:15.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:15 smithi006 ceph-mon[99452]: osdmap e72: 11 total, 11 up, 11 in 2023-10-14T08:50:16.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:16 smithi178 ceph-mon[103612]: osdmap e73: 11 total, 11 up, 11 in 2023-10-14T08:50:16.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:16 smithi057 ceph-mon[103313]: osdmap e73: 11 total, 11 up, 11 in 2023-10-14T08:50:16.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:16 smithi006 ceph-mon[99452]: osdmap e73: 11 total, 11 up, 11 in 2023-10-14T08:50:17.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:17 smithi178 ceph-mon[103612]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:17.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:17 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/2230770488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]: dispatch 2023-10-14T08:50:17.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:17 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]: dispatch 2023-10-14T08:50:17.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:17 smithi178 ceph-mon[103612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]': finished 2023-10-14T08:50:17.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:17 smithi178 ceph-mon[103612]: osdmap e74: 12 total, 11 up, 12 in 2023-10-14T08:50:17.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:17 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:17 smithi057 ceph-mon[103313]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:17 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/2230770488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]: dispatch 2023-10-14T08:50:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:17 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]: dispatch 2023-10-14T08:50:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:17 smithi057 ceph-mon[103313]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]': finished 2023-10-14T08:50:17.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:17 smithi057 ceph-mon[103313]: osdmap e74: 12 total, 11 up, 12 in 2023-10-14T08:50:17.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:17 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:17 smithi006 ceph-mon[99452]: pgmap v219: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:17 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/2230770488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]: dispatch 2023-10-14T08:50:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:17 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]: dispatch 2023-10-14T08:50:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:17 smithi006 ceph-mon[99452]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38288845-23b4-43cf-a07e-8a0e1e52342e"}]': finished 2023-10-14T08:50:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:17 smithi006 ceph-mon[99452]: osdmap e74: 12 total, 11 up, 12 in 2023-10-14T08:50:17.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:17 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:18.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:18 smithi057 ceph-mon[103313]: from='client.? 172.21.15.178:0/4153447929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:50:18.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:18 smithi006 ceph-mon[99452]: from='client.? 172.21.15.178:0/4153447929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:50:18.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:18 smithi178 ceph-mon[103612]: from='client.? 172.21.15.178:0/4153447929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-14T08:50:19.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:19 smithi057 ceph-mon[103313]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-14T08:50:19.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:19 smithi006 ceph-mon[99452]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-14T08:50:19.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:19 smithi178 ceph-mon[103612]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 134 KiB/s, 0 objects/s recovering 2023-10-14T08:50:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:21 smithi057 ceph-mon[103313]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:50:21.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:21 smithi006 ceph-mon[99452]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:50:21.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:21 smithi178 ceph-mon[103612]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-14T08:50:23.331 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:23 smithi178 ceph-mon[103612]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-14T08:50:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:23 smithi057 ceph-mon[103313]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-14T08:50:23.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:23 smithi006 ceph-mon[99452]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-10-14T08:50:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-14T08:50:24.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:24 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:24.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-14T08:50:24.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:24 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:24.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-14T08:50:24.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:24 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:25 smithi057 ceph-mon[103313]: Deploying daemon osd.11 on smithi178 2023-10-14T08:50:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:25 smithi057 ceph-mon[103313]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-10-14T08:50:25.461 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:25 smithi178 ceph-mon[103612]: Deploying daemon osd.11 on smithi178 2023-10-14T08:50:25.461 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:25 smithi178 ceph-mon[103612]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-10-14T08:50:25.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:25 smithi006 ceph-mon[99452]: Deploying daemon osd.11 on smithi178 2023-10-14T08:50:25.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:25 smithi006 ceph-mon[99452]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2023-10-14T08:50:27.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:27 smithi178 ceph-mon[103612]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-14T08:50:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:27 smithi057 ceph-mon[103313]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-14T08:50:27.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:27 smithi006 ceph-mon[99452]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-14T08:50:29.268 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:29 smithi178 ceph-mon[103612]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:29.268 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:29.269 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:29.269 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:29 smithi057 ceph-mon[103313]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:29.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:29 smithi006 ceph-mon[99452]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:29.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:30.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.936+0000 7fc8a5ffb700 1 -- 172.21.15.178:0/3016630217 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fc8a8069130 con 0x7fc8980a1480 2023-10-14T08:50:30.937 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 11 on host 'smithi178' 2023-10-14T08:50:30.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc8980a1480 msgr2=0x7fc8980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:30.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc8980a1480 0x7fc8980a3940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc894005950 tx=0x7fc8940058e0 comp rx=0 tx=0).stop 2023-10-14T08:50:30.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 msgr2=0x7fc8a8198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:30.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8198cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00c920 tx=0x7fc89c00cce0 comp rx=0 tx=0).stop 2023-10-14T08:50:30.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 shutdown_connections 2023-10-14T08:50:30.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc8980a1480 0x7fc8980a3940 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:30.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8a8101990 0x7fc8a81a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:30.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a80ffe70 0x7fc8a8198cf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:30.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 --2- 172.21.15.178:0/3016630217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a8100fd0 0x7fc8a8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:30.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 >> 172.21.15.178:0/3016630217 conn(0x7fc8a80fb3f0 msgr2=0x7fc8a8068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:30.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 shutdown_connections 2023-10-14T08:50:30.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:30.938+0000 7fc8aea72700 1 -- 172.21.15.178:0/3016630217 wait complete. 2023-10-14T08:50:31.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:31 smithi178 ceph-mon[103612]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:31.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:31.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:31 smithi057 ceph-mon[103313]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:31 smithi006 ceph-mon[99452]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:31.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:31.487 DEBUG:teuthology.orchestra.run.smithi178:osd.11> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.11.service 2023-10-14T08:50:31.490 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-14T08:50:31.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-14T08:50:31.519 INFO:journalctl@ceph.osd.11.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:50:32.072 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:50:32.384 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 08:50:32 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T08:50:32.032+0000 7f17f0094640 -1 osd.11 0 log_to_monitors true 2023-10-14T08:50:32.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:32.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:32.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:32 smithi178 ceph-mon[103612]: from='osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-14T08:50:32.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:32 smithi178 ceph-mon[103612]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-14T08:50:32.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:32 smithi006 ceph-mon[99452]: from='osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-14T08:50:32.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:32 smithi006 ceph-mon[99452]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-14T08:50:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:32 smithi057 ceph-mon[103313]: from='osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-14T08:50:32.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:32 smithi057 ceph-mon[103313]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-14T08:50:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 -- 172.21.15.6:0/262433337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 msgr2=0x7f1dc4101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 --2- 172.21.15.6:0/262433337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4101390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1db40099c0 tx=0x7f1db4009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 -- 172.21.15.6:0/262433337 shutdown_connections 2023-10-14T08:50:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 --2- 172.21.15.6:0/262433337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dc4102b10 0x7f1dc41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 --2- 172.21.15.6:0/262433337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4101390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 --2- 172.21.15.6:0/262433337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dc4102170 0x7f1dc41025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 -- 172.21.15.6:0/262433337 >> 172.21.15.6:0/262433337 conn(0x7f1dc40fc4f0 msgr2=0x7f1dc40fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 -- 172.21.15.6:0/262433337 shutdown_connections 2023-10-14T08:50:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.366+0000 7f1dc9352700 1 -- 172.21.15.6:0/262433337 wait complete. 2023-10-14T08:50:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 Processor -- start 2023-10-14T08:50:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 -- start start 2023-10-14T08:50:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dc4102170 0x7f1dc4197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dc4102b10 0x7f1dc419e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc419e780 con 0x7f1dc4100f70 2023-10-14T08:50:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc419e8c0 con 0x7f1dc4102b10 2023-10-14T08:50:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc9352700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc419ea80 con 0x7f1dc4102170 2023-10-14T08:50:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58930/0 (socket says 172.21.15.6:58930) 2023-10-14T08:50:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc2ffd700 1 -- 172.21.15.6:0/3441448880 learned_addr learned my addr 172.21.15.6:0/3441448880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc27fc700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dc4102170 0x7f1dc4197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.367+0000 7f1dc37fe700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dc4102b10 0x7f1dc419e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc2ffd700 1 -- 172.21.15.6:0/3441448880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dc4102170 msgr2=0x7f1dc4197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc2ffd700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dc4102170 0x7f1dc4197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc2ffd700 1 -- 172.21.15.6:0/3441448880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dc4102b10 msgr2=0x7f1dc419e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc2ffd700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dc4102b10 0x7f1dc419e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc2ffd700 1 -- 172.21.15.6:0/3441448880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40095f0 con 0x7f1dc4100f70 2023-10-14T08:50:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc2ffd700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4196c30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009fd0 tx=0x7f1db400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db401d070 con 0x7f1dc4100f70 2023-10-14T08:50:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc40731a0 con 0x7f1dc4100f70 2023-10-14T08:50:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1db4005030 con 0x7f1dc4100f70 2023-10-14T08:50:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4004aa0 con 0x7f1dc4100f70 2023-10-14T08:50:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.368+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc4073690 con 0x7f1dc4100f70 2023-10-14T08:50:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.369+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc4108590 con 0x7f1dc4100f70 2023-10-14T08:50:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.370+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1db4005410 con 0x7f1dc4100f70 2023-10-14T08:50:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.371+0000 7f1dabfff700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1dac0a1480 0x7f1dac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.371+0000 7f1dc27fc700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1dac0a1480 0x7f1dac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.371+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f1db40cd9b0 con 0x7f1dc4100f70 2023-10-14T08:50:33.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.371+0000 7f1dc27fc700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1dac0a1480 0x7f1dac0a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005950 tx=0x7f1db800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:33.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.374+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1db4097660 con 0x7f1dc4100f70 2023-10-14T08:50:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:33 smithi006 ceph-mon[99452]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:33 smithi006 ceph-mon[99452]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-14T08:50:33.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:33 smithi006 ceph-mon[99452]: osdmap e75: 12 total, 11 up, 12 in 2023-10-14T08:50:33.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:33.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:33 smithi006 ceph-mon[99452]: from='osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:50:33.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:33 smithi006 ceph-mon[99452]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:50:33.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.576+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f1dc410c8c0 con 0x7f1dc4100f70 2023-10-14T08:50:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.576+0000 7f1dabfff700 1 -- 172.21.15.6:0/3441448880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f1db409ac80 con 0x7f1dc4100f70 2023-10-14T08:50:33.578 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1dac0a1480 msgr2=0x7f1dac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1dac0a1480 0x7f1dac0a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1db8005950 tx=0x7f1db800b410 comp rx=0 tx=0).stop 2023-10-14T08:50:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 msgr2=0x7f1dc4196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4196c30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009fd0 tx=0x7f1db400f690 comp rx=0 tx=0).stop 2023-10-14T08:50:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 shutdown_connections 2023-10-14T08:50:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1dac0a1480 0x7f1dac0a3940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1dc4102b10 0x7f1dc419e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dc4100f70 0x7f1dc4196c30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 --2- 172.21.15.6:0/3441448880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dc4102170 0x7f1dc4197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 >> 172.21.15.6:0/3441448880 conn(0x7f1dc40fc4f0 msgr2=0x7f1dc41056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 shutdown_connections 2023-10-14T08:50:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:33.578+0000 7f1dc9352700 1 -- 172.21.15.6:0/3441448880 wait complete. 2023-10-14T08:50:33.634 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T08:50:33.228+0000 7f17e4f0a700 -1 osd.11 0 waiting for initial osdmap 2023-10-14T08:50:33.634 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T08:50:33.246+0000 7f17df4fc700 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T08:50:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-mon[103612]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:33.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-mon[103612]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-14T08:50:33.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-mon[103612]: osdmap e75: 12 total, 11 up, 12 in 2023-10-14T08:50:33.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:33.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-mon[103612]: from='osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:50:33.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:33 smithi178 ceph-mon[103612]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:50:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:33 smithi057 ceph-mon[103313]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:33 smithi057 ceph-mon[103313]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-14T08:50:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:33 smithi057 ceph-mon[103313]: osdmap e75: 12 total, 11 up, 12 in 2023-10-14T08:50:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:33.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:33 smithi057 ceph-mon[103313]: from='osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:50:33.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:33 smithi057 ceph-mon[103313]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2023-10-14T08:50:34.022 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1697273411,"num_in_osds":12,"osd_in_since":1697273416,"num_remapped_pgs":0} 2023-10-14T08:50:34.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:50:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: osdmap e76: 12 total, 11 up, 12 in 2023-10-14T08:50:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:34.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3441448880' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-14T08:50:34.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:50:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: osdmap e76: 12 total, 11 up, 12 in 2023-10-14T08:50:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3441448880' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-14T08:50:34.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2023-10-14T08:50:34.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: osdmap e76: 12 total, 11 up, 12 in 2023-10-14T08:50:34.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-14T08:50:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3441448880' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-14T08:50:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:35.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd stat -f json 2023-10-14T08:50:35.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: purged_snaps scrub starts 2023-10-14T08:50:35.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: purged_snaps scrub ok 2023-10-14T08:50:35.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] boot 2023-10-14T08:50:35.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: osdmap e77: 12 total, 12 up, 12 in 2023-10-14T08:50:35.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:35.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: Detected new or changed devices on smithi178 2023-10-14T08:50:35.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi178 to 4292M 2023-10-14T08:50:35.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:35.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:35.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:35.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:35.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:35.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.594 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:50:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: purged_snaps scrub starts 2023-10-14T08:50:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: purged_snaps scrub ok 2023-10-14T08:50:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] boot 2023-10-14T08:50:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: osdmap e77: 12 total, 12 up, 12 in 2023-10-14T08:50:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: Detected new or changed devices on smithi178 2023-10-14T08:50:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi178 to 4292M 2023-10-14T08:50:35.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:35.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:35.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:35.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:35.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:35.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: purged_snaps scrub starts 2023-10-14T08:50:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: purged_snaps scrub ok 2023-10-14T08:50:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: osd.11 [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] boot 2023-10-14T08:50:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: osdmap e77: 12 total, 12 up, 12 in 2023-10-14T08:50:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-14T08:50:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: Detected new or changed devices on smithi178 2023-10-14T08:50:35.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-14T08:50:35.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi178 to 4292M 2023-10-14T08:50:35.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:35.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:35.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:35.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:35.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:35.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:35.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:36.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:36 smithi006 ceph-mon[99452]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:36.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:36 smithi006 ceph-mon[99452]: osdmap e78: 12 total, 12 up, 12 in 2023-10-14T08:50:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 -- 172.21.15.6:0/2590454055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 msgr2=0x7f46a8101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 --2- 172.21.15.6:0/2590454055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a8101450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4690009990 tx=0x7f4690009ca0 comp rx=0 tx=0).stop 2023-10-14T08:50:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 -- 172.21.15.6:0/2590454055 shutdown_connections 2023-10-14T08:50:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 --2- 172.21.15.6:0/2590454055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a8101990 0x7f46a81082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:36.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 --2- 172.21.15.6:0/2590454055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 0x7f46a8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:36.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 --2- 172.21.15.6:0/2590454055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a8101450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:36.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 -- 172.21.15.6:0/2590454055 >> 172.21.15.6:0/2590454055 conn(0x7f46a80fb3f0 msgr2=0x7f46a80fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:36.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 -- 172.21.15.6:0/2590454055 shutdown_connections 2023-10-14T08:50:36.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.786+0000 7f46ad64a700 1 -- 172.21.15.6:0/2590454055 wait complete. 2023-10-14T08:50:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 Processor -- start 2023-10-14T08:50:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 -- start start 2023-10-14T08:50:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 0x7f46a8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a8101990 0x7f46a819e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a819e830 con 0x7f46a8100fd0 2023-10-14T08:50:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a819e9a0 con 0x7f46a8101990 2023-10-14T08:50:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46ad64a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a819eb60 con 0x7f46a80ffe70 2023-10-14T08:50:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46a67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46a67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a819ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58950/0 (socket says 172.21.15.6:58950) 2023-10-14T08:50:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.787+0000 7f46a67fc700 1 -- 172.21.15.6:0/1225070855 learned_addr learned my addr 172.21.15.6:0/1225070855 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a6ffd700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 0x7f46a8069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a77fe700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a8101990 0x7f46a819e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a67fc700 1 -- 172.21.15.6:0/1225070855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 msgr2=0x7f46a8069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a67fc700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 0x7f46a8069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a67fc700 1 -- 172.21.15.6:0/1225070855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a8101990 msgr2=0x7f46a819e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a67fc700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a8101990 0x7f46a819e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a67fc700 1 -- 172.21.15.6:0/1225070855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46900095f0 con 0x7f46a8100fd0 2023-10-14T08:50:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a6ffd700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 0x7f46a8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:50:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46a67fc700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a819ba50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4690005910 tx=0x7f46900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469001d070 con 0x7f46a8100fd0 2023-10-14T08:50:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a819ede0 con 0x7f46a8100fd0 2023-10-14T08:50:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46900040e0 con 0x7f46a8100fd0 2023-10-14T08:50:36.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000f460 con 0x7f46a8100fd0 2023-10-14T08:50:36.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.788+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a819f270 con 0x7f46a8100fd0 2023-10-14T08:50:36.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.789+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a8107480 con 0x7f46a8100fd0 2023-10-14T08:50:36.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.790+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4690003c20 con 0x7f46a8100fd0 2023-10-14T08:50:36.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.791+0000 7f469ffff700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46940a1480 0x7f46940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:36.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.791+0000 7f46a6ffd700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46940a1480 0x7f46940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:36.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.791+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f46900cdec0 con 0x7f46a8100fd0 2023-10-14T08:50:36.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.791+0000 7f46a6ffd700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46940a1480 0x7f46940a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46980099d0 tx=0x7f4698008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:36.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.796+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f46900979b0 con 0x7f46a8100fd0 2023-10-14T08:50:36.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:36 smithi178 ceph-mon[103612]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:36.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:36 smithi178 ceph-mon[103612]: osdmap e78: 12 total, 12 up, 12 in 2023-10-14T08:50:36.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:36 smithi057 ceph-mon[103313]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:36.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:36 smithi057 ceph-mon[103313]: osdmap e78: 12 total, 12 up, 12 in 2023-10-14T08:50:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.999+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f46a802d1c0 con 0x7f46a8100fd0 2023-10-14T08:50:37.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:36.999+0000 7f469ffff700 1 -- 172.21.15.6:0/1225070855 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7f469009afd0 con 0x7f46a8100fd0 2023-10-14T08:50:37.001 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46940a1480 msgr2=0x7f46940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46940a1480 0x7f46940a3940 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46980099d0 tx=0x7f4698008040 comp rx=0 tx=0).stop 2023-10-14T08:50:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 msgr2=0x7f46a819ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a819ba50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4690005910 tx=0x7f46900057f0 comp rx=0 tx=0).stop 2023-10-14T08:50:37.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 shutdown_connections 2023-10-14T08:50:37.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46940a1480 0x7f46940a3940 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:37.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46a8101990 0x7f46a819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:37.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a80ffe70 0x7f46a8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:37.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 --2- 172.21.15.6:0/1225070855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46a8100fd0 0x7f46a819ba50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:37.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.001+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 >> 172.21.15.6:0/1225070855 conn(0x7f46a80fb3f0 msgr2=0x7f46a81045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:37.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.002+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 shutdown_connections 2023-10-14T08:50:37.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:37.002+0000 7f46ad64a700 1 -- 172.21.15.6:0/1225070855 wait complete. 2023-10-14T08:50:37.353 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1697273434,"num_in_osds":12,"osd_in_since":1697273416,"num_remapped_pgs":0} 2023-10-14T08:50:37.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-14T08:50:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:37 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1225070855' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-14T08:50:37.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:37 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1225070855' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-14T08:50:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:50:37.943 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:37 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1225070855' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-14T08:50:38.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:38 smithi006 ceph-mon[99452]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:38.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:38 smithi178 ceph-mon[103612]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:38.943 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:38 smithi057 ceph-mon[103313]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:39.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/41346151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc8105e70 msgr2=0x7f3fc8106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/41346151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc8105e70 0x7f3fc8106250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80099c0 tx=0x7f3fb8009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/41346151 shutdown_connections 2023-10-14T08:50:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/41346151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc8100820 0x7f3fc810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/41346151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc8105e70 0x7f3fc8106250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/41346151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc80ffe60 0x7f3fc81002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/41346151 >> 172.21.15.6:0/41346151 conn(0x7f3fc8075e00 msgr2=0x7f3fc8076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:39.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/41346151 shutdown_connections 2023-10-14T08:50:39.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/41346151 wait complete. 2023-10-14T08:50:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.103+0000 7f3fcdfb9700 1 Processor -- start 2023-10-14T08:50:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 -- start start 2023-10-14T08:50:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc80ffe60 0x7f3fc810d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:39.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc8100820 0x7f3fc810dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 0x7f3fc810e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81a5420 con 0x7f3fc8105e70 2023-10-14T08:50:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81a5590 con 0x7f3fc80ffe60 2023-10-14T08:50:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fcdfb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc81a5750 con 0x7f3fc8100820 2023-10-14T08:50:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 0x7f3fc810e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 0x7f3fc810e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58972/0 (socket says 172.21.15.6:58972) 2023-10-14T08:50:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3112332964 learned_addr learned my addr 172.21.15.6:0/3112332964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc6ffd700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc8100820 0x7f3fc810dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc77fe700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc80ffe60 0x7f3fc810d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3112332964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc8100820 msgr2=0x7f3fc810dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc8100820 0x7f3fc810dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3112332964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc80ffe60 msgr2=0x7f3fc810d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc80ffe60 0x7f3fc810d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 -- 172.21.15.6:0/3112332964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc009520 con 0x7f3fc8105e70 2023-10-14T08:50:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc77fe700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc80ffe60 0x7f3fc810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:50:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc7fff700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 0x7f3fc810e120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000ef30 tx=0x7f3fc000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.104+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0018070 con 0x7f3fc8105e70 2023-10-14T08:50:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.105+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb80095f0 con 0x7f3fc8105e70 2023-10-14T08:50:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.105+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fc000f040 con 0x7f3fc8105e70 2023-10-14T08:50:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.105+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0003dc0 con 0x7f3fc8105e70 2023-10-14T08:50:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.105+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc81a5d40 con 0x7f3fc8105e70 2023-10-14T08:50:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.105+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc804ebb0 con 0x7f3fc8105e70 2023-10-14T08:50:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.107+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3fc000caa0 con 0x7f3fc8105e70 2023-10-14T08:50:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.107+0000 7f3fc4ff9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb00a1480 0x7f3fb00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.108+0000 7f3fc77fe700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb00a1480 0x7f3fb00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.108+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3fc00cceb0 con 0x7f3fc8105e70 2023-10-14T08:50:39.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.108+0000 7f3fc77fe700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb00a1480 0x7f3fb00a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8000c00 tx=0x7f3fb8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.111+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fc00fa100 con 0x7f3fc8105e70 2023-10-14T08:50:39.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.315+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fc8111090 con 0x7f3fc8105e70 2023-10-14T08:50:39.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.316+0000 7f3fc4ff9700 1 -- 172.21.15.6:0/3112332964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f3fc0096a40 con 0x7f3fc8105e70 2023-10-14T08:50:39.318 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:39.319 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:50:35.480696+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:50:39.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb00a1480 msgr2=0x7f3fb00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:39.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb00a1480 0x7f3fb00a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8000c00 tx=0x7f3fb8019040 comp rx=0 tx=0).stop 2023-10-14T08:50:39.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 msgr2=0x7f3fc810e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:39.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 0x7f3fc810e120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000ef30 tx=0x7f3fc000c450 comp rx=0 tx=0).stop 2023-10-14T08:50:39.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 shutdown_connections 2023-10-14T08:50:39.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fc8105e70 0x7f3fc810e120 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb00a1480 0x7f3fb00a3940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fc80ffe60 0x7f3fc810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 --2- 172.21.15.6:0/3112332964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc8100820 0x7f3fc810dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:39.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 >> 172.21.15.6:0/3112332964 conn(0x7f3fc8075e00 msgr2=0x7f3fc8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:39.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 shutdown_connections 2023-10-14T08:50:39.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:39.318+0000 7f3fcdfb9700 1 -- 172.21.15.6:0/3112332964 wait complete. 2023-10-14T08:50:39.683 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:39 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3112332964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:50:39.685 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:50:39.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-14T08:50:39.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:39 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3112332964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:50:39.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:39 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3112332964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:50:40.251 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:50:40.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:40 smithi006 ceph-mon[99452]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:40.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:40 smithi178 ceph-mon[103612]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:40.943 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:40 smithi057 ceph-mon[103313]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 -- 172.21.15.6:0/2104826282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940105e70 msgr2=0x7fe940106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:41.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 --2- 172.21.15.6:0/2104826282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940105e70 0x7fe940106250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe9300099c0 tx=0x7fe930009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 -- 172.21.15.6:0/2104826282 shutdown_connections 2023-10-14T08:50:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 --2- 172.21.15.6:0/2104826282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940100820 0x7fe94010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 --2- 172.21.15.6:0/2104826282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940105e70 0x7fe940106250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 --2- 172.21.15.6:0/2104826282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9400ffe60 0x7fe9401002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 -- 172.21.15.6:0/2104826282 >> 172.21.15.6:0/2104826282 conn(0x7fe940075e00 msgr2=0x7fe940076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 -- 172.21.15.6:0/2104826282 shutdown_connections 2023-10-14T08:50:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.409+0000 7fe944e39700 1 -- 172.21.15.6:0/2104826282 wait complete. 2023-10-14T08:50:41.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 Processor -- start 2023-10-14T08:50:41.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 -- start start 2023-10-14T08:50:41.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9400ffe60 0x7fe940197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:41.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 0x7fe9401982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:41.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940105e70 0x7fe9401a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:41.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940198c20 con 0x7fe940100820 2023-10-14T08:50:41.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401a3360 con 0x7fe940105e70 2023-10-14T08:50:41.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe944e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401a3520 con 0x7fe9400ffe60 2023-10-14T08:50:41.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 0x7fe9401982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:41.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 0x7fe9401982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58982/0 (socket says 172.21.15.6:58982) 2023-10-14T08:50:41.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 -- 172.21.15.6:0/900076214 learned_addr learned my addr 172.21.15.6:0/900076214 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:41.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93e59c700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9400ffe60 0x7fe940197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:41.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93ed9d700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940105e70 0x7fe9401a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:41.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 -- 172.21.15.6:0/900076214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9400ffe60 msgr2=0x7fe940197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:41.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9400ffe60 0x7fe940197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 -- 172.21.15.6:0/900076214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940105e70 msgr2=0x7fe9401a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:41.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940105e70 0x7fe9401a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93dd9b700 1 -- 172.21.15.6:0/900076214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300095f0 con 0x7fe940100820 2023-10-14T08:50:41.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.410+0000 7fe93ed9d700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940105e70 0x7fe9401a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:50:41.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.411+0000 7fe93dd9b700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 0x7fe9401982e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe93400b530 tx=0x7fe93400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:41.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.411+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934011830 con 0x7fe940100820 2023-10-14T08:50:41.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.411+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9401a3800 con 0x7fe940100820 2023-10-14T08:50:41.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.411+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe934011e50 con 0x7fe940100820 2023-10-14T08:50:41.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.411+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400f2e0 con 0x7fe940100820 2023-10-14T08:50:41.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.411+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9401a3d00 con 0x7fe940100820 2023-10-14T08:50:41.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.412+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94004ebb0 con 0x7fe940100820 2023-10-14T08:50:41.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.413+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe934010580 con 0x7fe940100820 2023-10-14T08:50:41.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.414+0000 7fe92f7fe700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe9280a1480 0x7fe9280a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:41.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.414+0000 7fe93e59c700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe9280a1480 0x7fe9280a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:41.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.414+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9340cc390 con 0x7fe940100820 2023-10-14T08:50:41.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.414+0000 7fe93e59c700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe9280a1480 0x7fe9280a3940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:41.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.419+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe934095e90 con 0x7fe940100820 2023-10-14T08:50:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.616+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe94010fdb0 con 0x7fe940100820 2023-10-14T08:50:41.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.617+0000 7fe92f7fe700 1 -- 172.21.15.6:0/900076214 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9340994b0 con 0x7fe940100820 2023-10-14T08:50:41.619 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:50:41.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe9280a1480 msgr2=0x7fe9280a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe9280a1480 0x7fe9280a3940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930005fb0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 msgr2=0x7fe9401982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 0x7fe9401982e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe93400b530 tx=0x7fe93400b8f0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 shutdown_connections 2023-10-14T08:50:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe9280a1480 0x7fe9280a3940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe940105e70 0x7fe9401a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9400ffe60 0x7fe940197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 --2- 172.21.15.6:0/900076214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe940100820 0x7fe9401982e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:41.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 >> 172.21.15.6:0/900076214 conn(0x7fe940075e00 msgr2=0x7fe9400fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 shutdown_connections 2023-10-14T08:50:41.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:41.619+0000 7fe944e39700 1 -- 172.21.15.6:0/900076214 wait complete. 2023-10-14T08:50:42.010 INFO:tasks.cephadm:Adding mds.a on smithi006 2023-10-14T08:50:42.010 INFO:tasks.cephadm:Adding mds.d on smithi006 2023-10-14T08:50:42.011 INFO:tasks.cephadm:Adding mds.g on smithi006 2023-10-14T08:50:42.011 INFO:tasks.cephadm:Adding mds.j on smithi006 2023-10-14T08:50:42.011 INFO:tasks.cephadm:Adding mds.b on smithi057 2023-10-14T08:50:42.012 INFO:tasks.cephadm:Adding mds.e on smithi057 2023-10-14T08:50:42.012 INFO:tasks.cephadm:Adding mds.h on smithi057 2023-10-14T08:50:42.012 INFO:tasks.cephadm:Adding mds.k on smithi057 2023-10-14T08:50:42.013 INFO:tasks.cephadm:Adding mds.c on smithi178 2023-10-14T08:50:42.013 INFO:tasks.cephadm:Adding mds.f on smithi178 2023-10-14T08:50:42.013 INFO:tasks.cephadm:Adding mds.i on smithi178 2023-10-14T08:50:42.013 INFO:tasks.cephadm:Adding mds.l on smithi178 2023-10-14T08:50:42.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph orch apply mds all '12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l' 2023-10-14T08:50:42.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/900076214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:50:42.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:42 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/900076214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:50:42.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:42 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/900076214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:50:42.587 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T08:50:43.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:43 smithi178 ceph-mon[103612]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:43 smithi057 ceph-mon[103313]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:43.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:43 smithi006 ceph-mon[99452]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:43.955 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 -- 172.21.15.178:0/3120080153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90100f70 msgr2=0x7fac90101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:43.955 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 --2- 172.21.15.178:0/3120080153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90100f70 0x7fac90101390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009990 tx=0x7fac8c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:50:43.956 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 -- 172.21.15.178:0/3120080153 shutdown_connections 2023-10-14T08:50:43.956 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 --2- 172.21.15.178:0/3120080153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac90102b10 0x7fac901093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:43.956 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 --2- 172.21.15.178:0/3120080153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90100f70 0x7fac90101390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:43.956 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 --2- 172.21.15.178:0/3120080153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac90102170 0x7fac901025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:43.957 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 -- 172.21.15.178:0/3120080153 >> 172.21.15.178:0/3120080153 conn(0x7fac900fc4d0 msgr2=0x7fac900fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:43.957 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 -- 172.21.15.178:0/3120080153 shutdown_connections 2023-10-14T08:50:43.957 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 -- 172.21.15.178:0/3120080153 wait complete. 2023-10-14T08:50:43.957 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 Processor -- start 2023-10-14T08:50:43.957 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 -- start start 2023-10-14T08:50:43.958 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac90100f70 0x7fac90074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:43.958 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.953+0000 7fac98460700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac90102170 0x7fac900732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:43.958 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac98460700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 0x7fac900737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:43.958 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac98460700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac90073f60 con 0x7fac90102170 2023-10-14T08:50:43.958 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac98460700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac900740d0 con 0x7fac90100f70 2023-10-14T08:50:43.959 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac98460700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac901a0d50 con 0x7fac90102b10 2023-10-14T08:50:43.959 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 0x7fac900737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:43.959 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 0x7fac900737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:41794/0 (socket says 172.21.15.178:41794) 2023-10-14T08:50:43.959 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 -- 172.21.15.178:0/3802512628 learned_addr learned my addr 172.21.15.178:0/3802512628 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-10-14T08:50:43.959 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac961fc700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac90100f70 0x7fac90074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:43.960 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac959fb700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac90102170 0x7fac900732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:43.960 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 -- 172.21.15.178:0/3802512628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac90100f70 msgr2=0x7fac90074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:43.960 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac90100f70 0x7fac90074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:43.961 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 -- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac90102170 msgr2=0x7fac900732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:43.961 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac90102170 0x7fac900732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:43.961 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 -- 172.21.15.178:0/3802512628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0095f0 con 0x7fac90102b10 2023-10-14T08:50:43.961 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac969fd700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 0x7fac900737e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac8800ada0 tx=0x7fac8800c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:43.961 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800f070 con 0x7fac90102b10 2023-10-14T08:50:43.961 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac88007b30 con 0x7fac90102b10 2023-10-14T08:50:43.962 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88005440 con 0x7fac90102b10 2023-10-14T08:50:43.962 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac901a0fd0 con 0x7fac90102b10 2023-10-14T08:50:43.962 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.954+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac901a14d0 con 0x7fac90102b10 2023-10-14T08:50:43.963 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.955+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9010c7f0 con 0x7fac90102b10 2023-10-14T08:50:43.964 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.956+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fac88004ad0 con 0x7fac90102b10 2023-10-14T08:50:43.964 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.957+0000 7fac877fe700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac7c0a1480 0x7fac7c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:43.964 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.957+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fac880cc4b0 con 0x7fac90102b10 2023-10-14T08:50:43.964 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.957+0000 7fac961fc700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac7c0a1480 0x7fac7c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:43.964 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.958+0000 7fac961fc700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac7c0a1480 0x7fac7c0a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0036f0 tx=0x7fac8c003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:43.964 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:43.961+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fac88096040 con 0x7fac90102b10 2023-10-14T08:50:44.160 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.159+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fac900613f0 con 0x7fac7c0a1480 2023-10-14T08:50:44.171 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.171+0000 7fac877fe700 1 -- 172.21.15.178:0/3802512628 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fac900613f0 con 0x7fac7c0a1480 2023-10-14T08:50:44.172 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mds.all update... 2023-10-14T08:50:44.174 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac7c0a1480 msgr2=0x7fac7c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:44.174 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac7c0a1480 0x7fac7c0a3940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0036f0 tx=0x7fac8c003680 comp rx=0 tx=0).stop 2023-10-14T08:50:44.175 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 msgr2=0x7fac900737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:44.175 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 0x7fac900737e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac8800ada0 tx=0x7fac8800c330 comp rx=0 tx=0).stop 2023-10-14T08:50:44.175 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 shutdown_connections 2023-10-14T08:50:44.175 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102b10 0x7fac900737e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:44.175 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac7c0a1480 0x7fac7c0a3940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:44.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac90100f70 0x7fac90074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:44.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 --2- 172.21.15.178:0/3802512628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac90102170 0x7fac900732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:44.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 >> 172.21.15.178:0/3802512628 conn(0x7fac900fc4d0 msgr2=0x7fac900fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:44.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 shutdown_connections 2023-10-14T08:50:44.176 INFO:teuthology.orchestra.run.smithi178.stderr:2023-10-14T08:50:44.173+0000 7fac98460700 1 -- 172.21.15.178:0/3802512628 wait complete. 2023-10-14T08:50:44.750 DEBUG:teuthology.orchestra.run.smithi006:mds.a> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.a.service 2023-10-14T08:50:44.753 DEBUG:teuthology.orchestra.run.smithi006:mds.d> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.d.service 2023-10-14T08:50:44.787 INFO:journalctl@ceph.mds.a.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:50:44.788 DEBUG:teuthology.orchestra.run.smithi006:mds.g> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.g.service 2023-10-14T08:50:44.816 INFO:journalctl@ceph.mds.d.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:50:44.817 DEBUG:teuthology.orchestra.run.smithi006:mds.j> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.j.service 2023-10-14T08:50:44.844 INFO:journalctl@ceph.mds.g.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:50:44.845 DEBUG:teuthology.orchestra.run.smithi057:mds.b> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.b.service 2023-10-14T08:50:44.848 DEBUG:teuthology.orchestra.run.smithi057:mds.e> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.e.service 2023-10-14T08:50:44.872 INFO:journalctl@ceph.mds.j.smithi006.stdout:-- Logs begin at Sat 2023-10-14 08:29:30 UTC. -- 2023-10-14T08:50:44.879 INFO:journalctl@ceph.mds.b.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:50:44.880 DEBUG:teuthology.orchestra.run.smithi057:mds.h> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.h.service 2023-10-14T08:50:44.907 INFO:journalctl@ceph.mds.e.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:50:44.908 DEBUG:teuthology.orchestra.run.smithi057:mds.k> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.k.service 2023-10-14T08:50:44.934 INFO:journalctl@ceph.mds.h.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:50:44.935 DEBUG:teuthology.orchestra.run.smithi178:mds.c> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.c.service 2023-10-14T08:50:44.938 DEBUG:teuthology.orchestra.run.smithi178:mds.f> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.f.service 2023-10-14T08:50:44.961 INFO:journalctl@ceph.mds.k.smithi057.stdout:-- Logs begin at Sat 2023-10-14 08:29:48 UTC. -- 2023-10-14T08:50:44.967 INFO:journalctl@ceph.mds.c.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:50:44.968 DEBUG:teuthology.orchestra.run.smithi178:mds.i> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.i.service 2023-10-14T08:50:44.994 INFO:journalctl@ceph.mds.f.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:50:44.995 DEBUG:teuthology.orchestra.run.smithi178:mds.l> sudo journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.l.service 2023-10-14T08:50:45.019 INFO:journalctl@ceph.mds.i.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:50:45.021 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-14T08:50:45.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:50:45.046 INFO:journalctl@ceph.mds.l.smithi178.stdout:-- Logs begin at Sat 2023-10-14 08:29:55 UTC. -- 2023-10-14T08:50:45.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 -- 172.21.15.6:0/2478042224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 msgr2=0x7fcaf4101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/2478042224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf4101430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcae80099c0 tx=0x7fcae8009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 -- 172.21.15.6:0/2478042224 shutdown_connections 2023-10-14T08:50:45.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/2478042224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf4101970 0x7fcaf4108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/2478042224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 0x7fcaf4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/2478042224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf4101430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 -- 172.21.15.6:0/2478042224 >> 172.21.15.6:0/2478042224 conn(0x7fcaf40fb310 msgr2=0x7fcaf40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 -- 172.21.15.6:0/2478042224 shutdown_connections 2023-10-14T08:50:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 -- 172.21.15.6:0/2478042224 wait complete. 2023-10-14T08:50:45.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.163+0000 7fcafa8c2700 1 Processor -- start 2023-10-14T08:50:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 -- start start 2023-10-14T08:50:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 0x7fcaf4068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf4101970 0x7fcaf419de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf419e650 con 0x7fcaf4100fd0 2023-10-14T08:50:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf419e7c0 con 0x7fcaf40ffde0 2023-10-14T08:50:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcafa8c2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf419e980 con 0x7fcaf4101970 2023-10-14T08:50:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58996/0 (socket says 172.21.15.6:58996) 2023-10-14T08:50:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 -- 172.21.15.6:0/120249232 learned_addr learned my addr 172.21.15.6:0/120249232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf8e5f700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf4101970 0x7fcaf419de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf3fff700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 0x7fcaf4068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 -- 172.21.15.6:0/120249232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf4101970 msgr2=0x7fcaf419de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf4101970 0x7fcaf419de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 -- 172.21.15.6:0/120249232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 msgr2=0x7fcaf4068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 0x7fcaf4068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 -- 172.21.15.6:0/120249232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80095f0 con 0x7fcaf4100fd0 2023-10-14T08:50:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf3fff700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 0x7fcaf4068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:50:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.164+0000 7fcaf37fe700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf419b830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcae80036f0 tx=0x7fcae8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.165+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae801d070 con 0x7fcaf4100fd0 2023-10-14T08:50:45.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.165+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcae8004010 con 0x7fcaf4100fd0 2023-10-14T08:50:45.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.165+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8022da0 con 0x7fcaf4100fd0 2023-10-14T08:50:45.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.165+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf419ec00 con 0x7fcaf4100fd0 2023-10-14T08:50:45.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.165+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf419efd0 con 0x7fcaf4100fd0 2023-10-14T08:50:45.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.166+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf4106c90 con 0x7fcaf4100fd0 2023-10-14T08:50:45.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.167+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcae8022500 con 0x7fcaf4100fd0 2023-10-14T08:50:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.167+0000 7fcaf17fa700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcadc0a1480 0x7fcadc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.167+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcae80cdc10 con 0x7fcaf4100fd0 2023-10-14T08:50:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.167+0000 7fcaf3fff700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcadc0a1480 0x7fcadc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.168+0000 7fcaf3fff700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcadc0a1480 0x7fcadc0a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcae4005fd0 tx=0x7fcae4005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:45.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.172+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcae80977a0 con 0x7fcaf4100fd0 2023-10-14T08:50:45.355 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:45.355 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:50:45.355 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2023-10-14T08:50:45.355 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:45.356 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:45.356 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:45.356 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:45.356 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:45.356 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:45.357 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:45.357 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:45.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.376+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaf410b880 con 0x7fcaf4100fd0 2023-10-14T08:50:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.377+0000 7fcaf17fa700 1 -- 172.21.15.6:0/120249232 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18337 (secure 0 0 0) 0x7fcae809adc0 con 0x7fcaf4100fd0 2023-10-14T08:50:45.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:45.380 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:50:35.480696+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:50:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.379+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcadc0a1480 msgr2=0x7fcadc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.379+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcadc0a1480 0x7fcadc0a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcae4005fd0 tx=0x7fcae4005e40 comp rx=0 tx=0).stop 2023-10-14T08:50:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 msgr2=0x7fcaf419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf419b830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcae80036f0 tx=0x7fcae8005740 comp rx=0 tx=0).stop 2023-10-14T08:50:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 shutdown_connections 2023-10-14T08:50:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf4101970 0x7fcaf419de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcadc0a1480 0x7fcadc0a3940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf40ffde0 0x7fcaf4068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 --2- 172.21.15.6:0/120249232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf4100fd0 0x7fcaf419b830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 >> 172.21.15.6:0/120249232 conn(0x7fcaf40fb310 msgr2=0x7fcaf40fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 shutdown_connections 2023-10-14T08:50:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.380+0000 7fcafa8c2700 1 -- 172.21.15.6:0/120249232 wait complete. 2023-10-14T08:50:45.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:45.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:50:45.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2023-10-14T08:50:45.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:45.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:45.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:45.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:45.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:45.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:45.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:45.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:45.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:50:45.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:50:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:50:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2023-10-14T08:50:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:50:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:50:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:45.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:45.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:45.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 -- 172.21.15.6:0/1122557889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 msgr2=0x7f6fc41002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 --2- 172.21.15.6:0/1122557889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc41002c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009990 tx=0x7f6fc0009ca0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 -- 172.21.15.6:0/1122557889 shutdown_connections 2023-10-14T08:50:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 --2- 172.21.15.6:0/1122557889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc41019b0 0x7f6fc41082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 --2- 172.21.15.6:0/1122557889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc41002c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 --2- 172.21.15.6:0/1122557889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc4100ff0 0x7f6fc4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 -- 172.21.15.6:0/1122557889 >> 172.21.15.6:0/1122557889 conn(0x7f6fc40fb430 msgr2=0x7f6fc40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 -- 172.21.15.6:0/1122557889 shutdown_connections 2023-10-14T08:50:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.527+0000 7f6fcc150700 1 -- 172.21.15.6:0/1122557889 wait complete. 2023-10-14T08:50:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 Processor -- start 2023-10-14T08:50:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 -- start start 2023-10-14T08:50:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc4196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4100ff0 0x7f6fc41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc41019b0 0x7f6fc419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc419e820 con 0x7f6fc40ffea0 2023-10-14T08:50:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc419e990 con 0x7f6fc41019b0 2023-10-14T08:50:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fcc150700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc419eb50 con 0x7f6fc4100ff0 2023-10-14T08:50:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc4196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc4196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59008/0 (socket says 172.21.15.6:59008) 2023-10-14T08:50:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 -- 172.21.15.6:0/3387767475 learned_addr learned my addr 172.21.15.6:0/3387767475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc96eb700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4100ff0 0x7f6fc41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fca6ed700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc41019b0 0x7f6fc419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 -- 172.21.15.6:0/3387767475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4100ff0 msgr2=0x7f6fc41971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4100ff0 0x7f6fc41971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 -- 172.21.15.6:0/3387767475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc41019b0 msgr2=0x7f6fc419e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc41019b0 0x7f6fc419e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.528+0000 7f6fc9eec700 1 -- 172.21.15.6:0/3387767475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00095f0 con 0x7f6fc40ffea0 2023-10-14T08:50:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.529+0000 7f6fc9eec700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc4196cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c010 tx=0x7f6fc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.529+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc001d070 con 0x7f6fc40ffea0 2023-10-14T08:50:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.529+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fc0005030 con 0x7f6fc40ffea0 2023-10-14T08:50:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.529+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc419edd0 con 0x7f6fc40ffea0 2023-10-14T08:50:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.529+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0004b90 con 0x7f6fc40ffea0 2023-10-14T08:50:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.529+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc419f1a0 con 0x7f6fc40ffea0 2023-10-14T08:50:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.530+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc410c830 con 0x7f6fc40ffea0 2023-10-14T08:50:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.531+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6fc00051a0 con 0x7f6fc40ffea0 2023-10-14T08:50:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.531+0000 7f6fb6ffd700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6fb00a1500 0x7f6fb00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.532+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6fc00cdeb0 con 0x7f6fc40ffea0 2023-10-14T08:50:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.532+0000 7f6fc96eb700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6fb00a1500 0x7f6fb00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.532+0000 7f6fc96eb700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6fb00a1500 0x7f6fb00a39c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6fc41981b0 tx=0x7f6fb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.535+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6fc0097a40 con 0x7f6fc40ffea0 2023-10-14T08:50:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.738+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fc4106de0 con 0x7f6fc40ffea0 2023-10-14T08:50:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.738+0000 7f6fb6ffd700 1 -- 172.21.15.6:0/3387767475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fc009b060 con 0x7f6fc40ffea0 2023-10-14T08:50:45.740 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:50:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6fb00a1500 msgr2=0x7f6fb00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6fb00a1500 0x7f6fb00a39c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6fc41981b0 tx=0x7f6fb8009260 comp rx=0 tx=0).stop 2023-10-14T08:50:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 msgr2=0x7f6fc4196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc4196cb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c010 tx=0x7f6fc0004730 comp rx=0 tx=0).stop 2023-10-14T08:50:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 shutdown_connections 2023-10-14T08:50:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6fb00a1500 0x7f6fb00a39c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc41019b0 0x7f6fc419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fc40ffea0 0x7f6fc4196cb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 --2- 172.21.15.6:0/3387767475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fc4100ff0 0x7f6fc41971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 >> 172.21.15.6:0/3387767475 conn(0x7f6fc40fb430 msgr2=0x7f6fc40fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 shutdown_connections 2023-10-14T08:50:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.741+0000 7f6fcc150700 1 -- 172.21.15.6:0/3387767475 wait complete. 2023-10-14T08:50:45.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:50:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 -- 172.21.15.6:0/3794630567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748100dd0 msgr2=0x7f3748101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 --2- 172.21.15.6:0/3794630567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748100dd0 0x7f3748101230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f37340099c0 tx=0x7f3734009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 -- 172.21.15.6:0/3794630567 shutdown_connections 2023-10-14T08:50:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 --2- 172.21.15.6:0/3794630567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3748101770 0x7f3748108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 --2- 172.21.15.6:0/3794630567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37480ffbe0 0x7f3748100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 --2- 172.21.15.6:0/3794630567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748100dd0 0x7f3748101230 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 -- 172.21.15.6:0/3794630567 >> 172.21.15.6:0/3794630567 conn(0x7f37480fb130 msgr2=0x7f37480fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 -- 172.21.15.6:0/3794630567 shutdown_connections 2023-10-14T08:50:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 -- 172.21.15.6:0/3794630567 wait complete. 2023-10-14T08:50:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 Processor -- start 2023-10-14T08:50:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.879+0000 7f374dfa2700 1 -- start start 2023-10-14T08:50:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480ffbe0 0x7f3748069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3748100dd0 0x7f374819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 0x7f374819dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374819e530 con 0x7f3748101770 2023-10-14T08:50:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374819e6a0 con 0x7f3748100dd0 2023-10-14T08:50:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374819e860 con 0x7f37480ffbe0 2023-10-14T08:50:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 0x7f374819dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 0x7f374819dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59026/0 (socket says 172.21.15.6:59026) 2023-10-14T08:50:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 -- 172.21.15.6:0/358061402 learned_addr learned my addr 172.21.15.6:0/358061402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374cfa0700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480ffbe0 0x7f3748069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f3747fff700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3748100dd0 0x7f374819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 -- 172.21.15.6:0/358061402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480ffbe0 msgr2=0x7f3748069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480ffbe0 0x7f3748069ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 -- 172.21.15.6:0/358061402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3748100dd0 msgr2=0x7f374819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3748100dd0 0x7f374819b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 -- 172.21.15.6:0/358061402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340095f0 con 0x7f3748101770 2023-10-14T08:50:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374d7a1700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 0x7f374819dd60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3740007ee0 tx=0x7f374000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740017070 con 0x7f3748101770 2023-10-14T08:50:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f374000f040 con 0x7f3748101770 2023-10-14T08:50:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374819eb40 con 0x7f3748101770 2023-10-14T08:50:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.880+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740005580 con 0x7f3748101770 2023-10-14T08:50:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.881+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374819f020 con 0x7f3748101770 2023-10-14T08:50:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.882+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3748106b60 con 0x7f3748101770 2023-10-14T08:50:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.883+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f374000db20 con 0x7f3748101770 2023-10-14T08:50:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.883+0000 7f3745ffb700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37380a1500 0x7f37380a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.883+0000 7f374cfa0700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37380a1500 0x7f37380a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.883+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f37400cbf80 con 0x7f3748101770 2023-10-14T08:50:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.884+0000 7f374cfa0700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37380a1500 0x7f37380a39c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3748100c30 tx=0x7f373c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:45.888+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3740095a20 con 0x7f3748101770 2023-10-14T08:50:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.135+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f374810b440 con 0x7f3748101770 2023-10-14T08:50:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.135+0000 7f3745ffb700 1 -- 172.21.15.6:0/358061402 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f3740099040 con 0x7f3748101770 2023-10-14T08:50:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:46.138 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-14T08:50:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37380a1500 msgr2=0x7f37380a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37380a1500 0x7f37380a39c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3748100c30 tx=0x7f373c009260 comp rx=0 tx=0).stop 2023-10-14T08:50:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 msgr2=0x7f374819dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 0x7f374819dd60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3740007ee0 tx=0x7f374000d3b0 comp rx=0 tx=0).stop 2023-10-14T08:50:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 shutdown_connections 2023-10-14T08:50:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3748101770 0x7f374819dd60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37480ffbe0 0x7f3748069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37380a1500 0x7f37380a39c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 --2- 172.21.15.6:0/358061402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3748100dd0 0x7f374819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 >> 172.21.15.6:0/358061402 conn(0x7f37480fb130 msgr2=0x7f37480fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 shutdown_connections 2023-10-14T08:50:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:46.138+0000 7f374dfa2700 1 -- 172.21.15.6:0/358061402 wait complete. 2023-10-14T08:50:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 1 2023-10-14T08:50:46.310 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:46 smithi178 ceph-mon[103612]: Deploying daemon mds.l on smithi178 2023-10-14T08:50:46.310 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/120249232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:50:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3387767475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:50:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/358061402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:46 smithi057 ceph-mon[103313]: Deploying daemon mds.l on smithi178 2023-10-14T08:50:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/120249232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:50:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3387767475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:50:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/358061402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:46.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:46 smithi006 ceph-mon[99452]: Deploying daemon mds.l on smithi178 2023-10-14T08:50:46.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/120249232' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:50:46.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3387767475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:50:46.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/358061402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:46.629 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 08:50:46 smithi178 systemd[1]: Starting Ceph mds.l for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:50:46.883 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 08:50:46 smithi178 podman[141090]: 2023-10-14T08:50:46.884 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 08:50:46 smithi178 ceph-mds[141130]: -- 172.21.15.178:0/2861049980 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5587cf3151e0 con 0x5587cf2eac00 2023-10-14T08:50:46.884 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 08:50:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l[141106]: starting mds.l at 2023-10-14T08:50:47.180 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 08:50:46 smithi178 bash[141090]: bb926148098cf426e7c1384e2e16f79babccec9f3ec42d17c1bb3b8929fa4a3f 2023-10-14T08:50:47.180 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 08:50:46 smithi178 systemd[1]: Started Ceph mds.l for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:50:47.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:47.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6832/3050202963,v1:172.21.15.178:6833/3050202963] up:boot 2023-10-14T08:50:47.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: fsmap 1 up:standby 2023-10-14T08:50:47.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-14T08:50:47.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:47.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:47.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6832/3050202963,v1:172.21.15.178:6833/3050202963] up:boot 2023-10-14T08:50:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: fsmap 1 up:standby 2023-10-14T08:50:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-14T08:50:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:47.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:47.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6832/3050202963,v1:172.21.15.178:6833/3050202963] up:boot 2023-10-14T08:50:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: fsmap 1 up:standby 2023-10-14T08:50:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-14T08:50:47.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:47.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:47.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:47.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:48.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:50:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/3381684335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 msgr2=0x7f9a88101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/3381684335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88101440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9a840099c0 tx=0x7f9a84009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/3381684335 shutdown_connections 2023-10-14T08:50:48.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/3381684335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a88101980 0x7f9a88108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/3381684335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a880ffdf0 0x7f9a88100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/3381684335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88101440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/3381684335 >> 172.21.15.6:0/3381684335 conn(0x7f9a880fb320 msgr2=0x7f9a880fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/3381684335 shutdown_connections 2023-10-14T08:50:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.292+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/3381684335 wait complete. 2023-10-14T08:50:48.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 Processor -- start 2023-10-14T08:50:48.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 -- start start 2023-10-14T08:50:48.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 0x7f9a88196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:48.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:48.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a88101980 0x7f9a8819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:48.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8819e780 con 0x7f9a88100fe0 2023-10-14T08:50:48.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8819e8f0 con 0x7f9a880ffdf0 2023-10-14T08:50:48.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8f5d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8819eab0 con 0x7f9a88101980 2023-10-14T08:50:48.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8cb6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:48.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8d370700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 0x7f9a88196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:48.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8d370700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 0x7f9a88196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:57794/0 (socket says 172.21.15.6:57794) 2023-10-14T08:50:48.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8cb6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59038/0 (socket says 172.21.15.6:59038) 2023-10-14T08:50:48.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8d370700 1 -- 172.21.15.6:0/772357268 learned_addr learned my addr 172.21.15.6:0/772357268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:48.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.293+0000 7f9a8db71700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a88101980 0x7f9a8819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:48.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8d370700 1 -- 172.21.15.6:0/772357268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a88101980 msgr2=0x7f9a8819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:48.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8d370700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a88101980 0x7f9a8819e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8d370700 1 -- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 msgr2=0x7f9a88197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:48.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8d370700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8d370700 1 -- 172.21.15.6:0/772357268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840095f0 con 0x7f9a880ffdf0 2023-10-14T08:50:48.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8cb6f700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:50:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8d370700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 0x7f9a88196c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d980 tx=0x7f9a7800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78009930 con 0x7f9a880ffdf0 2023-10-14T08:50:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8819ed90 con 0x7f9a880ffdf0 2023-10-14T08:50:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a78010460 con 0x7f9a880ffdf0 2023-10-14T08:50:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800f620 con 0x7f9a880ffdf0 2023-10-14T08:50:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.294+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8819f190 con 0x7f9a880ffdf0 2023-10-14T08:50:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.295+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8810b620 con 0x7f9a880ffdf0 2023-10-14T08:50:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.296+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9a78010860 con 0x7f9a880ffdf0 2023-10-14T08:50:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.297+0000 7f9a7e7fc700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9a740a1480 0x7f9a740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.297+0000 7f9a8cb6f700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9a740a1480 0x7f9a740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.297+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9a780cc3a0 con 0x7f9a880ffdf0 2023-10-14T08:50:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.297+0000 7f9a8cb6f700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9a740a1480 0x7f9a740a3940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400b580 tx=0x7f9a8401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.300+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9a78095e00 con 0x7f9a880ffdf0 2023-10-14T08:50:48.373 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:48 smithi057 ceph-mon[103313]: Deploying daemon mds.k on smithi057 2023-10-14T08:50:48.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:48 smithi006 ceph-mon[99452]: Deploying daemon mds.k on smithi057 2023-10-14T08:50:48.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.549+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a8810b8f0 con 0x7f9a880ffdf0 2023-10-14T08:50:48.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.550+0000 7f9a7e7fc700 1 -- 172.21.15.6:0/772357268 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f9a78017540 con 0x7f9a880ffdf0 2023-10-14T08:50:48.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:48.552 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T08:50:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9a740a1480 msgr2=0x7f9a740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9a740a1480 0x7f9a740a3940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400b580 tx=0x7f9a8401a040 comp rx=0 tx=0).stop 2023-10-14T08:50:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 msgr2=0x7f9a88196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:48.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 0x7f9a88196c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d980 tx=0x7f9a7800dc90 comp rx=0 tx=0).stop 2023-10-14T08:50:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 shutdown_connections 2023-10-14T08:50:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a88101980 0x7f9a8819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9a740a1480 0x7f9a740a3940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a880ffdf0 0x7f9a88196c40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 --2- 172.21.15.6:0/772357268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a88100fe0 0x7f9a88197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 >> 172.21.15.6:0/772357268 conn(0x7f9a880fb320 msgr2=0x7f9a88068f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 shutdown_connections 2023-10-14T08:50:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:48.552+0000 7f9a8f5d4700 1 -- 172.21.15.6:0/772357268 wait complete. 2023-10-14T08:50:48.556 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2023-10-14T08:50:48.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:48 smithi178 ceph-mon[103612]: Deploying daemon mds.k on smithi057 2023-10-14T08:50:48.886 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 08:50:48 smithi057 systemd[1]: Starting Ceph mds.k for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:50:49.156 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 08:50:48 smithi057 podman[139627]: 2023-10-14T08:50:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:49 smithi057 ceph-mon[103313]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:49.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:49 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/772357268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:49.444 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 08:50:49 smithi057 bash[139627]: 3f98560be857d7685407edf6c3549209436e9f0c7b96878111acb39f5c27eb48 2023-10-14T08:50:49.445 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 08:50:49 smithi057 ceph-mds[139667]: -- 172.21.15.57:0/2333481284 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558d46c531e0 con 0x558d46c29000 2023-10-14T08:50:49.445 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 08:50:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k[139643]: starting mds.k at 2023-10-14T08:50:49.445 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 08:50:49 smithi057 systemd[1]: Started Ceph mds.k for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:50:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:49 smithi006 ceph-mon[99452]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:49 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/772357268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:49 smithi178 ceph-mon[103612]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:49 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/772357268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:50.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] up:boot 2023-10-14T08:50:50.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: fsmap 2 up:standby 2023-10-14T08:50:50.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-14T08:50:50.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:50.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:50.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:50.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:50:50.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] up:boot 2023-10-14T08:50:50.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: fsmap 2 up:standby 2023-10-14T08:50:50.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-14T08:50:50.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:50.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:50.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:50.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] up:boot 2023-10-14T08:50:50.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: fsmap 2 up:standby 2023-10-14T08:50:50.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-14T08:50:50.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:50.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:50.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:50.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:50.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 -- 172.21.15.6:0/3378809663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4106c60 msgr2=0x7f05b4109070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 --2- 172.21.15.6:0/3378809663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4106c60 0x7f05b4109070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00b0a0 tx=0x7f05ac00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:50:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 -- 172.21.15.6:0/3378809663 shutdown_connections 2023-10-14T08:50:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 --2- 172.21.15.6:0/3378809663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4106c60 0x7f05b4109070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 --2- 172.21.15.6:0/3378809663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b4101a00 0x7f05b4103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 --2- 172.21.15.6:0/3378809663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b4104330 0x7f05b4106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 -- 172.21.15.6:0/3378809663 >> 172.21.15.6:0/3378809663 conn(0x7f05b40fb370 msgr2=0x7f05b40fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 -- 172.21.15.6:0/3378809663 shutdown_connections 2023-10-14T08:50:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.766+0000 7f05bb674700 1 -- 172.21.15.6:0/3378809663 wait complete. 2023-10-14T08:50:50.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 Processor -- start 2023-10-14T08:50:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 -- start start 2023-10-14T08:50:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b4101a00 0x7f05b4196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 0x7f05b4197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b4106c60 0x7f05b419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b419e770 con 0x7f05b4104330 2023-10-14T08:50:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b419e8e0 con 0x7f05b4106c60 2023-10-14T08:50:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05bb674700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b419eaa0 con 0x7f05b4101a00 2023-10-14T08:50:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05b8c0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 0x7f05b4197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05b8c0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 0x7f05b4197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59052/0 (socket says 172.21.15.6:59052) 2023-10-14T08:50:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05b8c0f700 1 -- 172.21.15.6:0/4202886385 learned_addr learned my addr 172.21.15.6:0/4202886385 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.767+0000 7f05b9410700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b4101a00 0x7f05b4196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b9c11700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b4106c60 0x7f05b419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b8c0f700 1 -- 172.21.15.6:0/4202886385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b4101a00 msgr2=0x7f05b4196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b8c0f700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b4101a00 0x7f05b4196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b8c0f700 1 -- 172.21.15.6:0/4202886385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b4106c60 msgr2=0x7f05b419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b8c0f700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b4106c60 0x7f05b419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b8c0f700 1 -- 172.21.15.6:0/4202886385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009d00 con 0x7f05b4104330 2023-10-14T08:50:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05b8c0f700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 0x7f05b4197170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f05a400d950 tx=0x7f05a400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4009940 con 0x7f05b4104330 2023-10-14T08:50:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05a4010460 con 0x7f05b4104330 2023-10-14T08:50:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a400f620 con 0x7f05b4104330 2023-10-14T08:50:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b419ed80 con 0x7f05b4104330 2023-10-14T08:50:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.768+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b419f1d0 con 0x7f05b4104330 2023-10-14T08:50:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.769+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b40fcef0 con 0x7f05b4104330 2023-10-14T08:50:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.770+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f05a40108d0 con 0x7f05b4104330 2023-10-14T08:50:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.771+0000 7f05aa7fc700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05a00a1500 0x7f05a00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.771+0000 7f05b9410700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05a00a1500 0x7f05a00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.771+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f05a40cc5f0 con 0x7f05b4104330 2023-10-14T08:50:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.771+0000 7f05b9410700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05a00a1500 0x7f05a00a39c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05b4198100 tx=0x7f05b000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:50.774+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05a40960f0 con 0x7f05b4104330 2023-10-14T08:50:50.791 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 08:50:50 smithi006 systemd[1]: Starting Ceph mds.j for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:50:51.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.047+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05b402d270 con 0x7f05b4104330 2023-10-14T08:50:51.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.047+0000 7f05aa7fc700 1 -- 172.21.15.6:0/4202886385 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f05a4016860 con 0x7f05b4104330 2023-10-14T08:50:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:51.049 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T08:50:51.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05a00a1500 msgr2=0x7f05a00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05a00a1500 0x7f05a00a39c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05b4198100 tx=0x7f05b000a380 comp rx=0 tx=0).stop 2023-10-14T08:50:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 msgr2=0x7f05b4197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 0x7f05b4197170 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f05a400d950 tx=0x7f05a400dc60 comp rx=0 tx=0).stop 2023-10-14T08:50:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 shutdown_connections 2023-10-14T08:50:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05a00a1500 0x7f05a00a39c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05b4106c60 0x7f05b419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b4101a00 0x7f05b4196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 --2- 172.21.15.6:0/4202886385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b4104330 0x7f05b4197170 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 >> 172.21.15.6:0/4202886385 conn(0x7f05b40fb370 msgr2=0x7f05b4102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 shutdown_connections 2023-10-14T08:50:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:51.050+0000 7f05bb674700 1 -- 172.21.15.6:0/4202886385 wait complete. 2023-10-14T08:50:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-10-14T08:50:51.333 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 08:50:51 smithi006 podman[148840]: 2023-10-14T08:50:51.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:51 smithi006 ceph-mon[99452]: Deploying daemon mds.j on smithi006 2023-10-14T08:50:51.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:51 smithi006 ceph-mon[99452]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:51.334 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:51 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4202886385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:51 smithi178 ceph-mon[103612]: Deploying daemon mds.j on smithi006 2023-10-14T08:50:51.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:51 smithi178 ceph-mon[103612]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:51.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:51 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/4202886385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:51 smithi057 ceph-mon[103313]: Deploying daemon mds.j on smithi006 2023-10-14T08:50:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:51 smithi057 ceph-mon[103313]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:51 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/4202886385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:51.731 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 08:50:51 smithi006 bash[148840]: 82b5c9f5669c0cd8c85bf6d9e668122931866d90d9109ac611b9c776470cf4b1 2023-10-14T08:50:51.731 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 08:50:51 smithi006 ceph-mds[148882]: -- 172.21.15.6:0/4258379509 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d0ce82d1e0 con 0x55d0ce802800 2023-10-14T08:50:51.732 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 08:50:51 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-j[148858]: starting mds.j at 2023-10-14T08:50:51.732 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 08:50:51 smithi006 systemd[1]: Started Ceph mds.j for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:50:52.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:52.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:52.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:52.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:52.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: Deploying daemon mds.d on smithi006 2023-10-14T08:50:52.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.6:6834/2026844490,v1:172.21.15.6:6835/2026844490] up:boot 2023-10-14T08:50:52.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: fsmap 3 up:standby 2023-10-14T08:50:52.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:52 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-14T08:50:52.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:52.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:52.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:52.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:52.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: Deploying daemon mds.d on smithi006 2023-10-14T08:50:52.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.6:6834/2026844490,v1:172.21.15.6:6835/2026844490] up:boot 2023-10-14T08:50:52.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: fsmap 3 up:standby 2023-10-14T08:50:52.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:52 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-14T08:50:52.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:52.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:52.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:52.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:52.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: Deploying daemon mds.d on smithi006 2023-10-14T08:50:52.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.6:6834/2026844490,v1:172.21.15.6:6835/2026844490] up:boot 2023-10-14T08:50:52.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: fsmap 3 up:standby 2023-10-14T08:50:52.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:52 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-14T08:50:52.997 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 08:50:52 smithi006 systemd[1]: Starting Ceph mds.d for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:50:53.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:50:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 -- 172.21.15.6:0/3947476267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb510100fd0 msgr2=0x7fb510101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 --2- 172.21.15.6:0/3947476267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb510100fd0 0x7fb510101430 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80099c0 tx=0x7fb4f8009cd0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 -- 172.21.15.6:0/3947476267 shutdown_connections 2023-10-14T08:50:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 --2- 172.21.15.6:0/3947476267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb510101970 0x7fb510108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 --2- 172.21.15.6:0/3947476267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5100ffde0 0x7fb510100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 --2- 172.21.15.6:0/3947476267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb510100fd0 0x7fb510101430 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.209+0000 7fb515653700 1 -- 172.21.15.6:0/3947476267 >> 172.21.15.6:0/3947476267 conn(0x7fb5100fb350 msgr2=0x7fb5100fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 -- 172.21.15.6:0/3947476267 shutdown_connections 2023-10-14T08:50:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 -- 172.21.15.6:0/3947476267 wait complete. 2023-10-14T08:50:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 Processor -- start 2023-10-14T08:50:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 -- start start 2023-10-14T08:50:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 0x7fb510069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb510100fd0 0x7fb51019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb510101970 0x7fb51019deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51019e650 con 0x7fb5100ffde0 2023-10-14T08:50:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51019e7c0 con 0x7fb510101970 2023-10-14T08:50:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb515653700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51019e980 con 0x7fb510100fd0 2023-10-14T08:50:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.210+0000 7fb50effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 0x7fb510069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 0x7fb510069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59076/0 (socket says 172.21.15.6:59076) 2023-10-14T08:50:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 -- 172.21.15.6:0/524186815 learned_addr learned my addr 172.21.15.6:0/524186815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50f7fe700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb510101970 0x7fb51019deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50e7fc700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb510100fd0 0x7fb51019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 -- 172.21.15.6:0/524186815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb510100fd0 msgr2=0x7fb51019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb510100fd0 0x7fb51019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 -- 172.21.15.6:0/524186815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb510101970 msgr2=0x7fb51019deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb510101970 0x7fb51019deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 -- 172.21.15.6:0/524186815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80095f0 con 0x7fb5100ffde0 2023-10-14T08:50:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb50effd700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 0x7fb510069f90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb508007f10 tx=0x7fb50800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb5100ffde0 2023-10-14T08:50:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50800f040 con 0x7fb5100ffde0 2023-10-14T08:50:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51019ec60 con 0x7fb5100ffde0 2023-10-14T08:50:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508004580 con 0x7fb5100ffde0 2023-10-14T08:50:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.211+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51019f1c0 con 0x7fb5100ffde0 2023-10-14T08:50:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.212+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb510107350 con 0x7fb5100ffde0 2023-10-14T08:50:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.213+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb5080046e0 con 0x7fb5100ffde0 2023-10-14T08:50:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.214+0000 7fb507fff700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4fc0a1500 0x7fb4fc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.214+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5080cc4e0 con 0x7fb5100ffde0 2023-10-14T08:50:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.214+0000 7fb50e7fc700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4fc0a1500 0x7fb4fc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.214+0000 7fb50e7fc700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4fc0a1500 0x7fb4fc0a39c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800b580 tx=0x7fb4f8005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:53.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.218+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb508095fe0 con 0x7fb5100ffde0 2023-10-14T08:50:53.378 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 08:50:53 smithi006 podman[149204]: 2023-10-14T08:50:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.491+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb51002d020 con 0x7fb5100ffde0 2023-10-14T08:50:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.492+0000 7fb507fff700 1 -- 172.21.15.6:0/524186815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fb508099600 con 0x7fb5100ffde0 2023-10-14T08:50:53.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T08:50:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4fc0a1500 msgr2=0x7fb4fc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4fc0a1500 0x7fb4fc0a39c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800b580 tx=0x7fb4f8005bc0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 msgr2=0x7fb510069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 0x7fb510069f90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb508007f10 tx=0x7fb50800d3b0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 shutdown_connections 2023-10-14T08:50:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4fc0a1500 0x7fb4fc0a39c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb510101970 0x7fb51019deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5100ffde0 0x7fb510069f90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 --2- 172.21.15.6:0/524186815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb510100fd0 0x7fb51019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 >> 172.21.15.6:0/524186815 conn(0x7fb5100fb350 msgr2=0x7fb510104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 shutdown_connections 2023-10-14T08:50:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:53.494+0000 7fb515653700 1 -- 172.21.15.6:0/524186815 wait complete. 2023-10-14T08:50:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 4 2023-10-14T08:50:53.981 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 08:50:53 smithi006 ceph-mds[149266]: -- 172.21.15.6:0/2062260858 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563d0ecc91e0 con 0x563d0ec9e800 2023-10-14T08:50:53.981 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 08:50:53 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-d[149240]: starting mds.d at 2023-10-14T08:50:53.982 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 08:50:53 smithi006 bash[149204]: 213ee11070cf5e809979caf893ca83383a7dbeb4d0bb217d4063e11a90cd9b99 2023-10-14T08:50:53.982 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 08:50:53 smithi006 systemd[1]: Started Ceph mds.d for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:50:54.641 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:54.641 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/524186815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:54.641 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.641 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.642 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.642 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:54.642 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:54.642 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:54.642 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:54 smithi057 ceph-mon[103313]: Deploying daemon mds.e on smithi057 2023-10-14T08:50:54.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:54.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/524186815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:54.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:54.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:54.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:54.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:54 smithi006 ceph-mon[99452]: Deploying daemon mds.e on smithi057 2023-10-14T08:50:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/524186815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:54.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:54.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:54.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:54.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:54 smithi178 ceph-mon[103612]: Deploying daemon mds.e on smithi057 2023-10-14T08:50:55.509 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:50:55.567 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 08:50:55 smithi057 systemd[1]: Starting Ceph mds.e for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:50:55.568 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:55 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.6:6836/1177003632,v1:172.21.15.6:6837/1177003632] up:boot 2023-10-14T08:50:55.568 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:55 smithi057 ceph-mon[103313]: fsmap 4 up:standby 2023-10-14T08:50:55.568 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:55 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-14T08:50:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 -- 172.21.15.6:0/326200285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 msgr2=0x7f54bc106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 --2- 172.21.15.6:0/326200285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc106680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009990 tx=0x7f54b8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 -- 172.21.15.6:0/326200285 shutdown_connections 2023-10-14T08:50:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 --2- 172.21.15.6:0/326200285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc106bc0 0x7f54bc109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 --2- 172.21.15.6:0/326200285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc101960 0x7f54bc103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 --2- 172.21.15.6:0/326200285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc106680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 -- 172.21.15.6:0/326200285 >> 172.21.15.6:0/326200285 conn(0x7f54bc0fb310 msgr2=0x7f54bc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 -- 172.21.15.6:0/326200285 shutdown_connections 2023-10-14T08:50:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.649+0000 7f54c41c9700 1 -- 172.21.15.6:0/326200285 wait complete. 2023-10-14T08:50:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 Processor -- start 2023-10-14T08:50:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 -- start start 2023-10-14T08:50:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc101960 0x7f54bc196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc106bc0 0x7f54bc19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc19e7a0 con 0x7f54bc104290 2023-10-14T08:50:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc19e910 con 0x7f54bc106bc0 2023-10-14T08:50:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c41c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc19ead0 con 0x7f54bc101960 2023-10-14T08:50:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59104/0 (socket says 172.21.15.6:59104) 2023-10-14T08:50:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 -- 172.21.15.6:0/2628028081 learned_addr learned my addr 172.21.15.6:0/2628028081 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c2766700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc106bc0 0x7f54bc19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 -- 172.21.15.6:0/2628028081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc101960 msgr2=0x7f54bc196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc101960 0x7f54bc196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 -- 172.21.15.6:0/2628028081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc106bc0 msgr2=0x7f54bc19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc106bc0 0x7f54bc19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c1764700 1 -- 172.21.15.6:0/2628028081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80095f0 con 0x7f54bc104290 2023-10-14T08:50:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.650+0000 7f54c2766700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc106bc0 0x7f54bc19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:50:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.651+0000 7f54c1764700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc1971a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54b8004730 tx=0x7f54b8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.651+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b801d070 con 0x7f54bc104290 2023-10-14T08:50:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.651+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54b8004cd0 con 0x7f54bc104290 2023-10-14T08:50:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.651+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc19ed50 con 0x7f54bc104290 2023-10-14T08:50:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.651+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8005610 con 0x7f54bc104290 2023-10-14T08:50:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.651+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc19f110 con 0x7f54bc104290 2023-10-14T08:50:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.652+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc0fce90 con 0x7f54bc104290 2023-10-14T08:50:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.653+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f54b800fc70 con 0x7f54bc104290 2023-10-14T08:50:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.653+0000 7f54aeffd700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f54a80a1480 0x7f54a80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.654+0000 7f54c1f65700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f54a80a1480 0x7f54a80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.654+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54b80ce130 con 0x7f54bc104290 2023-10-14T08:50:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.654+0000 7f54c1f65700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f54a80a1480 0x7f54a80a3940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f54bc198130 tx=0x7f54b0006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.657+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f54b8097cc0 con 0x7f54bc104290 2023-10-14T08:50:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:55 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.6:6836/1177003632,v1:172.21.15.6:6837/1177003632] up:boot 2023-10-14T08:50:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:55 smithi006 ceph-mon[99452]: fsmap 4 up:standby 2023-10-14T08:50:55.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:55 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-14T08:50:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:55 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.6:6836/1177003632,v1:172.21.15.6:6837/1177003632] up:boot 2023-10-14T08:50:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:55 smithi178 ceph-mon[103612]: fsmap 4 up:standby 2023-10-14T08:50:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:55 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-14T08:50:55.888 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 08:50:55 smithi057 podman[139969]: 2023-10-14T08:50:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.903+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54bc02d2b0 con 0x7f54bc104290 2023-10-14T08:50:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.904+0000 7f54aeffd700 1 -- 172.21.15.6:0/2628028081 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3695 (secure 0 0 0) 0x7f54b802fe80 con 0x7f54bc104290 2023-10-14T08:50:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:55.906 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T08:50:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f54a80a1480 msgr2=0x7f54a80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f54a80a1480 0x7f54a80a3940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f54bc198130 tx=0x7f54b0006d20 comp rx=0 tx=0).stop 2023-10-14T08:50:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 msgr2=0x7f54bc1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc1971a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f54b8004730 tx=0x7f54b8005ef0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 shutdown_connections 2023-10-14T08:50:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f54a80a1480 0x7f54a80a3940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54bc106bc0 0x7f54bc19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54bc101960 0x7f54bc196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 --2- 172.21.15.6:0/2628028081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54bc104290 0x7f54bc1971a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 >> 172.21.15.6:0/2628028081 conn(0x7f54bc0fb310 msgr2=0x7f54bc1025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:55.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 shutdown_connections 2023-10-14T08:50:55.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:55.906+0000 7f54c41c9700 1 -- 172.21.15.6:0/2628028081 wait complete. 2023-10-14T08:50:55.910 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 5 2023-10-14T08:50:56.194 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 08:50:55 smithi057 bash[139969]: 10f59e8e1ddf46f133def6a8dab3712ed19e26c9452b6afef1b430cada09d548 2023-10-14T08:50:56.194 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 08:50:55 smithi057 ceph-mds[140009]: -- 172.21.15.57:0/150752969 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5591560bb1e0 con 0x559156091000 2023-10-14T08:50:56.195 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 08:50:55 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e[139985]: starting mds.e at 2023-10-14T08:50:56.195 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 08:50:55 smithi057 systemd[1]: Started Ceph mds.e for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:50:56.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:56.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2628028081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:56.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:56.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:56.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:56 smithi006 ceph-mon[99452]: Deploying daemon mds.f on smithi178 2023-10-14T08:50:56.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:56.788 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2628028081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:56.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:56.789 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:56.790 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:56.790 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:56 smithi178 ceph-mon[103612]: Deploying daemon mds.f on smithi178 2023-10-14T08:50:56.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:56.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2628028081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:56.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:56.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:56.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:56.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:56.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:56 smithi057 ceph-mon[103313]: Deploying daemon mds.f on smithi178 2023-10-14T08:50:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:57 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] up:boot 2023-10-14T08:50:57.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:57 smithi006 ceph-mon[99452]: fsmap 5 up:standby 2023-10-14T08:50:57.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:57 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-14T08:50:57.869 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:57 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] up:boot 2023-10-14T08:50:57.870 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:57 smithi178 ceph-mon[103612]: fsmap 5 up:standby 2023-10-14T08:50:57.870 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:57 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-14T08:50:57.870 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 08:50:57 smithi178 systemd[1]: Starting Ceph mds.f for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:50:57.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:50:57.943 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:57 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] up:boot 2023-10-14T08:50:57.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:57 smithi057 ceph-mon[103313]: fsmap 5 up:standby 2023-10-14T08:50:57.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:57 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-14T08:50:58.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 -- 172.21.15.6:0/1367768263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 msgr2=0x7f3eb41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:58.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 --2- 172.21.15.6:0/1367768263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb41012b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b0a0 tx=0x7f3eac00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 -- 172.21.15.6:0/1367768263 shutdown_connections 2023-10-14T08:50:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 --2- 172.21.15.6:0/1367768263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3eb4102a30 0x7f3eb4109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 --2- 172.21.15.6:0/1367768263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb41012b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 --2- 172.21.15.6:0/1367768263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb4102070 0x7f3eb41024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 -- 172.21.15.6:0/1367768263 >> 172.21.15.6:0/1367768263 conn(0x7f3eb40fc410 msgr2=0x7f3eb40fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 -- 172.21.15.6:0/1367768263 shutdown_connections 2023-10-14T08:50:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.060+0000 7f3eba11d700 1 -- 172.21.15.6:0/1367768263 wait complete. 2023-10-14T08:50:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 Processor -- start 2023-10-14T08:50:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 -- start start 2023-10-14T08:50:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb4196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:58.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb4102070 0x7f3eb41972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:58.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3eb4102a30 0x7f3eb419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:58.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb419e8e0 con 0x7f3eb4100e90 2023-10-14T08:50:58.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb419ea20 con 0x7f3eb4102a30 2023-10-14T08:50:58.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eba11d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb419ebb0 con 0x7f3eb4102070 2023-10-14T08:50:58.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.061+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb4196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:58.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb4196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59116/0 (socket says 172.21.15.6:59116) 2023-10-14T08:50:58.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 -- 172.21.15.6:0/3689755110 learned_addr learned my addr 172.21.15.6:0/3689755110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:50:58.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb2ffd700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb4102070 0x7f3eb41972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:58.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb3fff700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3eb4102a30 0x7f3eb419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:58.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 -- 172.21.15.6:0/3689755110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb4102070 msgr2=0x7f3eb41972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:58.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb4102070 0x7f3eb41972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 -- 172.21.15.6:0/3689755110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3eb4102a30 msgr2=0x7f3eb419e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:58.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3eb4102a30 0x7f3eb419e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 -- 172.21.15.6:0/3689755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac009d00 con 0x7f3eb4100e90 2023-10-14T08:50:58.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb37fe700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb4196d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b780 tx=0x7f3eac00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:58.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00e040 con 0x7f3eb4100e90 2023-10-14T08:50:58.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3eac0094a0 con 0x7f3eb4100e90 2023-10-14T08:50:58.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb419ee30 con 0x7f3eb4100e90 2023-10-14T08:50:58.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac005330 con 0x7f3eb4100e90 2023-10-14T08:50:58.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.062+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb419f1f0 con 0x7f3eb4100e90 2023-10-14T08:50:58.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.063+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb41084f0 con 0x7f3eb4100e90 2023-10-14T08:50:58.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.064+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3eac01d9c0 con 0x7f3eb4100e90 2023-10-14T08:50:58.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.065+0000 7f3eb0ff9700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3ea00a1480 0x7f3ea00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:50:58.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.065+0000 7f3eb2ffd700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3ea00a1480 0x7f3ea00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:50:58.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.065+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3eac0ce800 con 0x7f3eb4100e90 2023-10-14T08:50:58.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.065+0000 7f3eb2ffd700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3ea00a1480 0x7f3ea00a3940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4100bb0 tx=0x7f3e9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:50:58.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.069+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3eac0982f0 con 0x7f3eb4100e90 2023-10-14T08:50:58.133 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 08:50:57 smithi178 podman[141432]: 2023-10-14T08:50:58.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.318+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3eb410c9c0 con 0x7f3eb4100e90 2023-10-14T08:50:58.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.318+0000 7f3eb0ff9700 1 -- 172.21.15.6:0/3689755110 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f3eac09b910 con 0x7f3eb4100e90 2023-10-14T08:50:58.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:50:58.320 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-14T08:50:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3ea00a1480 msgr2=0x7f3ea00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3ea00a1480 0x7f3ea00a3940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4100bb0 tx=0x7f3e9c009260 comp rx=0 tx=0).stop 2023-10-14T08:50:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 msgr2=0x7f3eb4196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:50:58.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb4196d60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00b780 tx=0x7f3eac00bd60 comp rx=0 tx=0).stop 2023-10-14T08:50:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 shutdown_connections 2023-10-14T08:50:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3ea00a1480 0x7f3ea00a3940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3eb4102a30 0x7f3eb419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3eb4100e90 0x7f3eb4196d60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 --2- 172.21.15.6:0/3689755110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb4102070 0x7f3eb41972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:50:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 >> 172.21.15.6:0/3689755110 conn(0x7f3eb40fc410 msgr2=0x7f3eb4105630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:50:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.320+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 shutdown_connections 2023-10-14T08:50:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:50:58.321+0000 7f3eba11d700 1 -- 172.21.15.6:0/3689755110 wait complete. 2023-10-14T08:50:58.324 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2023-10-14T08:50:58.458 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mds[141472]: -- 172.21.15.178:0/284253946 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5652ef75b1e0 con 0x5652ef731000 2023-10-14T08:50:58.459 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 08:50:58 smithi178 bash[141432]: 7131aaf1f5a7edc6754f6c8d75ab457663099d7916c27f89ad89c4f91e9c874a 2023-10-14T08:50:58.459 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f[141448]: starting mds.f at 2023-10-14T08:50:58.459 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 08:50:58 smithi178 systemd[1]: Started Ceph mds.f for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:50:58.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:58.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3689755110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:58.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:58.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:58.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:58 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:58.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:58.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3689755110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:58.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:58.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:58.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:58 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:58.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:50:58.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3689755110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:50:58.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:50:58.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:50:58.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:50:58.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:58 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:50:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:59 smithi178 ceph-mon[103612]: Deploying daemon mds.c on smithi178 2023-10-14T08:50:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:59 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6834/4072673445,v1:172.21.15.178:6835/4072673445] up:boot 2023-10-14T08:50:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:59 smithi178 ceph-mon[103612]: fsmap 6 up:standby 2023-10-14T08:50:59.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:50:59 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-14T08:50:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:59 smithi006 ceph-mon[99452]: Deploying daemon mds.c on smithi178 2023-10-14T08:50:59.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:59 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6834/4072673445,v1:172.21.15.178:6835/4072673445] up:boot 2023-10-14T08:50:59.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:59 smithi006 ceph-mon[99452]: fsmap 6 up:standby 2023-10-14T08:50:59.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:50:59 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-14T08:50:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:59 smithi057 ceph-mon[103313]: Deploying daemon mds.c on smithi178 2023-10-14T08:50:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:59 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6834/4072673445,v1:172.21.15.178:6835/4072673445] up:boot 2023-10-14T08:50:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:59 smithi057 ceph-mon[103313]: fsmap 6 up:standby 2023-10-14T08:50:59.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:50:59 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-14T08:51:00.218 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 08:50:59 smithi178 systemd[1]: Starting Ceph mds.c for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:51:00.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:00.474 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 08:51:00 smithi178 podman[141771]: 2023-10-14T08:51:00.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/2368129823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b0106c20 msgr2=0x7fb5b0109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:00.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/2368129823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b0106c20 0x7fb5b0109030 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800b0a0 tx=0x7fb5a800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/2368129823 shutdown_connections 2023-10-14T08:51:00.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/2368129823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b0106c20 0x7fb5b0109030 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/2368129823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b01019c0 0x7fb5b0103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/2368129823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5b01042f0 0x7fb5b01066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/2368129823 >> 172.21.15.6:0/2368129823 conn(0x7fb5b00fb310 msgr2=0x7fb5b00fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:00.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/2368129823 shutdown_connections 2023-10-14T08:51:00.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.476+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/2368129823 wait complete. 2023-10-14T08:51:00.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 Processor -- start 2023-10-14T08:51:00.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 -- start start 2023-10-14T08:51:00.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5b01019c0 0x7fb5b0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:00.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 0x7fb5b01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:00.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b0106c20 0x7fb5b019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:00.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b019e800 con 0x7fb5b01042f0 2023-10-14T08:51:00.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b019e970 con 0x7fb5b0106c20 2023-10-14T08:51:00.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5b5cd4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b019eb30 con 0x7fb5b01019c0 2023-10-14T08:51:00.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 0x7fb5b01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:00.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 0x7fb5b01971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59132/0 (socket says 172.21.15.6:59132) 2023-10-14T08:51:00.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 -- 172.21.15.6:0/851201031 learned_addr learned my addr 172.21.15.6:0/851201031 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:00.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5af7fe700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5b01019c0 0x7fb5b0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:00.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5affff700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b0106c20 0x7fb5b019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:00.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 -- 172.21.15.6:0/851201031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5b01019c0 msgr2=0x7fb5b0196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:00.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5b01019c0 0x7fb5b0196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 -- 172.21.15.6:0/851201031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b0106c20 msgr2=0x7fb5b019e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:00.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b0106c20 0x7fb5b019e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5aeffd700 1 -- 172.21.15.6:0/851201031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a8009d00 con 0x7fb5b01042f0 2023-10-14T08:51:00.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.477+0000 7fb5affff700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b0106c20 0x7fb5b019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:00.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.478+0000 7fb5aeffd700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 0x7fb5b01971d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400e9a0 tx=0x7fb5a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:00.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.478+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4009790 con 0x7fb5b01042f0 2023-10-14T08:51:00.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.478+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb5a400cbd0 con 0x7fb5b01042f0 2023-10-14T08:51:00.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.478+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b019ee10 con 0x7fb5b01042f0 2023-10-14T08:51:00.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.478+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4018680 con 0x7fb5b01042f0 2023-10-14T08:51:00.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.478+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b019f2e0 con 0x7fb5b01042f0 2023-10-14T08:51:00.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.479+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b00fce90 con 0x7fb5b01042f0 2023-10-14T08:51:00.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.480+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb5a400cd40 con 0x7fb5b01042f0 2023-10-14T08:51:00.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.481+0000 7fb5acff9700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb5980a1500 0x7fb5980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:00.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.481+0000 7fb5af7fe700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb5980a1500 0x7fb5980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:00.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.481+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb5a4014070 con 0x7fb5b01042f0 2023-10-14T08:51:00.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.481+0000 7fb5af7fe700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb5980a1500 0x7fb5980a39c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0197b60 tx=0x7fb5a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:00.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.485+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb5a4052100 con 0x7fb5b01042f0 2023-10-14T08:51:00.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:00 smithi006 ceph-mon[99452]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:00.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.737+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5b010c6c0 con 0x7fb5b01042f0 2023-10-14T08:51:00.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.737+0000 7fb5acff9700 1 -- 172.21.15.6:0/851201031 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7fb5a4096530 con 0x7fb5b01042f0 2023-10-14T08:51:00.739 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:00.740 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-14T08:51:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.739+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb5980a1500 msgr2=0x7fb5980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.739+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb5980a1500 0x7fb5980a39c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0197b60 tx=0x7fb5a0009260 comp rx=0 tx=0).stop 2023-10-14T08:51:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.739+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 msgr2=0x7fb5b01971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.739+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 0x7fb5b01971d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400e9a0 tx=0x7fb5a400ecb0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 shutdown_connections 2023-10-14T08:51:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb5980a1500 0x7fb5980a39c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5b0106c20 0x7fb5b019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5b01019c0 0x7fb5b0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 --2- 172.21.15.6:0/851201031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5b01042f0 0x7fb5b01971d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 >> 172.21.15.6:0/851201031 conn(0x7fb5b00fb310 msgr2=0x7fb5b0102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 shutdown_connections 2023-10-14T08:51:00.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:00.740+0000 7fb5b5cd4700 1 -- 172.21.15.6:0/851201031 wait complete. 2023-10-14T08:51:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-10-14T08:51:00.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:00 smithi178 ceph-mon[103612]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:00.884 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 08:51:00 smithi178 ceph-mds[141811]: -- 172.21.15.178:0/3391647450 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5578d8ce11e0 con 0x5578d8cb6c00 2023-10-14T08:51:00.884 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 08:51:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c[141787]: starting mds.c at 2023-10-14T08:51:00.884 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 08:51:00 smithi178 bash[141771]: f3ba4991d74269a5c8c772678804e98df162e2df9afbed28bbe04dcec7269fa5 2023-10-14T08:51:00.885 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 08:51:00 smithi178 systemd[1]: Started Ceph mds.c for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:51:00.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:00 smithi057 ceph-mon[103313]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:01.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:01.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:01.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:01.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:01.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: Deploying daemon mds.h on smithi057 2023-10-14T08:51:01.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/851201031' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:01.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6836/4069767165,v1:172.21.15.178:6837/4069767165] up:boot 2023-10-14T08:51:01.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: fsmap 7 up:standby 2023-10-14T08:51:01.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:01 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-14T08:51:01.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:01.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:01.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:01.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:01.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:01.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:01.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: Deploying daemon mds.h on smithi057 2023-10-14T08:51:01.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/851201031' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:01.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6836/4069767165,v1:172.21.15.178:6837/4069767165] up:boot 2023-10-14T08:51:01.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: fsmap 7 up:standby 2023-10-14T08:51:01.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:01 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-14T08:51:02.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:02.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:02.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:02.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:02.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:02.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:02.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: Deploying daemon mds.h on smithi057 2023-10-14T08:51:02.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/851201031' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:02.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6836/4069767165,v1:172.21.15.178:6837/4069767165] up:boot 2023-10-14T08:51:02.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: fsmap 7 up:standby 2023-10-14T08:51:02.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:01 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-14T08:51:02.516 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 08:51:02 smithi057 systemd[1]: Starting Ceph mds.h for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:51:02.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:02.817 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 08:51:02 smithi057 podman[140317]: 2023-10-14T08:51:02.817 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 08:51:02 smithi057 bash[140317]: c480398994ddf83acf4aa5b9279af2f7c6c8f49d857570cfb5942657cea1a3c9 2023-10-14T08:51:02.818 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 08:51:02 smithi057 ceph-mds[140357]: -- 172.21.15.57:0/1978443026 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557bdac9f1e0 con 0x557bdac74800 2023-10-14T08:51:02.818 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 08:51:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h[140333]: starting mds.h at 2023-10-14T08:51:02.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 -- 172.21.15.6:0/2610094745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100110 msgr2=0x7fc794100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 --2- 172.21.15.6:0/2610094745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100110 0x7fc794100590 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc7880099c0 tx=0x7fc788009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 -- 172.21.15.6:0/2610094745 shutdown_connections 2023-10-14T08:51:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 --2- 172.21.15.6:0/2610094745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc794100ad0 0x7fc794100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:02.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 --2- 172.21.15.6:0/2610094745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc7940ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:02.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 --2- 172.21.15.6:0/2610094745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100110 0x7fc794100590 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:02.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 -- 172.21.15.6:0/2610094745 >> 172.21.15.6:0/2610094745 conn(0x7fc7940fb310 msgr2=0x7fc7940fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:02.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 -- 172.21.15.6:0/2610094745 shutdown_connections 2023-10-14T08:51:02.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.898+0000 7fc79976a700 1 -- 172.21.15.6:0/2610094745 wait complete. 2023-10-14T08:51:02.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 Processor -- start 2023-10-14T08:51:02.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 -- start start 2023-10-14T08:51:02.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc794198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:02.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc794100110 0x7fc794199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:02.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 0x7fc7941a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7941a0950 con 0x7fc794100ad0 2023-10-14T08:51:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7941a0a90 con 0x7fc7940ff7b0 2023-10-14T08:51:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc79976a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7941a0c20 con 0x7fc794100110 2023-10-14T08:51:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc7937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 0x7fc7941a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:02.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc794198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:02.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc7937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 0x7fc7941a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59148/0 (socket says 172.21.15.6:59148) 2023-10-14T08:51:02.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc794198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:57902/0 (socket says 172.21.15.6:57902) 2023-10-14T08:51:02.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc7927fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc794100110 0x7fc794199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:02.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc7937fe700 1 -- 172.21.15.6:0/2623486628 learned_addr learned my addr 172.21.15.6:0/2623486628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:02.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 -- 172.21.15.6:0/2623486628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc794100110 msgr2=0x7fc794199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc794100110 0x7fc794199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 -- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 msgr2=0x7fc7941a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 0x7fc7941a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc792ffd700 1 -- 172.21.15.6:0/2623486628 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880095f0 con 0x7fc7940ff7b0 2023-10-14T08:51:02.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.899+0000 7fc7937fe700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 0x7fc7941a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.900+0000 7fc792ffd700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc794198dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc78400e9f0 tx=0x7fc78400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.900+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400c9c0 con 0x7fc7940ff7b0 2023-10-14T08:51:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.900+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc784010430 con 0x7fc7940ff7b0 2023-10-14T08:51:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.900+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7941a0f00 con 0x7fc7940ff7b0 2023-10-14T08:51:02.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.900+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784018680 con 0x7fc7940ff7b0 2023-10-14T08:51:02.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.900+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7941a1330 con 0x7fc7940ff7b0 2023-10-14T08:51:02.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.901+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79410a590 con 0x7fc7940ff7b0 2023-10-14T08:51:02.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.902+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc78400cb20 con 0x7fc7940ff7b0 2023-10-14T08:51:02.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.902+0000 7fc77bfff700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc77c0a1500 0x7fc77c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:02.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.903+0000 7fc7927fc700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc77c0a1500 0x7fc77c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:02.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.903+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc784014070 con 0x7fc7940ff7b0 2023-10-14T08:51:02.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.903+0000 7fc7927fc700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc77c0a1500 0x7fc77c0a39c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc78800b580 tx=0x7fc788005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:02.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:02.907+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc784052100 con 0x7fc7940ff7b0 2023-10-14T08:51:03.103 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 08:51:02 smithi057 systemd[1]: Started Ceph mds.h for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:51:03.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.154+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc79410e920 con 0x7fc7940ff7b0 2023-10-14T08:51:03.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.156+0000 7fc77bfff700 1 -- 172.21.15.6:0/2623486628 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6865 (secure 0 0 0) 0x7fc7840963f0 con 0x7fc7940ff7b0 2023-10-14T08:51:03.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:03.157 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-14T08:51:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc77c0a1500 msgr2=0x7fc77c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc77c0a1500 0x7fc77c0a39c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc78800b580 tx=0x7fc788005fb0 comp rx=0 tx=0).stop 2023-10-14T08:51:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 msgr2=0x7fc794198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:03.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc794198dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc78400e9f0 tx=0x7fc78400ed00 comp rx=0 tx=0).stop 2023-10-14T08:51:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 shutdown_connections 2023-10-14T08:51:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc794100ad0 0x7fc7941a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc77c0a1500 0x7fc77c0a39c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7940ff7b0 0x7fc794198dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:03.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 --2- 172.21.15.6:0/2623486628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc794100110 0x7fc794199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 >> 172.21.15.6:0/2623486628 conn(0x7fc7940fb310 msgr2=0x7fc7940fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 shutdown_connections 2023-10-14T08:51:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:03.157+0000 7fc79976a700 1 -- 172.21.15.6:0/2623486628 wait complete. 2023-10-14T08:51:03.161 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-10-14T08:51:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:03.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:03.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:03.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:04.254 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:04 smithi178 ceph-mon[103612]: Deploying daemon mds.i on smithi178 2023-10-14T08:51:04.254 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:04 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] up:boot 2023-10-14T08:51:04.255 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:04 smithi178 ceph-mon[103612]: fsmap 8 up:standby 2023-10-14T08:51:04.255 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-14T08:51:04.255 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:04 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2623486628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:04.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:04 smithi057 ceph-mon[103313]: Deploying daemon mds.i on smithi178 2023-10-14T08:51:04.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:04 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] up:boot 2023-10-14T08:51:04.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:04 smithi057 ceph-mon[103313]: fsmap 8 up:standby 2023-10-14T08:51:04.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-14T08:51:04.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:04 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2623486628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:04.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:04 smithi006 ceph-mon[99452]: Deploying daemon mds.i on smithi178 2023-10-14T08:51:04.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:04 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] up:boot 2023-10-14T08:51:04.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:04 smithi006 ceph-mon[99452]: fsmap 8 up:standby 2023-10-14T08:51:04.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-14T08:51:04.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:04 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2623486628' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:04.634 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:04 smithi178 systemd[1]: Starting Ceph mds.i for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:51:05.060 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:04 smithi178 podman[142120]: 2023-10-14T08:51:05.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 -- 172.21.15.6:0/1020372454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101a00 msgr2=0x7f8688103df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 --2- 172.21.15.6:0/1020372454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101a00 0x7f8688103df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8678009990 tx=0x7f8678009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 -- 172.21.15.6:0/1020372454 shutdown_connections 2023-10-14T08:51:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 --2- 172.21.15.6:0/1020372454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8688106c60 0x7f8688109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 --2- 172.21.15.6:0/1020372454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101a00 0x7f8688103df0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 --2- 172.21.15.6:0/1020372454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8688104330 0x7f8688106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 -- 172.21.15.6:0/1020372454 >> 172.21.15.6:0/1020372454 conn(0x7f86880fb310 msgr2=0x7f86880fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 -- 172.21.15.6:0/1020372454 shutdown_connections 2023-10-14T08:51:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 -- 172.21.15.6:0/1020372454 wait complete. 2023-10-14T08:51:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.313+0000 7f868e4c4700 1 Processor -- start 2023-10-14T08:51:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 -- start start 2023-10-14T08:51:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8688101a00 0x7f8688196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8688104330 0x7f86881970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 0x7f868819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819e720 con 0x7f8688106c60 2023-10-14T08:51:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819e860 con 0x7f8688101a00 2023-10-14T08:51:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868e4c4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819e9f0 con 0x7f8688104330 2023-10-14T08:51:05.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868ca61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 0x7f868819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868ca61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 0x7f868819e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59162/0 (socket says 172.21.15.6:59162) 2023-10-14T08:51:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868ca61700 1 -- 172.21.15.6:0/3552261332 learned_addr learned my addr 172.21.15.6:0/3552261332 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f86877fe700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8688104330 0x7f86881970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f8687fff700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8688101a00 0x7f8688196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:05.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868ca61700 1 -- 172.21.15.6:0/3552261332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8688104330 msgr2=0x7f86881970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.314+0000 7f868ca61700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8688104330 0x7f86881970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f868ca61700 1 -- 172.21.15.6:0/3552261332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8688101a00 msgr2=0x7f8688196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f868ca61700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8688101a00 0x7f8688196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f868ca61700 1 -- 172.21.15.6:0/3552261332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780095f0 con 0x7f8688106c60 2023-10-14T08:51:05.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f868ca61700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 0x7f868819e150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8680007ee0 tx=0x7f868000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000dd20 con 0x7f8688106c60 2023-10-14T08:51:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868819ecd0 con 0x7f8688106c60 2023-10-14T08:51:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f868000f040 con 0x7f8688106c60 2023-10-14T08:51:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800048a0 con 0x7f8688106c60 2023-10-14T08:51:05.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.315+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868819f190 con 0x7f8688106c60 2023-10-14T08:51:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.316+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880fce90 con 0x7f8688106c60 2023-10-14T08:51:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.317+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8680003a00 con 0x7f8688106c60 2023-10-14T08:51:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.318+0000 7f86857fa700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86700a1480 0x7f86700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.318+0000 7f8687fff700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86700a1480 0x7f86700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:05.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.318+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f86800cc990 con 0x7f8688106c60 2023-10-14T08:51:05.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.318+0000 7f8687fff700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86700a1480 0x7f86700a3940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f867800b5c0 tx=0x7f8678005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:05.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.325+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86800963f0 con 0x7f8688106c60 2023-10-14T08:51:05.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:05 smithi178 ceph-mon[103612]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:05.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:05 smithi178 ceph-mds[142160]: -- 172.21.15.178:0/1105222013 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563b730e71e0 con 0x563b730bd000 2023-10-14T08:51:05.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: starting mds.i at 2023-10-14T08:51:05.385 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:05 smithi178 bash[142120]: e45f2816f16dd55cdc45bfc7fd808c52e7566cafb740de52c6f85bdeefcd7303 2023-10-14T08:51:05.385 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:05 smithi178 systemd[1]: Started Ceph mds.i for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:51:05.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:05 smithi057 ceph-mon[103313]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:05.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:05 smithi006 ceph-mon[99452]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.579+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f868810c6c0 con 0x7f8688106c60 2023-10-14T08:51:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.580+0000 7f86857fa700 1 -- 172.21.15.6:0/3552261332 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7661 (secure 0 0 0) 0x7f8680099a10 con 0x7f8688106c60 2023-10-14T08:51:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:05.582 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-14T08:51:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86700a1480 msgr2=0x7f86700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86700a1480 0x7f86700a3940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f867800b5c0 tx=0x7f8678005fd0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 msgr2=0x7f868819e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 0x7f868819e150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8680007ee0 tx=0x7f868000d3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 shutdown_connections 2023-10-14T08:51:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688106c60 0x7f868819e150 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86700a1480 0x7f86700a3940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8688101a00 0x7f8688196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 --2- 172.21.15.6:0/3552261332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8688104330 0x7f86881970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 >> 172.21.15.6:0/3552261332 conn(0x7f86880fb310 msgr2=0x7f8688102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 shutdown_connections 2023-10-14T08:51:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:05.583+0000 7f868e4c4700 1 -- 172.21.15.6:0/3552261332 wait complete. 2023-10-14T08:51:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 10 2023-10-14T08:51:06.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] up:boot 2023-10-14T08:51:06.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: fsmap 9 up:standby 2023-10-14T08:51:06.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-14T08:51:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:06.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: Deploying daemon mds.g on smithi006 2023-10-14T08:51:06.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:06 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3552261332' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:06.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] up:boot 2023-10-14T08:51:06.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: fsmap 9 up:standby 2023-10-14T08:51:06.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-14T08:51:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:06.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: Deploying daemon mds.g on smithi006 2023-10-14T08:51:06.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:06 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3552261332' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:06.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] up:boot 2023-10-14T08:51:06.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: fsmap 9 up:standby 2023-10-14T08:51:06.455 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-14T08:51:06.455 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.455 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.455 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:06.455 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:06.455 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:06.456 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:06.456 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: Deploying daemon mds.g on smithi006 2023-10-14T08:51:06.456 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:06 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3552261332' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:06.705 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 08:51:06 smithi006 systemd[1]: Starting Ceph mds.g for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:51:07.294 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:07 smithi006 ceph-mon[99452]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:07.295 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 08:51:06 smithi006 podman[149793]: 2023-10-14T08:51:07.295 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 08:51:07 smithi006 bash[149793]: 9c38f192d2629bf3a07087104c9fb265df42563c3cd4378737fed0d4104710c1 2023-10-14T08:51:07.295 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 08:51:07 smithi006 ceph-mds[149833]: -- 172.21.15.6:0/2573891342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5582baebb1e0 con 0x5582bae91000 2023-10-14T08:51:07.295 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 08:51:07 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: starting mds.g at 2023-10-14T08:51:07.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:07 smithi057 ceph-mon[103313]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:07.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:07.630 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 08:51:07 smithi006 systemd[1]: Started Ceph mds.g for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:51:07.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:07 smithi178 ceph-mon[103612]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 -- 172.21.15.6:0/3379714095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102a30 msgr2=0x7f9b00109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3379714095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102a30 0x7f9b00109350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9af800b0a0 tx=0x7f9af800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 -- 172.21.15.6:0/3379714095 shutdown_connections 2023-10-14T08:51:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3379714095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102a30 0x7f9b00109350 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3379714095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b00100e90 0x7f9b001012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3379714095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00102070 0x7f9b001024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 -- 172.21.15.6:0/3379714095 >> 172.21.15.6:0/3379714095 conn(0x7f9b000fc430 msgr2=0x7f9b000fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 -- 172.21.15.6:0/3379714095 shutdown_connections 2023-10-14T08:51:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.732+0000 7f9b071f8700 1 -- 172.21.15.6:0/3379714095 wait complete. 2023-10-14T08:51:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 Processor -- start 2023-10-14T08:51:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 -- start start 2023-10-14T08:51:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00100e90 0x7f9b00196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 0x7f9b001971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b00102a30 0x7f9b0019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0019e7b0 con 0x7f9b00102070 2023-10-14T08:51:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0019e920 con 0x7f9b00102a30 2023-10-14T08:51:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.733+0000 7f9b071f8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0019eae0 con 0x7f9b00100e90 2023-10-14T08:51:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 0x7f9b001971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 0x7f9b001971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59184/0 (socket says 172.21.15.6:59184) 2023-10-14T08:51:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 -- 172.21.15.6:0/3462401358 learned_addr learned my addr 172.21.15.6:0/3462401358 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9b05795700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b00102a30 0x7f9b0019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:07.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9b04f94700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00100e90 0x7f9b00196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 -- 172.21.15.6:0/3462401358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00100e90 msgr2=0x7f9b00196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00100e90 0x7f9b00196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 -- 172.21.15.6:0/3462401358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b00102a30 msgr2=0x7f9b0019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b00102a30 0x7f9b0019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:07.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 -- 172.21.15.6:0/3462401358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009d00 con 0x7f9b00102070 2023-10-14T08:51:07.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9b04f94700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00100e90 0x7f9b00196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:07.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afffff700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 0x7f9b001971b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00d980 tx=0x7f9aec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:07.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec004020 con 0x7f9b00102070 2023-10-14T08:51:07.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9aec009730 con 0x7f9b00102070 2023-10-14T08:51:07.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0019edc0 con 0x7f9b00102070 2023-10-14T08:51:07.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.734+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec003a80 con 0x7f9b00102070 2023-10-14T08:51:07.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.735+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0019f210 con 0x7f9b00102070 2023-10-14T08:51:07.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.735+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0010c700 con 0x7f9b00102070 2023-10-14T08:51:07.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.737+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9aec0098a0 con 0x7f9b00102070 2023-10-14T08:51:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.737+0000 7f9afdffb700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9af00a1480 0x7f9af00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.738+0000 7f9b04f94700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9af00a1480 0x7f9af00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.738+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9aec0cc8e0 con 0x7f9b00102070 2023-10-14T08:51:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.738+0000 7f9b04f94700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9af00a1480 0x7f9af00a3940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005fd0 tx=0x7f9af4005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:07.741+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9aec0963e0 con 0x7f9b00102070 2023-10-14T08:51:08.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.027+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b00107d90 con 0x7f9b00102070 2023-10-14T08:51:08.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.028+0000 7f9afdffb700 1 -- 172.21.15.6:0/3462401358 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7661 (secure 0 0 0) 0x7f9aec099a00 con 0x7f9b00102070 2023-10-14T08:51:08.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:08.030 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-14T08:51:08.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9af00a1480 msgr2=0x7f9af00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9af00a1480 0x7f9af00a3940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005fd0 tx=0x7f9af4005dd0 comp rx=0 tx=0).stop 2023-10-14T08:51:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 msgr2=0x7f9b001971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 0x7f9b001971b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00d980 tx=0x7f9aec00dc90 comp rx=0 tx=0).stop 2023-10-14T08:51:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 shutdown_connections 2023-10-14T08:51:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9af00a1480 0x7f9af00a3940 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b00102a30 0x7f9b0019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b00100e90 0x7f9b00196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 --2- 172.21.15.6:0/3462401358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b00102070 0x7f9b001971b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 >> 172.21.15.6:0/3462401358 conn(0x7f9b000fc430 msgr2=0x7f9b000fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 shutdown_connections 2023-10-14T08:51:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:08.030+0000 7f9b071f8700 1 -- 172.21.15.6:0/3462401358 wait complete. 2023-10-14T08:51:08.034 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 10 2023-10-14T08:51:08.594 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.594 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.595 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.595 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:08.595 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:08.595 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:08.595 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: Deploying daemon mds.a on smithi006 2023-10-14T08:51:08.596 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:08.596 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3462401358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:08.596 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.6:6838/977658940,v1:172.21.15.6:6839/977658940] up:boot 2023-10-14T08:51:08.596 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: fsmap 10 up:standby 2023-10-14T08:51:08.596 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:08 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-14T08:51:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:08.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:08.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:08.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: Deploying daemon mds.a on smithi006 2023-10-14T08:51:08.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:08.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3462401358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:08.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.6:6838/977658940,v1:172.21.15.6:6839/977658940] up:boot 2023-10-14T08:51:08.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: fsmap 10 up:standby 2023-10-14T08:51:08.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:08 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-14T08:51:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:08.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:08.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:08.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: Deploying daemon mds.a on smithi006 2023-10-14T08:51:08.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:08.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3462401358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:08.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.6:6838/977658940,v1:172.21.15.6:6839/977658940] up:boot 2023-10-14T08:51:08.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: fsmap 10 up:standby 2023-10-14T08:51:08.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:08 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-14T08:51:09.232 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 08:51:08 smithi006 systemd[1]: Starting Ceph mds.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:51:09.510 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 08:51:09 smithi006 podman[150181]: 2023-10-14T08:51:09.511 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 08:51:09 smithi006 bash[150181]: ceec0bf7d2c6e20e5a958bbf9f25c145a87c7b9ab37edc18923e4693163312e5 2023-10-14T08:51:09.511 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 08:51:09 smithi006 ceph-mds[150221]: -- 172.21.15.6:0/3423109289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5616606651e0 con 0x56166063ac00 2023-10-14T08:51:09.511 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 08:51:09 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a[150197]: starting mds.a at 2023-10-14T08:51:09.981 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 08:51:09 smithi006 systemd[1]: Started Ceph mds.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:51:10.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:10.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.182+0000 7fd80e94d700 1 -- 172.21.15.6:0/2222393573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8080ffe20 msgr2=0x7fd808100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:10.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.182+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2222393573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8080ffe20 0x7fd808100240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009990 tx=0x7fd7f8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.182+0000 7fd80e94d700 1 -- 172.21.15.6:0/2222393573 shutdown_connections 2023-10-14T08:51:10.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.182+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2222393573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd808101930 0x7fd808108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.182+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2222393573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8080ffe20 0x7fd808100240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.182+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2222393573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd808100f70 0x7fd8081013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.183+0000 7fd80e94d700 1 -- 172.21.15.6:0/2222393573 >> 172.21.15.6:0/2222393573 conn(0x7fd8080fb370 msgr2=0x7fd8080fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:10.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.183+0000 7fd80e94d700 1 -- 172.21.15.6:0/2222393573 shutdown_connections 2023-10-14T08:51:10.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.183+0000 7fd80e94d700 1 -- 172.21.15.6:0/2222393573 wait complete. 2023-10-14T08:51:10.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.183+0000 7fd80e94d700 1 Processor -- start 2023-10-14T08:51:10.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.183+0000 7fd80e94d700 1 -- start start 2023-10-14T08:51:10.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8080ffe20 0x7fd808195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:10.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 0x7fd8081960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:10.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd808101930 0x7fd80819d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80819d710 con 0x7fd808100f70 2023-10-14T08:51:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80819d850 con 0x7fd808101930 2023-10-14T08:51:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80819d9e0 con 0x7fd8080ffe20 2023-10-14T08:51:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 0x7fd8081960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 0x7fd8081960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59212/0 (socket says 172.21.15.6:59212) 2023-10-14T08:51:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 -- 172.21.15.6:0/2608726369 learned_addr learned my addr 172.21.15.6:0/2608726369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd807fff700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8080ffe20 0x7fd808195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80ceea700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd808101930 0x7fd80819d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 -- 172.21.15.6:0/2608726369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8080ffe20 msgr2=0x7fd808195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8080ffe20 0x7fd808195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 -- 172.21.15.6:0/2608726369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd808101930 msgr2=0x7fd80819d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd808101930 0x7fd80819d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 -- 172.21.15.6:0/2608726369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80095f0 con 0x7fd808100f70 2023-10-14T08:51:10.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd807fff700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8080ffe20 0x7fd808195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:10.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8077fe700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 0x7fd8081960d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00d950 tx=0x7fd7fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:10.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc009940 con 0x7fd808100f70 2023-10-14T08:51:10.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7fc010460 con 0x7fd808100f70 2023-10-14T08:51:10.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80819dcc0 con 0x7fd808100f70 2023-10-14T08:51:10.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00f620 con 0x7fd808100f70 2023-10-14T08:51:10.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.184+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80819e1d0 con 0x7fd808100f70 2023-10-14T08:51:10.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.185+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8081073d0 con 0x7fd808100f70 2023-10-14T08:51:10.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.186+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd7fc0108d0 con 0x7fd808100f70 2023-10-14T08:51:10.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.187+0000 7fd8057fa700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7f00a1480 0x7fd7f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:10.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.187+0000 7fd807fff700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7f00a1480 0x7fd7f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:10.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.187+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd7fc0cc710 con 0x7fd808100f70 2023-10-14T08:51:10.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.187+0000 7fd807fff700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7f00a1480 0x7fd7f00a3940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b5c0 tx=0x7fd7f8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:10.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.190+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd7fc096170 con 0x7fd808100f70 2023-10-14T08:51:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.438+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd80810b940 con 0x7fd808100f70 2023-10-14T08:51:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.438+0000 7fd8057fa700 1 -- 172.21.15.6:0/2608726369 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8447 (secure 0 0 0) 0x7fd7fc099790 con 0x7fd808100f70 2023-10-14T08:51:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:10.441 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-14T08:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.440+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7f00a1480 msgr2=0x7fd7f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.440+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7f00a1480 0x7fd7f00a3940 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800b5c0 tx=0x7fd7f8005fb0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.440+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 msgr2=0x7fd8081960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.440+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 0x7fd8081960d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00d950 tx=0x7fd7fc00dc60 comp rx=0 tx=0).stop 2023-10-14T08:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 shutdown_connections 2023-10-14T08:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7f00a1480 0x7fd7f00a3940 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd808101930 0x7fd80819d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8080ffe20 0x7fd808195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 --2- 172.21.15.6:0/2608726369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd808100f70 0x7fd8081960d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 >> 172.21.15.6:0/2608726369 conn(0x7fd8080fb370 msgr2=0x7fd808104510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 shutdown_connections 2023-10-14T08:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:10.441+0000 7fd80e94d700 1 -- 172.21.15.6:0/2608726369 wait complete. 2023-10-14T08:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 11 2023-10-14T08:51:10.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:10.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: Deploying daemon mds.b on smithi057 2023-10-14T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2608726369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.6:6840/4202282219,v1:172.21.15.6:6841/4202282219] up:boot 2023-10-14T08:51:10.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: fsmap 11 up:standby 2023-10-14T08:51:10.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:10 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-14T08:51:10.843 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:10.844 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.844 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.844 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.844 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:10.844 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:10.845 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:10.845 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: Deploying daemon mds.b on smithi057 2023-10-14T08:51:10.845 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2608726369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:10.845 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.6:6840/4202282219,v1:172.21.15.6:6841/4202282219] up:boot 2023-10-14T08:51:10.845 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: fsmap 11 up:standby 2023-10-14T08:51:10.846 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:10 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-14T08:51:10.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:10.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:10.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-14T08:51:10.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-14T08:51:10.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:10.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: Deploying daemon mds.b on smithi057 2023-10-14T08:51:10.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2608726369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:10.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.6:6840/4202282219,v1:172.21.15.6:6841/4202282219] up:boot 2023-10-14T08:51:10.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: fsmap 11 up:standby 2023-10-14T08:51:10.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:10 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-14T08:51:11.389 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:51:11 smithi057 systemd[1]: Starting Ceph mds.b for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T08:51:11.670 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:51:11 smithi057 podman[140656]: 2023-10-14T08:51:11.944 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:51:11 smithi057 bash[140656]: d6a104350c918e5086e03a94f090bf039a7e5fb47e2c7b9edc86f3b9d76b8dec 2023-10-14T08:51:11.944 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:51:11 smithi057 ceph-mds[140696]: -- 172.21.15.57:0/2021155333 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55883a8e31e0 con 0x55883a8b9000 2023-10-14T08:51:11.944 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:51:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: starting mds.b at 2023-10-14T08:51:11.945 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:51:11 smithi057 systemd[1]: Started Ceph mds.b for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T08:51:12.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:12.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 -- 172.21.15.6:0/927467864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c100a20 msgr2=0x7faa8c1082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:12.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 --2- 172.21.15.6:0/927467864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c100a20 0x7faa8c1082e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b0a0 tx=0x7faa8400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 -- 172.21.15.6:0/927467864 shutdown_connections 2023-10-14T08:51:12.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 --2- 172.21.15.6:0/927467864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c100a20 0x7faa8c1082e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 --2- 172.21.15.6:0/927467864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c1013e0 0x7faa8c101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 --2- 172.21.15.6:0/927467864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c100080 0x7faa8c1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 -- 172.21.15.6:0/927467864 >> 172.21.15.6:0/927467864 conn(0x7faa8c0faad0 msgr2=0x7faa8c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 -- 172.21.15.6:0/927467864 shutdown_connections 2023-10-14T08:51:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 -- 172.21.15.6:0/927467864 wait complete. 2023-10-14T08:51:12.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 Processor -- start 2023-10-14T08:51:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.585+0000 7faa91c97700 1 -- start start 2023-10-14T08:51:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c100080 0x7faa8c194ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c100a20 0x7faa8c195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:12.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 0x7faa8c198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:12.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c198620 con 0x7faa8c1013e0 2023-10-14T08:51:12.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c198790 con 0x7faa8c100080 2023-10-14T08:51:12.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c198950 con 0x7faa8c100a20 2023-10-14T08:51:12.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 0x7faa8c198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:12.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 0x7faa8c198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59230/0 (socket says 172.21.15.6:59230) 2023-10-14T08:51:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c100080 0x7faa8c194ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 -- 172.21.15.6:0/3108813163 learned_addr learned my addr 172.21.15.6:0/3108813163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8affd700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c100a20 0x7faa8c195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 -- 172.21.15.6:0/3108813163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c100a20 msgr2=0x7faa8c195000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:12.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c100a20 0x7faa8c195000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 -- 172.21.15.6:0/3108813163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c100080 msgr2=0x7faa8c194ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c100080 0x7faa8c194ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 -- 172.21.15.6:0/3108813163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c009520 con 0x7faa8c1013e0 2023-10-14T08:51:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa8bfff700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 0x7faa8c198050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b780 tx=0x7faa8400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400e040 con 0x7faa8c1013e0 2023-10-14T08:51:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa84009d00 con 0x7faa8c1013e0 2023-10-14T08:51:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa840094a0 con 0x7faa8c1013e0 2023-10-14T08:51:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84005390 con 0x7faa8c1013e0 2023-10-14T08:51:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.586+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c198e10 con 0x7faa8c1013e0 2023-10-14T08:51:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.588+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c068220 con 0x7faa8c1013e0 2023-10-14T08:51:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.588+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7faa8401d470 con 0x7faa8c1013e0 2023-10-14T08:51:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.589+0000 7faa88ff9700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa740a1480 0x7faa740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.589+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faa840ce010 con 0x7faa8c1013e0 2023-10-14T08:51:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.589+0000 7faa8b7fe700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa740a1480 0x7faa740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.590+0000 7faa8b7fe700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa740a1480 0x7faa740a3940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa8c069180 tx=0x7faa8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.594+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faa8c068220 con 0x7faa8c1013e0 2023-10-14T08:51:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.854+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa8c199000 con 0x7faa8c1013e0 2023-10-14T08:51:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.855+0000 7faa88ff9700 1 -- 172.21.15.6:0/3108813163 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10028 (secure 0 0 0) 0x7faa84097ba0 con 0x7faa8c1013e0 2023-10-14T08:51:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:12.857 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24508,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-14T08:51:12.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa740a1480 msgr2=0x7faa740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:12.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa740a1480 0x7faa740a3940 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa8c069180 tx=0x7faa8000b410 comp rx=0 tx=0).stop 2023-10-14T08:51:12.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 msgr2=0x7faa8c198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:12.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 0x7faa8c198050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b780 tx=0x7faa8400bd60 comp rx=0 tx=0).stop 2023-10-14T08:51:12.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 shutdown_connections 2023-10-14T08:51:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c1013e0 0x7faa8c198050 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa740a1480 0x7faa740a3940 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c100080 0x7faa8c194ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 --2- 172.21.15.6:0/3108813163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c100a20 0x7faa8c195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 >> 172.21.15.6:0/3108813163 conn(0x7faa8c0faad0 msgr2=0x7faa8c0fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 shutdown_connections 2023-10-14T08:51:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:12.857+0000 7faa91c97700 1 -- 172.21.15.6:0/3108813163 wait complete. 2023-10-14T08:51:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 13 2023-10-14T08:51:12.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:51:13.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 -- 172.21.15.6:0/2760775659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 msgr2=0x7f6f8c101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2760775659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c101120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0099c0 tx=0x7f6f7c009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 -- 172.21.15.6:0/2760775659 shutdown_connections 2023-10-14T08:51:13.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2760775659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f8c102890 0x7f6f8c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2760775659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c101120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2760775659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f8c101ef0 0x7f6f8c102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 -- 172.21.15.6:0/2760775659 >> 172.21.15.6:0/2760775659 conn(0x7f6f8c0fc270 msgr2=0x7f6f8c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 -- 172.21.15.6:0/2760775659 shutdown_connections 2023-10-14T08:51:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 -- 172.21.15.6:0/2760775659 wait complete. 2023-10-14T08:51:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.000+0000 7f6f91a03700 1 Processor -- start 2023-10-14T08:51:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 -- start start 2023-10-14T08:51:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f8c101ef0 0x7f6f8c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f8c102890 0x7f6f8c19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c19e610 con 0x7f6f8c100d00 2023-10-14T08:51:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c19e750 con 0x7f6f8c101ef0 2023-10-14T08:51:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f91a03700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c19e8e0 con 0x7f6f8c102890 2023-10-14T08:51:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59238/0 (socket says 172.21.15.6:59238) 2023-10-14T08:51:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 -- 172.21.15.6:0/2228364185 learned_addr learned my addr 172.21.15.6:0/2228364185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:13.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8a7fc700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f8c101ef0 0x7f6f8c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8b7fe700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f8c102890 0x7f6f8c19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 -- 172.21.15.6:0/2228364185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f8c102890 msgr2=0x7f6f8c19e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f8c102890 0x7f6f8c19e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 -- 172.21.15.6:0/2228364185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f8c101ef0 msgr2=0x7f6f8c196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f8c101ef0 0x7f6f8c196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 -- 172.21.15.6:0/2228364185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0095f0 con 0x7f6f8c100d00 2023-10-14T08:51:13.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.001+0000 7f6f8affd700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c196a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009990 tx=0x7f6f7c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:13.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.002+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c01d070 con 0x7f6f8c100d00 2023-10-14T08:51:13.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.002+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f7c0054f0 con 0x7f6f8c100d00 2023-10-14T08:51:13.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.002+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c19eb60 con 0x7f6f8c100d00 2023-10-14T08:51:13.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.002+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c004bb0 con 0x7f6f8c100d00 2023-10-14T08:51:13.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.002+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c19efe0 con 0x7f6f8c100d00 2023-10-14T08:51:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.003+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c1082e0 con 0x7f6f8c100d00 2023-10-14T08:51:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.004+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6f7c00fc30 con 0x7f6f8c100d00 2023-10-14T08:51:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.004+0000 7f6f90a01700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6f740a1500 0x7f6f740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.005+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6f7c0cd740 con 0x7f6f8c100d00 2023-10-14T08:51:13.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.005+0000 7f6f8a7fc700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6f740a1500 0x7f6f740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.005+0000 7f6f8a7fc700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6f740a1500 0x7f6f740a39c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009bf0 tx=0x7f6f80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:13.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.009+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f7c097230 con 0x7f6f8c100d00 2023-10-14T08:51:13.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:13.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:51:13.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:boot 2023-10-14T08:51:13.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: fsmap 12 up:standby 2023-10-14T08:51:13.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:12 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-14T08:51:13.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:13.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:51:13.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:boot 2023-10-14T08:51:13.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: fsmap 12 up:standby 2023-10-14T08:51:13.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:12 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-14T08:51:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.220+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f8c10c560 con 0x7f6f8c100d00 2023-10-14T08:51:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.221+0000 7f6f90a01700 1 -- 172.21.15.6:0/2228364185 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18337 (secure 0 0 0) 0x7f6f7c09a850 con 0x7f6f8c100d00 2023-10-14T08:51:13.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:13.223 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:50:35.480696+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:51:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6f740a1500 msgr2=0x7f6f740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6f740a1500 0x7f6f740a39c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f80009bf0 tx=0x7f6f80009260 comp rx=0 tx=0).stop 2023-10-14T08:51:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 msgr2=0x7f6f8c196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c196a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009990 tx=0x7f6f7c00f740 comp rx=0 tx=0).stop 2023-10-14T08:51:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 shutdown_connections 2023-10-14T08:51:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f8c102890 0x7f6f8c19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f8c100d00 0x7f6f8c196a90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6f740a1500 0x7f6f740a39c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.223+0000 7f6f91a03700 1 --2- 172.21.15.6:0/2228364185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f8c101ef0 0x7f6f8c196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.224+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 >> 172.21.15.6:0/2228364185 conn(0x7f6f8c0fc270 msgr2=0x7f6f8c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.224+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 shutdown_connections 2023-10-14T08:51:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.224+0000 7f6f91a03700 1 -- 172.21.15.6:0/2228364185 wait complete. 2023-10-14T08:51:13.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:13.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:51:13.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:boot 2023-10-14T08:51:13.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: fsmap 12 up:standby 2023-10-14T08:51:13.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:12 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-14T08:51:13.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:51:13.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:51:13.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 -- 172.21.15.6:0/776814201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c1019b0 msgr2=0x7f8e0c1082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/776814201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c1019b0 0x7f8e0c1082d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8e0400b0a0 tx=0x7f8e0400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 -- 172.21.15.6:0/776814201 shutdown_connections 2023-10-14T08:51:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/776814201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c1019b0 0x7f8e0c1082d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/776814201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c1002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/776814201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0c100ff0 0x7f8e0c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 -- 172.21.15.6:0/776814201 >> 172.21.15.6:0/776814201 conn(0x7f8e0c0fb430 msgr2=0x7f8e0c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 -- 172.21.15.6:0/776814201 shutdown_connections 2023-10-14T08:51:13.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.375+0000 7f8e10e7c700 1 -- 172.21.15.6:0/776814201 wait complete. 2023-10-14T08:51:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 Processor -- start 2023-10-14T08:51:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 -- start start 2023-10-14T08:51:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0c100ff0 0x7f8e0c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e0c1019b0 0x7f8e0c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c19e8b0 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c19ea20 con 0x7f8e0c1019b0 2023-10-14T08:51:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e10e7c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c19ebe0 con 0x7f8e0c100ff0 2023-10-14T08:51:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e0a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e0a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c068d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59252/0 (socket says 172.21.15.6:59252) 2023-10-14T08:51:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e0a59c700 1 -- 172.21.15.6:0/3885685081 learned_addr learned my addr 172.21.15.6:0/3885685081 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.376+0000 7f8e09d9b700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0c100ff0 0x7f8e0c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0ad9d700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e0c1019b0 0x7f8e0c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0a59c700 1 -- 172.21.15.6:0/3885685081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0c100ff0 msgr2=0x7f8e0c19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0a59c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0c100ff0 0x7f8e0c19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0a59c700 1 -- 172.21.15.6:0/3885685081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e0c1019b0 msgr2=0x7f8e0c19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0a59c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e0c1019b0 0x7f8e0c19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0a59c700 1 -- 172.21.15.6:0/3885685081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04009d00 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e0a59c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c068d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00e9a0 tx=0x7f8dfc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009790 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dfc010430 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c19eec0 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc018680 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.377+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c19f2f0 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.378+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c106d70 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.379+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8dfc0105a0 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.380+0000 7f8dfb7fe700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8df40a1500 0x7f8df40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.380+0000 7f8e09d9b700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8df40a1500 0x7f8df40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.380+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8dfc014070 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.381+0000 7f8e09d9b700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8df40a1500 0x7f8df40a39c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009c60 tx=0x7f8e00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.385+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8dfc096480 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.598+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e0c10b9a0 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.598+0000 7f8dfb7fe700 1 -- 172.21.15.6:0/3885685081 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dfc099aa0 con 0x7f8e0c0ffea0 2023-10-14T08:51:13.600 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:51:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8df40a1500 msgr2=0x7f8df40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8df40a1500 0x7f8df40a39c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009c60 tx=0x7f8e00009260 comp rx=0 tx=0).stop 2023-10-14T08:51:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 msgr2=0x7f8e0c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c068d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00e9a0 tx=0x7f8dfc00ecb0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 shutdown_connections 2023-10-14T08:51:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8df40a1500 0x7f8df40a39c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e0c1019b0 0x7f8e0c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e0c0ffea0 0x7f8e0c068d80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 --2- 172.21.15.6:0/3885685081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e0c100ff0 0x7f8e0c19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 >> 172.21.15.6:0/3885685081 conn(0x7f8e0c0fb430 msgr2=0x7f8e0c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 shutdown_connections 2023-10-14T08:51:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.600+0000 7f8e10e7c700 1 -- 172.21.15.6:0/3885685081 wait complete. 2023-10-14T08:51:13.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T08:51:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 -- 172.21.15.6:0/2960959109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 msgr2=0x7f2130103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 --2- 172.21.15.6:0/2960959109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130103dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2120009990 tx=0x7f2120009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 -- 172.21.15.6:0/2960959109 shutdown_connections 2023-10-14T08:51:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 --2- 172.21.15.6:0/2960959109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2130106c30 0x7f2130109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 --2- 172.21.15.6:0/2960959109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130103dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 --2- 172.21.15.6:0/2960959109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2130104300 0x7f21301066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 -- 172.21.15.6:0/2960959109 >> 172.21.15.6:0/2960959109 conn(0x7f21300fb320 msgr2=0x7f21300fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 -- 172.21.15.6:0/2960959109 shutdown_connections 2023-10-14T08:51:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.750+0000 7f2134f13700 1 -- 172.21.15.6:0/2960959109 wait complete. 2023-10-14T08:51:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 Processor -- start 2023-10-14T08:51:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 -- start start 2023-10-14T08:51:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2130104300 0x7f2130197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2130106c30 0x7f213019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213019e750 con 0x7f21301019d0 2023-10-14T08:51:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213019e890 con 0x7f2130106c30 2023-10-14T08:51:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f2134f13700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213019ea20 con 0x7f2130104300 2023-10-14T08:51:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f212e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.751+0000 7f212e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59264/0 (socket says 172.21.15.6:59264) 2023-10-14T08:51:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 -- 172.21.15.6:0/2637504361 learned_addr learned my addr 172.21.15.6:0/2637504361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212ed9d700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2130106c30 0x7f213019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212dd9b700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2130104300 0x7f2130197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 -- 172.21.15.6:0/2637504361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2130104300 msgr2=0x7f2130197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2130104300 0x7f2130197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 -- 172.21.15.6:0/2637504361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2130106c30 msgr2=0x7f213019e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2130106c30 0x7f213019e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 -- 172.21.15.6:0/2637504361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200095f0 con 0x7f21301019d0 2023-10-14T08:51:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f212e59c700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130196bd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2120004730 tx=0x7f2120004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212001d070 con 0x7f21301019d0 2023-10-14T08:51:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2120004c90 con 0x7f21301019d0 2023-10-14T08:51:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213019eca0 con 0x7f21301019d0 2023-10-14T08:51:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120005570 con 0x7f21301019d0 2023-10-14T08:51:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.752+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213019f060 con 0x7f21301019d0 2023-10-14T08:51:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.753+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21300fcea0 con 0x7f21301019d0 2023-10-14T08:51:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.754+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f212000fc70 con 0x7f21301019d0 2023-10-14T08:51:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.755+0000 7f211f7fe700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f21180a1480 0x7f21180a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.755+0000 7f212dd9b700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f21180a1480 0x7f21180a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.755+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f21200cdc70 con 0x7f21301019d0 2023-10-14T08:51:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.756+0000 7f212dd9b700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f21180a1480 0x7f21180a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2124005950 tx=0x7f21240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.760+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f212005b100 con 0x7f21301019d0 2023-10-14T08:51:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.969+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f213010c910 con 0x7f21301019d0 2023-10-14T08:51:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.969+0000 7f211f7fe700 1 -- 172.21.15.6:0/2637504361 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2120097800 con 0x7f21301019d0 2023-10-14T08:51:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:13.972 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-14T08:51:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T08:51:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-10-14T08:51:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-10-14T08:51:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T08:51:13.973 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-14T08:51:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f21180a1480 msgr2=0x7f21180a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f21180a1480 0x7f21180a3940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2124005950 tx=0x7f21240058e0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 msgr2=0x7f2130196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130196bd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2120004730 tx=0x7f2120004760 comp rx=0 tx=0).stop 2023-10-14T08:51:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 shutdown_connections 2023-10-14T08:51:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f21180a1480 0x7f21180a3940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2130106c30 0x7f213019e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21301019d0 0x7f2130196bd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 --2- 172.21.15.6:0/2637504361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2130104300 0x7f2130197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 >> 172.21.15.6:0/2637504361 conn(0x7f21300fb320 msgr2=0x7f2130102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 shutdown_connections 2023-10-14T08:51:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:13.973+0000 7f2134f13700 1 -- 172.21.15.6:0/2637504361 wait complete. 2023-10-14T08:51:13.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3108813163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:13.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2228364185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:13.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:13 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:13.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3885685081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:51:13.987 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T08:51:13.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T08:51:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 -- 172.21.15.6:0/1275803394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c104390 msgr2=0x7fa41c106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 --2- 172.21.15.6:0/1275803394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c104390 0x7fa41c106780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009990 tx=0x7fa40c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 -- 172.21.15.6:0/1275803394 shutdown_connections 2023-10-14T08:51:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 --2- 172.21.15.6:0/1275803394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa41c106cc0 0x7fa41c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 --2- 172.21.15.6:0/1275803394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c101a60 0x7fa41c103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 --2- 172.21.15.6:0/1275803394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c104390 0x7fa41c106780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 -- 172.21.15.6:0/1275803394 >> 172.21.15.6:0/1275803394 conn(0x7fa41c0fb450 msgr2=0x7fa41c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 -- 172.21.15.6:0/1275803394 shutdown_connections 2023-10-14T08:51:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.122+0000 7fa423e8e700 1 -- 172.21.15.6:0/1275803394 wait complete. 2023-10-14T08:51:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.123+0000 7fa423e8e700 1 Processor -- start 2023-10-14T08:51:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.123+0000 7fa423e8e700 1 -- start start 2023-10-14T08:51:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 0x7fa41c196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c104390 0x7fa41c197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa41c106cc0 0x7fa41c19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c19e790 con 0x7fa41c101a60 2023-10-14T08:51:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c19e900 con 0x7fa41c106cc0 2023-10-14T08:51:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c19eac0 con 0x7fa41c104390 2023-10-14T08:51:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 0x7fa41c196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 0x7fa41c196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59276/0 (socket says 172.21.15.6:59276) 2023-10-14T08:51:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 -- 172.21.15.6:0/2248962964 learned_addr learned my addr 172.21.15.6:0/2248962964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421429700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c104390 0x7fa41c197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa42242b700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa41c106cc0 0x7fa41c19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 -- 172.21.15.6:0/2248962964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c104390 msgr2=0x7fa41c197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c104390 0x7fa41c197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 -- 172.21.15.6:0/2248962964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa41c106cc0 msgr2=0x7fa41c19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa41c106cc0 0x7fa41c19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 -- 172.21.15.6:0/2248962964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0095f0 con 0x7fa41c101a60 2023-10-14T08:51:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa421c2a700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 0x7fa41c196c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa41800c920 tx=0x7fa41800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418004a30 con 0x7fa41c101a60 2023-10-14T08:51:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c19eda0 con 0x7fa41c101a60 2023-10-14T08:51:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.124+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4180054e0 con 0x7fa41c101a60 2023-10-14T08:51:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.125+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418007c10 con 0x7fa41c101a60 2023-10-14T08:51:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.125+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c19f210 con 0x7fa41c101a60 2023-10-14T08:51:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.125+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c10c7d0 con 0x7fa41c101a60 2023-10-14T08:51:14.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3108813163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:14.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2228364185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:14.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:13 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:14.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3885685081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:51:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.128+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa418005000 con 0x7fa41c101a60 2023-10-14T08:51:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.128+0000 7fa412ffd700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa4080a1500 0x7fa4080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.128+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa4180cc920 con 0x7fa41c101a60 2023-10-14T08:51:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.128+0000 7fa421429700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa4080a1500 0x7fa4080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.129+0000 7fa421429700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa4080a1500 0x7fa4080a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa40c006010 tx=0x7fa40c00b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.135+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa418096380 con 0x7fa41c101a60 2023-10-14T08:51:14.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3108813163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:14.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2228364185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:14.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:13 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:14.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3885685081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:51:14.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.345+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa41c10c980 con 0x7fa41c101a60 2023-10-14T08:51:14.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.834+0000 7fa412ffd700 1 -- 172.21.15.6:0/2248962964 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa4180999a0 con 0x7fa41c101a60 2023-10-14T08:51:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa4080a1500 msgr2=0x7fa4080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa4080a1500 0x7fa4080a39c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa40c006010 tx=0x7fa40c00b280 comp rx=0 tx=0).stop 2023-10-14T08:51:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 msgr2=0x7fa41c196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 0x7fa41c196c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa41800c920 tx=0x7fa41800cc30 comp rx=0 tx=0).stop 2023-10-14T08:51:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 shutdown_connections 2023-10-14T08:51:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa4080a1500 0x7fa4080a39c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa41c106cc0 0x7fa41c19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa41c101a60 0x7fa41c196c50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 --2- 172.21.15.6:0/2248962964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c104390 0x7fa41c197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 >> 172.21.15.6:0/2248962964 conn(0x7fa41c0fb450 msgr2=0x7fa41c102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.837+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 shutdown_connections 2023-10-14T08:51:14.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.838+0000 7fa423e8e700 1 -- 172.21.15.6:0/2248962964 wait complete. 2023-10-14T08:51:14.843 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-10-14T08:51:14.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T08:51:14.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1117828932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c101420 msgr2=0x7fdf9c101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1117828932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c101420 0x7fdf9c101840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009990 tx=0x7fdf8c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1117828932 shutdown_connections 2023-10-14T08:51:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1117828932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9c100af0 0x7fdf9c1083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1117828932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c101420 0x7fdf9c101840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1117828932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9c100150 0x7fdf9c1005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1117828932 >> 172.21.15.6:0/1117828932 conn(0x7fdf9c0fab60 msgr2=0x7fdf9c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1117828932 shutdown_connections 2023-10-14T08:51:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1117828932 wait complete. 2023-10-14T08:51:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 Processor -- start 2023-10-14T08:51:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.985+0000 7fdfa1d0f700 1 -- start start 2023-10-14T08:51:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdfa1d0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 0x7fdf9c104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdfa1d0f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9c100af0 0x7fdf9c1028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdfa1d0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9c101420 0x7fdf9c102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdfa1d0f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c1035a0 con 0x7fdf9c100150 2023-10-14T08:51:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdfa1d0f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c103710 con 0x7fdf9c101420 2023-10-14T08:51:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdfa1d0f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c1a0cf0 con 0x7fdf9c100af0 2023-10-14T08:51:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 0x7fdf9c104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 0x7fdf9c104280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59290/0 (socket says 172.21.15.6:59290) 2023-10-14T08:51:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 -- 172.21.15.6:0/1727504866 learned_addr learned my addr 172.21.15.6:0/1727504866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9affd700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9c100af0 0x7fdf9c1028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9bfff700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9c101420 0x7fdf9c102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 -- 172.21.15.6:0/1727504866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9c100af0 msgr2=0x7fdf9c1028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9c100af0 0x7fdf9c1028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 -- 172.21.15.6:0/1727504866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9c101420 msgr2=0x7fdf9c102e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9c101420 0x7fdf9c102e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 -- 172.21.15.6:0/1727504866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009c40 con 0x7fdf9c100150 2023-10-14T08:51:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf9b7fe700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 0x7fdf9c104280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c004710 tx=0x7fdf8c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.986+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c01d070 con 0x7fdf9c100150 2023-10-14T08:51:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.987+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c0095f0 con 0x7fdf9c100150 2023-10-14T08:51:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.987+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf8c021410 con 0x7fdf9c100150 2023-10-14T08:51:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.987+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c017650 con 0x7fdf9c100150 2023-10-14T08:51:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.987+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c1a11b0 con 0x7fdf9c100150 2023-10-14T08:51:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.987+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9c1080c0 con 0x7fdf9c100150 2023-10-14T08:51:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.989+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdf8c021580 con 0x7fdf9c100150 2023-10-14T08:51:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.989+0000 7fdf98ff9700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdf880a1480 0x7fdf880a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.990+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fdf8c0ce040 con 0x7fdf9c100150 2023-10-14T08:51:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.990+0000 7fdf9affd700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdf880a1480 0x7fdf880a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.990+0000 7fdf9affd700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdf880a1480 0x7fdf880a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009c60 tx=0x7fdf84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:14.994+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf8c0979c0 con 0x7fdf9c100150 2023-10-14T08:51:15.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:14 smithi178 ceph-mon[103612]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:15.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:14 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2637504361' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-14T08:51:15.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:14 smithi057 ceph-mon[103313]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:15.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:14 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2637504361' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-14T08:51:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.197+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf9c10b680 con 0x7fdf9c100150 2023-10-14T08:51:15.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:14 smithi006 ceph-mon[99452]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:15.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:14 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2637504361' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-14T08:51:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.839+0000 7fdf98ff9700 1 -- 172.21.15.6:0/1727504866 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf8c09afe0 con 0x7fdf9c100150 2023-10-14T08:51:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdf880a1480 msgr2=0x7fdf880a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdf880a1480 0x7fdf880a3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009c60 tx=0x7fdf84009260 comp rx=0 tx=0).stop 2023-10-14T08:51:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 msgr2=0x7fdf9c104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 0x7fdf9c104280 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c004710 tx=0x7fdf8c009580 comp rx=0 tx=0).stop 2023-10-14T08:51:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 shutdown_connections 2023-10-14T08:51:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdf880a1480 0x7fdf880a3940 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf84009c60 tx=0x7fdf84009260 comp rx=0 tx=0).stop 2023-10-14T08:51:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9c101420 0x7fdf9c102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9c100150 0x7fdf9c104280 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 --2- 172.21.15.6:0/1727504866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9c100af0 0x7fdf9c1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.842+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 >> 172.21.15.6:0/1727504866 conn(0x7fdf9c0fab60 msgr2=0x7fdf9c0fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.843+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 shutdown_connections 2023-10-14T08:51:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:15.848+0000 7fdfa1d0f700 1 -- 172.21.15.6:0/1727504866 wait complete. 2023-10-14T08:51:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-10-14T08:51:15.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T08:51:16.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/953573183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 msgr2=0x7f6a34100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:16.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/953573183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34100450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6a240098f0 tx=0x7f6a24009c00 comp rx=0 tx=0).stop 2023-10-14T08:51:16.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/953573183 shutdown_connections 2023-10-14T08:51:16.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/953573183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a34101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:16.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/953573183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 0x7f6a340ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:16.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/953573183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34100450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:16.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/953573183 >> 172.21.15.6:0/953573183 conn(0x7f6a340fab80 msgr2=0x7f6a340fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:16.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/953573183 shutdown_connections 2023-10-14T08:51:16.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.008+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/953573183 wait complete. 2023-10-14T08:51:16.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 Processor -- start 2023-10-14T08:51:16.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 -- start start 2023-10-14T08:51:16.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 0x7f6a34198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:16.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:16.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a341a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:16.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341a09d0 con 0x7f6a34100990 2023-10-14T08:51:16.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341a0b10 con 0x7f6a340ff270 2023-10-14T08:51:16.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3bdd4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a341a0ca0 con 0x7f6a340fffd0 2023-10-14T08:51:16.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3a371700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a341a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:16.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3a371700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a341a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59312/0 (socket says 172.21.15.6:59312) 2023-10-14T08:51:16.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3a371700 1 -- 172.21.15.6:0/669380141 learned_addr learned my addr 172.21.15.6:0/669380141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:16.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a3936f700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:16.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.009+0000 7f6a39b70700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 0x7f6a34198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:16.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3a371700 1 -- 172.21.15.6:0/669380141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 msgr2=0x7f6a34199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:16.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3a371700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:16.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3a371700 1 -- 172.21.15.6:0/669380141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 msgr2=0x7f6a34198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:16.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3a371700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 0x7f6a34198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:16.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3a371700 1 -- 172.21.15.6:0/669380141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24009520 con 0x7f6a34100990 2023-10-14T08:51:16.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3936f700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:16.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a39b70700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 0x7f6a34198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:16.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3a371700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a341a0400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c110 tx=0x7f6a2c00c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:16.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c017070 con 0x7f6a34100990 2023-10-14T08:51:16.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a2c00e050 con 0x7f6a34100990 2023-10-14T08:51:16.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a341a0f20 con 0x7f6a34100990 2023-10-14T08:51:16.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0078f0 con 0x7f6a34100990 2023-10-14T08:51:16.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.010+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a341a1350 con 0x7f6a34100990 2023-10-14T08:51:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.011+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3410ae10 con 0x7f6a34100990 2023-10-14T08:51:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.012+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6a2c007a50 con 0x7f6a34100990 2023-10-14T08:51:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.013+0000 7f6a2affd700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6a200a1480 0x7f6a200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.013+0000 7f6a39b70700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6a200a1480 0x7f6a200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:16.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.013+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f6a2c0cc610 con 0x7f6a34100990 2023-10-14T08:51:16.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.013+0000 7f6a39b70700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6a200a1480 0x7f6a200a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a30011490 tx=0x7f6a30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:16.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.018+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6a2c095d80 con 0x7f6a34100990 2023-10-14T08:51:16.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2248962964' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-14T08:51:16.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2248962964' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-14T08:51:16.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: osdmap e79: 12 total, 12 up, 12 in 2023-10-14T08:51:16.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1727504866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-14T08:51:16.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:16.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:51:16.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:15 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2248962964' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-14T08:51:16.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2248962964' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-14T08:51:16.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: osdmap e79: 12 total, 12 up, 12 in 2023-10-14T08:51:16.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1727504866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-14T08:51:16.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:16.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:51:16.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:15 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2248962964' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-14T08:51:16.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2248962964' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-14T08:51:16.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: osdmap e79: 12 total, 12 up, 12 in 2023-10-14T08:51:16.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1727504866' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-14T08:51:16.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:16.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:51:16.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:15 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:16.277+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6a3410eb40 con 0x7f6a34100990 2023-10-14T08:51:17.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.094+0000 7f6a2affd700 1 -- 172.21.15.6:0/669380141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6a2c0993a0 con 0x7f6a34100990 2023-10-14T08:51:17.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6a200a1480 msgr2=0x7f6a200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6a200a1480 0x7f6a200a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6a30011490 tx=0x7f6a30009260 comp rx=0 tx=0).stop 2023-10-14T08:51:17.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 msgr2=0x7f6a341a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a341a0400 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c110 tx=0x7f6a2c00c420 comp rx=0 tx=0).stop 2023-10-14T08:51:17.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 shutdown_connections 2023-10-14T08:51:17.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a34100990 0x7f6a341a0400 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6a200a1480 0x7f6a200a3940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a340ff270 0x7f6a34198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 --2- 172.21.15.6:0/669380141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a340fffd0 0x7f6a34199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 >> 172.21.15.6:0/669380141 conn(0x7f6a340fab80 msgr2=0x7f6a340fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 shutdown_connections 2023-10-14T08:51:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.097+0000 7f6a3bdd4700 1 -- 172.21.15.6:0/669380141 wait complete. 2023-10-14T08:51:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T08:51:17.112 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: pgmap v255: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:17.113 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-14T08:51:17.113 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:51:17.113 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1727504866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-14T08:51:17.113 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: osdmap e80: 12 total, 12 up, 12 in 2023-10-14T08:51:17.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/669380141' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-14T08:51:17.114 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:16 smithi006 ceph-mon[99452]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-14T08:51:17.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:51:17.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: pgmap v255: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:17.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-14T08:51:17.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:51:17.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1727504866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-14T08:51:17.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: osdmap e80: 12 total, 12 up, 12 in 2023-10-14T08:51:17.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/669380141' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-14T08:51:17.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:16 smithi178 ceph-mon[103612]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-14T08:51:17.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: pgmap v255: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:17.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-14T08:51:17.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:51:17.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1727504866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-14T08:51:17.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: osdmap e80: 12 total, 12 up, 12 in 2023-10-14T08:51:17.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/669380141' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-14T08:51:17.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:16 smithi057 ceph-mon[103313]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-14T08:51:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 -- 172.21.15.6:0/3743084840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd90108fc0 msgr2=0x7fdd9010b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 --2- 172.21.15.6:0/3743084840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd90108fc0 0x7fdd9010b3b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd800098f0 tx=0x7fdd80009c00 comp rx=0 tx=0).stop 2023-10-14T08:51:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 -- 172.21.15.6:0/3743084840 shutdown_connections 2023-10-14T08:51:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 --2- 172.21.15.6:0/3743084840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010e270 0x7fdd90110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 --2- 172.21.15.6:0/3743084840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd90108fc0 0x7fdd9010b3b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 --2- 172.21.15.6:0/3743084840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd9010b8f0 0x7fdd9010dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 -- 172.21.15.6:0/3743084840 >> 172.21.15.6:0/3743084840 conn(0x7fdd9006dc90 msgr2=0x7fdd900700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 -- 172.21.15.6:0/3743084840 shutdown_connections 2023-10-14T08:51:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.244+0000 7fdd96037700 1 -- 172.21.15.6:0/3743084840 wait complete. 2023-10-14T08:51:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 Processor -- start 2023-10-14T08:51:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 -- start start 2023-10-14T08:51:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 0x7fdd90108a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 0x7fdd901a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9010e270 0x7fdd901a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901a7010 con 0x7fdd90108fc0 2023-10-14T08:51:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901a7180 con 0x7fdd9010e270 2023-10-14T08:51:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd96037700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd901a7340 con 0x7fdd9010b8f0 2023-10-14T08:51:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 0x7fdd90108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 0x7fdd901a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 0x7fdd90108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59324/0 (socket says 172.21.15.6:59324) 2023-10-14T08:51:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 0x7fdd901a41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:56728/0 (socket says 172.21.15.6:56728) 2023-10-14T08:51:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/424051930 learned_addr learned my addr 172.21.15.6:0/424051930 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.245+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9010e270 0x7fdd901a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8effd700 1 -- 172.21.15.6:0/424051930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9010e270 msgr2=0x7fdd901a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8effd700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9010e270 0x7fdd901a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8effd700 1 -- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 msgr2=0x7fdd90108a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8effd700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 0x7fdd90108a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8effd700 1 -- 172.21.15.6:0/424051930 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009520 con 0x7fdd9010b8f0 2023-10-14T08:51:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8effd700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 0x7fdd901a41f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd84005fd0 tx=0x7fdd8400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9010e270 0x7fdd901a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84010900 con 0x7fdd9010b8f0 2023-10-14T08:51:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 0x7fdd90108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd84018420 con 0x7fdd9010b8f0 2023-10-14T08:51:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd901a7620 con 0x7fdd9010b8f0 2023-10-14T08:51:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400f680 con 0x7fdd9010b8f0 2023-10-14T08:51:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.246+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd901a7b30 con 0x7fdd9010b8f0 2023-10-14T08:51:17.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.247+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9006f810 con 0x7fdd9010b8f0 2023-10-14T08:51:17.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.248+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdd84010a60 con 0x7fdd9010b8f0 2023-10-14T08:51:17.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.249+0000 7fdd8cff9700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd780a1480 0x7fdd780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.249+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdd84014070 con 0x7fdd9010b8f0 2023-10-14T08:51:17.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.249+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd780a1480 0x7fdd780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.249+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd780a1480 0x7fdd780a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000c010 tx=0x7fdd80019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:17.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.253+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdd840963e0 con 0x7fdd9010b8f0 2023-10-14T08:51:17.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.459+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd90113fe0 con 0x7fdd9010b8f0 2023-10-14T08:51:17.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.461+0000 7fdd8cff9700 1 -- 172.21.15.6:0/424051930 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22047 (secure 0 0 0) 0x7fdd84099a00 con 0x7fdd9010b8f0 2023-10-14T08:51:17.463 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:17.463 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":81,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:51:16.279525+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:51:17.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd780a1480 msgr2=0x7fdd780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd780a1480 0x7fdd780a3940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000c010 tx=0x7fdd80019040 comp rx=0 tx=0).stop 2023-10-14T08:51:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 msgr2=0x7fdd901a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 0x7fdd901a41f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd84005fd0 tx=0x7fdd8400eca0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 shutdown_connections 2023-10-14T08:51:17.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd780a1480 0x7fdd780a3940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd9010e270 0x7fdd901a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90108fc0 0x7fdd90108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.463+0000 7fdd96037700 1 --2- 172.21.15.6:0/424051930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd9010b8f0 0x7fdd901a41f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.464+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 >> 172.21.15.6:0/424051930 conn(0x7fdd9006dc90 msgr2=0x7fdd90109c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.464+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 shutdown_connections 2023-10-14T08:51:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.464+0000 7fdd96037700 1 -- 172.21.15.6:0/424051930 wait complete. 2023-10-14T08:51:17.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:51:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 -- 172.21.15.6:0/286525571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 msgr2=0x7f7fc8108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 --2- 172.21.15.6:0/286525571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8108220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b0d0 tx=0x7f7fc000b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 -- 172.21.15.6:0/286525571 shutdown_connections 2023-10-14T08:51:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 --2- 172.21.15.6:0/286525571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8108220 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 --2- 172.21.15.6:0/286525571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc80ffde0 0x7f7fc8100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 --2- 172.21.15.6:0/286525571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc8100fd0 0x7f7fc8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 -- 172.21.15.6:0/286525571 >> 172.21.15.6:0/286525571 conn(0x7f7fc80fb310 msgr2=0x7f7fc80fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 -- 172.21.15.6:0/286525571 shutdown_connections 2023-10-14T08:51:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.607+0000 7f7fce510700 1 -- 172.21.15.6:0/286525571 wait complete. 2023-10-14T08:51:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 Processor -- start 2023-10-14T08:51:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 -- start start 2023-10-14T08:51:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc80ffde0 0x7f7fc810a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc8100fd0 0x7f7fc8108d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8109a10 con 0x7f7fc8101970 2023-10-14T08:51:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8109b80 con 0x7f7fc80ffde0 2023-10-14T08:51:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fce510700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc81a0d20 con 0x7f7fc8100fd0 2023-10-14T08:51:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fccaad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc80ffde0 0x7f7fc810a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fccaad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8109270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59342/0 (socket says 172.21.15.6:59342) 2023-10-14T08:51:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fccaad700 1 -- 172.21.15.6:0/3467207407 learned_addr learned my addr 172.21.15.6:0/3467207407 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.608+0000 7f7fc7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc80ffde0 0x7f7fc810a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:58096/0 (socket says 172.21.15.6:58096) 2023-10-14T08:51:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fc77fe700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc8100fd0 0x7f7fc8108d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fccaad700 1 -- 172.21.15.6:0/3467207407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc8100fd0 msgr2=0x7f7fc8108d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fccaad700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc8100fd0 0x7f7fc8108d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fccaad700 1 -- 172.21.15.6:0/3467207407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc80ffde0 msgr2=0x7f7fc810a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fccaad700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc80ffde0 0x7f7fc810a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fccaad700 1 -- 172.21.15.6:0/3467207407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0009d00 con 0x7f7fc8101970 2023-10-14T08:51:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fccaad700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8109270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007990 tx=0x7f7fc0008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000e040 con 0x7f7fc8101970 2023-10-14T08:51:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fc000be30 con 0x7f7fc8101970 2023-10-14T08:51:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc001d6d0 con 0x7f7fc8101970 2023-10-14T08:51:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc81a0fa0 con 0x7f7fc8101970 2023-10-14T08:51:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.609+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc81a1360 con 0x7f7fc8101970 2023-10-14T08:51:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.610+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc8106cc0 con 0x7f7fc8101970 2023-10-14T08:51:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.611+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7fc00051b0 con 0x7f7fc8101970 2023-10-14T08:51:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.612+0000 7f7fc57fa700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fb00a1480 0x7f7fb00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.612+0000 7f7fc7fff700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fb00a1480 0x7f7fb00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.612+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7fc00ce290 con 0x7f7fc8101970 2023-10-14T08:51:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.612+0000 7f7fc7fff700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fb00a1480 0x7f7fb00a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8100e30 tx=0x7f7fb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.615+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7fc0097ad0 con 0x7f7fc8101970 2023-10-14T08:51:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.830+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc810c9b0 con 0x7f7fc8101970 2023-10-14T08:51:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.832+0000 7f7fc57fa700 1 -- 172.21.15.6:0/3467207407 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22034 (secure 0 0 0) 0x7f7fc0011390 con 0x7f7fc8101970 2023-10-14T08:51:17.834 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:17.834 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:51:17.789244+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:51:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fb00a1480 msgr2=0x7f7fb00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fb00a1480 0x7f7fb00a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8100e30 tx=0x7f7fb8009260 comp rx=0 tx=0).stop 2023-10-14T08:51:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 msgr2=0x7f7fc8109270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8109270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0007990 tx=0x7f7fc0008eb0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 shutdown_connections 2023-10-14T08:51:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc8101970 0x7f7fc8109270 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fb00a1480 0x7f7fb00a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fc80ffde0 0x7f7fc810a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 --2- 172.21.15.6:0/3467207407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fc8100fd0 0x7f7fc8108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 >> 172.21.15.6:0/3467207407 conn(0x7f7fc80fb310 msgr2=0x7f7fc80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 shutdown_connections 2023-10-14T08:51:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.834+0000 7f7fce510700 1 -- 172.21.15.6:0/3467207407 wait complete. 2023-10-14T08:51:17.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T08:51:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 -- 172.21.15.6:0/3172716163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c1011c0 msgr2=0x7f2c2c107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 --2- 172.21.15.6:0/3172716163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c107a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00b0d0 tx=0x7f2c1c00b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 -- 172.21.15.6:0/3172716163 shutdown_connections 2023-10-14T08:51:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 --2- 172.21.15.6:0/3172716163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c107a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 --2- 172.21.15.6:0/3172716163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c0ff630 0x7f2c2c0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 --2- 172.21.15.6:0/3172716163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c100820 0x7f2c2c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 -- 172.21.15.6:0/3172716163 >> 172.21.15.6:0/3172716163 conn(0x7f2c2c0fab80 msgr2=0x7f2c2c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 -- 172.21.15.6:0/3172716163 shutdown_connections 2023-10-14T08:51:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.983+0000 7f2c33f56700 1 -- 172.21.15.6:0/3172716163 wait complete. 2023-10-14T08:51:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 Processor -- start 2023-10-14T08:51:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 -- start start 2023-10-14T08:51:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c0ff630 0x7f2c2c196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c100820 0x7f2c2c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c19e8e0 con 0x7f2c2c0ff630 2023-10-14T08:51:17.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c19ea20 con 0x7f2c2c100820 2023-10-14T08:51:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c33f56700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2c19ebb0 con 0x7f2c2c1011c0 2023-10-14T08:51:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c31cf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c0ff630 0x7f2c2c196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c31cf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c0ff630 0x7f2c2c196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59352/0 (socket says 172.21.15.6:59352) 2023-10-14T08:51:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c31cf2700 1 -- 172.21.15.6:0/2717309887 learned_addr learned my addr 172.21.15.6:0/2717309887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c324f3700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.984+0000 7f2c314f1700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c100820 0x7f2c2c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c324f3700 1 -- 172.21.15.6:0/2717309887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c100820 msgr2=0x7f2c2c1972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c324f3700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c100820 0x7f2c2c1972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c324f3700 1 -- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c0ff630 msgr2=0x7f2c2c196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c324f3700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c0ff630 0x7f2c2c196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c324f3700 1 -- 172.21.15.6:0/2717309887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c009d00 con 0x7f2c2c1011c0 2023-10-14T08:51:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c324f3700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c19e310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00b770 tx=0x7f2c1c008f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00e040 con 0x7f2c2c1011c0 2023-10-14T08:51:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c19ee30 con 0x7f2c2c1011c0 2023-10-14T08:51:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c1c00be30 con 0x7f2c2c1011c0 2023-10-14T08:51:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c01b9f0 con 0x7f2c2c1011c0 2023-10-14T08:51:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.985+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2c19f200 con 0x7f2c2c1011c0 2023-10-14T08:51:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.986+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2c107400 con 0x7f2c2c1011c0 2023-10-14T08:51:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.987+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2c1c01dcc0 con 0x7f2c2c1011c0 2023-10-14T08:51:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.988+0000 7f2c2affd700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2c140a1480 0x7f2c140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.988+0000 7f2c31cf2700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2c140a1480 0x7f2c140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.988+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2c1c0ce610 con 0x7f2c2c1011c0 2023-10-14T08:51:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.988+0000 7f2c31cf2700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2c140a1480 0x7f2c140a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c24005950 tx=0x7f2c24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:17.991+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c1c097e30 con 0x7f2c2c1011c0 2023-10-14T08:51:18.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:17 smithi178 ceph-mon[103612]: osdmap e81: 12 total, 12 up, 12 in 2023-10-14T08:51:18.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:17 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/669380141' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-14T08:51:18.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:17 smithi178 ceph-mon[103612]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-14T08:51:18.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:17 smithi178 ceph-mon[103612]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-14T08:51:18.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:17 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/424051930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:18.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:17 smithi057 ceph-mon[103313]: osdmap e81: 12 total, 12 up, 12 in 2023-10-14T08:51:18.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:17 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/669380141' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-14T08:51:18.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:17 smithi057 ceph-mon[103313]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-14T08:51:18.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:17 smithi057 ceph-mon[103313]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-14T08:51:18.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:17 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/424051930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:18.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:17 smithi006 ceph-mon[99452]: osdmap e81: 12 total, 12 up, 12 in 2023-10-14T08:51:18.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:17 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/669380141' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-14T08:51:18.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:17 smithi006 ceph-mon[99452]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-14T08:51:18.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:17 smithi006 ceph-mon[99452]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-14T08:51:18.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:17 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/424051930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:18.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:18.254+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2c2c10b0c0 con 0x7f2c2c1011c0 2023-10-14T08:51:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.105+0000 7f2c2affd700 1 -- 172.21.15.6:0/2717309887 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2c1c09b450 con 0x7f2c2c1011c0 2023-10-14T08:51:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2c140a1480 msgr2=0x7f2c140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2c140a1480 0x7f2c140a3940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c24005950 tx=0x7f2c24009260 comp rx=0 tx=0).stop 2023-10-14T08:51:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c1011c0 msgr2=0x7f2c2c19e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c19e310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c00b770 tx=0x7f2c1c008f10 comp rx=0 tx=0).stop 2023-10-14T08:51:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 shutdown_connections 2023-10-14T08:51:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c2c1011c0 0x7f2c2c19e310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c2c0ff630 0x7f2c2c196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2c140a1480 0x7f2c140a3940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 --2- 172.21.15.6:0/2717309887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c2c100820 0x7f2c2c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 >> 172.21.15.6:0/2717309887 conn(0x7f2c2c0fab80 msgr2=0x7f2c2c0fbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 shutdown_connections 2023-10-14T08:51:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.107+0000 7f2c33f56700 1 -- 172.21.15.6:0/2717309887 wait complete. 2023-10-14T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: pgmap v258: 97 pgs: 16 active+clean, 33 creating+peering, 48 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: osdmap e82: 12 total, 12 up, 12 in 2023-10-14T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3467207407' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:19.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-14T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: Cluster is now healthy 2023-10-14T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] up:active 2023-10-14T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:19.122 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2717309887' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-14T08:51:19.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-14T08:51:19.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:19.124 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:51:19.125 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:18 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.127 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-10-14T08:51:19.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-14T08:51:19.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: pgmap v258: 97 pgs: 16 active+clean, 33 creating+peering, 48 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:19.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: osdmap e82: 12 total, 12 up, 12 in 2023-10-14T08:51:19.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3467207407' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:19.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-14T08:51:19.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: Cluster is now healthy 2023-10-14T08:51:19.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] up:active 2023-10-14T08:51:19.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:19.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:19.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2717309887' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-14T08:51:19.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-14T08:51:19.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:19.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:51:19.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:18 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: pgmap v258: 97 pgs: 16 active+clean, 33 creating+peering, 48 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T08:51:19.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: osdmap e82: 12 total, 12 up, 12 in 2023-10-14T08:51:19.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3467207407' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:19.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-14T08:51:19.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: Cluster is now healthy 2023-10-14T08:51:19.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] up:active 2023-10-14T08:51:19.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:19.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:19.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2717309887' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-14T08:51:19.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-14T08:51:19.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.196 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:51:19.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:51:19.198 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:18 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:51:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 -- 172.21.15.6:0/2875282869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101070 msgr2=0x7fbdbc1014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 --2- 172.21.15.6:0/2875282869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101070 0x7fbdbc1014f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009990 tx=0x7fbda8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 -- 172.21.15.6:0/2875282869 shutdown_connections 2023-10-14T08:51:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 --2- 172.21.15.6:0/2875282869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc101a30 0x7fbdbc108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 --2- 172.21.15.6:0/2875282869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdbc0ffe90 0x7fbdbc1002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 --2- 172.21.15.6:0/2875282869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101070 0x7fbdbc1014f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 -- 172.21.15.6:0/2875282869 >> 172.21.15.6:0/2875282869 conn(0x7fbdbc0fb450 msgr2=0x7fbdbc0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 -- 172.21.15.6:0/2875282869 shutdown_connections 2023-10-14T08:51:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.257+0000 7fbdc3229700 1 -- 172.21.15.6:0/2875282869 wait complete. 2023-10-14T08:51:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 Processor -- start 2023-10-14T08:51:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 -- start start 2023-10-14T08:51:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc0ffe90 0x7fbdbc195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdbc101070 0x7fbdbc1960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 0x7fbdbc19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc19d6e0 con 0x7fbdbc101a30 2023-10-14T08:51:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc19d820 con 0x7fbdbc101070 2023-10-14T08:51:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc3229700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc19d9b0 con 0x7fbdbc0ffe90 2023-10-14T08:51:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc17c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 0x7fbdbc19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc17c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 0x7fbdbc19d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59370/0 (socket says 172.21.15.6:59370) 2023-10-14T08:51:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdc17c6700 1 -- 172.21.15.6:0/3085772370 learned_addr learned my addr 172.21.15.6:0/3085772370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.258+0000 7fbdbbfff700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdbc101070 0x7fbdbc1960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc0fc5700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc0ffe90 0x7fbdbc195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc17c6700 1 -- 172.21.15.6:0/3085772370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc0ffe90 msgr2=0x7fbdbc195b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc17c6700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc0ffe90 0x7fbdbc195b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc17c6700 1 -- 172.21.15.6:0/3085772370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdbc101070 msgr2=0x7fbdbc1960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc17c6700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdbc101070 0x7fbdbc1960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc17c6700 1 -- 172.21.15.6:0/3085772370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80095f0 con 0x7fbdbc101a30 2023-10-14T08:51:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc17c6700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 0x7fbdbc19d110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4007ee0 tx=0x7fbdb400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4017070 con 0x7fbdbc101a30 2023-10-14T08:51:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdb400f040 con 0x7fbdbc101a30 2023-10-14T08:51:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc19dc90 con 0x7fbdbc101a30 2023-10-14T08:51:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4005740 con 0x7fbdbc101a30 2023-10-14T08:51:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.259+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc19e150 con 0x7fbdbc101a30 2023-10-14T08:51:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.260+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc10b700 con 0x7fbdbc101a30 2023-10-14T08:51:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.261+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbdb400dc60 con 0x7fbdbc101a30 2023-10-14T08:51:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.262+0000 7fbdb9ffb700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbdac0a1480 0x7fbdac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.262+0000 7fbdc0fc5700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbdac0a1480 0x7fbdac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.262+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbdb40cc330 con 0x7fbdbc101a30 2023-10-14T08:51:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.262+0000 7fbdc0fc5700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbdac0a1480 0x7fbdac0a3940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc100be0 tx=0x7fbdb000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.266+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbdb4095ae0 con 0x7fbdbc101a30 2023-10-14T08:51:19.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:19.517+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fbdbc106dc0 con 0x7fbdbc101a30 2023-10-14T08:51:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.112+0000 7fbdb9ffb700 1 -- 172.21.15.6:0/3085772370 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fbdb4099100 con 0x7fbdbc101a30 2023-10-14T08:51:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbdac0a1480 msgr2=0x7fbdac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbdac0a1480 0x7fbdac0a3940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc100be0 tx=0x7fbdb000b5b0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 msgr2=0x7fbdbc19d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 0x7fbdbc19d110 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4007ee0 tx=0x7fbdb400d3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 shutdown_connections 2023-10-14T08:51:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc101a30 0x7fbdbc19d110 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc0ffe90 0x7fbdbc195b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbdac0a1480 0x7fbdac0a3940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 --2- 172.21.15.6:0/3085772370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdbc101070 0x7fbdbc1960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 >> 172.21.15.6:0/3085772370 conn(0x7fbdbc0fb450 msgr2=0x7fbdbc0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 shutdown_connections 2023-10-14T08:51:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.115+0000 7fbdc3229700 1 -- 172.21.15.6:0/3085772370 wait complete. 2023-10-14T08:51:20.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-14T08:51:20.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 -- 172.21.15.6:0/3723116168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c100fb0 msgr2=0x7f093c1013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:20.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 --2- 172.21.15.6:0/3723116168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c100fb0 0x7f093c1013d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f09300099c0 tx=0x7f0930009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 -- 172.21.15.6:0/3723116168 shutdown_connections 2023-10-14T08:51:20.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 --2- 172.21.15.6:0/3723116168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c102b40 0x7f093c1093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 --2- 172.21.15.6:0/3723116168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c100fb0 0x7f093c1013d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 --2- 172.21.15.6:0/3723116168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f093c1021a0 0x7f093c102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 -- 172.21.15.6:0/3723116168 >> 172.21.15.6:0/3723116168 conn(0x7f093c0fc520 msgr2=0x7f093c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:20.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 -- 172.21.15.6:0/3723116168 shutdown_connections 2023-10-14T08:51:20.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 -- 172.21.15.6:0/3723116168 wait complete. 2023-10-14T08:51:20.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.269+0000 7f09415e9700 1 Processor -- start 2023-10-14T08:51:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 -- start start 2023-10-14T08:51:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f093c100fb0 0x7f093c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 0x7f093c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c102b40 0x7f093c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c19e850 con 0x7f093c1021a0 2023-10-14T08:51:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c19e9c0 con 0x7f093c100fb0 2023-10-14T08:51:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f09415e9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c19eb80 con 0x7f093c102b40 2023-10-14T08:51:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 0x7f093c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 0x7f093c197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59382/0 (socket says 172.21.15.6:59382) 2023-10-14T08:51:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 -- 172.21.15.6:0/3284580738 learned_addr learned my addr 172.21.15.6:0/3284580738 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093b7fe700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c102b40 0x7f093c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093affd700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f093c100fb0 0x7f093c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 -- 172.21.15.6:0/3284580738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c102b40 msgr2=0x7f093c19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c102b40 0x7f093c19e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 -- 172.21.15.6:0/3284580738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f093c100fb0 msgr2=0x7f093c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f093c100fb0 0x7f093c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 -- 172.21.15.6:0/3284580738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300095f0 con 0x7f093c1021a0 2023-10-14T08:51:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.270+0000 7f093a7fc700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 0x7f093c197250 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f092c00c920 tx=0x7f092c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.271+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c007b00 con 0x7f093c1021a0 2023-10-14T08:51:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.271+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f092c004cf0 con 0x7f093c1021a0 2023-10-14T08:51:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.271+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c19ee60 con 0x7f093c1021a0 2023-10-14T08:51:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.271+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c005610 con 0x7f093c1021a0 2023-10-14T08:51:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.271+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c19f280 con 0x7f093c1021a0 2023-10-14T08:51:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.272+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c10c890 con 0x7f093c1021a0 2023-10-14T08:51:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.273+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f092c004750 con 0x7f093c1021a0 2023-10-14T08:51:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.273+0000 7f0923fff700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f09240a1480 0x7f09240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.274+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f092c0ccc00 con 0x7f093c1021a0 2023-10-14T08:51:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.274+0000 7f093affd700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f09240a1480 0x7f09240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.274+0000 7f093affd700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f09240a1480 0x7f09240a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f093c1981e0 tx=0x7f0930000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.278+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f092c096310 con 0x7f093c1021a0 2023-10-14T08:51:20.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: 2023-10-14T08:51:20.124+0000 7f1c5709a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T08:51:20.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:20 smithi178 ceph-mon[103612]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-14T08:51:20.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:20 smithi178 ceph-mon[103612]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:20.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:20 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3085772370' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-14T08:51:20.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:20 smithi057 ceph-mon[103313]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-14T08:51:20.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:20 smithi057 ceph-mon[103313]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:20.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:20 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3085772370' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-14T08:51:20.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:20 smithi006 ceph-mon[99452]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-14T08:51:20.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:20 smithi006 ceph-mon[99452]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:20.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:20 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3085772370' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-14T08:51:20.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:20.526+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f093c10ca20 con 0x7f093c1021a0 2023-10-14T08:51:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.094+0000 7f0923fff700 1 -- 172.21.15.6:0/3284580738 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f092c01d020 con 0x7f093c1021a0 2023-10-14T08:51:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f09240a1480 msgr2=0x7f09240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f09240a1480 0x7f09240a3940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f093c1981e0 tx=0x7f0930000bc0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 msgr2=0x7f093c197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 0x7f093c197250 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f092c00c920 tx=0x7f092c00cce0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 shutdown_connections 2023-10-14T08:51:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c102b40 0x7f093c19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f09240a1480 0x7f09240a3940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f093c100fb0 0x7f093c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 --2- 172.21.15.6:0/3284580738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f093c1021a0 0x7f093c197250 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 >> 172.21.15.6:0/3284580738 conn(0x7f093c0fc520 msgr2=0x7f093c0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 shutdown_connections 2023-10-14T08:51:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.097+0000 7f09415e9700 1 -- 172.21.15.6:0/3284580738 wait complete. 2023-10-14T08:51:21.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-14T08:51:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 -- 172.21.15.6:0/3236803135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380102b70 msgr2=0x7f0380109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3236803135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380102b70 0x7f0380109420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f037800b0d0 tx=0x7f037800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 -- 172.21.15.6:0/3236803135 shutdown_connections 2023-10-14T08:51:21.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3236803135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0380102b70 0x7f0380109420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3236803135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0380100fe0 0x7f0380101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3236803135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03801021d0 0x7f0380102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 -- 172.21.15.6:0/3236803135 >> 172.21.15.6:0/3236803135 conn(0x7f03800fc510 msgr2=0x7f03800fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:21.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 -- 172.21.15.6:0/3236803135 shutdown_connections 2023-10-14T08:51:21.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.247+0000 7f0385cd3700 1 -- 172.21.15.6:0/3236803135 wait complete. 2023-10-14T08:51:21.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 Processor -- start 2023-10-14T08:51:21.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 -- start start 2023-10-14T08:51:21.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0380100fe0 0x7f0380196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:21.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 0x7f0380197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:21.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0380102b70 0x7f038019e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038019e880 con 0x7f03801021d0 2023-10-14T08:51:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038019e9f0 con 0x7f0380100fe0 2023-10-14T08:51:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f0385cd3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038019ebb0 con 0x7f0380102b70 2023-10-14T08:51:21.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f037effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 0x7f0380197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f037effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 0x7f0380197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59396/0 (socket says 172.21.15.6:59396) 2023-10-14T08:51:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f037effd700 1 -- 172.21.15.6:0/3913267749 learned_addr learned my addr 172.21.15.6:0/3913267749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f037f7fe700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0380100fe0 0x7f0380196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.248+0000 7f037ffff700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0380102b70 0x7f038019e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037effd700 1 -- 172.21.15.6:0/3913267749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0380102b70 msgr2=0x7f038019e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:21.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037effd700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0380102b70 0x7f038019e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037effd700 1 -- 172.21.15.6:0/3913267749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0380100fe0 msgr2=0x7f0380196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:21.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037effd700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0380100fe0 0x7f0380196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:21.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037effd700 1 -- 172.21.15.6:0/3913267749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378009d00 con 0x7f03801021d0 2023-10-14T08:51:21.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037effd700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 0x7f0380197280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f037400d950 tx=0x7f037400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400f890 con 0x7f03801021d0 2023-10-14T08:51:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0374010460 con 0x7f03801021d0 2023-10-14T08:51:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038019ee90 con 0x7f03801021d0 2023-10-14T08:51:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400e610 con 0x7f03801021d0 2023-10-14T08:51:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.249+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038019f310 con 0x7f03801021d0 2023-10-14T08:51:21.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.250+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0380108530 con 0x7f03801021d0 2023-10-14T08:51:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.251+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f03740108d0 con 0x7f03801021d0 2023-10-14T08:51:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.252+0000 7f037cff9700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f03680a1500 0x7f03680a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.252+0000 7f037f7fe700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f03680a1500 0x7f03680a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.252+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f03740cc900 con 0x7f03801021d0 2023-10-14T08:51:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.252+0000 7f037f7fe700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f03680a1500 0x7f03680a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0380198210 tx=0x7f037000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.255+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03740960b0 con 0x7f03801021d0 2023-10-14T08:51:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: pgmap v260: 97 pgs: 36 active+clean, 33 creating+peering, 28 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 222 B/s wr, 4 op/s 2023-10-14T08:51:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-14T08:51:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3085772370' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-14T08:51:21.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-14T08:51:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2023-10-14T08:51:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: daemon mds.b is now active in filesystem cephfs as rank 1 2023-10-14T08:51:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3284580738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-14T08:51:21.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3284580738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-14T08:51:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:active 2023-10-14T08:51:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-14T08:51:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 2 up:standby-replay 8 up:standby 2023-10-14T08:51:21.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:21 smithi178 ceph-mon[103612]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:creating} 2 up:standby-replay 7 up:standby 2023-10-14T08:51:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: pgmap v260: 97 pgs: 36 active+clean, 33 creating+peering, 28 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 222 B/s wr, 4 op/s 2023-10-14T08:51:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-14T08:51:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3085772370' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-14T08:51:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-14T08:51:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2023-10-14T08:51:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: daemon mds.b is now active in filesystem cephfs as rank 1 2023-10-14T08:51:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3284580738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-14T08:51:21.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3284580738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-14T08:51:21.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:active 2023-10-14T08:51:21.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-14T08:51:21.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 2 up:standby-replay 8 up:standby 2023-10-14T08:51:21.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:21 smithi057 ceph-mon[103313]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:creating} 2 up:standby-replay 7 up:standby 2023-10-14T08:51:21.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: pgmap v260: 97 pgs: 36 active+clean, 33 creating+peering, 28 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 222 B/s wr, 4 op/s 2023-10-14T08:51:21.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-14T08:51:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3085772370' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-14T08:51:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-14T08:51:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-14T08:51:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2023-10-14T08:51:21.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: daemon mds.b is now active in filesystem cephfs as rank 1 2023-10-14T08:51:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3284580738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-14T08:51:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3284580738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-14T08:51:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:active 2023-10-14T08:51:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-14T08:51:21.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 2 up:standby-replay 8 up:standby 2023-10-14T08:51:21.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:21 smithi006 ceph-mon[99452]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:creating} 2 up:standby-replay 7 up:standby 2023-10-14T08:51:21.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:21.504+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f038002d1a0 con 0x7f03801021d0 2023-10-14T08:51:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.125+0000 7f037cff9700 1 -- 172.21.15.6:0/3913267749 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f03740200b0 con 0x7f03801021d0 2023-10-14T08:51:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f03680a1500 msgr2=0x7f03680a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f03680a1500 0x7f03680a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0380198210 tx=0x7f037000a380 comp rx=0 tx=0).stop 2023-10-14T08:51:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 msgr2=0x7f0380197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 0x7f0380197280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f037400d950 tx=0x7f037400dc60 comp rx=0 tx=0).stop 2023-10-14T08:51:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 shutdown_connections 2023-10-14T08:51:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0380102b70 0x7f038019e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f03680a1500 0x7f03680a39c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0380100fe0 0x7f0380196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 --2- 172.21.15.6:0/3913267749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03801021d0 0x7f0380197280 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.128+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 >> 172.21.15.6:0/3913267749 conn(0x7f03800fc510 msgr2=0x7f0380105670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.129+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 shutdown_connections 2023-10-14T08:51:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.129+0000 7f0385cd3700 1 -- 172.21.15.6:0/3913267749 wait complete. 2023-10-14T08:51:22.148 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2023-10-14T08:51:22.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-14T08:51:22.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 -- 172.21.15.6:0/3065815781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28104370 msgr2=0x7f6d28106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3065815781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28104370 0x7f6d28106760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c009990 tx=0x7f6d1c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 -- 172.21.15.6:0/3065815781 shutdown_connections 2023-10-14T08:51:22.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3065815781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d28106ca0 0x7f6d28109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3065815781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d28101a40 0x7f6d28103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3065815781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28104370 0x7f6d28106760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 -- 172.21.15.6:0/3065815781 >> 172.21.15.6:0/3065815781 conn(0x7f6d280fb410 msgr2=0x7f6d280fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 -- 172.21.15.6:0/3065815781 shutdown_connections 2023-10-14T08:51:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 -- 172.21.15.6:0/3065815781 wait complete. 2023-10-14T08:51:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 Processor -- start 2023-10-14T08:51:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.285+0000 7f6d2e803700 1 -- start start 2023-10-14T08:51:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2e803700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d28101a40 0x7f6d281013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2e803700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d28104370 0x7f6d280ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2e803700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 0x7f6d280fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2e803700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281006d0 con 0x7f6d28106ca0 2023-10-14T08:51:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2e803700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28100840 con 0x7f6d28104370 2023-10-14T08:51:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2e803700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281a0cd0 con 0x7f6d28101a40 2023-10-14T08:51:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 0x7f6d280fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 0x7f6d280fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59412/0 (socket says 172.21.15.6:59412) 2023-10-14T08:51:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 -- 172.21.15.6:0/3037933270 learned_addr learned my addr 172.21.15.6:0/3037933270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d27fff700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d28101a40 0x7f6d281013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 -- 172.21.15.6:0/3037933270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d28101a40 msgr2=0x7f6d281013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d28101a40 0x7f6d281013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 -- 172.21.15.6:0/3037933270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d28104370 msgr2=0x7f6d280ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d28104370 0x7f6d280ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 -- 172.21.15.6:0/3037933270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c0095f0 con 0x7f6d28106ca0 2023-10-14T08:51:22.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d2cda0700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 0x7f6d280fff30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007ee0 tx=0x7f6d2000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:22.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.286+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20017070 con 0x7f6d28106ca0 2023-10-14T08:51:22.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.287+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d2000f040 con 0x7f6d28106ca0 2023-10-14T08:51:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.287+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d281a0fb0 con 0x7f6d28106ca0 2023-10-14T08:51:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.287+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20005740 con 0x7f6d28106ca0 2023-10-14T08:51:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.287+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d281a1430 con 0x7f6d28106ca0 2023-10-14T08:51:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.287+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2810c800 con 0x7f6d28106ca0 2023-10-14T08:51:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.289+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6d2000dc60 con 0x7f6d28106ca0 2023-10-14T08:51:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.290+0000 7f6d257fa700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6d100a1500 0x7f6d100a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.290+0000 7f6d27fff700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6d100a1500 0x7f6d100a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.290+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6d200cc950 con 0x7f6d28106ca0 2023-10-14T08:51:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.290+0000 7f6d27fff700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6d100a1500 0x7f6d100a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009c60 tx=0x7f6d18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.293+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6d20096100 con 0x7f6d28106ca0 2023-10-14T08:51:22.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:22 smithi178 ceph-mon[103612]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-14T08:51:22.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:22 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3913267749' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-14T08:51:22.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:22 smithi057 ceph-mon[103313]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-14T08:51:22.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:22 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3913267749' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-14T08:51:22.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-mon[99452]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-10-14T08:51:22.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3913267749' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-14T08:51:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.528+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d28103610 con 0x7f6d100a1500 2023-10-14T08:51:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.571+0000 7f6d257fa700 1 -- 172.21.15.6:0/3037933270 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6d28103610 con 0x7f6d100a1500 2023-10-14T08:51:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6d100a1500 msgr2=0x7f6d100a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6d100a1500 0x7f6d100a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009c60 tx=0x7f6d18009260 comp rx=0 tx=0).stop 2023-10-14T08:51:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 msgr2=0x7f6d280fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 0x7f6d280fff30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d20007ee0 tx=0x7f6d2000d3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 shutdown_connections 2023-10-14T08:51:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d28106ca0 0x7f6d280fff30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d28101a40 0x7f6d281013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6d100a1500 0x7f6d100a39c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 --2- 172.21.15.6:0/3037933270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d28104370 0x7f6d280ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 >> 172.21.15.6:0/3037933270 conn(0x7f6d280fb410 msgr2=0x7f6d28102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 shutdown_connections 2023-10-14T08:51:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.573+0000 7f6d2e803700 1 -- 172.21.15.6:0/3037933270 wait complete. 2023-10-14T08:51:22.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-14T08:51:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 -- 172.21.15.6:0/806760396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 msgr2=0x7fae681082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 --2- 172.21.15.6:0/806760396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae681082d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae6000b0a0 tx=0x7fae6000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 -- 172.21.15.6:0/806760396 shutdown_connections 2023-10-14T08:51:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 --2- 172.21.15.6:0/806760396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae681082d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 --2- 172.21.15.6:0/806760396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae680ffea0 0x7fae681002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 --2- 172.21.15.6:0/806760396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 0x7fae68101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 -- 172.21.15.6:0/806760396 >> 172.21.15.6:0/806760396 conn(0x7fae680fb430 msgr2=0x7fae680fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 -- 172.21.15.6:0/806760396 shutdown_connections 2023-10-14T08:51:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.715+0000 7fae6e268700 1 -- 172.21.15.6:0/806760396 wait complete. 2023-10-14T08:51:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 Processor -- start 2023-10-14T08:51:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 -- start start 2023-10-14T08:51:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae680ffea0 0x7fae68195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 0x7fae681961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae6819d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6819d800 con 0x7fae681019b0 2023-10-14T08:51:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6819d970 con 0x7fae68100ff0 2023-10-14T08:51:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6e268700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6819db30 con 0x7fae680ffea0 2023-10-14T08:51:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae6819d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae6819d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59444/0 (socket says 172.21.15.6:59444) 2023-10-14T08:51:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 -- 172.21.15.6:0/425560993 learned_addr learned my addr 172.21.15.6:0/425560993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae67fff700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae680ffea0 0x7fae68195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae677fe700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 0x7fae681961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 -- 172.21.15.6:0/425560993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae680ffea0 msgr2=0x7fae68195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae680ffea0 0x7fae68195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 -- 172.21.15.6:0/425560993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 msgr2=0x7fae681961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 0x7fae681961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae6c805700 1 -- 172.21.15.6:0/425560993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60009d00 con 0x7fae681019b0 2023-10-14T08:51:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.716+0000 7fae677fe700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 0x7fae681961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.717+0000 7fae6c805700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae6819d230 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae6000d010 tx=0x7fae6000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.717+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000e040 con 0x7fae681019b0 2023-10-14T08:51:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.717+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae60003e10 con 0x7fae681019b0 2023-10-14T08:51:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.717+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6819ddb0 con 0x7fae681019b0 2023-10-14T08:51:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.717+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60005260 con 0x7fae681019b0 2023-10-14T08:51:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.717+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6819e1d0 con 0x7fae681019b0 2023-10-14T08:51:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.718+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae68106d70 con 0x7fae681019b0 2023-10-14T08:51:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.719+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fae600053c0 con 0x7fae681019b0 2023-10-14T08:51:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.719+0000 7fae657fa700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fae540a1500 0x7fae540a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.720+0000 7fae67fff700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fae540a1500 0x7fae540a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.720+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fae600cd870 con 0x7fae681019b0 2023-10-14T08:51:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.720+0000 7fae67fff700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fae540a1500 0x7fae540a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae68196b60 tx=0x7fae5000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.724+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae600970b0 con 0x7fae681019b0 2023-10-14T08:51:22.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.963+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fae6802d230 con 0x7fae540a1500 2023-10-14T08:51:22.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.968+0000 7fae657fa700 1 -- 172.21.15.6:0/425560993 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fae6802d230 con 0x7fae540a1500 2023-10-14T08:51:22.970 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/_nogroup/sv_0/3eb53062-d306-4f05-b676-67d0de6e8be4 2023-10-14T08:51:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fae540a1500 msgr2=0x7fae540a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fae540a1500 0x7fae540a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae68196b60 tx=0x7fae5000b410 comp rx=0 tx=0).stop 2023-10-14T08:51:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 msgr2=0x7fae6819d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae6819d230 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae6000d010 tx=0x7fae6000bc80 comp rx=0 tx=0).stop 2023-10-14T08:51:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 shutdown_connections 2023-10-14T08:51:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae681019b0 0x7fae6819d230 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae680ffea0 0x7fae68195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fae540a1500 0x7fae540a39c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 --2- 172.21.15.6:0/425560993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae68100ff0 0x7fae681961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 >> 172.21.15.6:0/425560993 conn(0x7fae680fb430 msgr2=0x7fae680fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 shutdown_connections 2023-10-14T08:51:22.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:22.970+0000 7fae6e268700 1 -- 172.21.15.6:0/425560993 wait complete. 2023-10-14T08:51:22.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:51:22.533+0000 7f98b820d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T08:51:22.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:51:22.533+0000 7f98b820d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T08:51:22.981 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:51:22.533+0000 7f98b820d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T08:51:22.982 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:51:22.533+0000 7f98b820d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T08:51:22.982 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 08:51:22 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T08:51:22.533+0000 7f98b820d700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-14T08:51:22.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-14T08:51:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 -- 172.21.15.6:0/1258774848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac101a20 msgr2=0x7f44ac108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/1258774848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac101a20 0x7f44ac108340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f44a400b0a0 tx=0x7f44a400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 -- 172.21.15.6:0/1258774848 shutdown_connections 2023-10-14T08:51:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/1258774848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac101a20 0x7f44ac108340 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/1258774848 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44ac0ffe80 0x7f44ac1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/1258774848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ac101060 0x7f44ac1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 -- 172.21.15.6:0/1258774848 >> 172.21.15.6:0/1258774848 conn(0x7f44ac0fb420 msgr2=0x7f44ac0fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 -- 172.21.15.6:0/1258774848 shutdown_connections 2023-10-14T08:51:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.113+0000 7f44b2d9f700 1 -- 172.21.15.6:0/1258774848 wait complete. 2023-10-14T08:51:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 Processor -- start 2023-10-14T08:51:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 -- start start 2023-10-14T08:51:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 0x7f44ac195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44ac101060 0x7f44ac196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ac101a20 0x7f44ac19d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac19d830 con 0x7f44ac0ffe80 2023-10-14T08:51:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac19d9a0 con 0x7f44ac101060 2023-10-14T08:51:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b2d9f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac19db60 con 0x7f44ac101a20 2023-10-14T08:51:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 0x7f44ac195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 0x7f44ac195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59454/0 (socket says 172.21.15.6:59454) 2023-10-14T08:51:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 -- 172.21.15.6:0/2519158367 learned_addr learned my addr 172.21.15.6:0/2519158367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b133c700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ac101a20 0x7f44ac19d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44abfff700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44ac101060 0x7f44ac196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 -- 172.21.15.6:0/2519158367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ac101a20 msgr2=0x7f44ac19d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ac101a20 0x7f44ac19d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 -- 172.21.15.6:0/2519158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44ac101060 msgr2=0x7f44ac196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44ac101060 0x7f44ac196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.114+0000 7f44b0b3b700 1 -- 172.21.15.6:0/2519158367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009d00 con 0x7f44ac0ffe80 2023-10-14T08:51:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.115+0000 7f44b0b3b700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 0x7f44ac195cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f44a000e970 tx=0x7f44a000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.115+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0009790 con 0x7f44ac0ffe80 2023-10-14T08:51:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.115+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44a000eec0 con 0x7f44ac0ffe80 2023-10-14T08:51:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.115+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac19de40 con 0x7f44ac0ffe80 2023-10-14T08:51:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.115+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0003cf0 con 0x7f44ac0ffe80 2023-10-14T08:51:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.115+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac19e260 con 0x7f44ac0ffe80 2023-10-14T08:51:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.116+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac107450 con 0x7f44ac0ffe80 2023-10-14T08:51:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.117+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f44a000ccd0 con 0x7f44ac0ffe80 2023-10-14T08:51:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.117+0000 7f44a9ffb700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f449c0a1480 0x7f449c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.117+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f44a0014070 con 0x7f44ac0ffe80 2023-10-14T08:51:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.117+0000 7f44abfff700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f449c0a1480 0x7f449c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.118+0000 7f44abfff700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f449c0a1480 0x7f449c0a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0ffba0 tx=0x7f4498009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.122+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f44a0096590 con 0x7f44ac0ffe80 2023-10-14T08:51:23.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.361+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f44ac02d160 con 0x7f449c0a1480 2023-10-14T08:51:23.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: pgmap v261: 97 pgs: 92 active+clean, 5 creating+peering; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-14T08:51:23.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3913267749' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-14T08:51:23.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] up:active 2023-10-14T08:51:23.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-14T08:51:23.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2023-10-14T08:51:23.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=h=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-10-14T08:51:23.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:23 smithi178 ceph-mon[103612]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-10-14T08:51:23.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.386+0000 7f44a9ffb700 1 -- 172.21.15.6:0/2519158367 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f44ac02d160 con 0x7f449c0a1480 2023-10-14T08:51:23.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.388+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f449c0a1480 msgr2=0x7f449c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.388+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f449c0a1480 0x7f449c0a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0ffba0 tx=0x7f4498009260 comp rx=0 tx=0).stop 2023-10-14T08:51:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 msgr2=0x7f44ac195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 0x7f44ac195cf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f44a000e970 tx=0x7f44a000ec80 comp rx=0 tx=0).stop 2023-10-14T08:51:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 shutdown_connections 2023-10-14T08:51:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44ac101a20 0x7f44ac19d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44ac0ffe80 0x7f44ac195cf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f449c0a1480 0x7f449c0a3940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 --2- 172.21.15.6:0/2519158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44ac101060 0x7f44ac196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 >> 172.21.15.6:0/2519158367 conn(0x7f44ac0fb420 msgr2=0x7f44ac104590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 shutdown_connections 2023-10-14T08:51:23.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.389+0000 7f44b2d9f700 1 -- 172.21.15.6:0/2519158367 wait complete. 2023-10-14T08:51:23.401 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: pgmap v261: 97 pgs: 92 active+clean, 5 creating+peering; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-14T08:51:23.401 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3913267749' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-14T08:51:23.402 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] up:active 2023-10-14T08:51:23.402 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-14T08:51:23.402 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2023-10-14T08:51:23.402 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=h=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-10-14T08:51:23.402 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:23 smithi006 ceph-mon[99452]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-10-14T08:51:23.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-14T08:51:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: pgmap v261: 97 pgs: 92 active+clean, 5 creating+peering; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-14T08:51:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3913267749' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-14T08:51:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] up:active 2023-10-14T08:51:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-14T08:51:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2023-10-14T08:51:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=h=up:active,3=e=up:creating} 2 up:standby-replay 6 up:standby 2023-10-14T08:51:23.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:23 smithi057 ceph-mon[103313]: daemon mds.e is now active in filesystem cephfs as rank 3 2023-10-14T08:51:23.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/3122253576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 msgr2=0x7fbe84101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/3122253576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe84101470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009990 tx=0x7fbe70009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/3122253576 shutdown_connections 2023-10-14T08:51:23.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/3122253576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe841019b0 0x7fbe841082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/3122253576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe840ffea0 0x7fbe841002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/3122253576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe84101470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/3122253576 >> 172.21.15.6:0/3122253576 conn(0x7fbe840fb430 msgr2=0x7fbe840fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/3122253576 shutdown_connections 2023-10-14T08:51:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.531+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/3122253576 wait complete. 2023-10-14T08:51:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.532+0000 7fbe8ab6b700 1 Processor -- start 2023-10-14T08:51:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.532+0000 7fbe8ab6b700 1 -- start start 2023-10-14T08:51:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe840ffea0 0x7fbe84068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe8419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe841019b0 0x7fbe8419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8419e780 con 0x7fbe84100ff0 2023-10-14T08:51:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8419e8f0 con 0x7fbe841019b0 2023-10-14T08:51:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8419eab0 con 0x7fbe840ffea0 2023-10-14T08:51:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe8419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe8419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59472/0 (socket says 172.21.15.6:59472) 2023-10-14T08:51:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 -- 172.21.15.6:0/479387255 learned_addr learned my addr 172.21.15.6:0/479387255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe88907700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe840ffea0 0x7fbe84068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 -- 172.21.15.6:0/479387255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe840ffea0 msgr2=0x7fbe84068d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe840ffea0 0x7fbe84068d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 -- 172.21.15.6:0/479387255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe841019b0 msgr2=0x7fbe8419dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe841019b0 0x7fbe8419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 -- 172.21.15.6:0/479387255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700095f0 con 0x7fbe84100ff0 2023-10-14T08:51:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe83fff700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe8419b950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe70004760 tx=0x7fbe70009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7001d070 con 0x7fbe84100ff0 2023-10-14T08:51:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe70004200 con 0x7fbe84100ff0 2023-10-14T08:51:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8419ed30 con 0x7fbe84100ff0 2023-10-14T08:51:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.533+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe700049f0 con 0x7fbe84100ff0 2023-10-14T08:51:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.534+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8419f190 con 0x7fbe84100ff0 2023-10-14T08:51:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.534+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe84107420 con 0x7fbe84100ff0 2023-10-14T08:51:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.536+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbe70003d40 con 0x7fbe84100ff0 2023-10-14T08:51:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.536+0000 7fbe81ffb700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe740a1480 0x7fbe740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.536+0000 7fbe88907700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe740a1480 0x7fbe740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.536+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbe700cdb10 con 0x7fbe84100ff0 2023-10-14T08:51:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.537+0000 7fbe88907700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe740a1480 0x7fbe740a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe78005950 tx=0x7fbe780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:23.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.540+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbe70097350 con 0x7fbe84100ff0 2023-10-14T08:51:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.777+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe8402d320 con 0x7fbe740a1480 2023-10-14T08:51:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.782+0000 7fbe81ffb700 1 -- 172.21.15.6:0/479387255 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fbe8402d320 con 0x7fbe740a1480 2023-10-14T08:51:23.783 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e 2023-10-14T08:51:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe740a1480 msgr2=0x7fbe740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe740a1480 0x7fbe740a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbe78005950 tx=0x7fbe780058e0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 msgr2=0x7fbe8419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe8419b950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe70004760 tx=0x7fbe70009f90 comp rx=0 tx=0).stop 2023-10-14T08:51:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 shutdown_connections 2023-10-14T08:51:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe740a1480 0x7fbe740a3940 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe841019b0 0x7fbe8419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe840ffea0 0x7fbe84068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 --2- 172.21.15.6:0/479387255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe84100ff0 0x7fbe8419b950 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 >> 172.21.15.6:0/479387255 conn(0x7fbe840fb430 msgr2=0x7fbe84104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 shutdown_connections 2023-10-14T08:51:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.784+0000 7fbe8ab6b700 1 -- 172.21.15.6:0/479387255 wait complete. 2023-10-14T08:51:23.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:51:23.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 -- 172.21.15.6:0/384992764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 msgr2=0x7fbfa8108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/384992764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa8108270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000b0a0 tx=0x7fbfa000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 -- 172.21.15.6:0/384992764 shutdown_connections 2023-10-14T08:51:23.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/384992764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa8108270 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/384992764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfa8101450 0x7fbfa8101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/384992764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8100010 0x7fbfa8100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 -- 172.21.15.6:0/384992764 >> 172.21.15.6:0/384992764 conn(0x7fbfa80faa80 msgr2=0x7fbfa80fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 -- 172.21.15.6:0/384992764 shutdown_connections 2023-10-14T08:51:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 -- 172.21.15.6:0/384992764 wait complete. 2023-10-14T08:51:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 Processor -- start 2023-10-14T08:51:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.924+0000 7fbfae6b4700 1 -- start start 2023-10-14T08:51:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfa8100010 0x7fbfa80ffa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8101450 0x7fbfa819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819e7e0 con 0x7fbfa81009d0 2023-10-14T08:51:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819e950 con 0x7fbfa8101450 2023-10-14T08:51:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819eb10 con 0x7fbfa8100010 2023-10-14T08:51:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59486/0 (socket says 172.21.15.6:59486) 2023-10-14T08:51:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 -- 172.21.15.6:0/1946697974 learned_addr learned my addr 172.21.15.6:0/1946697974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa7fff700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfa8100010 0x7fbfa80ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfacc51700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8101450 0x7fbfa819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 -- 172.21.15.6:0/1946697974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfa8100010 msgr2=0x7fbfa80ffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfa8100010 0x7fbfa80ffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 -- 172.21.15.6:0/1946697974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8101450 msgr2=0x7fbfa819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8101450 0x7fbfa819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 -- 172.21.15.6:0/1946697974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009d00 con 0x7fbfa81009d0 2023-10-14T08:51:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfacc51700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8101450 0x7fbfa819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa77fe700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa819b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d950 tx=0x7fbf9800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98009b40 con 0x7fbfa81009d0 2023-10-14T08:51:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.925+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa819edf0 con 0x7fbfa81009d0 2023-10-14T08:51:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.926+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf98009ca0 con 0x7fbfa81009d0 2023-10-14T08:51:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.926+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800f620 con 0x7fbfa81009d0 2023-10-14T08:51:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.926+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa819f280 con 0x7fbfa81009d0 2023-10-14T08:51:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.927+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa810b610 con 0x7fbfa81009d0 2023-10-14T08:51:23.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.928+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbf98010460 con 0x7fbfa81009d0 2023-10-14T08:51:23.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.928+0000 7fbfa57fa700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf940a1480 0x7fbf940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:23.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.928+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbf980ccf30 con 0x7fbfa81009d0 2023-10-14T08:51:23.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.928+0000 7fbfa7fff700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf940a1480 0x7fbf940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:23.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.929+0000 7fbfa7fff700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf940a1480 0x7fbf940a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf90005950 tx=0x7fbf900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:23.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:23.933+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbf980966e0 con 0x7fbfa81009d0 2023-10-14T08:51:24.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.158+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fbf98096ab0 con 0x7fbfa81009d0 2023-10-14T08:51:24.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.188+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfa8106c90 con 0x7fbfa81009d0 2023-10-14T08:51:24.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.189+0000 7fbfa57fa700 1 -- 172.21.15.6:0/1946697974 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7fbf9805f800 con 0x7fbfa81009d0 2023-10-14T08:51:24.191 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:24.191 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:51:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf940a1480 msgr2=0x7fbf940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf940a1480 0x7fbf940a3940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf90005950 tx=0x7fbf900058e0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 msgr2=0x7fbfa819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa819b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d950 tx=0x7fbf9800dd10 comp rx=0 tx=0).stop 2023-10-14T08:51:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 shutdown_connections 2023-10-14T08:51:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf940a1480 0x7fbf940a3940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa8101450 0x7fbfa819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfa8100010 0x7fbfa80ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 --2- 172.21.15.6:0/1946697974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbfa81009d0 0x7fbfa819b9c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.191+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 >> 172.21.15.6:0/1946697974 conn(0x7fbfa80faa80 msgr2=0x7fbfa80fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.192+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 shutdown_connections 2023-10-14T08:51:24.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.192+0000 7fbfae6b4700 1 -- 172.21.15.6:0/1946697974 wait complete. 2023-10-14T08:51:24.196 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:51:24.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:51:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 -- 172.21.15.6:0/403332775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 msgr2=0x7fcdc8109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/403332775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc8109030 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000b0a0 tx=0x7fcdc000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 -- 172.21.15.6:0/403332775 shutdown_connections 2023-10-14T08:51:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/403332775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc8109030 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/403332775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc81019c0 0x7fcdc8103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/403332775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc81042f0 0x7fcdc81066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.329+0000 7fcdcf17b700 1 -- 172.21.15.6:0/403332775 >> 172.21.15.6:0/403332775 conn(0x7fcdc80fb310 msgr2=0x7fcdc80fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 -- 172.21.15.6:0/403332775 shutdown_connections 2023-10-14T08:51:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 -- 172.21.15.6:0/403332775 wait complete. 2023-10-14T08:51:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 Processor -- start 2023-10-14T08:51:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 -- start start 2023-10-14T08:51:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc81019c0 0x7fcdc8196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc81042f0 0x7fcdc81971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc819e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc819e810 con 0x7fcdc8106c20 2023-10-14T08:51:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc819e980 con 0x7fcdc81042f0 2023-10-14T08:51:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcf17b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc819eb40 con 0x7fcdc81019c0 2023-10-14T08:51:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcd718700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc819e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcd718700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc819e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59524/0 (socket says 172.21.15.6:59524) 2023-10-14T08:51:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdcd718700 1 -- 172.21.15.6:0/3447235119 learned_addr learned my addr 172.21.15.6:0/3447235119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.330+0000 7fcdccf17700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc81019c0 0x7fcdc8196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdc7fff700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc81042f0 0x7fcdc81971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcd718700 1 -- 172.21.15.6:0/3447235119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc81019c0 msgr2=0x7fcdc8196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcd718700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc81019c0 0x7fcdc8196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcd718700 1 -- 172.21.15.6:0/3447235119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc81042f0 msgr2=0x7fcdc81971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcd718700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc81042f0 0x7fcdc81971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcd718700 1 -- 172.21.15.6:0/3447235119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0009d00 con 0x7fcdc8106c20 2023-10-14T08:51:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcd718700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc819e240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00062a0 tx=0x7fcdc0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc000e040 con 0x7fcdc8106c20 2023-10-14T08:51:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdc000cec0 con 0x7fcdc8106c20 2023-10-14T08:51:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc819edc0 con 0x7fcdc8106c20 2023-10-14T08:51:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc001baf0 con 0x7fcdc8106c20 2023-10-14T08:51:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.331+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc819f1e0 con 0x7fcdc8106c20 2023-10-14T08:51:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.332+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc80fce90 con 0x7fcdc8106c20 2023-10-14T08:51:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.333+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fcdc001bc50 con 0x7fcdc8106c20 2023-10-14T08:51:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.334+0000 7fcdc5ffb700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcdb80a1590 0x7fcdb80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.334+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcdc00ce8a0 con 0x7fcdc8106c20 2023-10-14T08:51:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.334+0000 7fcdccf17700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcdb80a1590 0x7fcdb80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.334+0000 7fcdccf17700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcdb80a1590 0x7fcdb80a3a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8197b70 tx=0x7fcdbc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:24.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.338+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcdc0097fe0 con 0x7fcdc8106c20 2023-10-14T08:51:24.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:24.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:24.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] up:active 2023-10-14T08:51:24.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-14T08:51:24.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-14T08:51:24.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: Cluster is now healthy 2023-10-14T08:51:24.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=h=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-10-14T08:51:24.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-10-14T08:51:24.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:24 smithi057 ceph-mon[103313]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-10-14T08:51:24.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:24.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:24.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] up:active 2023-10-14T08:51:24.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-14T08:51:24.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-14T08:51:24.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: Cluster is now healthy 2023-10-14T08:51:24.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=h=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-10-14T08:51:24.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-10-14T08:51:24.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:24 smithi006 ceph-mon[99452]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-10-14T08:51:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.543+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdc810c840 con 0x7fcdc8106c20 2023-10-14T08:51:24.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.545+0000 7fcdc5ffb700 1 -- 172.21.15.6:0/3447235119 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22034 (secure 0 0 0) 0x7fcdc009b600 con 0x7fcdc8106c20 2023-10-14T08:51:24.547 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:24.547 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:51:17.789244+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:51:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcdb80a1590 msgr2=0x7fcdb80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcdb80a1590 0x7fcdb80a3a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8197b70 tx=0x7fcdbc00a380 comp rx=0 tx=0).stop 2023-10-14T08:51:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 msgr2=0x7fcdc819e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc819e240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00062a0 tx=0x7fcdc0004d00 comp rx=0 tx=0).stop 2023-10-14T08:51:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 shutdown_connections 2023-10-14T08:51:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdc8106c20 0x7fcdc819e240 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdc81019c0 0x7fcdc8196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcdb80a1590 0x7fcdb80a3a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 --2- 172.21.15.6:0/3447235119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc81042f0 0x7fcdc81971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 >> 172.21.15.6:0/3447235119 conn(0x7fcdc80fb310 msgr2=0x7fcdc8102630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 shutdown_connections 2023-10-14T08:51:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.547+0000 7fcdcf17b700 1 -- 172.21.15.6:0/3447235119 wait complete. 2023-10-14T08:51:24.561 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T08:51:24.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T08:51:24.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:24.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:24.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] up:active 2023-10-14T08:51:24.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-14T08:51:24.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-14T08:51:24.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: Cluster is now healthy 2023-10-14T08:51:24.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=h=up:active,3=e=up:active} 2 up:standby-replay 6 up:standby 2023-10-14T08:51:24.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-10-14T08:51:24.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:24 smithi178 ceph-mon[103612]: daemon mds.k is now active in filesystem cephfs as rank 4 2023-10-14T08:51:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 -- 172.21.15.6:0/3504016482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 msgr2=0x7ff474102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 --2- 172.21.15.6:0/3504016482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff474102680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff460009990 tx=0x7ff460009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 -- 172.21.15.6:0/3504016482 shutdown_connections 2023-10-14T08:51:24.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 --2- 172.21.15.6:0/3504016482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff474102bc0 0x7ff474109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 --2- 172.21.15.6:0/3504016482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740ff1b0 0x7ff4740ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 --2- 172.21.15.6:0/3504016482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff474102680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 -- 172.21.15.6:0/3504016482 >> 172.21.15.6:0/3504016482 conn(0x7ff4740faa80 msgr2=0x7ff4740fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:24.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 -- 172.21.15.6:0/3504016482 shutdown_connections 2023-10-14T08:51:24.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 -- 172.21.15.6:0/3504016482 wait complete. 2023-10-14T08:51:24.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 Processor -- start 2023-10-14T08:51:24.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.686+0000 7ff47aece700 1 -- start start 2023-10-14T08:51:24.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740ff1b0 0x7ff474101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff4741001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff474102bc0 0x7ff474100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474100eb0 con 0x7ff474102220 2023-10-14T08:51:24.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474101020 con 0x7ff474102bc0 2023-10-14T08:51:24.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741a0c40 con 0x7ff4740ff1b0 2023-10-14T08:51:24.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff4741001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff4741001d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59536/0 (socket says 172.21.15.6:59536) 2023-10-14T08:51:24.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 -- 172.21.15.6:0/2083788037 learned_addr learned my addr 172.21.15.6:0/2083788037 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:24.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff478c6a700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740ff1b0 0x7ff474101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 -- 172.21.15.6:0/2083788037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740ff1b0 msgr2=0x7ff474101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740ff1b0 0x7ff474101b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 -- 172.21.15.6:0/2083788037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff474102bc0 msgr2=0x7ff474100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff474102bc0 0x7ff474100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 -- 172.21.15.6:0/2083788037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600095f0 con 0x7ff474102220 2023-10-14T08:51:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff473fff700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff4741001d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff460005910 tx=0x7ff46000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46001d070 con 0x7ff474102220 2023-10-14T08:51:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4741a0ec0 con 0x7ff474102220 2023-10-14T08:51:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff46000fc30 con 0x7ff474102220 2023-10-14T08:51:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.687+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460017650 con 0x7ff474102220 2023-10-14T08:51:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.688+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4741a12e0 con 0x7ff474102220 2023-10-14T08:51:24.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.688+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474107fb0 con 0x7ff474102220 2023-10-14T08:51:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.690+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7ff460022470 con 0x7ff474102220 2023-10-14T08:51:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.690+0000 7ff471ffb700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff4640a1510 0x7ff4640a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.690+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff4600ce5e0 con 0x7ff474102220 2023-10-14T08:51:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.690+0000 7ff478c6a700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff4640a1510 0x7ff4640a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.691+0000 7ff478c6a700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff4640a1510 0x7ff4640a39d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff468005950 tx=0x7ff4680058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.694+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff460097db0 con 0x7ff474102220 2023-10-14T08:51:24.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.894+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff47402d360 con 0x7ff4640a1510 2023-10-14T08:51:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.906+0000 7ff471ffb700 1 -- 172.21.15.6:0/2083788037 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335124 (secure 0 0 0) 0x7ff47402d360 con 0x7ff4640a1510 2023-10-14T08:51:24.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:24.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff4640a1510 msgr2=0x7ff4640a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff4640a1510 0x7ff4640a39d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff468005950 tx=0x7ff4680058e0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 msgr2=0x7ff4741001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:24.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff4741001d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff460005910 tx=0x7ff46000f740 comp rx=0 tx=0).stop 2023-10-14T08:51:24.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 shutdown_connections 2023-10-14T08:51:24.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff4640a1510 0x7ff4640a39d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff474102bc0 0x7ff474100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740ff1b0 0x7ff474101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 --2- 172.21.15.6:0/2083788037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff474102220 0x7ff4741001d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:24.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.910+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 >> 172.21.15.6:0/2083788037 conn(0x7ff4740faa80 msgr2=0x7ff4740fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:24.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.911+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 shutdown_connections 2023-10-14T08:51:24.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:24.911+0000 7ff47aece700 1 -- 172.21.15.6:0/2083788037 wait complete. 2023-10-14T08:51:24.918 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:51:24.925 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-10-14T08:51:23.432264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594072,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":136,"num_read_kb":117,"num_write":254,"num_write_kb":2962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336440,"kb_used_data":12212,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605384,"statfs":{"total":1151940427776,"available":1151595913216,"internally_reserved":0,"allocated":12505088,"data_stored":6865594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3704,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.590490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943427+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:51:17.943427+0000","last_peered":"2023-10-14T08:51:17.943427+0000","last_clean":"2023-10-14T08:51:17.943427+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:51:17.943427+0000","last_undegraded":"2023-10-14T08:51:17.943427+0000","last_fullsized":"2023-10-14T08:51:17.943427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303447+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:51:18.303447+0000","last_peered":"2023-10-14T08:51:18.303447+0000","last_clean":"2023-10-14T08:51:18.303447+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:51:18.303447+0000","last_undegraded":"2023-10-14T08:51:18.303447+0000","last_fullsized":"2023-10-14T08:51:18.303447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303393+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:51:18.303393+0000","last_peered":"2023-10-14T08:51:18.303393+0000","last_clean":"2023-10-14T08:51:18.303393+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:51:18.303393+0000","last_undegraded":"2023-10-14T08:51:18.303393+0000","last_fullsized":"2023-10-14T08:51:18.303393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303661+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:51:18.303661+0000","last_peered":"2023-10-14T08:51:18.303661+0000","last_clean":"2023-10-14T08:51:18.303661+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:51:18.303661+0000","last_undegraded":"2023-10-14T08:51:18.303661+0000","last_fullsized":"2023-10-14T08:51:18.303661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792964+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:51:17.792964+0000","last_peered":"2023-10-14T08:51:17.792964+0000","last_clean":"2023-10-14T08:51:17.792964+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:51:17.792964+0000","last_undegraded":"2023-10-14T08:51:17.792964+0000","last_fullsized":"2023-10-14T08:51:17.792964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303906+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:51:18.303906+0000","last_peered":"2023-10-14T08:51:18.303906+0000","last_clean":"2023-10-14T08:51:18.303906+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:51:18.303906+0000","last_undegraded":"2023-10-14T08:51:18.303906+0000","last_fullsized":"2023-10-14T08:51:18.303906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796977+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:51:17.796977+0000","last_peered":"2023-10-14T08:51:17.796977+0000","last_clean":"2023-10-14T08:51:17.796977+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:51:17.796977+0000","last_undegraded":"2023-10-14T08:51:17.796977+0000","last_fullsized":"2023-10-14T08:51:17.796977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864046+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:51:17.864046+0000","last_peered":"2023-10-14T08:51:17.864046+0000","last_clean":"2023-10-14T08:51:17.864046+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:51:17.864046+0000","last_undegraded":"2023-10-14T08:51:17.864046+0000","last_fullsized":"2023-10-14T08:51:17.864046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303385+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:51:18.303385+0000","last_peered":"2023-10-14T08:51:18.303385+0000","last_clean":"2023-10-14T08:51:18.303385+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:51:18.303385+0000","last_undegraded":"2023-10-14T08:51:18.303385+0000","last_fullsized":"2023-10-14T08:51:18.303385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.304201+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:51:18.304201+0000","last_peered":"2023-10-14T08:51:18.304201+0000","last_clean":"2023-10-14T08:51:18.304201+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:51:18.304201+0000","last_undegraded":"2023-10-14T08:51:18.304201+0000","last_fullsized":"2023-10-14T08:51:18.304201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797358+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:51:17.797358+0000","last_peered":"2023-10-14T08:51:17.797358+0000","last_clean":"2023-10-14T08:51:17.797358+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:51:17.797358+0000","last_undegraded":"2023-10-14T08:51:17.797358+0000","last_fullsized":"2023-10-14T08:51:17.797358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303516+0000","last_change":"2023-10-14T08:51:16.820037+0000","last_active":"2023-10-14T08:51:18.303516+0000","last_peered":"2023-10-14T08:51:18.303516+0000","last_clean":"2023-10-14T08:51:18.303516+0000","last_became_active":"2023-10-14T08:51:16.819251+0000","last_became_peered":"2023-10-14T08:51:16.819251+0000","last_unstale":"2023-10-14T08:51:18.303516+0000","last_undegraded":"2023-10-14T08:51:18.303516+0000","last_fullsized":"2023-10-14T08:51:18.303516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:37.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792932+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:51:17.792932+0000","last_peered":"2023-10-14T08:51:17.792932+0000","last_clean":"2023-10-14T08:51:17.792932+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:51:17.792932+0000","last_undegraded":"2023-10-14T08:51:17.792932+0000","last_fullsized":"2023-10-14T08:51:17.792932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302685+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:51:18.302685+0000","last_peered":"2023-10-14T08:51:18.302685+0000","last_clean":"2023-10-14T08:51:18.302685+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:51:18.302685+0000","last_undegraded":"2023-10-14T08:51:18.302685+0000","last_fullsized":"2023-10-14T08:51:18.302685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302848+0000","last_change":"2023-10-14T08:51:16.819942+0000","last_active":"2023-10-14T08:51:18.302848+0000","last_peered":"2023-10-14T08:51:18.302848+0000","last_clean":"2023-10-14T08:51:18.302848+0000","last_became_active":"2023-10-14T08:51:16.819615+0000","last_became_peered":"2023-10-14T08:51:16.819615+0000","last_unstale":"2023-10-14T08:51:18.302848+0000","last_undegraded":"2023-10-14T08:51:18.302848+0000","last_fullsized":"2023-10-14T08:51:18.302848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:10.523238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302489+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:51:18.302489+0000","last_peered":"2023-10-14T08:51:18.302489+0000","last_clean":"2023-10-14T08:51:18.302489+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:51:18.302489+0000","last_undegraded":"2023-10-14T08:51:18.302489+0000","last_fullsized":"2023-10-14T08:51:18.302489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943598+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:51:17.943598+0000","last_peered":"2023-10-14T08:51:17.943598+0000","last_clean":"2023-10-14T08:51:17.943598+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:51:17.943598+0000","last_undegraded":"2023-10-14T08:51:17.943598+0000","last_fullsized":"2023-10-14T08:51:17.943598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302614+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:51:18.302614+0000","last_peered":"2023-10-14T08:51:18.302614+0000","last_clean":"2023-10-14T08:51:18.302614+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:51:18.302614+0000","last_undegraded":"2023-10-14T08:51:18.302614+0000","last_fullsized":"2023-10-14T08:51:18.302614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302553+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:51:18.302553+0000","last_peered":"2023-10-14T08:51:18.302553+0000","last_clean":"2023-10-14T08:51:18.302553+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:51:18.302553+0000","last_undegraded":"2023-10-14T08:51:18.302553+0000","last_fullsized":"2023-10-14T08:51:18.302553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.107447+0000","last_change":"2023-10-14T08:51:15.861680+0000","last_active":"2023-10-14T08:51:17.107447+0000","last_peered":"2023-10-14T08:51:17.107447+0000","last_clean":"2023-10-14T08:51:17.107447+0000","last_became_active":"2023-10-14T08:51:15.861353+0000","last_became_peered":"2023-10-14T08:51:15.861353+0000","last_unstale":"2023-10-14T08:51:17.107447+0000","last_undegraded":"2023-10-14T08:51:17.107447+0000","last_fullsized":"2023-10-14T08:51:17.107447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:40:24.320642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864587+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:51:17.864587+0000","last_peered":"2023-10-14T08:51:17.864587+0000","last_clean":"2023-10-14T08:51:17.864587+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:51:17.864587+0000","last_undegraded":"2023-10-14T08:51:17.864587+0000","last_fullsized":"2023-10-14T08:51:17.864587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864516+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:51:17.864516+0000","last_peered":"2023-10-14T08:51:17.864516+0000","last_clean":"2023-10-14T08:51:17.864516+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:51:17.864516+0000","last_undegraded":"2023-10-14T08:51:17.864516+0000","last_fullsized":"2023-10-14T08:51:17.864516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303619+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:51:18.303619+0000","last_peered":"2023-10-14T08:51:18.303619+0000","last_clean":"2023-10-14T08:51:18.303619+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:51:18.303619+0000","last_undegraded":"2023-10-14T08:51:18.303619+0000","last_fullsized":"2023-10-14T08:51:18.303619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793320+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:51:17.793320+0000","last_peered":"2023-10-14T08:51:17.793320+0000","last_clean":"2023-10-14T08:51:17.793320+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:51:17.793320+0000","last_undegraded":"2023-10-14T08:51:17.793320+0000","last_fullsized":"2023-10-14T08:51:17.793320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303392+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:51:18.303392+0000","last_peered":"2023-10-14T08:51:18.303392+0000","last_clean":"2023-10-14T08:51:18.303392+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:51:18.303392+0000","last_undegraded":"2023-10-14T08:51:18.303392+0000","last_fullsized":"2023-10-14T08:51:18.303392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793166+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:51:17.793166+0000","last_peered":"2023-10-14T08:51:17.793166+0000","last_clean":"2023-10-14T08:51:17.793166+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:51:17.793166+0000","last_undegraded":"2023-10-14T08:51:17.793166+0000","last_fullsized":"2023-10-14T08:51:17.793166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802533+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:51:17.802533+0000","last_peered":"2023-10-14T08:51:17.802533+0000","last_clean":"2023-10-14T08:51:17.802533+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:51:17.802533+0000","last_undegraded":"2023-10-14T08:51:17.802533+0000","last_fullsized":"2023-10-14T08:51:17.802533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.105164+0000","last_change":"2023-10-14T08:51:15.860943+0000","last_active":"2023-10-14T08:51:21.105164+0000","last_peered":"2023-10-14T08:51:21.105164+0000","last_clean":"2023-10-14T08:51:21.105164+0000","last_became_active":"2023-10-14T08:51:15.860636+0000","last_became_peered":"2023-10-14T08:51:15.860636+0000","last_unstale":"2023-10-14T08:51:21.105164+0000","last_undegraded":"2023-10-14T08:51:21.105164+0000","last_fullsized":"2023-10-14T08:51:21.105164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:36.037274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792973+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:51:17.792973+0000","last_peered":"2023-10-14T08:51:17.792973+0000","last_clean":"2023-10-14T08:51:17.792973+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:51:17.792973+0000","last_undegraded":"2023-10-14T08:51:17.792973+0000","last_fullsized":"2023-10-14T08:51:17.792973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.116627+0000","last_change":"2023-10-14T08:51:15.864182+0000","last_active":"2023-10-14T08:51:21.116627+0000","last_peered":"2023-10-14T08:51:21.116627+0000","last_clean":"2023-10-14T08:51:21.116627+0000","last_became_active":"2023-10-14T08:51:15.863841+0000","last_became_peered":"2023-10-14T08:51:15.863841+0000","last_unstale":"2023-10-14T08:51:21.116627+0000","last_undegraded":"2023-10-14T08:51:21.116627+0000","last_fullsized":"2023-10-14T08:51:21.116627+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:21.974223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802079+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:51:17.802079+0000","last_peered":"2023-10-14T08:51:17.802079+0000","last_clean":"2023-10-14T08:51:17.802079+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:51:17.802079+0000","last_undegraded":"2023-10-14T08:51:17.802079+0000","last_fullsized":"2023-10-14T08:51:17.802079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.791659+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:51:16.791659+0000","last_peered":"2023-10-14T08:51:16.791659+0000","last_clean":"2023-10-14T08:51:16.791659+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:51:16.791659+0000","last_undegraded":"2023-10-14T08:51:16.791659+0000","last_fullsized":"2023-10-14T08:51:16.791659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864335+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:51:17.864335+0000","last_peered":"2023-10-14T08:51:17.864335+0000","last_clean":"2023-10-14T08:51:17.864335+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:51:17.864335+0000","last_undegraded":"2023-10-14T08:51:17.864335+0000","last_fullsized":"2023-10-14T08:51:17.864335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801802+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:51:17.801802+0000","last_peered":"2023-10-14T08:51:17.801802+0000","last_clean":"2023-10-14T08:51:17.801802+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:51:17.801802+0000","last_undegraded":"2023-10-14T08:51:17.801802+0000","last_fullsized":"2023-10-14T08:51:17.801802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302706+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:51:18.302706+0000","last_peered":"2023-10-14T08:51:18.302706+0000","last_clean":"2023-10-14T08:51:18.302706+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:51:18.302706+0000","last_undegraded":"2023-10-14T08:51:18.302706+0000","last_fullsized":"2023-10-14T08:51:18.302706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131680+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:51:20.131680+0000","last_peered":"2023-10-14T08:51:20.131680+0000","last_clean":"2023-10-14T08:51:20.131680+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:51:20.131680+0000","last_undegraded":"2023-10-14T08:51:20.131680+0000","last_fullsized":"2023-10-14T08:51:20.131680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302765+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:51:18.302765+0000","last_peered":"2023-10-14T08:51:18.302765+0000","last_clean":"2023-10-14T08:51:18.302765+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:51:18.302765+0000","last_undegraded":"2023-10-14T08:51:18.302765+0000","last_fullsized":"2023-10-14T08:51:18.302765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131201+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:51:20.131201+0000","last_peered":"2023-10-14T08:51:20.131201+0000","last_clean":"2023-10-14T08:51:20.131201+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:51:20.131201+0000","last_undegraded":"2023-10-14T08:51:20.131201+0000","last_fullsized":"2023-10-14T08:51:20.131201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303623+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:51:18.303623+0000","last_peered":"2023-10-14T08:51:18.303623+0000","last_clean":"2023-10-14T08:51:18.303623+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:51:18.303623+0000","last_undegraded":"2023-10-14T08:51:18.303623+0000","last_fullsized":"2023-10-14T08:51:18.303623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131412+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:51:20.131412+0000","last_peered":"2023-10-14T08:51:20.131412+0000","last_clean":"2023-10-14T08:51:20.131412+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:51:20.131412+0000","last_undegraded":"2023-10-14T08:51:20.131412+0000","last_fullsized":"2023-10-14T08:51:20.131412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303602+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:51:18.303602+0000","last_peered":"2023-10-14T08:51:18.303602+0000","last_clean":"2023-10-14T08:51:18.303602+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:51:18.303602+0000","last_undegraded":"2023-10-14T08:51:18.303602+0000","last_fullsized":"2023-10-14T08:51:18.303602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.105241+0000","last_change":"2023-10-14T08:51:15.865840+0000","last_active":"2023-10-14T08:51:21.105241+0000","last_peered":"2023-10-14T08:51:21.105241+0000","last_clean":"2023-10-14T08:51:21.105241+0000","last_became_active":"2023-10-14T08:51:15.865393+0000","last_became_peered":"2023-10-14T08:51:15.865393+0000","last_unstale":"2023-10-14T08:51:21.105241+0000","last_undegraded":"2023-10-14T08:51:21.105241+0000","last_fullsized":"2023-10-14T08:51:21.105241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:02:17.524700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793227+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:51:17.793227+0000","last_peered":"2023-10-14T08:51:17.793227+0000","last_clean":"2023-10-14T08:51:17.793227+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:51:17.793227+0000","last_undegraded":"2023-10-14T08:51:17.793227+0000","last_fullsized":"2023-10-14T08:51:17.793227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.130780+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:51:20.130780+0000","last_peered":"2023-10-14T08:51:20.130780+0000","last_clean":"2023-10-14T08:51:20.130780+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:51:20.130780+0000","last_undegraded":"2023-10-14T08:51:20.130780+0000","last_fullsized":"2023-10-14T08:51:20.130780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792895+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:51:17.792895+0000","last_peered":"2023-10-14T08:51:17.792895+0000","last_clean":"2023-10-14T08:51:17.792895+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:51:17.792895+0000","last_undegraded":"2023-10-14T08:51:17.792895+0000","last_fullsized":"2023-10-14T08:51:17.792895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131618+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:51:20.131618+0000","last_peered":"2023-10-14T08:51:20.131618+0000","last_clean":"2023-10-14T08:51:20.131618+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:51:20.131618+0000","last_undegraded":"2023-10-14T08:51:20.131618+0000","last_fullsized":"2023-10-14T08:51:20.131618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797419+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:51:17.797419+0000","last_peered":"2023-10-14T08:51:17.797419+0000","last_clean":"2023-10-14T08:51:17.797419+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:51:17.797419+0000","last_undegraded":"2023-10-14T08:51:17.797419+0000","last_fullsized":"2023-10-14T08:51:17.797419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.807137+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:51:16.807137+0000","last_peered":"2023-10-14T08:51:16.807137+0000","last_clean":"2023-10-14T08:51:16.807137+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:51:16.807137+0000","last_undegraded":"2023-10-14T08:51:16.807137+0000","last_fullsized":"2023-10-14T08:51:16.807137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796933+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:51:17.796933+0000","last_peered":"2023-10-14T08:51:17.796933+0000","last_clean":"2023-10-14T08:51:17.796933+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:51:17.796933+0000","last_undegraded":"2023-10-14T08:51:17.796933+0000","last_fullsized":"2023-10-14T08:51:17.796933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792832+0000","last_change":"2023-10-14T08:51:15.858977+0000","last_active":"2023-10-14T08:51:17.792832+0000","last_peered":"2023-10-14T08:51:17.792832+0000","last_clean":"2023-10-14T08:51:17.792832+0000","last_became_active":"2023-10-14T08:51:15.858670+0000","last_became_peered":"2023-10-14T08:51:15.858670+0000","last_unstale":"2023-10-14T08:51:17.792832+0000","last_undegraded":"2023-10-14T08:51:17.792832+0000","last_fullsized":"2023-10-14T08:51:17.792832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:34.002214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801980+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:51:17.801980+0000","last_peered":"2023-10-14T08:51:17.801980+0000","last_clean":"2023-10-14T08:51:17.801980+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:51:17.801980+0000","last_undegraded":"2023-10-14T08:51:17.801980+0000","last_fullsized":"2023-10-14T08:51:17.801980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793445+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:51:17.793445+0000","last_peered":"2023-10-14T08:51:17.793445+0000","last_clean":"2023-10-14T08:51:17.793445+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:51:17.793445+0000","last_undegraded":"2023-10-14T08:51:17.793445+0000","last_fullsized":"2023-10-14T08:51:17.793445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943453+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:51:17.943453+0000","last_peered":"2023-10-14T08:51:17.943453+0000","last_clean":"2023-10-14T08:51:17.943453+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:51:17.943453+0000","last_undegraded":"2023-10-14T08:51:17.943453+0000","last_fullsized":"2023-10-14T08:51:17.943453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.798388+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:51:16.798388+0000","last_peered":"2023-10-14T08:51:16.798388+0000","last_clean":"2023-10-14T08:51:16.798388+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:51:16.798388+0000","last_undegraded":"2023-10-14T08:51:16.798388+0000","last_fullsized":"2023-10-14T08:51:16.798388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303879+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:51:18.303879+0000","last_peered":"2023-10-14T08:51:18.303879+0000","last_clean":"2023-10-14T08:51:18.303879+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:51:18.303879+0000","last_undegraded":"2023-10-14T08:51:18.303879+0000","last_fullsized":"2023-10-14T08:51:18.303879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.811308+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:51:16.811308+0000","last_peered":"2023-10-14T08:51:16.811308+0000","last_clean":"2023-10-14T08:51:16.811308+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:51:16.811308+0000","last_undegraded":"2023-10-14T08:51:16.811308+0000","last_fullsized":"2023-10-14T08:51:16.811308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303951+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:51:18.303951+0000","last_peered":"2023-10-14T08:51:18.303951+0000","last_clean":"2023-10-14T08:51:18.303951+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:51:18.303951+0000","last_undegraded":"2023-10-14T08:51:18.303951+0000","last_fullsized":"2023-10-14T08:51:18.303951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801911+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:51:17.801911+0000","last_peered":"2023-10-14T08:51:17.801911+0000","last_clean":"2023-10-14T08:51:17.801911+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:51:17.801911+0000","last_undegraded":"2023-10-14T08:51:17.801911+0000","last_fullsized":"2023-10-14T08:51:17.801911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.791509+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:51:16.791509+0000","last_peered":"2023-10-14T08:51:16.791509+0000","last_clean":"2023-10-14T08:51:16.791509+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:51:16.791509+0000","last_undegraded":"2023-10-14T08:51:16.791509+0000","last_fullsized":"2023-10-14T08:51:16.791509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864286+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:51:17.864286+0000","last_peered":"2023-10-14T08:51:17.864286+0000","last_clean":"2023-10-14T08:51:17.864286+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:51:17.864286+0000","last_undegraded":"2023-10-14T08:51:17.864286+0000","last_fullsized":"2023-10-14T08:51:17.864286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.132047+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:51:20.132047+0000","last_peered":"2023-10-14T08:51:20.132047+0000","last_clean":"2023-10-14T08:51:20.132047+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:51:20.132047+0000","last_undegraded":"2023-10-14T08:51:20.132047+0000","last_fullsized":"2023-10-14T08:51:20.132047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.805425+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:51:16.805425+0000","last_peered":"2023-10-14T08:51:16.805425+0000","last_clean":"2023-10-14T08:51:16.805425+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:51:16.805425+0000","last_undegraded":"2023-10-14T08:51:16.805425+0000","last_fullsized":"2023-10-14T08:51:16.805425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792905+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:51:17.792905+0000","last_peered":"2023-10-14T08:51:17.792905+0000","last_clean":"2023-10-14T08:51:17.792905+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:51:17.792905+0000","last_undegraded":"2023-10-14T08:51:17.792905+0000","last_fullsized":"2023-10-14T08:51:17.792905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797066+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:51:17.797066+0000","last_peered":"2023-10-14T08:51:17.797066+0000","last_clean":"2023-10-14T08:51:17.797066+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:51:17.797066+0000","last_undegraded":"2023-10-14T08:51:17.797066+0000","last_fullsized":"2023-10-14T08:51:17.797066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793202+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:51:17.793202+0000","last_peered":"2023-10-14T08:51:17.793202+0000","last_clean":"2023-10-14T08:51:17.793202+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:51:17.793202+0000","last_undegraded":"2023-10-14T08:51:17.793202+0000","last_fullsized":"2023-10-14T08:51:17.793202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792944+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:51:17.792944+0000","last_peered":"2023-10-14T08:51:17.792944+0000","last_clean":"2023-10-14T08:51:17.792944+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:51:17.792944+0000","last_undegraded":"2023-10-14T08:51:17.792944+0000","last_fullsized":"2023-10-14T08:51:17.792944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302575+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:51:18.302575+0000","last_peered":"2023-10-14T08:51:18.302575+0000","last_clean":"2023-10-14T08:51:18.302575+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:51:18.302575+0000","last_undegraded":"2023-10-14T08:51:18.302575+0000","last_fullsized":"2023-10-14T08:51:18.302575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864409+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:51:17.864409+0000","last_peered":"2023-10-14T08:51:17.864409+0000","last_clean":"2023-10-14T08:51:17.864409+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:51:17.864409+0000","last_undegraded":"2023-10-14T08:51:17.864409+0000","last_fullsized":"2023-10-14T08:51:17.864409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.129788+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:51:20.129788+0000","last_peered":"2023-10-14T08:51:20.129788+0000","last_clean":"2023-10-14T08:51:20.129788+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:51:20.129788+0000","last_undegraded":"2023-10-14T08:51:20.129788+0000","last_fullsized":"2023-10-14T08:51:20.129788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303483+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:51:18.303483+0000","last_peered":"2023-10-14T08:51:18.303483+0000","last_clean":"2023-10-14T08:51:18.303483+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:51:18.303483+0000","last_undegraded":"2023-10-14T08:51:18.303483+0000","last_fullsized":"2023-10-14T08:51:18.303483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302569+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:51:18.302569+0000","last_peered":"2023-10-14T08:51:18.302569+0000","last_clean":"2023-10-14T08:51:18.302569+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:51:18.302569+0000","last_undegraded":"2023-10-14T08:51:18.302569+0000","last_fullsized":"2023-10-14T08:51:18.302569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792916+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:51:17.792916+0000","last_peered":"2023-10-14T08:51:17.792916+0000","last_clean":"2023-10-14T08:51:17.792916+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:51:17.792916+0000","last_undegraded":"2023-10-14T08:51:17.792916+0000","last_fullsized":"2023-10-14T08:51:17.792916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.863985+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:51:17.863985+0000","last_peered":"2023-10-14T08:51:17.863985+0000","last_clean":"2023-10-14T08:51:17.863985+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:51:17.863985+0000","last_undegraded":"2023-10-14T08:51:17.863985+0000","last_fullsized":"2023-10-14T08:51:17.863985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943214+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:51:17.943214+0000","last_peered":"2023-10-14T08:51:17.943214+0000","last_clean":"2023-10-14T08:51:17.943214+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:51:17.943214+0000","last_undegraded":"2023-10-14T08:51:17.943214+0000","last_fullsized":"2023-10-14T08:51:17.943214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.799596+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:51:16.799596+0000","last_peered":"2023-10-14T08:51:16.799596+0000","last_clean":"2023-10-14T08:51:16.799596+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:51:16.799596+0000","last_undegraded":"2023-10-14T08:51:16.799596+0000","last_fullsized":"2023-10-14T08:51:16.799596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864192+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:51:17.864192+0000","last_peered":"2023-10-14T08:51:17.864192+0000","last_clean":"2023-10-14T08:51:17.864192+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:51:17.864192+0000","last_undegraded":"2023-10-14T08:51:17.864192+0000","last_fullsized":"2023-10-14T08:51:17.864192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793107+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:51:17.793107+0000","last_peered":"2023-10-14T08:51:17.793107+0000","last_clean":"2023-10-14T08:51:17.793107+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:51:17.793107+0000","last_undegraded":"2023-10-14T08:51:17.793107+0000","last_fullsized":"2023-10-14T08:51:17.793107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797314+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:51:17.797314+0000","last_peered":"2023-10-14T08:51:17.797314+0000","last_clean":"2023-10-14T08:51:17.797314+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:51:17.797314+0000","last_undegraded":"2023-10-14T08:51:17.797314+0000","last_fullsized":"2023-10-14T08:51:17.797314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.800041+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:51:16.800041+0000","last_peered":"2023-10-14T08:51:16.800041+0000","last_clean":"2023-10-14T08:51:16.800041+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:51:16.800041+0000","last_undegraded":"2023-10-14T08:51:16.800041+0000","last_fullsized":"2023-10-14T08:51:16.800041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797434+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:51:17.797434+0000","last_peered":"2023-10-14T08:51:17.797434+0000","last_clean":"2023-10-14T08:51:17.797434+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:51:17.797434+0000","last_undegraded":"2023-10-14T08:51:17.797434+0000","last_fullsized":"2023-10-14T08:51:17.797434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802436+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:51:17.802436+0000","last_peered":"2023-10-14T08:51:17.802436+0000","last_clean":"2023-10-14T08:51:17.802436+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:51:17.802436+0000","last_undegraded":"2023-10-14T08:51:17.802436+0000","last_fullsized":"2023-10-14T08:51:17.802436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797122+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:51:17.797122+0000","last_peered":"2023-10-14T08:51:17.797122+0000","last_clean":"2023-10-14T08:51:17.797122+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:51:17.797122+0000","last_undegraded":"2023-10-14T08:51:17.797122+0000","last_fullsized":"2023-10-14T08:51:17.797122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.105345+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:51:17.105345+0000","last_peered":"2023-10-14T08:51:17.105345+0000","last_clean":"2023-10-14T08:51:17.105345+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:51:17.105345+0000","last_undegraded":"2023-10-14T08:51:17.105345+0000","last_fullsized":"2023-10-14T08:51:17.105345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797270+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:51:17.797270+0000","last_peered":"2023-10-14T08:51:17.797270+0000","last_clean":"2023-10-14T08:51:17.797270+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:51:17.797270+0000","last_undegraded":"2023-10-14T08:51:17.797270+0000","last_fullsized":"2023-10-14T08:51:17.797270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943306+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:51:17.943306+0000","last_peered":"2023-10-14T08:51:17.943306+0000","last_clean":"2023-10-14T08:51:17.943306+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:51:17.943306+0000","last_undegraded":"2023-10-14T08:51:17.943306+0000","last_fullsized":"2023-10-14T08:51:17.943306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302480+0000","last_change":"2023-10-14T08:51:16.819726+0000","last_active":"2023-10-14T08:51:18.302480+0000","last_peered":"2023-10-14T08:51:18.302480+0000","last_clean":"2023-10-14T08:51:18.302480+0000","last_became_active":"2023-10-14T08:51:16.819393+0000","last_became_peered":"2023-10-14T08:51:16.819393+0000","last_unstale":"2023-10-14T08:51:18.302480+0000","last_undegraded":"2023-10-14T08:51:18.302480+0000","last_fullsized":"2023-10-14T08:51:18.302480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:29.169157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302481+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:51:18.302481+0000","last_peered":"2023-10-14T08:51:18.302481+0000","last_clean":"2023-10-14T08:51:18.302481+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:51:18.302481+0000","last_undegraded":"2023-10-14T08:51:18.302481+0000","last_fullsized":"2023-10-14T08:51:18.302481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303321+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:51:18.303321+0000","last_peered":"2023-10-14T08:51:18.303321+0000","last_clean":"2023-10-14T08:51:18.303321+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:51:18.303321+0000","last_undegraded":"2023-10-14T08:51:18.303321+0000","last_fullsized":"2023-10-14T08:51:18.303321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792805+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:51:17.792805+0000","last_peered":"2023-10-14T08:51:17.792805+0000","last_clean":"2023-10-14T08:51:17.792805+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:51:17.792805+0000","last_undegraded":"2023-10-14T08:51:17.792805+0000","last_fullsized":"2023-10-14T08:51:17.792805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943505+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:51:17.943505+0000","last_peered":"2023-10-14T08:51:17.943505+0000","last_clean":"2023-10-14T08:51:17.943505+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:51:17.943505+0000","last_undegraded":"2023-10-14T08:51:17.943505+0000","last_fullsized":"2023-10-14T08:51:17.943505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302783+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:51:18.302783+0000","last_peered":"2023-10-14T08:51:18.302783+0000","last_clean":"2023-10-14T08:51:18.302783+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:51:18.302783+0000","last_undegraded":"2023-10-14T08:51:18.302783+0000","last_fullsized":"2023-10-14T08:51:18.302783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864305+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:51:17.864305+0000","last_peered":"2023-10-14T08:51:17.864305+0000","last_clean":"2023-10-14T08:51:17.864305+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:51:17.864305+0000","last_undegraded":"2023-10-14T08:51:17.864305+0000","last_fullsized":"2023-10-14T08:51:17.864305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801856+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:51:17.801856+0000","last_peered":"2023-10-14T08:51:17.801856+0000","last_clean":"2023-10-14T08:51:17.801856+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:51:17.801856+0000","last_undegraded":"2023-10-14T08:51:17.801856+0000","last_fullsized":"2023-10-14T08:51:17.801856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864142+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:51:17.864142+0000","last_peered":"2023-10-14T08:51:17.864142+0000","last_clean":"2023-10-14T08:51:17.864142+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:51:17.864142+0000","last_undegraded":"2023-10-14T08:51:17.864142+0000","last_fullsized":"2023-10-14T08:51:17.864142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302890+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:51:18.302890+0000","last_peered":"2023-10-14T08:51:18.302890+0000","last_clean":"2023-10-14T08:51:18.302890+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:51:18.302890+0000","last_undegraded":"2023-10-14T08:51:18.302890+0000","last_fullsized":"2023-10-14T08:51:18.302890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792899+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:51:17.792899+0000","last_peered":"2023-10-14T08:51:17.792899+0000","last_clean":"2023-10-14T08:51:17.792899+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:51:17.792899+0000","last_undegraded":"2023-10-14T08:51:17.792899+0000","last_fullsized":"2023-10-14T08:51:17.792899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943304+0000","last_change":"2023-10-14T08:51:16.823067+0000","last_active":"2023-10-14T08:51:17.943304+0000","last_peered":"2023-10-14T08:51:17.943304+0000","last_clean":"2023-10-14T08:51:17.943304+0000","last_became_active":"2023-10-14T08:51:16.822703+0000","last_became_peered":"2023-10-14T08:51:16.822703+0000","last_unstale":"2023-10-14T08:51:17.943304+0000","last_undegraded":"2023-10-14T08:51:17.943304+0000","last_fullsized":"2023-10-14T08:51:17.943304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:55:57.159977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3704,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":12742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481804,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":423678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":10,"up_from":69,"seq":296352743440,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1016905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.752},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82999999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.874}]},{"osd":9,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]}]},{"osd":9,"up_from":64,"seq":274877906964,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":424462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.501},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.68999999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.59599999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71999999999999997}]}]},{"osd":8,"up_from":57,"seq":244813135897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":424282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.499},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.434},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.622},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Oct 14 08:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":7,"up_from":49,"seq":210453397533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1486848,"data_stored":1015250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53900000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.69699999999999995}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.874,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.748},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.78100000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.61099999999999999}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.83899999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82699999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.89900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":6,"up_from":44,"seq":188978561058,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":423678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.376}]},{"osd":1,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.54700000000000004,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.46100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.49399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.64200000000000002},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.68700000000000006}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77400000000000002}]},{"osd":9,"last update":"Sat Oct 14 08:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.48199999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.875},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":888832,"data_stored":425017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.34599999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76900000000000002,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.90700000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.46800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.87,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Oct 14 08:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.6629999999999998,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.86399999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.88}]},{"osd":7,"last update":"Sat Oct 14 08:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.441,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.089,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79300000000000004}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.0149999999999999}]},{"osd":9,"last update":"Sat Oct 14 08:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.98499999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.96699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":424372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Oct 14 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57899999999999996,"15min":0.54200000000000004},"min":{"1min":0.45800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Oct 14 08:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.69799999999999995}]},{"osd":6,"last update":"Sat Oct 14 08:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61699999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.73799999999999999}]},{"osd":9,"last update":"Sat Oct 14 08:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60399999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.81299999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":425277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.498,"15min":0.47999999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.48999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Oct 14 08:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Oct 14 08:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33800000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.498}]},{"osd":9,"last update":"Sat Oct 14 08:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.60699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":888832,"data_stored":423782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"min":{"1min":0.30499999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.371,"15min":0.35199999999999998},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.745}]},{"osd":1,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.5},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56999999999999995,"15min":0.54800000000000004},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.54900000000000004},"min":{"1min":0.48699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 08:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.49299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81499999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.751,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.439}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59599999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.76400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953514,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":423700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.39400000000000002,"15min":0.36799999999999999},"min":{"1min":0.34999999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.33700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.371}]},{"osd":2,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.501}]},{"osd":3,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.59399999999999997,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Oct 14 08:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.69199999999999995,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.54300000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.625},{"interface":"front","average":{"1min":0.623,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58099999999999996}]},{"osd":8,"last update":"Sat Oct 14 08:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66600000000000004}]},{"osd":9,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.71599999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":37,"seq":158913789990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1499136,"data_stored":1015191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.5,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.28699999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.623},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.877}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.84599999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.86499999999999999}]},{"osd":9,"last update":"Sat Oct 14 08:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.96099999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.3559999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:51:24.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T08:51:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 -- 172.21.15.6:0/115227773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34100e90 msgr2=0x7f1c341012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 --2- 172.21.15.6:0/115227773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34100e90 0x7f1c341012b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009990 tx=0x7f1c28009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 -- 172.21.15.6:0/115227773 shutdown_connections 2023-10-14T08:51:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 --2- 172.21.15.6:0/115227773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c34102a30 0x7f1c34109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 --2- 172.21.15.6:0/115227773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34100e90 0x7f1c341012b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 --2- 172.21.15.6:0/115227773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c34102070 0x7f1c341024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 -- 172.21.15.6:0/115227773 >> 172.21.15.6:0/115227773 conn(0x7f1c340fc410 msgr2=0x7f1c340fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 -- 172.21.15.6:0/115227773 shutdown_connections 2023-10-14T08:51:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.090+0000 7f1c3b059700 1 -- 172.21.15.6:0/115227773 wait complete. 2023-10-14T08:51:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 Processor -- start 2023-10-14T08:51:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 -- start start 2023-10-14T08:51:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c34100e90 0x7f1c34196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c34102070 0x7f1c341971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 0x7f1c3419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3419e7e0 con 0x7f1c34102a30 2023-10-14T08:51:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3419e950 con 0x7f1c34102070 2023-10-14T08:51:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3419eb10 con 0x7f1c34100e90 2023-10-14T08:51:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 0x7f1c3419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 0x7f1c3419e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59552/0 (socket says 172.21.15.6:59552) 2023-10-14T08:51:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 -- 172.21.15.6:0/3220068851 learned_addr learned my addr 172.21.15.6:0/3220068851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:25.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c38df5700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c34100e90 0x7f1c34196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 -- 172.21.15.6:0/3220068851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c34100e90 msgr2=0x7f1c34196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c34100e90 0x7f1c34196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 -- 172.21.15.6:0/3220068851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c34102070 msgr2=0x7f1c341971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c33fff700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c34102070 0x7f1c341971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:25.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c34102070 0x7f1c341971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 -- 172.21.15.6:0/3220068851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280095f0 con 0x7f1c34102a30 2023-10-14T08:51:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c395f6700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 0x7f1c3419e210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00b970 tx=0x7f1c2c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00c9b0 con 0x7f1c34102a30 2023-10-14T08:51:25.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c2c014440 con 0x7f1c34102a30 2023-10-14T08:51:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.091+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3419edf0 con 0x7f1c34102a30 2023-10-14T08:51:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.092+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0075d0 con 0x7f1c34102a30 2023-10-14T08:51:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.092+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3419f2d0 con 0x7f1c34102a30 2023-10-14T08:51:25.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.093+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3410c780 con 0x7f1c34102a30 2023-10-14T08:51:25.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.094+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f1c2c0145b0 con 0x7f1c34102a30 2023-10-14T08:51:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.094+0000 7f1c31ffb700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c240a1590 0x7f1c240a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.094+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1c2c006e40 con 0x7f1c34102a30 2023-10-14T08:51:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.094+0000 7f1c38df5700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c240a1590 0x7f1c240a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:25.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.095+0000 7f1c38df5700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c240a1590 0x7f1c240a3a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b5c0 tx=0x7f1c28005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:25.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.099+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1c2c04f100 con 0x7f1c34102a30 2023-10-14T08:51:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: pgmap v262: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-10-14T08:51:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] up:active 2023-10-14T08:51:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-10-14T08:51:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: mgrmap e17: x(active, since 6m), standbys: y, z 2023-10-14T08:51:25.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:51:25.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1946697974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:25.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:25 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3447235119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:25.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.296+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c340612f0 con 0x7f1c240a1590 2023-10-14T08:51:25.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.308+0000 7f1c31ffb700 1 -- 172.21.15.6:0/3220068851 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335124 (secure 0 0 0) 0x7f1c340612f0 con 0x7f1c240a1590 2023-10-14T08:51:25.314 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c240a1590 msgr2=0x7f1c240a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:25.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c240a1590 0x7f1c240a3a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b5c0 tx=0x7f1c28005fd0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 msgr2=0x7f1c3419e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 0x7f1c3419e210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00b970 tx=0x7f1c2c00bd30 comp rx=0 tx=0).stop 2023-10-14T08:51:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 shutdown_connections 2023-10-14T08:51:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c34102a30 0x7f1c3419e210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c34100e90 0x7f1c34196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c240a1590 0x7f1c240a3a50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 --2- 172.21.15.6:0/3220068851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c34102070 0x7f1c341971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 >> 172.21.15.6:0/3220068851 conn(0x7f1c340fc410 msgr2=0x7f1c340fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 shutdown_connections 2023-10-14T08:51:25.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:25.312+0000 7f1c3b059700 1 -- 172.21.15.6:0/3220068851 wait complete. 2023-10-14T08:51:25.319 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:51:25.326 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-10-14T08:51:23.432264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594072,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":136,"num_read_kb":117,"num_write":254,"num_write_kb":2962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":268,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336440,"kb_used_data":12212,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605384,"statfs":{"total":1151940427776,"available":1151595913216,"internally_reserved":0,"allocated":12505088,"data_stored":6865594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3704,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.590490"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943427+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:51:17.943427+0000","last_peered":"2023-10-14T08:51:17.943427+0000","last_clean":"2023-10-14T08:51:17.943427+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:51:17.943427+0000","last_undegraded":"2023-10-14T08:51:17.943427+0000","last_fullsized":"2023-10-14T08:51:17.943427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303447+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:51:18.303447+0000","last_peered":"2023-10-14T08:51:18.303447+0000","last_clean":"2023-10-14T08:51:18.303447+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:51:18.303447+0000","last_undegraded":"2023-10-14T08:51:18.303447+0000","last_fullsized":"2023-10-14T08:51:18.303447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303393+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:51:18.303393+0000","last_peered":"2023-10-14T08:51:18.303393+0000","last_clean":"2023-10-14T08:51:18.303393+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:51:18.303393+0000","last_undegraded":"2023-10-14T08:51:18.303393+0000","last_fullsized":"2023-10-14T08:51:18.303393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303661+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:51:18.303661+0000","last_peered":"2023-10-14T08:51:18.303661+0000","last_clean":"2023-10-14T08:51:18.303661+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:51:18.303661+0000","last_undegraded":"2023-10-14T08:51:18.303661+0000","last_fullsized":"2023-10-14T08:51:18.303661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792964+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:51:17.792964+0000","last_peered":"2023-10-14T08:51:17.792964+0000","last_clean":"2023-10-14T08:51:17.792964+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:51:17.792964+0000","last_undegraded":"2023-10-14T08:51:17.792964+0000","last_fullsized":"2023-10-14T08:51:17.792964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303906+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:51:18.303906+0000","last_peered":"2023-10-14T08:51:18.303906+0000","last_clean":"2023-10-14T08:51:18.303906+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:51:18.303906+0000","last_undegraded":"2023-10-14T08:51:18.303906+0000","last_fullsized":"2023-10-14T08:51:18.303906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796977+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:51:17.796977+0000","last_peered":"2023-10-14T08:51:17.796977+0000","last_clean":"2023-10-14T08:51:17.796977+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:51:17.796977+0000","last_undegraded":"2023-10-14T08:51:17.796977+0000","last_fullsized":"2023-10-14T08:51:17.796977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864046+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:51:17.864046+0000","last_peered":"2023-10-14T08:51:17.864046+0000","last_clean":"2023-10-14T08:51:17.864046+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:51:17.864046+0000","last_undegraded":"2023-10-14T08:51:17.864046+0000","last_fullsized":"2023-10-14T08:51:17.864046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303385+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:51:18.303385+0000","last_peered":"2023-10-14T08:51:18.303385+0000","last_clean":"2023-10-14T08:51:18.303385+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:51:18.303385+0000","last_undegraded":"2023-10-14T08:51:18.303385+0000","last_fullsized":"2023-10-14T08:51:18.303385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.304201+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:51:18.304201+0000","last_peered":"2023-10-14T08:51:18.304201+0000","last_clean":"2023-10-14T08:51:18.304201+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:51:18.304201+0000","last_undegraded":"2023-10-14T08:51:18.304201+0000","last_fullsized":"2023-10-14T08:51:18.304201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797358+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:51:17.797358+0000","last_peered":"2023-10-14T08:51:17.797358+0000","last_clean":"2023-10-14T08:51:17.797358+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:51:17.797358+0000","last_undegraded":"2023-10-14T08:51:17.797358+0000","last_fullsized":"2023-10-14T08:51:17.797358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303516+0000","last_change":"2023-10-14T08:51:16.820037+0000","last_active":"2023-10-14T08:51:18.303516+0000","last_peered":"2023-10-14T08:51:18.303516+0000","last_clean":"2023-10-14T08:51:18.303516+0000","last_became_active":"2023-10-14T08:51:16.819251+0000","last_became_peered":"2023-10-14T08:51:16.819251+0000","last_unstale":"2023-10-14T08:51:18.303516+0000","last_undegraded":"2023-10-14T08:51:18.303516+0000","last_fullsized":"2023-10-14T08:51:18.303516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:37.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792932+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:51:17.792932+0000","last_peered":"2023-10-14T08:51:17.792932+0000","last_clean":"2023-10-14T08:51:17.792932+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:51:17.792932+0000","last_undegraded":"2023-10-14T08:51:17.792932+0000","last_fullsized":"2023-10-14T08:51:17.792932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302685+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:51:18.302685+0000","last_peered":"2023-10-14T08:51:18.302685+0000","last_clean":"2023-10-14T08:51:18.302685+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:51:18.302685+0000","last_undegraded":"2023-10-14T08:51:18.302685+0000","last_fullsized":"2023-10-14T08:51:18.302685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302848+0000","last_change":"2023-10-14T08:51:16.819942+0000","last_active":"2023-10-14T08:51:18.302848+0000","last_peered":"2023-10-14T08:51:18.302848+0000","last_clean":"2023-10-14T08:51:18.302848+0000","last_became_active":"2023-10-14T08:51:16.819615+0000","last_became_peered":"2023-10-14T08:51:16.819615+0000","last_unstale":"2023-10-14T08:51:18.302848+0000","last_undegraded":"2023-10-14T08:51:18.302848+0000","last_fullsized":"2023-10-14T08:51:18.302848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:10.523238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302489+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:51:18.302489+0000","last_peered":"2023-10-14T08:51:18.302489+0000","last_clean":"2023-10-14T08:51:18.302489+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:51:18.302489+0000","last_undegraded":"2023-10-14T08:51:18.302489+0000","last_fullsized":"2023-10-14T08:51:18.302489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943598+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:51:17.943598+0000","last_peered":"2023-10-14T08:51:17.943598+0000","last_clean":"2023-10-14T08:51:17.943598+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:51:17.943598+0000","last_undegraded":"2023-10-14T08:51:17.943598+0000","last_fullsized":"2023-10-14T08:51:17.943598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302614+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:51:18.302614+0000","last_peered":"2023-10-14T08:51:18.302614+0000","last_clean":"2023-10-14T08:51:18.302614+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:51:18.302614+0000","last_undegraded":"2023-10-14T08:51:18.302614+0000","last_fullsized":"2023-10-14T08:51:18.302614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302553+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:51:18.302553+0000","last_peered":"2023-10-14T08:51:18.302553+0000","last_clean":"2023-10-14T08:51:18.302553+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:51:18.302553+0000","last_undegraded":"2023-10-14T08:51:18.302553+0000","last_fullsized":"2023-10-14T08:51:18.302553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.107447+0000","last_change":"2023-10-14T08:51:15.861680+0000","last_active":"2023-10-14T08:51:17.107447+0000","last_peered":"2023-10-14T08:51:17.107447+0000","last_clean":"2023-10-14T08:51:17.107447+0000","last_became_active":"2023-10-14T08:51:15.861353+0000","last_became_peered":"2023-10-14T08:51:15.861353+0000","last_unstale":"2023-10-14T08:51:17.107447+0000","last_undegraded":"2023-10-14T08:51:17.107447+0000","last_fullsized":"2023-10-14T08:51:17.107447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:40:24.320642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864587+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:51:17.864587+0000","last_peered":"2023-10-14T08:51:17.864587+0000","last_clean":"2023-10-14T08:51:17.864587+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:51:17.864587+0000","last_undegraded":"2023-10-14T08:51:17.864587+0000","last_fullsized":"2023-10-14T08:51:17.864587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864516+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:51:17.864516+0000","last_peered":"2023-10-14T08:51:17.864516+0000","last_clean":"2023-10-14T08:51:17.864516+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:51:17.864516+0000","last_undegraded":"2023-10-14T08:51:17.864516+0000","last_fullsized":"2023-10-14T08:51:17.864516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303619+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:51:18.303619+0000","last_peered":"2023-10-14T08:51:18.303619+0000","last_clean":"2023-10-14T08:51:18.303619+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:51:18.303619+0000","last_undegraded":"2023-10-14T08:51:18.303619+0000","last_fullsized":"2023-10-14T08:51:18.303619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793320+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:51:17.793320+0000","last_peered":"2023-10-14T08:51:17.793320+0000","last_clean":"2023-10-14T08:51:17.793320+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:51:17.793320+0000","last_undegraded":"2023-10-14T08:51:17.793320+0000","last_fullsized":"2023-10-14T08:51:17.793320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303392+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:51:18.303392+0000","last_peered":"2023-10-14T08:51:18.303392+0000","last_clean":"2023-10-14T08:51:18.303392+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:51:18.303392+0000","last_undegraded":"2023-10-14T08:51:18.303392+0000","last_fullsized":"2023-10-14T08:51:18.303392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793166+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:51:17.793166+0000","last_peered":"2023-10-14T08:51:17.793166+0000","last_clean":"2023-10-14T08:51:17.793166+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:51:17.793166+0000","last_undegraded":"2023-10-14T08:51:17.793166+0000","last_fullsized":"2023-10-14T08:51:17.793166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802533+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:51:17.802533+0000","last_peered":"2023-10-14T08:51:17.802533+0000","last_clean":"2023-10-14T08:51:17.802533+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:51:17.802533+0000","last_undegraded":"2023-10-14T08:51:17.802533+0000","last_fullsized":"2023-10-14T08:51:17.802533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.105164+0000","last_change":"2023-10-14T08:51:15.860943+0000","last_active":"2023-10-14T08:51:21.105164+0000","last_peered":"2023-10-14T08:51:21.105164+0000","last_clean":"2023-10-14T08:51:21.105164+0000","last_became_active":"2023-10-14T08:51:15.860636+0000","last_became_peered":"2023-10-14T08:51:15.860636+0000","last_unstale":"2023-10-14T08:51:21.105164+0000","last_undegraded":"2023-10-14T08:51:21.105164+0000","last_fullsized":"2023-10-14T08:51:21.105164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:36.037274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792973+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:51:17.792973+0000","last_peered":"2023-10-14T08:51:17.792973+0000","last_clean":"2023-10-14T08:51:17.792973+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:51:17.792973+0000","last_undegraded":"2023-10-14T08:51:17.792973+0000","last_fullsized":"2023-10-14T08:51:17.792973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.116627+0000","last_change":"2023-10-14T08:51:15.864182+0000","last_active":"2023-10-14T08:51:21.116627+0000","last_peered":"2023-10-14T08:51:21.116627+0000","last_clean":"2023-10-14T08:51:21.116627+0000","last_became_active":"2023-10-14T08:51:15.863841+0000","last_became_peered":"2023-10-14T08:51:15.863841+0000","last_unstale":"2023-10-14T08:51:21.116627+0000","last_undegraded":"2023-10-14T08:51:21.116627+0000","last_fullsized":"2023-10-14T08:51:21.116627+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:21.974223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802079+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:51:17.802079+0000","last_peered":"2023-10-14T08:51:17.802079+0000","last_clean":"2023-10-14T08:51:17.802079+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:51:17.802079+0000","last_undegraded":"2023-10-14T08:51:17.802079+0000","last_fullsized":"2023-10-14T08:51:17.802079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.791659+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:51:16.791659+0000","last_peered":"2023-10-14T08:51:16.791659+0000","last_clean":"2023-10-14T08:51:16.791659+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:51:16.791659+0000","last_undegraded":"2023-10-14T08:51:16.791659+0000","last_fullsized":"2023-10-14T08:51:16.791659+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864335+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:51:17.864335+0000","last_peered":"2023-10-14T08:51:17.864335+0000","last_clean":"2023-10-14T08:51:17.864335+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:51:17.864335+0000","last_undegraded":"2023-10-14T08:51:17.864335+0000","last_fullsized":"2023-10-14T08:51:17.864335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801802+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:51:17.801802+0000","last_peered":"2023-10-14T08:51:17.801802+0000","last_clean":"2023-10-14T08:51:17.801802+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:51:17.801802+0000","last_undegraded":"2023-10-14T08:51:17.801802+0000","last_fullsized":"2023-10-14T08:51:17.801802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302706+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:51:18.302706+0000","last_peered":"2023-10-14T08:51:18.302706+0000","last_clean":"2023-10-14T08:51:18.302706+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:51:18.302706+0000","last_undegraded":"2023-10-14T08:51:18.302706+0000","last_fullsized":"2023-10-14T08:51:18.302706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131680+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:51:20.131680+0000","last_peered":"2023-10-14T08:51:20.131680+0000","last_clean":"2023-10-14T08:51:20.131680+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:51:20.131680+0000","last_undegraded":"2023-10-14T08:51:20.131680+0000","last_fullsized":"2023-10-14T08:51:20.131680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302765+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:51:18.302765+0000","last_peered":"2023-10-14T08:51:18.302765+0000","last_clean":"2023-10-14T08:51:18.302765+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:51:18.302765+0000","last_undegraded":"2023-10-14T08:51:18.302765+0000","last_fullsized":"2023-10-14T08:51:18.302765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131201+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:51:20.131201+0000","last_peered":"2023-10-14T08:51:20.131201+0000","last_clean":"2023-10-14T08:51:20.131201+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:51:20.131201+0000","last_undegraded":"2023-10-14T08:51:20.131201+0000","last_fullsized":"2023-10-14T08:51:20.131201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303623+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:51:18.303623+0000","last_peered":"2023-10-14T08:51:18.303623+0000","last_clean":"2023-10-14T08:51:18.303623+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:51:18.303623+0000","last_undegraded":"2023-10-14T08:51:18.303623+0000","last_fullsized":"2023-10-14T08:51:18.303623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131412+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:51:20.131412+0000","last_peered":"2023-10-14T08:51:20.131412+0000","last_clean":"2023-10-14T08:51:20.131412+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:51:20.131412+0000","last_undegraded":"2023-10-14T08:51:20.131412+0000","last_fullsized":"2023-10-14T08:51:20.131412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303602+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:51:18.303602+0000","last_peered":"2023-10-14T08:51:18.303602+0000","last_clean":"2023-10-14T08:51:18.303602+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:51:18.303602+0000","last_undegraded":"2023-10-14T08:51:18.303602+0000","last_fullsized":"2023-10-14T08:51:18.303602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.105241+0000","last_change":"2023-10-14T08:51:15.865840+0000","last_active":"2023-10-14T08:51:21.105241+0000","last_peered":"2023-10-14T08:51:21.105241+0000","last_clean":"2023-10-14T08:51:21.105241+0000","last_became_active":"2023-10-14T08:51:15.865393+0000","last_became_peered":"2023-10-14T08:51:15.865393+0000","last_unstale":"2023-10-14T08:51:21.105241+0000","last_undegraded":"2023-10-14T08:51:21.105241+0000","last_fullsized":"2023-10-14T08:51:21.105241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:02:17.524700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793227+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:51:17.793227+0000","last_peered":"2023-10-14T08:51:17.793227+0000","last_clean":"2023-10-14T08:51:17.793227+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:51:17.793227+0000","last_undegraded":"2023-10-14T08:51:17.793227+0000","last_fullsized":"2023-10-14T08:51:17.793227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.130780+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:51:20.130780+0000","last_peered":"2023-10-14T08:51:20.130780+0000","last_clean":"2023-10-14T08:51:20.130780+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:51:20.130780+0000","last_undegraded":"2023-10-14T08:51:20.130780+0000","last_fullsized":"2023-10-14T08:51:20.130780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792895+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:51:17.792895+0000","last_peered":"2023-10-14T08:51:17.792895+0000","last_clean":"2023-10-14T08:51:17.792895+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:51:17.792895+0000","last_undegraded":"2023-10-14T08:51:17.792895+0000","last_fullsized":"2023-10-14T08:51:17.792895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131618+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:51:20.131618+0000","last_peered":"2023-10-14T08:51:20.131618+0000","last_clean":"2023-10-14T08:51:20.131618+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:51:20.131618+0000","last_undegraded":"2023-10-14T08:51:20.131618+0000","last_fullsized":"2023-10-14T08:51:20.131618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797419+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:51:17.797419+0000","last_peered":"2023-10-14T08:51:17.797419+0000","last_clean":"2023-10-14T08:51:17.797419+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:51:17.797419+0000","last_undegraded":"2023-10-14T08:51:17.797419+0000","last_fullsized":"2023-10-14T08:51:17.797419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.807137+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:51:16.807137+0000","last_peered":"2023-10-14T08:51:16.807137+0000","last_clean":"2023-10-14T08:51:16.807137+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:51:16.807137+0000","last_undegraded":"2023-10-14T08:51:16.807137+0000","last_fullsized":"2023-10-14T08:51:16.807137+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796933+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:51:17.796933+0000","last_peered":"2023-10-14T08:51:17.796933+0000","last_clean":"2023-10-14T08:51:17.796933+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:51:17.796933+0000","last_undegraded":"2023-10-14T08:51:17.796933+0000","last_fullsized":"2023-10-14T08:51:17.796933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792832+0000","last_change":"2023-10-14T08:51:15.858977+0000","last_active":"2023-10-14T08:51:17.792832+0000","last_peered":"2023-10-14T08:51:17.792832+0000","last_clean":"2023-10-14T08:51:17.792832+0000","last_became_active":"2023-10-14T08:51:15.858670+0000","last_became_peered":"2023-10-14T08:51:15.858670+0000","last_unstale":"2023-10-14T08:51:17.792832+0000","last_undegraded":"2023-10-14T08:51:17.792832+0000","last_fullsized":"2023-10-14T08:51:17.792832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:34.002214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801980+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:51:17.801980+0000","last_peered":"2023-10-14T08:51:17.801980+0000","last_clean":"2023-10-14T08:51:17.801980+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:51:17.801980+0000","last_undegraded":"2023-10-14T08:51:17.801980+0000","last_fullsized":"2023-10-14T08:51:17.801980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793445+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:51:17.793445+0000","last_peered":"2023-10-14T08:51:17.793445+0000","last_clean":"2023-10-14T08:51:17.793445+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:51:17.793445+0000","last_undegraded":"2023-10-14T08:51:17.793445+0000","last_fullsized":"2023-10-14T08:51:17.793445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943453+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:51:17.943453+0000","last_peered":"2023-10-14T08:51:17.943453+0000","last_clean":"2023-10-14T08:51:17.943453+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:51:17.943453+0000","last_undegraded":"2023-10-14T08:51:17.943453+0000","last_fullsized":"2023-10-14T08:51:17.943453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.798388+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:51:16.798388+0000","last_peered":"2023-10-14T08:51:16.798388+0000","last_clean":"2023-10-14T08:51:16.798388+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:51:16.798388+0000","last_undegraded":"2023-10-14T08:51:16.798388+0000","last_fullsized":"2023-10-14T08:51:16.798388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303879+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:51:18.303879+0000","last_peered":"2023-10-14T08:51:18.303879+0000","last_clean":"2023-10-14T08:51:18.303879+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:51:18.303879+0000","last_undegraded":"2023-10-14T08:51:18.303879+0000","last_fullsized":"2023-10-14T08:51:18.303879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.811308+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:51:16.811308+0000","last_peered":"2023-10-14T08:51:16.811308+0000","last_clean":"2023-10-14T08:51:16.811308+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:51:16.811308+0000","last_undegraded":"2023-10-14T08:51:16.811308+0000","last_fullsized":"2023-10-14T08:51:16.811308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303951+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:51:18.303951+0000","last_peered":"2023-10-14T08:51:18.303951+0000","last_clean":"2023-10-14T08:51:18.303951+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:51:18.303951+0000","last_undegraded":"2023-10-14T08:51:18.303951+0000","last_fullsized":"2023-10-14T08:51:18.303951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801911+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:51:17.801911+0000","last_peered":"2023-10-14T08:51:17.801911+0000","last_clean":"2023-10-14T08:51:17.801911+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:51:17.801911+0000","last_undegraded":"2023-10-14T08:51:17.801911+0000","last_fullsized":"2023-10-14T08:51:17.801911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.791509+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:51:16.791509+0000","last_peered":"2023-10-14T08:51:16.791509+0000","last_clean":"2023-10-14T08:51:16.791509+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:51:16.791509+0000","last_undegraded":"2023-10-14T08:51:16.791509+0000","last_fullsized":"2023-10-14T08:51:16.791509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864286+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:51:17.864286+0000","last_peered":"2023-10-14T08:51:17.864286+0000","last_clean":"2023-10-14T08:51:17.864286+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:51:17.864286+0000","last_undegraded":"2023-10-14T08:51:17.864286+0000","last_fullsized":"2023-10-14T08:51:17.864286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.132047+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:51:20.132047+0000","last_peered":"2023-10-14T08:51:20.132047+0000","last_clean":"2023-10-14T08:51:20.132047+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:51:20.132047+0000","last_undegraded":"2023-10-14T08:51:20.132047+0000","last_fullsized":"2023-10-14T08:51:20.132047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.805425+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:51:16.805425+0000","last_peered":"2023-10-14T08:51:16.805425+0000","last_clean":"2023-10-14T08:51:16.805425+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:51:16.805425+0000","last_undegraded":"2023-10-14T08:51:16.805425+0000","last_fullsized":"2023-10-14T08:51:16.805425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792905+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:51:17.792905+0000","last_peered":"2023-10-14T08:51:17.792905+0000","last_clean":"2023-10-14T08:51:17.792905+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:51:17.792905+0000","last_undegraded":"2023-10-14T08:51:17.792905+0000","last_fullsized":"2023-10-14T08:51:17.792905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797066+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:51:17.797066+0000","last_peered":"2023-10-14T08:51:17.797066+0000","last_clean":"2023-10-14T08:51:17.797066+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:51:17.797066+0000","last_undegraded":"2023-10-14T08:51:17.797066+0000","last_fullsized":"2023-10-14T08:51:17.797066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793202+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:51:17.793202+0000","last_peered":"2023-10-14T08:51:17.793202+0000","last_clean":"2023-10-14T08:51:17.793202+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:51:17.793202+0000","last_undegraded":"2023-10-14T08:51:17.793202+0000","last_fullsized":"2023-10-14T08:51:17.793202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792944+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:51:17.792944+0000","last_peered":"2023-10-14T08:51:17.792944+0000","last_clean":"2023-10-14T08:51:17.792944+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:51:17.792944+0000","last_undegraded":"2023-10-14T08:51:17.792944+0000","last_fullsized":"2023-10-14T08:51:17.792944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302575+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:51:18.302575+0000","last_peered":"2023-10-14T08:51:18.302575+0000","last_clean":"2023-10-14T08:51:18.302575+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:51:18.302575+0000","last_undegraded":"2023-10-14T08:51:18.302575+0000","last_fullsized":"2023-10-14T08:51:18.302575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864409+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:51:17.864409+0000","last_peered":"2023-10-14T08:51:17.864409+0000","last_clean":"2023-10-14T08:51:17.864409+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:51:17.864409+0000","last_undegraded":"2023-10-14T08:51:17.864409+0000","last_fullsized":"2023-10-14T08:51:17.864409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.129788+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:51:20.129788+0000","last_peered":"2023-10-14T08:51:20.129788+0000","last_clean":"2023-10-14T08:51:20.129788+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:51:20.129788+0000","last_undegraded":"2023-10-14T08:51:20.129788+0000","last_fullsized":"2023-10-14T08:51:20.129788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303483+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:51:18.303483+0000","last_peered":"2023-10-14T08:51:18.303483+0000","last_clean":"2023-10-14T08:51:18.303483+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:51:18.303483+0000","last_undegraded":"2023-10-14T08:51:18.303483+0000","last_fullsized":"2023-10-14T08:51:18.303483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302569+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:51:18.302569+0000","last_peered":"2023-10-14T08:51:18.302569+0000","last_clean":"2023-10-14T08:51:18.302569+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:51:18.302569+0000","last_undegraded":"2023-10-14T08:51:18.302569+0000","last_fullsized":"2023-10-14T08:51:18.302569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792916+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:51:17.792916+0000","last_peered":"2023-10-14T08:51:17.792916+0000","last_clean":"2023-10-14T08:51:17.792916+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:51:17.792916+0000","last_undegraded":"2023-10-14T08:51:17.792916+0000","last_fullsized":"2023-10-14T08:51:17.792916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.863985+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:51:17.863985+0000","last_peered":"2023-10-14T08:51:17.863985+0000","last_clean":"2023-10-14T08:51:17.863985+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:51:17.863985+0000","last_undegraded":"2023-10-14T08:51:17.863985+0000","last_fullsized":"2023-10-14T08:51:17.863985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943214+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:51:17.943214+0000","last_peered":"2023-10-14T08:51:17.943214+0000","last_clean":"2023-10-14T08:51:17.943214+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:51:17.943214+0000","last_undegraded":"2023-10-14T08:51:17.943214+0000","last_fullsized":"2023-10-14T08:51:17.943214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.799596+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:51:16.799596+0000","last_peered":"2023-10-14T08:51:16.799596+0000","last_clean":"2023-10-14T08:51:16.799596+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:51:16.799596+0000","last_undegraded":"2023-10-14T08:51:16.799596+0000","last_fullsized":"2023-10-14T08:51:16.799596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864192+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:51:17.864192+0000","last_peered":"2023-10-14T08:51:17.864192+0000","last_clean":"2023-10-14T08:51:17.864192+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:51:17.864192+0000","last_undegraded":"2023-10-14T08:51:17.864192+0000","last_fullsized":"2023-10-14T08:51:17.864192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793107+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:51:17.793107+0000","last_peered":"2023-10-14T08:51:17.793107+0000","last_clean":"2023-10-14T08:51:17.793107+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:51:17.793107+0000","last_undegraded":"2023-10-14T08:51:17.793107+0000","last_fullsized":"2023-10-14T08:51:17.793107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797314+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:51:17.797314+0000","last_peered":"2023-10-14T08:51:17.797314+0000","last_clean":"2023-10-14T08:51:17.797314+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:51:17.797314+0000","last_undegraded":"2023-10-14T08:51:17.797314+0000","last_fullsized":"2023-10-14T08:51:17.797314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.800041+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:51:16.800041+0000","last_peered":"2023-10-14T08:51:16.800041+0000","last_clean":"2023-10-14T08:51:16.800041+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:51:16.800041+0000","last_undegraded":"2023-10-14T08:51:16.800041+0000","last_fullsized":"2023-10-14T08:51:16.800041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797434+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:51:17.797434+0000","last_peered":"2023-10-14T08:51:17.797434+0000","last_clean":"2023-10-14T08:51:17.797434+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:51:17.797434+0000","last_undegraded":"2023-10-14T08:51:17.797434+0000","last_fullsized":"2023-10-14T08:51:17.797434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802436+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:51:17.802436+0000","last_peered":"2023-10-14T08:51:17.802436+0000","last_clean":"2023-10-14T08:51:17.802436+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:51:17.802436+0000","last_undegraded":"2023-10-14T08:51:17.802436+0000","last_fullsized":"2023-10-14T08:51:17.802436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797122+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:51:17.797122+0000","last_peered":"2023-10-14T08:51:17.797122+0000","last_clean":"2023-10-14T08:51:17.797122+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:51:17.797122+0000","last_undegraded":"2023-10-14T08:51:17.797122+0000","last_fullsized":"2023-10-14T08:51:17.797122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.105345+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:51:17.105345+0000","last_peered":"2023-10-14T08:51:17.105345+0000","last_clean":"2023-10-14T08:51:17.105345+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:51:17.105345+0000","last_undegraded":"2023-10-14T08:51:17.105345+0000","last_fullsized":"2023-10-14T08:51:17.105345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797270+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:51:17.797270+0000","last_peered":"2023-10-14T08:51:17.797270+0000","last_clean":"2023-10-14T08:51:17.797270+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:51:17.797270+0000","last_undegraded":"2023-10-14T08:51:17.797270+0000","last_fullsized":"2023-10-14T08:51:17.797270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943306+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:51:17.943306+0000","last_peered":"2023-10-14T08:51:17.943306+0000","last_clean":"2023-10-14T08:51:17.943306+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:51:17.943306+0000","last_undegraded":"2023-10-14T08:51:17.943306+0000","last_fullsized":"2023-10-14T08:51:17.943306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302480+0000","last_change":"2023-10-14T08:51:16.819726+0000","last_active":"2023-10-14T08:51:18.302480+0000","last_peered":"2023-10-14T08:51:18.302480+0000","last_clean":"2023-10-14T08:51:18.302480+0000","last_became_active":"2023-10-14T08:51:16.819393+0000","last_became_peered":"2023-10-14T08:51:16.819393+0000","last_unstale":"2023-10-14T08:51:18.302480+0000","last_undegraded":"2023-10-14T08:51:18.302480+0000","last_fullsized":"2023-10-14T08:51:18.302480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:29.169157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302481+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:51:18.302481+0000","last_peered":"2023-10-14T08:51:18.302481+0000","last_clean":"2023-10-14T08:51:18.302481+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:51:18.302481+0000","last_undegraded":"2023-10-14T08:51:18.302481+0000","last_fullsized":"2023-10-14T08:51:18.302481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303321+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:51:18.303321+0000","last_peered":"2023-10-14T08:51:18.303321+0000","last_clean":"2023-10-14T08:51:18.303321+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:51:18.303321+0000","last_undegraded":"2023-10-14T08:51:18.303321+0000","last_fullsized":"2023-10-14T08:51:18.303321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792805+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:51:17.792805+0000","last_peered":"2023-10-14T08:51:17.792805+0000","last_clean":"2023-10-14T08:51:17.792805+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:51:17.792805+0000","last_undegraded":"2023-10-14T08:51:17.792805+0000","last_fullsized":"2023-10-14T08:51:17.792805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943505+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:51:17.943505+0000","last_peered":"2023-10-14T08:51:17.943505+0000","last_clean":"2023-10-14T08:51:17.943505+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:51:17.943505+0000","last_undegraded":"2023-10-14T08:51:17.943505+0000","last_fullsized":"2023-10-14T08:51:17.943505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302783+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:51:18.302783+0000","last_peered":"2023-10-14T08:51:18.302783+0000","last_clean":"2023-10-14T08:51:18.302783+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:51:18.302783+0000","last_undegraded":"2023-10-14T08:51:18.302783+0000","last_fullsized":"2023-10-14T08:51:18.302783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864305+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:51:17.864305+0000","last_peered":"2023-10-14T08:51:17.864305+0000","last_clean":"2023-10-14T08:51:17.864305+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:51:17.864305+0000","last_undegraded":"2023-10-14T08:51:17.864305+0000","last_fullsized":"2023-10-14T08:51:17.864305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801856+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:51:17.801856+0000","last_peered":"2023-10-14T08:51:17.801856+0000","last_clean":"2023-10-14T08:51:17.801856+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:51:17.801856+0000","last_undegraded":"2023-10-14T08:51:17.801856+0000","last_fullsized":"2023-10-14T08:51:17.801856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864142+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:51:17.864142+0000","last_peered":"2023-10-14T08:51:17.864142+0000","last_clean":"2023-10-14T08:51:17.864142+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:51:17.864142+0000","last_undegraded":"2023-10-14T08:51:17.864142+0000","last_fullsized":"2023-10-14T08:51:17.864142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302890+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:51:18.302890+0000","last_peered":"2023-10-14T08:51:18.302890+0000","last_clean":"2023-10-14T08:51:18.302890+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:51:18.302890+0000","last_undegraded":"2023-10-14T08:51:18.302890+0000","last_fullsized":"2023-10-14T08:51:18.302890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792899+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:51:17.792899+0000","last_peered":"2023-10-14T08:51:17.792899+0000","last_clean":"2023-10-14T08:51:17.792899+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:51:17.792899+0000","last_undegraded":"2023-10-14T08:51:17.792899+0000","last_fullsized":"2023-10-14T08:51:17.792899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943304+0000","last_change":"2023-10-14T08:51:16.823067+0000","last_active":"2023-10-14T08:51:17.943304+0000","last_peered":"2023-10-14T08:51:17.943304+0000","last_clean":"2023-10-14T08:51:17.943304+0000","last_became_active":"2023-10-14T08:51:16.822703+0000","last_became_peered":"2023-10-14T08:51:16.822703+0000","last_unstale":"2023-10-14T08:51:17.943304+0000","last_undegraded":"2023-10-14T08:51:17.943304+0000","last_fullsized":"2023-10-14T08:51:17.943304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:55:57.159977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3704,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":12742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481804,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":423678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":10,"up_from":69,"seq":296352743440,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1016905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46800000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.752},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82999999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.874}]},{"osd":9,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.81499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]}]},{"osd":9,"up_from":64,"seq":274877906964,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":424462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42999999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.501},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.46500000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.68999999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.59599999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71999999999999997}]}]},{"osd":8,"up_from":57,"seq":244813135897,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":424282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.499},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53600000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.434},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.622},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.55100000000000005}]},{"osd":5,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66000000000000003}]},{"osd":9,"last update":"Sat Oct 14 08:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":7,"up_from":49,"seq":210453397533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1486848,"data_stored":1015250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53900000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.69699999999999995}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.874,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.748},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.78100000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.61099999999999999}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.83899999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:50:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.82699999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.89900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":6,"up_from":44,"seq":188978561058,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":423678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.40400000000000003},"min":{"1min":0.26800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.376}]},{"osd":1,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.54700000000000004,"15min":0.52700000000000002},"min":{"1min":0.33100000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.46100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.62},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.60099999999999998,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60099999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.49399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36699999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.63100000000000001,"15min":0.61699999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:50:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.65700000000000003,"15min":0.64200000000000002},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.68700000000000006}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.77400000000000002}]},{"osd":9,"last update":"Sat Oct 14 08:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.48199999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.875},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":888832,"data_stored":425017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.34599999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50700000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.437,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76900000000000002,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:50:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.378,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.90700000000000003,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.46800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.87,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Oct 14 08:50:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.61699999999999999,"15min":0.58999999999999997},"min":{"1min":0.45500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.6629999999999998,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.86399999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.88}]},{"osd":7,"last update":"Sat Oct 14 08:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.441,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.089,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79300000000000004}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":1.0149999999999999}]},{"osd":9,"last update":"Sat Oct 14 08:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.98499999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.96699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":424372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Oct 14 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57899999999999996,"15min":0.54200000000000004},"min":{"1min":0.45800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Sat Oct 14 08:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.59699999999999998,"15min":0.58499999999999996},"min":{"1min":0.438,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.69799999999999995}]},{"osd":6,"last update":"Sat Oct 14 08:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.57299999999999995,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61699999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.73799999999999999}]},{"osd":9,"last update":"Sat Oct 14 08:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60399999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.81299999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":425277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48899999999999999,"15min":0.46999999999999997},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.498,"15min":0.47999999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56399999999999995,"15min":0.54000000000000004},"min":{"1min":0.48999999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57599999999999996,"15min":0.55700000000000005},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Oct 14 08:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47299999999999998}]},{"osd":5,"last update":"Sat Oct 14 08:50:26 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.32100000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.434},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33800000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:50:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54300000000000004}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:50:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.498}]},{"osd":9,"last update":"Sat Oct 14 08:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.60699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":888832,"data_stored":423782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.34499999999999997},"min":{"1min":0.30499999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.371,"15min":0.35199999999999998},"min":{"1min":0.28100000000000003,"5min":0.221,"15min":0.221},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.745}]},{"osd":1,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.41199999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.5},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.42699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:50:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56999999999999995,"15min":0.54800000000000004},"min":{"1min":0.48399999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78000000000000003,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.57299999999999995,"15min":0.54900000000000004},"min":{"1min":0.48699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Oct 14 08:50:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85199999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.49299999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81499999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65900000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39300000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.751,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.439}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59599999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:50:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78700000000000003}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.76400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953514,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":423700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.39400000000000002,"15min":0.36799999999999999},"min":{"1min":0.34999999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.33700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.371}]},{"osd":2,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.501}]},{"osd":3,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:50:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.59399999999999997,"15min":0.56899999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Sat Oct 14 08:50:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.66600000000000004,"15min":0.65400000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.69199999999999995,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59999999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.54300000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.625},{"interface":"front","average":{"1min":0.623,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58099999999999996}]},{"osd":8,"last update":"Sat Oct 14 08:50:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66600000000000004}]},{"osd":9,"last update":"Sat Oct 14 08:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.71599999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":37,"seq":158913789990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1499136,"data_stored":1015191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.5,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.41499999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38200000000000001,"15min":0.378},"min":{"1min":0.28699999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68300000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54600000000000004,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66500000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.75900000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.623},"min":{"1min":0.47899999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81299999999999994,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.877}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.84599999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:50:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.86499999999999999}]},{"osd":9,"last update":"Sat Oct 14 08:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.96099999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.3559999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:51:25.334 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T08:51:25.335 INFO:tasks.cephadm:Setting up client nodes... 2023-10-14T08:51:25.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-14T08:51:25.383 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: 2023-10-14T08:51:25.125+0000 7f1c5709a700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-14T08:51:25.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: 2023-10-14T08:51:25.125+0000 7f1c5709a700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-14T08:51:25.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:25.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: pgmap v262: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-10-14T08:51:25.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:25.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] up:active 2023-10-14T08:51:25.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-10-14T08:51:25.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: mgrmap e17: x(active, since 6m), standbys: y, z 2023-10-14T08:51:25.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:51:25.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1946697974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:25.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:25 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3447235119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: pgmap v262: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2023-10-14T08:51:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:51:25.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] up:active 2023-10-14T08:51:25.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-10-14T08:51:25.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: mgrmap e17: x(active, since 6m), standbys: y, z 2023-10-14T08:51:25.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:51:25.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1946697974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:51:25.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:25 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3447235119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:25.924 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:26.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:26 smithi057 ceph-mon[103313]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:51:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:26 smithi006 ceph-mon[99452]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:51:26.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:26 smithi178 ceph-mon[103612]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:51:27.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3054459743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30102b50 msgr2=0x7ffb30109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:27.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3054459743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30102b50 0x7ffb30109400 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800b0d0 tx=0x7ffb2800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3054459743 shutdown_connections 2023-10-14T08:51:27.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3054459743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30102b50 0x7ffb30109400 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3054459743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb30100fb0 0x7ffb301013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3054459743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb301021b0 0x7ffb30102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3054459743 >> 172.21.15.6:0/3054459743 conn(0x7ffb300fc570 msgr2=0x7ffb300fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:27.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3054459743 shutdown_connections 2023-10-14T08:51:27.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.266+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3054459743 wait complete. 2023-10-14T08:51:27.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 Processor -- start 2023-10-14T08:51:27.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 -- start start 2023-10-14T08:51:27.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 0x7ffb30196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:27.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb301021b0 0x7ffb30197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:27.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb30102b50 0x7ffb3019e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:27.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3019e980 con 0x7ffb30100fb0 2023-10-14T08:51:27.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3019eac0 con 0x7ffb30102b50 2023-10-14T08:51:27.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb34d3b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3019ec50 con 0x7ffb301021b0 2023-10-14T08:51:27.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 0x7ffb30196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:27.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 0x7ffb30196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59562/0 (socket says 172.21.15.6:59562) 2023-10-14T08:51:27.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 -- 172.21.15.6:0/3667132104 learned_addr learned my addr 172.21.15.6:0/3667132104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:27.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2dd9b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb301021b0 0x7ffb30197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:27.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2ed9d700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb30102b50 0x7ffb3019e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:27.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 -- 172.21.15.6:0/3667132104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb301021b0 msgr2=0x7ffb30197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:27.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb301021b0 0x7ffb30197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 -- 172.21.15.6:0/3667132104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb30102b50 msgr2=0x7ffb3019e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:27.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb30102b50 0x7ffb3019e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2e59c700 1 -- 172.21.15.6:0/3667132104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28009d00 con 0x7ffb30100fb0 2023-10-14T08:51:27.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.267+0000 7ffb2ed9d700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb30102b50 0x7ffb3019e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.268+0000 7ffb2e59c700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 0x7ffb30196df0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400d9b0 tx=0x7ffb2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.268+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004020 con 0x7ffb30100fb0 2023-10-14T08:51:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.268+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb24009730 con 0x7ffb30100fb0 2023-10-14T08:51:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.268+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3019ef30 con 0x7ffb30100fb0 2023-10-14T08:51:27.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.268+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24003a30 con 0x7ffb30100fb0 2023-10-14T08:51:27.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.268+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3019f3d0 con 0x7ffb30100fb0 2023-10-14T08:51:27.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.269+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb30108530 con 0x7ffb30100fb0 2023-10-14T08:51:27.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.270+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7ffb240098a0 con 0x7ffb30100fb0 2023-10-14T08:51:27.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.271+0000 7ffb1f7fe700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb180a1590 0x7ffb180a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:27.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.271+0000 7ffb2dd9b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb180a1590 0x7ffb180a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:27.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.271+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb240ccd90 con 0x7ffb30100fb0 2023-10-14T08:51:27.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.271+0000 7ffb2dd9b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb180a1590 0x7ffb180a3a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009a10 tx=0x7ffb20009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.274+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffb240963c0 con 0x7ffb30100fb0 2023-10-14T08:51:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:27 smithi057 ceph-mon[103313]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:51:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:27 smithi057 ceph-mon[103313]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.4 KiB/s wr, 19 op/s 2023-10-14T08:51:27.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:27 smithi006 ceph-mon[99452]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:51:27.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:27 smithi006 ceph-mon[99452]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.4 KiB/s wr, 19 op/s 2023-10-14T08:51:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.558+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ffb3002cf70 con 0x7ffb30100fb0 2023-10-14T08:51:27.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.560+0000 7ffb1f7fe700 1 -- 172.21.15.6:0/3667132104 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7ffb240170f0 con 0x7ffb30100fb0 2023-10-14T08:51:27.562 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-10-14T08:51:27.562 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQCPVipl4QFaIRAAkA3akE7Hs4zNrvBNj+k1EA== 2023-10-14T08:51:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.562+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb180a1590 msgr2=0x7ffb180a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.562+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb180a1590 0x7ffb180a3a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009a10 tx=0x7ffb20009190 comp rx=0 tx=0).stop 2023-10-14T08:51:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.562+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 msgr2=0x7ffb30196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 0x7ffb30196df0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400d9b0 tx=0x7ffb2400dcc0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 shutdown_connections 2023-10-14T08:51:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb180a1590 0x7ffb180a3a50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb30102b50 0x7ffb3019e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb30100fb0 0x7ffb30196df0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 --2- 172.21.15.6:0/3667132104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb301021b0 0x7ffb30197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 >> 172.21.15.6:0/3667132104 conn(0x7ffb300fc570 msgr2=0x7ffb30105670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 shutdown_connections 2023-10-14T08:51:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:27.563+0000 7ffb34d3b700 1 -- 172.21.15.6:0/3667132104 wait complete. 2023-10-14T08:51:27.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:27 smithi178 ceph-mon[103612]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:51:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:27 smithi178 ceph-mon[103612]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5.4 KiB/s wr, 19 op/s 2023-10-14T08:51:27.981 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:51:27.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-14T08:51:27.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T08:51:28.023 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T08:51:28.024 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-14T08:51:28.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-14T08:51:28.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:28 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3667132104' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-14T08:51:28.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:28 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3667132104' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-14T08:51:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:28 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3667132104' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-14T08:51:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:28 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3667132104' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-14T08:51:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:28.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:28 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3667132104' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-14T08:51:28.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:28 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3667132104' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-14T08:51:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:29 smithi057 ceph-mon[103313]: pgmap v264: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 KiB/s wr, 28 op/s 2023-10-14T08:51:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:29 smithi006 ceph-mon[99452]: pgmap v264: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 KiB/s wr, 28 op/s 2023-10-14T08:51:29.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:29 smithi178 ceph-mon[103612]: pgmap v264: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 KiB/s wr, 28 op/s 2023-10-14T08:51:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 -- 172.21.15.6:0/3845650419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798100820 msgr2=0x7f479810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 --2- 172.21.15.6:0/3845650419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798100820 0x7f479810cc90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f479000b0d0 tx=0x7f479000b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 -- 172.21.15.6:0/3845650419 shutdown_connections 2023-10-14T08:51:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 --2- 172.21.15.6:0/3845650419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798100820 0x7f479810cc90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 --2- 172.21.15.6:0/3845650419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798105e70 0x7f4798106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:29.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 --2- 172.21.15.6:0/3845650419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 0x7f47981002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 -- 172.21.15.6:0/3845650419 >> 172.21.15.6:0/3845650419 conn(0x7f4798075e00 msgr2=0x7f4798076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 -- 172.21.15.6:0/3845650419 shutdown_connections 2023-10-14T08:51:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.950+0000 7f479db39700 1 -- 172.21.15.6:0/3845650419 wait complete. 2023-10-14T08:51:29.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 Processor -- start 2023-10-14T08:51:29.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 -- start start 2023-10-14T08:51:29.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 0x7f4798195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:29.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798100820 0x7f47981961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:29.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 0x7f4798196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:29.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47981a54f0 con 0x7f4798105e70 2023-10-14T08:51:29.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47981a5660 con 0x7f4798100820 2023-10-14T08:51:29.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f479db39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47981a5820 con 0x7f47980ffe60 2023-10-14T08:51:29.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f4797fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 0x7f4798196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:29.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f4797fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 0x7f4798196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59578/0 (socket says 172.21.15.6:59578) 2023-10-14T08:51:29.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f4797fff700 1 -- 172.21.15.6:0/1307221144 learned_addr learned my addr 172.21.15.6:0/1307221144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:29.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f47977fe700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 0x7f4798195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:29.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.951+0000 7f4796ffd700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798100820 0x7f47981961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:29.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4797fff700 1 -- 172.21.15.6:0/1307221144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 msgr2=0x7f4798195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:29.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4797fff700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 0x7f4798195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:29.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4797fff700 1 -- 172.21.15.6:0/1307221144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798100820 msgr2=0x7f47981961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:29.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4797fff700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798100820 0x7f47981961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:29.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4797fff700 1 -- 172.21.15.6:0/1307221144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790009d00 con 0x7f4798105e70 2023-10-14T08:51:29.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f47977fe700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 0x7f4798195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:29.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4796ffd700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798100820 0x7f47981961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:29.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4797fff700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 0x7f4798196730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4790007870 tx=0x7f4790007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:29.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000e040 con 0x7f4798105e70 2023-10-14T08:51:29.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f479000be30 con 0x7f4798105e70 2023-10-14T08:51:29.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479001b750 con 0x7f4798105e70 2023-10-14T08:51:29.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47981a5aa0 con 0x7f4798105e70 2023-10-14T08:51:29.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.952+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47981a5e60 con 0x7f4798105e70 2023-10-14T08:51:29.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.953+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479804ebb0 con 0x7f4798105e70 2023-10-14T08:51:29.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.954+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4790005090 con 0x7f4798105e70 2023-10-14T08:51:29.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.954+0000 7f4794ff9700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f47840a1510 0x7f47840a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:29.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.955+0000 7f47977fe700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f47840a1510 0x7f47840a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:29.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.955+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47900ce810 con 0x7f4798105e70 2023-10-14T08:51:29.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.955+0000 7f47977fe700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f47840a1510 0x7f47840a39d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4780009cb0 tx=0x7f4780009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:29.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:29.958+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4790097e50 con 0x7f4798105e70 2023-10-14T08:51:30.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.217+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4798068f90 con 0x7f4798105e70 2023-10-14T08:51:30.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.221+0000 7f4794ff9700 1 -- 172.21.15.6:0/1307221144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260395 (secure 0 0 0) 0x7f479002ce60 con 0x7f4798105e70 2023-10-14T08:51:30.226 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:30.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f47840a1510 msgr2=0x7f47840a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f47840a1510 0x7f47840a39d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4780009cb0 tx=0x7f4780009260 comp rx=0 tx=0).stop 2023-10-14T08:51:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 msgr2=0x7f4798196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 0x7f4798196730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4790007870 tx=0x7f4790007950 comp rx=0 tx=0).stop 2023-10-14T08:51:30.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 shutdown_connections 2023-10-14T08:51:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4798105e70 0x7f4798196730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980ffe60 0x7f4798195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f47840a1510 0x7f47840a39d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 --2- 172.21.15.6:0/1307221144 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4798100820 0x7f47981961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:30.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 >> 172.21.15.6:0/1307221144 conn(0x7f4798075e00 msgr2=0x7f47980fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 shutdown_connections 2023-10-14T08:51:30.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:30.224+0000 7f479db39700 1 -- 172.21.15.6:0/1307221144 wait complete. 2023-10-14T08:51:30.697 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":827561147},{"type":"v1","addr":"172.21.15.6:6801","nonce":827561147}]},"active_addr":"172.21.15.6:6801/827561147","active_change":"2023-10-14T08:45:03.353108+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.6:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2747318236}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":887401432}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":4218490888}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3739699064}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2096311404}]}]} 2023-10-14T08:51:30.703 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-14T08:51:30.703 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-14T08:51:30.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-14T08:51:31.271 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:31 smithi057 ceph-mon[103313]: pgmap v265: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.1 KiB/s wr, 24 op/s 2023-10-14T08:51:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:31 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1307221144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-14T08:51:31.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:31 smithi006 ceph-mon[99452]: pgmap v265: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.1 KiB/s wr, 24 op/s 2023-10-14T08:51:31.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:31 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1307221144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-14T08:51:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:31 smithi178 ceph-mon[103612]: pgmap v265: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.1 KiB/s wr, 24 op/s 2023-10-14T08:51:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:31 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1307221144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-14T08:51:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 -- 172.21.15.6:0/2711118302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 msgr2=0x7f07a01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2711118302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a01009a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f07940099c0 tx=0x7f0794009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 -- 172.21.15.6:0/2711118302 shutdown_connections 2023-10-14T08:51:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2711118302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 0x7f07a010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2711118302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0104e30 0x7f07a0105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2711118302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a01009a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 -- 172.21.15.6:0/2711118302 >> 172.21.15.6:0/2711118302 conn(0x7f07a0076360 msgr2=0x7f07a00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 -- 172.21.15.6:0/2711118302 shutdown_connections 2023-10-14T08:51:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.458+0000 7f07a83ee700 1 -- 172.21.15.6:0/2711118302 wait complete. 2023-10-14T08:51:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 Processor -- start 2023-10-14T08:51:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 -- start start 2023-10-14T08:51:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a00fb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 0x7f07a00fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0104e30 0x7f07a00fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a53b0 con 0x7f07a0100520 2023-10-14T08:51:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a5520 con 0x7f07a0104e30 2023-10-14T08:51:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a83ee700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a56e0 con 0x7f07a0100ee0 2023-10-14T08:51:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a618a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a00fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a618a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a00fb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59586/0 (socket says 172.21.15.6:59586) 2023-10-14T08:51:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.459+0000 7f07a618a700 1 -- 172.21.15.6:0/2151512854 learned_addr learned my addr 172.21.15.6:0/2151512854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a698b700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0104e30 0x7f07a00fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a5989700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 0x7f07a00fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a618a700 1 -- 172.21.15.6:0/2151512854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 msgr2=0x7f07a00fbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a618a700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 0x7f07a00fbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a618a700 1 -- 172.21.15.6:0/2151512854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0104e30 msgr2=0x7f07a00fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a618a700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0104e30 0x7f07a00fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a618a700 1 -- 172.21.15.6:0/2151512854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940095f0 con 0x7f07a0100520 2023-10-14T08:51:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a5989700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 0x7f07a00fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a618a700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a00fb800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c9b0 tx=0x7f079c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c007b00 con 0x7f07a0100520 2023-10-14T08:51:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f079c007c60 con 0x7f07a0100520 2023-10-14T08:51:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01a59c0 con 0x7f07a0100520 2023-10-14T08:51:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c018660 con 0x7f07a0100520 2023-10-14T08:51:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.460+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01a5f10 con 0x7f07a0100520 2023-10-14T08:51:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.461+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a004ebb0 con 0x7f07a0100520 2023-10-14T08:51:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.462+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f079c00f450 con 0x7f07a0100520 2023-10-14T08:51:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.463+0000 7f07937fe700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1590 0x7f078c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.463+0000 7f07a5989700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1590 0x7f078c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.463+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f079c0ccc10 con 0x7f07a0100520 2023-10-14T08:51:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.463+0000 7f07a5989700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1590 0x7f078c0a3a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0794006010 tx=0x7f0794000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.467+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f079c0962c0 con 0x7f07a0100520 2023-10-14T08:51:32.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.667+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07a0110010 con 0x7f07a0100520 2023-10-14T08:51:32.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.668+0000 7f07937fe700 1 -- 172.21.15.6:0/2151512854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22034 (secure 0 0 0) 0x7f079c0998e0 con 0x7f07a0100520 2023-10-14T08:51:32.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:32.671 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:51:17.789244+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:51:32.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.670+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1590 msgr2=0x7f078c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:32.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.670+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1590 0x7f078c0a3a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0794006010 tx=0x7f0794000bc0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.670+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 msgr2=0x7f07a00fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:32.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.670+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a00fb800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c9b0 tx=0x7f079c00ccc0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 shutdown_connections 2023-10-14T08:51:32.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1590 0x7f078c0a3a50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0104e30 0x7f07a00fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100520 0x7f07a00fb800 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 --2- 172.21.15.6:0/2151512854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a0100ee0 0x7f07a00fbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 >> 172.21.15.6:0/2151512854 conn(0x7f07a0076360 msgr2=0x7f07a00fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 shutdown_connections 2023-10-14T08:51:32.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:32.671+0000 7f07a83ee700 1 -- 172.21.15.6:0/2151512854 wait complete. 2023-10-14T08:51:33.121 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-14T08:51:33.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd dump --format=json 2023-10-14T08:51:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:33 smithi057 ceph-mon[103313]: pgmap v266: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2023-10-14T08:51:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:33 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2151512854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:33 smithi006 ceph-mon[99452]: pgmap v266: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2023-10-14T08:51:33.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:33 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2151512854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:33.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:33 smithi178 ceph-mon[103612]: pgmap v266: 97 pgs: 97 active+clean; 623 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 KiB/s wr, 24 op/s 2023-10-14T08:51:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:33 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2151512854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 -- 172.21.15.6:0/3745635513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a0100820 msgr2=0x7f00a010cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 --2- 172.21.15.6:0/3745635513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a0100820 0x7f00a010cc90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f009800b0d0 tx=0x7f009800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 -- 172.21.15.6:0/3745635513 shutdown_connections 2023-10-14T08:51:34.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 --2- 172.21.15.6:0/3745635513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a0100820 0x7f00a010cc90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 --2- 172.21.15.6:0/3745635513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00a0105e70 0x7f00a0106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 --2- 172.21.15.6:0/3745635513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a00ffe60 0x7f00a01002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 -- 172.21.15.6:0/3745635513 >> 172.21.15.6:0/3745635513 conn(0x7f00a0075e00 msgr2=0x7f00a0076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 -- 172.21.15.6:0/3745635513 shutdown_connections 2023-10-14T08:51:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.878+0000 7f00a493a700 1 -- 172.21.15.6:0/3745635513 wait complete. 2023-10-14T08:51:34.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 Processor -- start 2023-10-14T08:51:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 -- start start 2023-10-14T08:51:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 0x7f00a0197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a0100820 0x7f00a0197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00a0105e70 0x7f00a019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:34.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019c010 con 0x7f00a00ffe60 2023-10-14T08:51:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019c180 con 0x7f00a0100820 2023-10-14T08:51:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f00a493a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019c340 con 0x7f00a0105e70 2023-10-14T08:51:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f009e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 0x7f00a0197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.879+0000 7f009e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 0x7f00a0197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59600/0 (socket says 172.21.15.6:59600) 2023-10-14T08:51:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 -- 172.21.15.6:0/674020013 learned_addr learned my addr 172.21.15.6:0/674020013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:34.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009dd9b700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a0100820 0x7f00a0197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009ed9d700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00a0105e70 0x7f00a019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 -- 172.21.15.6:0/674020013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00a0105e70 msgr2=0x7f00a019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00a0105e70 0x7f00a019ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:34.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 -- 172.21.15.6:0/674020013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a0100820 msgr2=0x7f00a0197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a0100820 0x7f00a0197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 -- 172.21.15.6:0/674020013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098009d00 con 0x7f00a00ffe60 2023-10-14T08:51:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f009e59c700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 0x7f00a0197050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f009000c920 tx=0x7f009000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090004a30 con 0x7f00a00ffe60 2023-10-14T08:51:34.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a019c620 con 0x7f00a00ffe60 2023-10-14T08:51:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00900054e0 con 0x7f00a00ffe60 2023-10-14T08:51:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090007c10 con 0x7f00a00ffe60 2023-10-14T08:51:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.880+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a01a3e80 con 0x7f00a00ffe60 2023-10-14T08:51:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.881+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a004ebb0 con 0x7f00a00ffe60 2023-10-14T08:51:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.882+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f0090005000 con 0x7f00a00ffe60 2023-10-14T08:51:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.883+0000 7f00977fe700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f008c0a1510 0x7f008c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.883+0000 7f009dd9b700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f008c0a1510 0x7f008c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.883+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00900ccca0 con 0x7f00a00ffe60 2023-10-14T08:51:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.884+0000 7f009dd9b700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f008c0a1510 0x7f008c0a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00a0198670 tx=0x7f008800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:34.887+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0090096250 con 0x7f00a00ffe60 2023-10-14T08:51:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.087+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00a01983b0 con 0x7f00a00ffe60 2023-10-14T08:51:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.088+0000 7f00977fe700 1 -- 172.21.15.6:0/674020013 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22034 (secure 0 0 0) 0x7f009001d090 con 0x7f00a00ffe60 2023-10-14T08:51:35.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:51:35.090 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":82,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:51:17.789244+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:51:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f008c0a1510 msgr2=0x7f008c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f008c0a1510 0x7f008c0a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00a0198670 tx=0x7f008800a300 comp rx=0 tx=0).stop 2023-10-14T08:51:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 msgr2=0x7f00a0197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 0x7f00a0197050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f009000c920 tx=0x7f009000cc30 comp rx=0 tx=0).stop 2023-10-14T08:51:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 shutdown_connections 2023-10-14T08:51:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00a0105e70 0x7f00a019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00a00ffe60 0x7f00a0197050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f008c0a1510 0x7f008c0a39d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 --2- 172.21.15.6:0/674020013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00a0100820 0x7f00a0197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.090+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 >> 172.21.15.6:0/674020013 conn(0x7f00a0075e00 msgr2=0x7f00a00feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.091+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 shutdown_connections 2023-10-14T08:51:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:35.091+0000 7f00a493a700 1 -- 172.21.15.6:0/674020013 wait complete. 2023-10-14T08:51:35.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:35 smithi057 ceph-mon[103313]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2023-10-14T08:51:35.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:35 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/674020013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:35.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:35 smithi006 ceph-mon[99452]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2023-10-14T08:51:35.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:35 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/674020013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:35.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-14T08:51:35.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-14T08:51:35.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-14T08:51:35.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-14T08:51:35.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-14T08:51:35.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-14T08:51:35.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-14T08:51:35.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-14T08:51:35.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-14T08:51:35.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-14T08:51:35.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-14T08:51:35.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-14T08:51:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:35 smithi178 ceph-mon[103612]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2023-10-14T08:51:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:35 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/674020013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:51:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:36.959 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:37 smithi057 ceph-mon[103313]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2023-10-14T08:51:37.453 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:37.459 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:37 smithi006 ceph-mon[99452]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2023-10-14T08:51:37.466 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:37.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:37 smithi178 ceph-mon[103612]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2023-10-14T08:51:37.666 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:39.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:39 smithi006 ceph-mon[99452]: pgmap v269: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2023-10-14T08:51:39.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:39 smithi178 ceph-mon[103612]: pgmap v269: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2023-10-14T08:51:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:39 smithi057 ceph-mon[103313]: pgmap v269: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2023-10-14T08:51:39.780 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:39.781 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:40.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 -- 172.21.15.6:0/1181995046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c105e70 msgr2=0x7f264c106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 --2- 172.21.15.6:0/1181995046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c105e70 0x7f264c106250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26400099c0 tx=0x7f2640009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 -- 172.21.15.6:0/1181995046 shutdown_connections 2023-10-14T08:51:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 --2- 172.21.15.6:0/1181995046 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f264c100820 0x7f264c10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 --2- 172.21.15.6:0/1181995046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c105e70 0x7f264c106250 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 --2- 172.21.15.6:0/1181995046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f264c0ffe60 0x7f264c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 -- 172.21.15.6:0/1181995046 >> 172.21.15.6:0/1181995046 conn(0x7f264c075e00 msgr2=0x7f264c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 -- 172.21.15.6:0/1181995046 shutdown_connections 2023-10-14T08:51:40.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.330+0000 7f26531aa700 1 -- 172.21.15.6:0/1181995046 wait complete. 2023-10-14T08:51:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 Processor -- start 2023-10-14T08:51:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 -- start start 2023-10-14T08:51:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f264c0ffe60 0x7f264c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c100820 0x7f264c19aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f264c105e70 0x7f264c194b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c1951a0 con 0x7f264c100820 2023-10-14T08:51:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c195310 con 0x7f264c105e70 2023-10-14T08:51:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.331+0000 7f26531aa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c1954d0 con 0x7f264c0ffe60 2023-10-14T08:51:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c100820 0x7f264c19aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c100820 0x7f264c19aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59614/0 (socket says 172.21.15.6:59614) 2023-10-14T08:51:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 -- 172.21.15.6:0/2264634213 learned_addr learned my addr 172.21.15.6:0/2264634213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f2650f46700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f264c0ffe60 0x7f264c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f2651747700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f264c105e70 0x7f264c194b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 -- 172.21.15.6:0/2264634213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f264c0ffe60 msgr2=0x7f264c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f264c0ffe60 0x7f264c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 -- 172.21.15.6:0/2264634213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f264c105e70 msgr2=0x7f264c194b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f264c105e70 0x7f264c194b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 -- 172.21.15.6:0/2264634213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26400095f0 con 0x7f264c100820 2023-10-14T08:51:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f264bfff700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c100820 0x7f264c19aff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f263800d950 tx=0x7f263800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638009940 con 0x7f264c100820 2023-10-14T08:51:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2638010460 con 0x7f264c100820 2023-10-14T08:51:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c1957b0 con 0x7f264c100820 2023-10-14T08:51:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800f620 con 0x7f264c100820 2023-10-14T08:51:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.332+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c1a1aa0 con 0x7f264c100820 2023-10-14T08:51:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.333+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f264c04ebb0 con 0x7f264c100820 2023-10-14T08:51:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.334+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f26380108d0 con 0x7f264c100820 2023-10-14T08:51:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2649ffb700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f263c0a1590 0x7f263c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2650f46700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f263c0a1590 0x7f263c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f26380ccfc0 con 0x7f264c100820 2023-10-14T08:51:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2649ffb700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] conn(0x7f263c0aad70 0x7f263c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 --> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f263c0ad840 con 0x7f263c0aad70 2023-10-14T08:51:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26380cd460 con 0x7f264c100820 2023-10-14T08:51:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.335+0000 7f2651747700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] conn(0x7f263c0aad70 0x7f263c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.336+0000 7f2650f46700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f263c0a1590 0x7f263c0a3a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2640006010 tx=0x7f2640009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.336+0000 7f2651747700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] conn(0x7f263c0aad70 0x7f263c0ad190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.337+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== osd.6 v2:172.21.15.6:6818/1891012119 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f263c0ad840 con 0x7f263c0aad70 2023-10-14T08:51:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.355+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 --> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f264c10efd0 con 0x7f263c0aad70 2023-10-14T08:51:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.355+0000 7f2649ffb700 1 -- 172.21.15.6:0/2264634213 <== osd.6 v2:172.21.15.6:6818/1891012119 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2644004bb0 con 0x7f263c0aad70 2023-10-14T08:51:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] conn(0x7f263c0aad70 msgr2=0x7f263c0ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] conn(0x7f263c0aad70 0x7f263c0ad190 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f263c0a1590 msgr2=0x7f263c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f263c0a1590 0x7f263c0a3a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2640006010 tx=0x7f2640009f10 comp rx=0 tx=0).stop 2023-10-14T08:51:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c100820 msgr2=0x7f264c19aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 --2- 172.21.15.6:0/2264634213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f264c100820 0x7f264c19aff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f263800d950 tx=0x7f263800dc60 comp rx=0 tx=0).stop 2023-10-14T08:51:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f2651747700 1 -- 172.21.15.6:0/2264634213 reap_dead start 2023-10-14T08:51:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 shutdown_connections 2023-10-14T08:51:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 >> 172.21.15.6:0/2264634213 conn(0x7f264c075e00 msgr2=0x7f264c103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 shutdown_connections 2023-10-14T08:51:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.356+0000 7f26531aa700 1 -- 172.21.15.6:0/2264634213 wait complete. 2023-10-14T08:51:40.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 -- 172.21.15.6:0/34321237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 msgr2=0x7f090810af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 --2- 172.21.15.6:0/34321237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f090810af60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009990 tx=0x7f08fc009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 -- 172.21.15.6:0/34321237 shutdown_connections 2023-10-14T08:51:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 --2- 172.21.15.6:0/34321237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f090810b530 0x7f090810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 --2- 172.21.15.6:0/34321237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0908102150 0x7f0908102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 --2- 172.21.15.6:0/34321237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f090810af60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 -- 172.21.15.6:0/34321237 >> 172.21.15.6:0/34321237 conn(0x7f09080fb8a0 msgr2=0x7f09080fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 -- 172.21.15.6:0/34321237 shutdown_connections 2023-10-14T08:51:40.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.758+0000 7f090ce68700 1 -- 172.21.15.6:0/34321237 wait complete. 2023-10-14T08:51:40.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 Processor -- start 2023-10-14T08:51:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 -- start start 2023-10-14T08:51:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0908102150 0x7f0908199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f0908199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090810b530 0x7f090819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090819e180 con 0x7f0908102a70 2023-10-14T08:51:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090819e2f0 con 0x7f0908102150 2023-10-14T08:51:40.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090ce68700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090819e4b0 con 0x7f090810b530 2023-10-14T08:51:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f0905d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f0908199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f0905d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f0908199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59646/0 (socket says 172.21.15.6:59646) 2023-10-14T08:51:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f0905d9b700 1 -- 172.21.15.6:0/3786105134 learned_addr learned my addr 172.21.15.6:0/3786105134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.759+0000 7f090659c700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0908102150 0x7f0908199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0906d9d700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090810b530 0x7f090819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0905d9b700 1 -- 172.21.15.6:0/3786105134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090810b530 msgr2=0x7f090819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0905d9b700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090810b530 0x7f090819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0905d9b700 1 -- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0908102150 msgr2=0x7f0908199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0905d9b700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0908102150 0x7f0908199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0905d9b700 1 -- 172.21.15.6:0/3786105134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0095f0 con 0x7f0908102a70 2023-10-14T08:51:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0906d9d700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f090810b530 0x7f090819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f0905d9b700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f0908199770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08fc003730 tx=0x7f08fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01d070 con 0x7f0908102a70 2023-10-14T08:51:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090819e730 con 0x7f0908102a70 2023-10-14T08:51:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08fc00fb80 con 0x7f0908102a70 2023-10-14T08:51:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0173f0 con 0x7f0908102a70 2023-10-14T08:51:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.760+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09081a5ff0 con 0x7f0908102a70 2023-10-14T08:51:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.761+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0908111110 con 0x7f0908102a70 2023-10-14T08:51:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.762+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f08fc022470 con 0x7f0908102a70 2023-10-14T08:51:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f08f77fe700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f08f00a1510 0x7f08f00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f090659c700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f08f00a1510 0x7f08f00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08fc0ceb30 con 0x7f0908102a70 2023-10-14T08:51:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f08f77fe700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] conn(0x7f08f00aacf0 0x7f08f00ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 --> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08f00ad7c0 con 0x7f08f00aacf0 2023-10-14T08:51:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08fc0cefd0 con 0x7f0908102a70 2023-10-14T08:51:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f090659c700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f08f00a1510 0x7f08f00a39d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08f8005950 tx=0x7f08f800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:40.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.763+0000 7f0906d9d700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] conn(0x7f08f00aacf0 0x7f08f00ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.764+0000 7f0906d9d700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] conn(0x7f08f00aacf0 0x7f08f00ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.765+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== osd.10 v2:172.21.15.57:6824/104741011 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f08f00ad7c0 con 0x7f08f00aacf0 2023-10-14T08:51:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.786+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 --> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0908101840 con 0x7f08f00aacf0 2023-10-14T08:51:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f08f77fe700 1 -- 172.21.15.6:0/3786105134 <== osd.10 v2:172.21.15.57:6824/104741011 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0908101840 con 0x7f08f00aacf0 2023-10-14T08:51:40.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] conn(0x7f08f00aacf0 msgr2=0x7f08f00ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f090ce68700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] conn(0x7f08f00aacf0 0x7f08f00ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f08f00a1510 msgr2=0x7f08f00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f090ce68700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f08f00a1510 0x7f08f00a39d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08f8005950 tx=0x7f08f800b410 comp rx=0 tx=0).stop 2023-10-14T08:51:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 msgr2=0x7f0908199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:40.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f090ce68700 1 --2- 172.21.15.6:0/3786105134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0908102a70 0x7f0908199770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08fc003730 tx=0x7f08fc00f690 comp rx=0 tx=0).stop 2023-10-14T08:51:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.787+0000 7f0906d9d700 1 -- 172.21.15.6:0/3786105134 reap_dead start 2023-10-14T08:51:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.788+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 shutdown_connections 2023-10-14T08:51:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.788+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 >> 172.21.15.6:0/3786105134 conn(0x7f09080fb8a0 msgr2=0x7f090810d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.788+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 shutdown_connections 2023-10-14T08:51:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.788+0000 7f090ce68700 1 -- 172.21.15.6:0/3786105134 wait complete. 2023-10-14T08:51:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 -- 172.21.15.6:0/701316973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c100820 msgr2=0x7f248c10cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 --2- 172.21.15.6:0/701316973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c100820 0x7f248c10cc90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f248400b0d0 tx=0x7f248400b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 -- 172.21.15.6:0/701316973 shutdown_connections 2023-10-14T08:51:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 --2- 172.21.15.6:0/701316973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c100820 0x7f248c10cc90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 --2- 172.21.15.6:0/701316973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c105e70 0x7f248c106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 --2- 172.21.15.6:0/701316973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248c0ffe60 0x7f248c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 -- 172.21.15.6:0/701316973 >> 172.21.15.6:0/701316973 conn(0x7f248c075e00 msgr2=0x7f248c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 -- 172.21.15.6:0/701316973 shutdown_connections 2023-10-14T08:51:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.126+0000 7f2494409700 1 -- 172.21.15.6:0/701316973 wait complete. 2023-10-14T08:51:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 Processor -- start 2023-10-14T08:51:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 -- start start 2023-10-14T08:51:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248c0ffe60 0x7f248c101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c100820 0x7f248c102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c105e70 0x7f248c1025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1a5430 con 0x7f248c105e70 2023-10-14T08:51:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1a55a0 con 0x7f248c100820 2023-10-14T08:51:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f2494409700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1a5760 con 0x7f248c0ffe60 2023-10-14T08:51:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24929a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c105e70 0x7f248c1025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24929a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c105e70 0x7f248c1025a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59664/0 (socket says 172.21.15.6:59664) 2023-10-14T08:51:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24929a6700 1 -- 172.21.15.6:0/3936981293 learned_addr learned my addr 172.21.15.6:0/3936981293 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24921a5700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248c0ffe60 0x7f248c101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24919a4700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c100820 0x7f248c102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24929a6700 1 -- 172.21.15.6:0/3936981293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248c0ffe60 msgr2=0x7f248c101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.127+0000 7f24929a6700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f248c0ffe60 0x7f248c101ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f24929a6700 1 -- 172.21.15.6:0/3936981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c100820 msgr2=0x7f248c102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f24929a6700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c100820 0x7f248c102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f24929a6700 1 -- 172.21.15.6:0/3936981293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484009d00 con 0x7f248c105e70 2023-10-14T08:51:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f24919a4700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248c100820 0x7f248c102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f24929a6700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c105e70 0x7f248c1025a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2484009380 tx=0x7f24840093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400e040 con 0x7f248c105e70 2023-10-14T08:51:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c1a59e0 con 0x7f248c105e70 2023-10-14T08:51:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2484003e10 con 0x7f248c105e70 2023-10-14T08:51:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248401ba70 con 0x7f248c105e70 2023-10-14T08:51:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.128+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c1a5df0 con 0x7f248c105e70 2023-10-14T08:51:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.129+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f248c10fff0 con 0x7f248c105e70 2023-10-14T08:51:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.130+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f24840056c0 con 0x7f248c105e70 2023-10-14T08:51:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f247f7fe700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24780a1510 0x7f24780a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f24921a5700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24780a1510 0x7f24780a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f24840cec70 con 0x7f248c105e70 2023-10-14T08:51:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f247f7fe700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] conn(0x7f24780aacf0 0x7f24780ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 --> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24780ad7c0 con 0x7f24780aacf0 2023-10-14T08:51:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24840cefe0 con 0x7f248c105e70 2023-10-14T08:51:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f24919a4700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] conn(0x7f24780aacf0 0x7f24780ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f24921a5700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24780a1510 0x7f24780a39d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f248000abb0 tx=0x7f248000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.131+0000 7f24919a4700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] conn(0x7f24780aacf0 0x7f24780ad110 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.132+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== osd.0 v2:172.21.15.6:6802/3964100626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f24780ad7c0 con 0x7f24780aacf0 2023-10-14T08:51:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.150+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 --> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f248c04ebb0 con 0x7f24780aacf0 2023-10-14T08:51:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.150+0000 7f247f7fe700 1 -- 172.21.15.6:0/3936981293 <== osd.0 v2:172.21.15.6:6802/3964100626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f248c04ebb0 con 0x7f24780aacf0 2023-10-14T08:51:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 -- 172.21.15.6:0/2031148765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 msgr2=0x7fb1a010de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 --2- 172.21.15.6:0/2031148765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a010de60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb19800b0d0 tx=0x7fb19800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 -- 172.21.15.6:0/2031148765 shutdown_connections 2023-10-14T08:51:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 --2- 172.21.15.6:0/2031148765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a010de60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 --2- 172.21.15.6:0/2031148765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1a0069520 0x7fb1a0069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 --2- 172.21.15.6:0/2031148765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a0069ed0 0x7fb1a0105c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 -- 172.21.15.6:0/2031148765 >> 172.21.15.6:0/2031148765 conn(0x7fb1a0076cf0 msgr2=0x7fb1a0077100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 -- 172.21.15.6:0/2031148765 shutdown_connections 2023-10-14T08:51:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.150+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] conn(0x7f24780aacf0 msgr2=0x7f24780ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.150+0000 7f2494409700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] conn(0x7f24780aacf0 0x7f24780ad110 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 -- 172.21.15.6:0/2031148765 wait complete. 2023-10-14T08:51:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.455+0000 7fb1a583d700 1 Processor -- start 2023-10-14T08:51:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 -- start start 2023-10-14T08:51:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a0069520 0x7fb1a0197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1a0069ed0 0x7fb1a0197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a019c050 con 0x7fb1a0106340 2023-10-14T08:51:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a019c1c0 con 0x7fb1a0069520 2023-10-14T08:51:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb1a583d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a019c380 con 0x7fb1a0069ed0 2023-10-14T08:51:41.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59632/0 (socket says 172.21.15.6:59632) 2023-10-14T08:51:41.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 -- 172.21.15.6:0/3205459052 learned_addr learned my addr 172.21.15.6:0/3205459052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:41.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19effd700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a0069520 0x7fb1a0197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19e7fc700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1a0069ed0 0x7fb1a0197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 -- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1a0069ed0 msgr2=0x7fb1a0197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1a0069ed0 0x7fb1a0197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 -- 172.21.15.6:0/3205459052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a0069520 msgr2=0x7fb1a0197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a0069520 0x7fb1a0197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19f7fe700 1 -- 172.21.15.6:0/3205459052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009d00 con 0x7fb1a0106340 2023-10-14T08:51:41.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19effd700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1a0069520 0x7fb1a0197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:41.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.456+0000 7fb19e7fc700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1a0069ed0 0x7fb1a0197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:41.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.457+0000 7fb19f7fe700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a019ba40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb198004c80 tx=0x7fb198004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:41.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.457+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19800e040 con 0x7fb1a0106340 2023-10-14T08:51:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.457+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a019c600 con 0x7fb1a0106340 2023-10-14T08:51:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.457+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb19800be60 con 0x7fb1a0106340 2023-10-14T08:51:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.457+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1980052a0 con 0x7fb1a0106340 2023-10-14T08:51:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.457+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a01a3ec0 con 0x7fb1a0106340 2023-10-14T08:51:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.458+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1a004ebb0 con 0x7fb1a0106340 2023-10-14T08:51:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.459+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb19801d470 con 0x7fb1a0106340 2023-10-14T08:51:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb1a483b700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1880a1510 0x7fb1880a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb19effd700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1880a1510 0x7fb1880a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb1980ce920 con 0x7fb1a0106340 2023-10-14T08:51:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb1a483b700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] conn(0x7fb1880aacf0 0x7fb1880ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 --> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1880ad7c0 con 0x7fb1880aacf0 2023-10-14T08:51:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1980cec90 con 0x7fb1a0106340 2023-10-14T08:51:41.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb19effd700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1880a1510 0x7fb1880a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb190005950 tx=0x7fb1900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.460+0000 7fb19e7fc700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] conn(0x7fb1880aacf0 0x7fb1880ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.461+0000 7fb19e7fc700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] conn(0x7fb1880aacf0 0x7fb1880ad110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.462+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== osd.5 v2:172.21.15.178:6808/1403706440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb1880ad7c0 con 0x7fb1880aacf0 2023-10-14T08:51:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.478+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 --> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1a01110f0 con 0x7fb1880aacf0 2023-10-14T08:51:41.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.478+0000 7fb1a483b700 1 -- 172.21.15.6:0/3205459052 <== osd.5 v2:172.21.15.178:6808/1403706440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb1a01110f0 con 0x7fb1880aacf0 2023-10-14T08:51:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] conn(0x7fb1880aacf0 msgr2=0x7fb1880ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] conn(0x7fb1880aacf0 0x7fb1880ad110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1880a1510 msgr2=0x7fb1880a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1880a1510 0x7fb1880a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb190005950 tx=0x7fb1900058e0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 msgr2=0x7fb1a019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 --2- 172.21.15.6:0/3205459052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1a0106340 0x7fb1a019ba40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb198004c80 tx=0x7fb198004d60 comp rx=0 tx=0).stop 2023-10-14T08:51:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb19f7fe700 1 -- 172.21.15.6:0/3205459052 reap_dead start 2023-10-14T08:51:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 shutdown_connections 2023-10-14T08:51:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 >> 172.21.15.6:0/3205459052 conn(0x7fb1a0076cf0 msgr2=0x7fb1a00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:41.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 shutdown_connections 2023-10-14T08:51:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:40.479+0000 7fb1a583d700 1 -- 172.21.15.6:0/3205459052 wait complete. 2023-10-14T08:51:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.150+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24780a1510 msgr2=0x7f24780a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.150+0000 7f2494409700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24780a1510 0x7f24780a39d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f248000abb0 tx=0x7f248000a380 comp rx=0 tx=0).stop 2023-10-14T08:51:41.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.151+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c105e70 msgr2=0x7f248c1025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.151+0000 7f2494409700 1 --2- 172.21.15.6:0/3936981293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f248c105e70 0x7f248c1025a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2484009380 tx=0x7f24840093b0 comp rx=0 tx=0).stop 2023-10-14T08:51:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.151+0000 7f24929a6700 1 -- 172.21.15.6:0/3936981293 reap_dead start 2023-10-14T08:51:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.151+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 shutdown_connections 2023-10-14T08:51:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.151+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 >> 172.21.15.6:0/3936981293 conn(0x7f248c075e00 msgr2=0x7f248c0689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.152+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 shutdown_connections 2023-10-14T08:51:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:41.152+0000 7f2494409700 1 -- 172.21.15.6:0/3936981293 wait complete. 2023-10-14T08:51:41.200 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:41.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:41 smithi006 ceph-mon[99452]: pgmap v270: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-14T08:51:41.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:41 smithi178 ceph-mon[103612]: pgmap v270: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-14T08:51:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:41 smithi057 ceph-mon[103313]: pgmap v270: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-14T08:51:42.214 INFO:teuthology.orchestra.run.smithi006.stdout:158913789994 2023-10-14T08:51:42.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-14T08:51:42.350 INFO:teuthology.orchestra.run.smithi006.stdout:296352743444 2023-10-14T08:51:42.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-14T08:51:43.313 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:43 smithi006 ceph-mon[99452]: pgmap v271: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-10-14T08:51:43.314 INFO:teuthology.orchestra.run.smithi006.stdout:34359738433 2023-10-14T08:51:43.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-14T08:51:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 -- 172.21.15.6:0/3703164506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0731d0 msgr2=0x7fbe6c0735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 --2- 172.21.15.6:0/3703164506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0731d0 0x7fbe6c0735b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009990 tx=0x7fbe68009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 -- 172.21.15.6:0/3703164506 shutdown_connections 2023-10-14T08:51:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 --2- 172.21.15.6:0/3703164506 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c10d620 0x7fbe6c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 --2- 172.21.15.6:0/3703164506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c0731d0 0x7fbe6c0735b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 --2- 172.21.15.6:0/3703164506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe6c073af0 0x7fbe6c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.321+0000 7fbe7319f700 1 -- 172.21.15.6:0/3703164506 >> 172.21.15.6:0/3703164506 conn(0x7fbe6c0fc870 msgr2=0x7fbe6c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.322+0000 7fbe7319f700 1 -- 172.21.15.6:0/3703164506 shutdown_connections 2023-10-14T08:51:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.322+0000 7fbe7319f700 1 -- 172.21.15.6:0/3703164506 wait complete. 2023-10-14T08:51:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.322+0000 7fbe7319f700 1 Processor -- start 2023-10-14T08:51:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.322+0000 7fbe7319f700 1 -- start start 2023-10-14T08:51:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7319f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe6c0731d0 0x7fbe6c100d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7319f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c073af0 0x7fbe6c101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7319f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c10d620 0x7fbe6c1017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7319f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1a96c0 con 0x7fbe6c10d620 2023-10-14T08:51:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7319f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1a9830 con 0x7fbe6c073af0 2023-10-14T08:51:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7319f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1a99f0 con 0x7fbe6c0731d0 2023-10-14T08:51:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c10d620 0x7fbe6c1017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c10d620 0x7fbe6c1017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59680/0 (socket says 172.21.15.6:59680) 2023-10-14T08:51:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 -- 172.21.15.6:0/876396245 learned_addr learned my addr 172.21.15.6:0/876396245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7219d700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe6c0731d0 0x7fbe6c100d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7199c700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c073af0 0x7fbe6c101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 -- 172.21.15.6:0/876396245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe6c0731d0 msgr2=0x7fbe6c100d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe6c0731d0 0x7fbe6c100d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 -- 172.21.15.6:0/876396245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c073af0 msgr2=0x7fbe6c101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c073af0 0x7fbe6c101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 -- 172.21.15.6:0/876396245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe680095f0 con 0x7fbe6c10d620 2023-10-14T08:51:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7199c700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe6c073af0 0x7fbe6c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe7299e700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c10d620 0x7fbe6c1017c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400ef30 tx=0x7fbe6400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.323+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64018070 con 0x7fbe6c10d620 2023-10-14T08:51:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.324+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c1a9c70 con 0x7fbe6c10d620 2023-10-14T08:51:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.324+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe6400f040 con 0x7fbe6c10d620 2023-10-14T08:51:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.324+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400cdb0 con 0x7fbe6c10d620 2023-10-14T08:51:43.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.324+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c1aa1c0 con 0x7fbe6c10d620 2023-10-14T08:51:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.324+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe6c1131a0 con 0x7fbe6c10d620 2023-10-14T08:51:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.326+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fbe64003a00 con 0x7fbe6c10d620 2023-10-14T08:51:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe637fe700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe580a1510 0x7fbe580a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbe640cd190 con 0x7fbe6c10d620 2023-10-14T08:51:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe7219d700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe580a1510 0x7fbe580a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:43.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe637fe700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] conn(0x7fbe580aacf0 0x7fbe580ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:43.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 --> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe580ad7c0 con 0x7fbe580aacf0 2023-10-14T08:51:43.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe640cd630 con 0x7fbe6c10d620 2023-10-14T08:51:43.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe7199c700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] conn(0x7fbe580aacf0 0x7fbe580ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:43.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.327+0000 7fbe7219d700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe580a1510 0x7fbe580a39d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800b2e0 tx=0x7fbe68005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:43.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.328+0000 7fbe7199c700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] conn(0x7fbe580aacf0 0x7fbe580ad110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:43.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.328+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== osd.3 v2:172.21.15.6:6810/3136263459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbe580ad7c0 con 0x7fbe580aacf0 2023-10-14T08:51:43.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.346+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 --> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe6c04f400 con 0x7fbe580aacf0 2023-10-14T08:51:43.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.346+0000 7fbe637fe700 1 -- 172.21.15.6:0/876396245 <== osd.3 v2:172.21.15.6:6810/3136263459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbe6c04f400 con 0x7fbe580aacf0 2023-10-14T08:51:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] conn(0x7fbe580aacf0 msgr2=0x7fbe580ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] conn(0x7fbe580aacf0 0x7fbe580ad110 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe580a1510 msgr2=0x7fbe580a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:43.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe580a1510 0x7fbe580a39d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800b2e0 tx=0x7fbe68005fd0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c10d620 msgr2=0x7fbe6c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 --2- 172.21.15.6:0/876396245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe6c10d620 0x7fbe6c1017c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400ef30 tx=0x7fbe6400c3a0 comp rx=0 tx=0).stop 2023-10-14T08:51:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7299e700 1 -- 172.21.15.6:0/876396245 reap_dead start 2023-10-14T08:51:43.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 shutdown_connections 2023-10-14T08:51:43.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 >> 172.21.15.6:0/876396245 conn(0x7fbe6c0fc870 msgr2=0x7fbe6c10f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:43.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 shutdown_connections 2023-10-14T08:51:43.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:43.347+0000 7fbe7319f700 1 -- 172.21.15.6:0/876396245 wait complete. 2023-10-14T08:51:43.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:43 smithi178 ceph-mon[103612]: pgmap v271: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-10-14T08:51:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:43 smithi057 ceph-mon[103313]: pgmap v271: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-10-14T08:51:44.138 INFO:teuthology.orchestra.run.smithi006.stdout:188978561063 2023-10-14T08:51:44.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-14T08:51:44.569 INFO:teuthology.orchestra.run.smithi006.stdout:107374182452 2023-10-14T08:51:44.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-14T08:51:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/808587434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a240ffe60 msgr2=0x7f4a241002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/808587434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a240ffe60 0x7f4a241002e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a140099c0 tx=0x7f4a14009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/808587434 shutdown_connections 2023-10-14T08:51:44.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/808587434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a24100820 0x7f4a2410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/808587434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a24105e70 0x7f4a24106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/808587434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a240ffe60 0x7f4a241002e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/808587434 >> 172.21.15.6:0/808587434 conn(0x7f4a24075e00 msgr2=0x7f4a24076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/808587434 shutdown_connections 2023-10-14T08:51:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.520+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/808587434 wait complete. 2023-10-14T08:51:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 Processor -- start 2023-10-14T08:51:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 -- start start 2023-10-14T08:51:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a240ffe60 0x7f4a24196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a24100820 0x7f4a241974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a24105e70 0x7f4a2419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419bf20 con 0x7f4a24105e70 2023-10-14T08:51:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419c090 con 0x7f4a240ffe60 2023-10-14T08:51:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2c5d8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419c250 con 0x7f4a24100820 2023-10-14T08:51:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a24105e70 0x7f4a2419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:44.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a24105e70 0x7f4a2419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59694/0 (socket says 172.21.15.6:59694) 2023-10-14T08:51:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 -- 172.21.15.6:0/25663836 learned_addr learned my addr 172.21.15.6:0/25663836 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a29b73700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a24100820 0x7f4a241974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2a374700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a240ffe60 0x7f4a24196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 -- 172.21.15.6:0/25663836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a24100820 msgr2=0x7f4a241974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:44.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a24100820 0x7f4a241974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 -- 172.21.15.6:0/25663836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a240ffe60 msgr2=0x7f4a24196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a240ffe60 0x7f4a24196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 -- 172.21.15.6:0/25663836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140095f0 con 0x7f4a24105e70 2023-10-14T08:51:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a29b73700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a24100820 0x7f4a241974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:44.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.521+0000 7f4a2ab75700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a24105e70 0x7f4a2419b910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00ada0 tx=0x7f4a1c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.522+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00f070 con 0x7f4a24105e70 2023-10-14T08:51:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.522+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a1c007b30 con 0x7f4a24105e70 2023-10-14T08:51:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.522+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c005440 con 0x7f4a24105e70 2023-10-14T08:51:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.522+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2419c530 con 0x7f4a24105e70 2023-10-14T08:51:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.522+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a241a3d90 con 0x7f4a24105e70 2023-10-14T08:51:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.523+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a2410fff0 con 0x7f4a24105e70 2023-10-14T08:51:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.524+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4a1c004ad0 con 0x7f4a24105e70 2023-10-14T08:51:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.524+0000 7f4a1b7fe700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4a100a1510 0x7f4a100a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a2a374700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4a100a1510 0x7f4a100a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4a1c0ccdc0 con 0x7f4a24105e70 2023-10-14T08:51:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a1b7fe700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] conn(0x7f4a100aacf0 0x7f4a100ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 --> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a100ad7c0 con 0x7f4a100aacf0 2023-10-14T08:51:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a1c0cd260 con 0x7f4a24105e70 2023-10-14T08:51:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a29b73700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] conn(0x7f4a100aacf0 0x7f4a100ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a2a374700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4a100a1510 0x7f4a100a39d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4a20005fd0 tx=0x7f4a2000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.525+0000 7f4a29b73700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] conn(0x7f4a100aacf0 0x7f4a100ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:44.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.526+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== osd.9 v2:172.21.15.6:6826/1885446684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4a100ad7c0 con 0x7f4a100aacf0 2023-10-14T08:51:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.542+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 --> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a2404ebb0 con 0x7f4a100aacf0 2023-10-14T08:51:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a1b7fe700 1 -- 172.21.15.6:0/25663836 <== osd.9 v2:172.21.15.6:6826/1885446684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4a2404ebb0 con 0x7f4a100aacf0 2023-10-14T08:51:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] conn(0x7f4a100aacf0 msgr2=0x7f4a100ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] conn(0x7f4a100aacf0 0x7f4a100ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4a100a1510 msgr2=0x7f4a100a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4a100a1510 0x7f4a100a39d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4a20005fd0 tx=0x7f4a2000a560 comp rx=0 tx=0).stop 2023-10-14T08:51:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a24105e70 msgr2=0x7f4a2419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 --2- 172.21.15.6:0/25663836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a24105e70 0x7f4a2419b910 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00ada0 tx=0x7f4a1c00c330 comp rx=0 tx=0).stop 2023-10-14T08:51:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2ab75700 1 -- 172.21.15.6:0/25663836 reap_dead start 2023-10-14T08:51:44.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 shutdown_connections 2023-10-14T08:51:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 >> 172.21.15.6:0/25663836 conn(0x7f4a24075e00 msgr2=0x7f4a24103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 shutdown_connections 2023-10-14T08:51:44.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:44.543+0000 7f4a2c5d8700 1 -- 172.21.15.6:0/25663836 wait complete. 2023-10-14T08:51:45.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 -- 172.21.15.6:0/426029151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd300692c0 msgr2=0x7fdd3010d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 --2- 172.21.15.6:0/426029151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd300692c0 0x7fdd3010d4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0098f0 tx=0x7fdd1c009c00 comp rx=0 tx=0).stop 2023-10-14T08:51:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 -- 172.21.15.6:0/426029151 shutdown_connections 2023-10-14T08:51:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 --2- 172.21.15.6:0/426029151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd3010da10 0x7fdd3010fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 --2- 172.21.15.6:0/426029151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd300689a0 0x7fdd30068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 --2- 172.21.15.6:0/426029151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd300692c0 0x7fdd3010d4d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 -- 172.21.15.6:0/426029151 >> 172.21.15.6:0/426029151 conn(0x7fdd30075e00 msgr2=0x7fdd30076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 -- 172.21.15.6:0/426029151 shutdown_connections 2023-10-14T08:51:45.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.193+0000 7fdd3708b700 1 -- 172.21.15.6:0/426029151 wait complete. 2023-10-14T08:51:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 Processor -- start 2023-10-14T08:51:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 -- start start 2023-10-14T08:51:45.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd300689a0 0x7fdd30199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd300692c0 0x7fdd301997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd3010da10 0x7fdd3019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3019e190 con 0x7fdd3010da10 2023-10-14T08:51:45.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3019e300 con 0x7fdd300689a0 2023-10-14T08:51:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd3708b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3019e4c0 con 0x7fdd300692c0 2023-10-14T08:51:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd35628700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd3010da10 0x7fdd3019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd300692c0 0x7fdd301997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd35628700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd3010da10 0x7fdd3019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59708/0 (socket says 172.21.15.6:59708) 2023-10-14T08:51:45.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd2ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd300692c0 0x7fdd301997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:57108/0 (socket says 172.21.15.6:57108) 2023-10-14T08:51:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd35628700 1 -- 172.21.15.6:0/1371637470 learned_addr learned my addr 172.21.15.6:0/1371637470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.194+0000 7fdd34e27700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd300689a0 0x7fdd30199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd35628700 1 -- 172.21.15.6:0/1371637470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd300692c0 msgr2=0x7fdd301997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd35628700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd300692c0 0x7fdd301997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd35628700 1 -- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd300689a0 msgr2=0x7fdd30199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd35628700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd300689a0 0x7fdd30199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd35628700 1 -- 172.21.15.6:0/1371637470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c009520 con 0x7fdd3010da10 2023-10-14T08:51:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd2ffff700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd300692c0 0x7fdd301997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd35628700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd3010da10 0x7fdd3019db80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800ef90 tx=0x7fdd2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:45.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28018070 con 0x7fdd3010da10 2023-10-14T08:51:45.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd2800f040 con 0x7fdd3010da10 2023-10-14T08:51:45.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3019e740 con 0x7fdd3010da10 2023-10-14T08:51:45.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2800cc90 con 0x7fdd3010da10 2023-10-14T08:51:45.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.195+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3019e9f0 con 0x7fdd3010da10 2023-10-14T08:51:45.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.196+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd3004ebb0 con 0x7fdd3010da10 2023-10-14T08:51:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.197+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fdd28003a00 con 0x7fdd3010da10 2023-10-14T08:51:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd2dffb700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd200a1510 0x7fdd200a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdd280cd0b0 con 0x7fdd3010da10 2023-10-14T08:51:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd34e27700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd200a1510 0x7fdd200a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd2dffb700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] conn(0x7fdd200aacf0 0x7fdd200ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 --> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd200ad7c0 con 0x7fdd200aacf0 2023-10-14T08:51:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd280cd420 con 0x7fdd3010da10 2023-10-14T08:51:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd34e27700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd200a1510 0x7fdd200a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd24005950 tx=0x7fdd2400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:45.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.198+0000 7fdd2ffff700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] conn(0x7fdd200aacf0 0x7fdd200ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.199+0000 7fdd2ffff700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] conn(0x7fdd200aacf0 0x7fdd200ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:45.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.200+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== osd.1 v2:172.21.15.57:6800/3505442152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdd200ad7c0 con 0x7fdd200aacf0 2023-10-14T08:51:45.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.217+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 --> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd301132c0 con 0x7fdd200aacf0 2023-10-14T08:51:45.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.218+0000 7fdd2dffb700 1 -- 172.21.15.6:0/1371637470 <== osd.1 v2:172.21.15.57:6800/3505442152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd301132c0 con 0x7fdd200aacf0 2023-10-14T08:51:45.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.218+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] conn(0x7fdd200aacf0 msgr2=0x7fdd200ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.218+0000 7fdd3708b700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] conn(0x7fdd200aacf0 0x7fdd200ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd200a1510 msgr2=0x7fdd200a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdd200a1510 0x7fdd200a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd24005950 tx=0x7fdd2400b410 comp rx=0 tx=0).stop 2023-10-14T08:51:45.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd3010da10 msgr2=0x7fdd3019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 --2- 172.21.15.6:0/1371637470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd3010da10 0x7fdd3019db80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800ef90 tx=0x7fdd2800c3a0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd35628700 1 -- 172.21.15.6:0/1371637470 reap_dead start 2023-10-14T08:51:45.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 shutdown_connections 2023-10-14T08:51:45.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 >> 172.21.15.6:0/1371637470 conn(0x7fdd30075e00 msgr2=0x7fdd3010ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:45.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 shutdown_connections 2023-10-14T08:51:45.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.219+0000 7fdd3708b700 1 -- 172.21.15.6:0/1371637470 wait complete. 2023-10-14T08:51:45.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 -- 172.21.15.6:0/2332686901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00ffe10 msgr2=0x7f02b0100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 --2- 172.21.15.6:0/2332686901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00ffe10 0x7f02b0100290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009990 tx=0x7f02a0009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 -- 172.21.15.6:0/2332686901 shutdown_connections 2023-10-14T08:51:45.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 --2- 172.21.15.6:0/2332686901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02b01007d0 0x7f02b010cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 --2- 172.21.15.6:0/2332686901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02b0105ec0 0x7f02b01062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 --2- 172.21.15.6:0/2332686901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00ffe10 0x7f02b0100290 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 -- 172.21.15.6:0/2332686901 >> 172.21.15.6:0/2332686901 conn(0x7f02b0076dc0 msgr2=0x7f02b00771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:45.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 -- 172.21.15.6:0/2332686901 shutdown_connections 2023-10-14T08:51:45.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.287+0000 7f02b646c700 1 -- 172.21.15.6:0/2332686901 wait complete. 2023-10-14T08:51:45.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 Processor -- start 2023-10-14T08:51:45.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 -- start start 2023-10-14T08:51:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02b00ffe10 0x7f02b0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02b01007d0 0x7f02b0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b0105ec0 0x7f02b01a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b0198d10 con 0x7f02b0105ec0 2023-10-14T08:51:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b01a3480 con 0x7f02b01007d0 2023-10-14T08:51:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b646c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b01a35f0 con 0x7f02b00ffe10 2023-10-14T08:51:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b4a09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b0105ec0 0x7f02b01a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b4a09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b0105ec0 0x7f02b01a2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59724/0 (socket says 172.21.15.6:59724) 2023-10-14T08:51:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b4a09700 1 -- 172.21.15.6:0/3933683380 learned_addr learned my addr 172.21.15.6:0/3933683380 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02affff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02b00ffe10 0x7f02b0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02af7fe700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02b01007d0 0x7f02b0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b4a09700 1 -- 172.21.15.6:0/3933683380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02b00ffe10 msgr2=0x7f02b0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.288+0000 7f02b4a09700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02b00ffe10 0x7f02b0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02b4a09700 1 -- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02b01007d0 msgr2=0x7f02b0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02b4a09700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02b01007d0 0x7f02b0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02b4a09700 1 -- 172.21.15.6:0/3933683380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00095f0 con 0x7f02b0105ec0 2023-10-14T08:51:45.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02b4a09700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b0105ec0 0x7f02b01a2f40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f02a800ada0 tx=0x7f02a800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:45.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800f070 con 0x7f02b0105ec0 2023-10-14T08:51:45.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02a8007b30 con 0x7f02b0105ec0 2023-10-14T08:51:45.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b01a38d0 con 0x7f02b0105ec0 2023-10-14T08:51:45.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8005280 con 0x7f02b0105ec0 2023-10-14T08:51:45.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.289+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b01a3d80 con 0x7f02b0105ec0 2023-10-14T08:51:45.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.290+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02b010ffd0 con 0x7f02b0105ec0 2023-10-14T08:51:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.291+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f02a800a080 con 0x7f02b0105ec0 2023-10-14T08:51:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02ad7fa700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02980a1510 0x7f02980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02affff700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02980a1510 0x7f02980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f02a80ccd00 con 0x7f02b0105ec0 2023-10-14T08:51:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02ad7fa700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] conn(0x7f02980aacf0 0x7f02980ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:45.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 --> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02980ad7c0 con 0x7f02980aacf0 2023-10-14T08:51:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02a80cd070 con 0x7f02b0105ec0 2023-10-14T08:51:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02affff700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02980a1510 0x7f02980a39d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f02a4005950 tx=0x7f02a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.292+0000 7f02af7fe700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] conn(0x7f02980aacf0 0x7f02980ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.293+0000 7f02af7fe700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] conn(0x7f02980aacf0 0x7f02980ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:45.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.294+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== osd.7 v2:172.21.15.57:6816/2223075763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f02980ad7c0 con 0x7f02980aacf0 2023-10-14T08:51:45.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.316+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 --> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f02b004ebb0 con 0x7f02980aacf0 2023-10-14T08:51:45.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.317+0000 7f02ad7fa700 1 -- 172.21.15.6:0/3933683380 <== osd.7 v2:172.21.15.57:6816/2223075763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f02b004ebb0 con 0x7f02980aacf0 2023-10-14T08:51:45.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] conn(0x7f02980aacf0 msgr2=0x7f02980ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] conn(0x7f02980aacf0 0x7f02980ad110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:45.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02980a1510 msgr2=0x7f02980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02980a1510 0x7f02980a39d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f02a4005950 tx=0x7f02a400b410 comp rx=0 tx=0).stop 2023-10-14T08:51:45.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b0105ec0 msgr2=0x7f02b01a2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:45.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 --2- 172.21.15.6:0/3933683380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b0105ec0 0x7f02b01a2f40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f02a800ada0 tx=0x7f02a800c330 comp rx=0 tx=0).stop 2023-10-14T08:51:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b4a09700 1 -- 172.21.15.6:0/3933683380 reap_dead start 2023-10-14T08:51:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 shutdown_connections 2023-10-14T08:51:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 >> 172.21.15.6:0/3933683380 conn(0x7f02b0076dc0 msgr2=0x7f02b00fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 shutdown_connections 2023-10-14T08:51:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:45.318+0000 7f02b646c700 1 -- 172.21.15.6:0/3933683380 wait complete. 2023-10-14T08:51:45.476 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:45 smithi006 ceph-mon[99452]: pgmap v272: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-14T08:51:45.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:45 smithi178 ceph-mon[103612]: pgmap v272: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-14T08:51:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:45 smithi057 ceph-mon[103313]: pgmap v272: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-14T08:51:46.169 INFO:teuthology.orchestra.run.smithi006.stdout:210453397538 2023-10-14T08:51:46.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-14T08:51:46.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 -- 172.21.15.6:0/550189629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 msgr2=0x7fe6fc1002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:46.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 --2- 172.21.15.6:0/550189629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1002e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0099c0 tx=0x7fe6ec009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 -- 172.21.15.6:0/550189629 shutdown_connections 2023-10-14T08:51:46.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 --2- 172.21.15.6:0/550189629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc100820 0x7fe6fc10cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 --2- 172.21.15.6:0/550189629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc105e70 0x7fe6fc106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 --2- 172.21.15.6:0/550189629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1002e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 -- 172.21.15.6:0/550189629 >> 172.21.15.6:0/550189629 conn(0x7fe6fc075e00 msgr2=0x7fe6fc076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 -- 172.21.15.6:0/550189629 shutdown_connections 2023-10-14T08:51:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.432+0000 7fe7034b3700 1 -- 172.21.15.6:0/550189629 wait complete. 2023-10-14T08:51:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 Processor -- start 2023-10-14T08:51:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 -- start start 2023-10-14T08:51:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc100820 0x7fe6fc1a2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc105e70 0x7fe6fc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc19e2c0 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc19e430 con 0x7fe6fc105e70 2023-10-14T08:51:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe7034b3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc19e5f0 con 0x7fe6fc100820 2023-10-14T08:51:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe70124f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe70124f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1a22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59736/0 (socket says 172.21.15.6:59736) 2023-10-14T08:51:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.433+0000 7fe70124f700 1 -- 172.21.15.6:0/2862289861 learned_addr learned my addr 172.21.15.6:0/2862289861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe70124f700 1 -- 172.21.15.6:0/2862289861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc100820 msgr2=0x7fe6fc1a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe70124f700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6fc100820 0x7fe6fc1a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe70124f700 1 -- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc105e70 msgr2=0x7fe6fc19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe70124f700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6fc105e70 0x7fe6fc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe70124f700 1 -- 172.21.15.6:0/2862289861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0095f0 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe70124f700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1a22f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800e9a0 tx=0x7fe6f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800cbd0 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6f800cd30 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8018710 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc19e8d0 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.434+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc1aa450 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.435+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6fc10fff0 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.437+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fe6f8010430 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.437+0000 7fe6f27fc700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6e80a1590 0x7fe6e80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:46.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.437+0000 7fe700a4e700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6e80a1590 0x7fe6e80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:46.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.437+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe6f8014070 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.438+0000 7fe6f27fc700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] conn(0x7fe6e80aad70 0x7fe6e80ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.438+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 --> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6e80ad840 con 0x7fe6e80aad70 2023-10-14T08:51:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.438+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6f80cd710 con 0x7fe6fc0ffe60 2023-10-14T08:51:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.438+0000 7fe700a4e700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6e80a1590 0x7fe6e80a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009fd0 tx=0x7fe6ec000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:46.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.438+0000 7fe701a50700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] conn(0x7fe6e80aad70 0x7fe6e80ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.438+0000 7fe701a50700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] conn(0x7fe6e80aad70 0x7fe6e80ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:46.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.440+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== osd.4 v2:172.21.15.57:6808/4030613729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe6e80ad840 con 0x7fe6e80aad70 2023-10-14T08:51:46.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.456+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 --> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6fc069350 con 0x7fe6e80aad70 2023-10-14T08:51:46.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe6f27fc700 1 -- 172.21.15.6:0/2862289861 <== osd.4 v2:172.21.15.57:6808/4030613729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe6fc069350 con 0x7fe6e80aad70 2023-10-14T08:51:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] conn(0x7fe6e80aad70 msgr2=0x7fe6e80ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] conn(0x7fe6e80aad70 0x7fe6e80ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6e80a1590 msgr2=0x7fe6e80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6e80a1590 0x7fe6e80a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009fd0 tx=0x7fe6ec000bc0 comp rx=0 tx=0).stop 2023-10-14T08:51:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 msgr2=0x7fe6fc1a22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 --2- 172.21.15.6:0/2862289861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6fc0ffe60 0x7fe6fc1a22f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800e9a0 tx=0x7fe6f800ed60 comp rx=0 tx=0).stop 2023-10-14T08:51:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe701a50700 1 -- 172.21.15.6:0/2862289861 reap_dead start 2023-10-14T08:51:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 shutdown_connections 2023-10-14T08:51:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 >> 172.21.15.6:0/2862289861 conn(0x7fe6fc075e00 msgr2=0x7fe6fc068a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:46.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 shutdown_connections 2023-10-14T08:51:46.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:46.457+0000 7fe7034b3700 1 -- 172.21.15.6:0/2862289861 wait complete. 2023-10-14T08:51:46.916 INFO:teuthology.orchestra.run.smithi006.stdout:55834574910 2023-10-14T08:51:46.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-14T08:51:46.946 INFO:teuthology.orchestra.run.smithi006.stdout:274877906969 2023-10-14T08:51:46.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-14T08:51:47.189 INFO:teuthology.orchestra.run.smithi006.stdout:137438953520 2023-10-14T08:51:47.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-14T08:51:47.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 -- 172.21.15.6:0/1474957930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90041062b0 msgr2=0x7f900410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 --2- 172.21.15.6:0/1474957930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90041062b0 0x7f900410de30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00b0a0 tx=0x7f8ffc00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 -- 172.21.15.6:0/1474957930 shutdown_connections 2023-10-14T08:51:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 --2- 172.21.15.6:0/1474957930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90041062b0 0x7f900410de30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 --2- 172.21.15.6:0/1474957930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9004068c00 0x7f9004068fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 --2- 172.21.15.6:0/1474957930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90040695b0 0x7f9004105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 -- 172.21.15.6:0/1474957930 >> 172.21.15.6:0/1474957930 conn(0x7f9004075e00 msgr2=0x7f9004076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 -- 172.21.15.6:0/1474957930 shutdown_connections 2023-10-14T08:51:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.432+0000 7f900b48a700 1 -- 172.21.15.6:0/1474957930 wait complete. 2023-10-14T08:51:47.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 Processor -- start 2023-10-14T08:51:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 -- start start 2023-10-14T08:51:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9004068c00 0x7f90040fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90040695b0 0x7f9004100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90041062b0 0x7f90041009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041a54c0 con 0x7f9004068c00 2023-10-14T08:51:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041a5630 con 0x7f90040695b0 2023-10-14T08:51:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f900b48a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041a57f0 con 0x7f90041062b0 2023-10-14T08:51:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f9009226700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9004068c00 0x7f90040fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f9009226700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9004068c00 0x7f90040fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59752/0 (socket says 172.21.15.6:59752) 2023-10-14T08:51:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f9009226700 1 -- 172.21.15.6:0/2884703530 learned_addr learned my addr 172.21.15.6:0/2884703530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f9009a27700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90041062b0 0x7f90041009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.433+0000 7f9008a25700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90040695b0 0x7f9004100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9009226700 1 -- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90041062b0 msgr2=0x7f90041009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9009226700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90041062b0 0x7f90041009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9009226700 1 -- 172.21.15.6:0/2884703530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90040695b0 msgr2=0x7f9004100470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9009226700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90040695b0 0x7f9004100470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9009226700 1 -- 172.21.15.6:0/2884703530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009d00 con 0x7f9004068c00 2023-10-14T08:51:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9008a25700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90040695b0 0x7f9004100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f9009226700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9004068c00 0x7f90040fff30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f900000d950 tx=0x7f900000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000009940 con 0x7f9004068c00 2023-10-14T08:51:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9000010460 con 0x7f9004068c00 2023-10-14T08:51:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90041a5ad0 con 0x7f9004068c00 2023-10-14T08:51:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000f620 con 0x7f9004068c00 2023-10-14T08:51:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.434+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90041a5fd0 con 0x7f9004068c00 2023-10-14T08:51:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.435+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9004111200 con 0x7f9004068c00 2023-10-14T08:51:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.436+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f90000108d0 con 0x7f9004068c00 2023-10-14T08:51:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f8ffa7fc700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ff00a1510 0x7f8ff00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f9008a25700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ff00a1510 0x7f8ff00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f90000cd030 con 0x7f9004068c00 2023-10-14T08:51:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f8ffa7fc700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] conn(0x7f8ff00aacf0 0x7f8ff00ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 --> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ff00ad7c0 con 0x7f8ff00aacf0 2023-10-14T08:51:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90000cd4d0 con 0x7f9004068c00 2023-10-14T08:51:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f9008a25700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ff00a1510 0x7f8ff00a39d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9004101720 tx=0x7f8ff4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.437+0000 7f9009a27700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] conn(0x7f8ff00aacf0 0x7f8ff00ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.438+0000 7f9009a27700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] conn(0x7f8ff00aacf0 0x7f8ff00ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.439+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== osd.2 v2:172.21.15.178:6800/1191550997 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8ff00ad7c0 con 0x7f8ff00aacf0 2023-10-14T08:51:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.455+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 --> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f900404ebb0 con 0x7f8ff00aacf0 2023-10-14T08:51:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f8ffa7fc700 1 -- 172.21.15.6:0/2884703530 <== osd.2 v2:172.21.15.178:6800/1191550997 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f900404ebb0 con 0x7f8ff00aacf0 2023-10-14T08:51:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] conn(0x7f8ff00aacf0 msgr2=0x7f8ff00ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] conn(0x7f8ff00aacf0 0x7f8ff00ad110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ff00a1510 msgr2=0x7f8ff00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8ff00a1510 0x7f8ff00a39d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9004101720 tx=0x7f8ff4008040 comp rx=0 tx=0).stop 2023-10-14T08:51:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9004068c00 msgr2=0x7f90040fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 --2- 172.21.15.6:0/2884703530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9004068c00 0x7f90040fff30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f900000d950 tx=0x7f900000dc60 comp rx=0 tx=0).stop 2023-10-14T08:51:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f9009a27700 1 -- 172.21.15.6:0/2884703530 reap_dead start 2023-10-14T08:51:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 shutdown_connections 2023-10-14T08:51:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 >> 172.21.15.6:0/2884703530 conn(0x7f9004075e00 msgr2=0x7f90040fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 shutdown_connections 2023-10-14T08:51:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.456+0000 7f900b48a700 1 -- 172.21.15.6:0/2884703530 wait complete. 2023-10-14T08:51:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:47 smithi006 ceph-mon[99452]: pgmap v273: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-14T08:51:47.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 -- 172.21.15.6:0/2996725058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101b20 msgr2=0x7fa22c105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 --2- 172.21.15.6:0/2996725058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101b20 0x7fa22c105b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa218009990 tx=0x7fa218009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 -- 172.21.15.6:0/2996725058 shutdown_connections 2023-10-14T08:51:47.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 --2- 172.21.15.6:0/2996725058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c106250 0x7fa22c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 --2- 172.21.15.6:0/2996725058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c101170 0x7fa22c101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 --2- 172.21.15.6:0/2996725058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101b20 0x7fa22c105b70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 -- 172.21.15.6:0/2996725058 >> 172.21.15.6:0/2996725058 conn(0x7fa22c0fca20 msgr2=0x7fa22c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 -- 172.21.15.6:0/2996725058 shutdown_connections 2023-10-14T08:51:47.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.610+0000 7fa232c73700 1 -- 172.21.15.6:0/2996725058 wait complete. 2023-10-14T08:51:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 Processor -- start 2023-10-14T08:51:47.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 -- start start 2023-10-14T08:51:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101170 0x7fa22c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c101b20 0x7fa22c1975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c106250 0x7fa22c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c19c060 con 0x7fa22c101b20 2023-10-14T08:51:47.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c19c1d0 con 0x7fa22c106250 2023-10-14T08:51:47.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa232c73700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c19c390 con 0x7fa22c101170 2023-10-14T08:51:47.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c101b20 0x7fa22c1975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c101b20 0x7fa22c1975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59770/0 (socket says 172.21.15.6:59770) 2023-10-14T08:51:47.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 -- 172.21.15.6:0/1387145163 learned_addr learned my addr 172.21.15.6:0/1387145163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:47.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa230a0f700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101170 0x7fa22c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa231210700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c106250 0x7fa22c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 -- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101170 msgr2=0x7fa22c1970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22c101170 0x7fa22c1970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 -- 172.21.15.6:0/1387145163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c106250 msgr2=0x7fa22c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c106250 0x7fa22c19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.611+0000 7fa22bfff700 1 -- 172.21.15.6:0/1387145163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180095f0 con 0x7fa22c101b20 2023-10-14T08:51:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.612+0000 7fa22bfff700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c101b20 0x7fa22c1975e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa218000c00 tx=0x7fa21800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.612+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21801d070 con 0x7fa22c101b20 2023-10-14T08:51:47.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.612+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c19c610 con 0x7fa22c101b20 2023-10-14T08:51:47.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.612+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa21800be40 con 0x7fa22c101b20 2023-10-14T08:51:47.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.612+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180173f0 con 0x7fa22c101b20 2023-10-14T08:51:47.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.612+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c1a3ed0 con 0x7fa22c101b20 2023-10-14T08:51:47.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.614+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa22c111100 con 0x7fa22c101b20 2023-10-14T08:51:47.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.614+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa218022470 con 0x7fa22c101b20 2023-10-14T08:51:47.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa229ffb700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa21c0a1510 0x7fa21c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa230a0f700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa21c0a1510 0x7fa21c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa2180cdfa0 con 0x7fa22c101b20 2023-10-14T08:51:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa229ffb700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] conn(0x7fa21c0aabc0 0x7fa21c0acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:47.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 --> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa21c0ad690 con 0x7fa21c0aabc0 2023-10-14T08:51:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2180d06b0 con 0x7fa22c101b20 2023-10-14T08:51:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa230a0f700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa21c0a1510 0x7fa21c0a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa220005950 tx=0x7fa22000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.615+0000 7fa231210700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] conn(0x7fa21c0aabc0 0x7fa21c0acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.616+0000 7fa231210700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] conn(0x7fa21c0aabc0 0x7fa21c0acfe0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:47.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.617+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== osd.8 v2:172.21.15.178:6816/3668822662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa21c0ad690 con 0x7fa21c0aabc0 2023-10-14T08:51:47.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:47 smithi178 ceph-mon[103612]: pgmap v273: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-14T08:51:47.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.634+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 --> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa22c04ebb0 con 0x7fa21c0aabc0 2023-10-14T08:51:47.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa229ffb700 1 -- 172.21.15.6:0/1387145163 <== osd.8 v2:172.21.15.178:6816/3668822662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa22c04ebb0 con 0x7fa21c0aabc0 2023-10-14T08:51:47.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] conn(0x7fa21c0aabc0 msgr2=0x7fa21c0acfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa232c73700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] conn(0x7fa21c0aabc0 0x7fa21c0acfe0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:47.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa21c0a1510 msgr2=0x7fa21c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa232c73700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa21c0a1510 0x7fa21c0a39d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa220005950 tx=0x7fa22000b410 comp rx=0 tx=0).stop 2023-10-14T08:51:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c101b20 msgr2=0x7fa22c1975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa232c73700 1 --2- 172.21.15.6:0/1387145163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa22c101b20 0x7fa22c1975e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa218000c00 tx=0x7fa21800f690 comp rx=0 tx=0).stop 2023-10-14T08:51:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.635+0000 7fa231210700 1 -- 172.21.15.6:0/1387145163 reap_dead start 2023-10-14T08:51:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.636+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 shutdown_connections 2023-10-14T08:51:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.636+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 >> 172.21.15.6:0/1387145163 conn(0x7fa22c0fca20 msgr2=0x7fa22c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:47.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.636+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 shutdown_connections 2023-10-14T08:51:47.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:47.636+0000 7fa232c73700 1 -- 172.21.15.6:0/1387145163 wait complete. 2023-10-14T08:51:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:47 smithi057 ceph-mon[103313]: pgmap v273: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-14T08:51:48.198 INFO:teuthology.orchestra.run.smithi006.stdout:244813135903 2023-10-14T08:51:48.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-14T08:51:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 -- 172.21.15.6:0/3775738685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 msgr2=0x7f1c8c107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:48.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 --2- 172.21.15.6:0/3775738685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 0x7f1c8c107370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0099c0 tx=0x7f1c7c009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 -- 172.21.15.6:0/3775738685 shutdown_connections 2023-10-14T08:51:48.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 --2- 172.21.15.6:0/3775738685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c8c101940 0x7f1c8c10ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 --2- 172.21.15.6:0/3775738685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 0x7f1c8c107370 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 --2- 172.21.15.6:0/3775738685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 0x7f1c8c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 -- 172.21.15.6:0/3775738685 >> 172.21.15.6:0/3775738685 conn(0x7f1c8c0780a0 msgr2=0x7f1c8c0784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 -- 172.21.15.6:0/3775738685 shutdown_connections 2023-10-14T08:51:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.245+0000 7f1c91c60700 1 -- 172.21.15.6:0/3775738685 wait complete. 2023-10-14T08:51:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 Processor -- start 2023-10-14T08:51:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 -- start start 2023-10-14T08:51:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 0x7f1c8c0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c8c101940 0x7f1c8c0736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 0x7f1c8c073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1a5370 con 0x7f1c8c106f90 2023-10-14T08:51:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1a54e0 con 0x7f1c8c100f80 2023-10-14T08:51:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c91c60700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c1a56a0 con 0x7f1c8c101940 2023-10-14T08:51:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 0x7f1c8c0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 0x7f1c8c073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 0x7f1c8c0731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:58542/0 (socket says 172.21.15.6:58542) 2023-10-14T08:51:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.246+0000 7f1c8b7fe700 1 -- 172.21.15.6:0/1200085802 learned_addr learned my addr 172.21.15.6:0/1200085802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8b7fe700 1 -- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c8c101940 msgr2=0x7f1c8c0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8b7fe700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c8c101940 0x7f1c8c0736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8b7fe700 1 -- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 msgr2=0x7f1c8c073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8b7fe700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 0x7f1c8c073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8b7fe700 1 -- 172.21.15.6:0/1200085802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0095f0 con 0x7f1c8c100f80 2023-10-14T08:51:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8bfff700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c8c106f90 0x7f1c8c073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c8b7fe700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 0x7f1c8c0731b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009990 tx=0x7f1c7c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c01d070 con 0x7f1c8c100f80 2023-10-14T08:51:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c1a5920 con 0x7f1c8c100f80 2023-10-14T08:51:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.247+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c1a5d90 con 0x7f1c8c100f80 2023-10-14T08:51:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.248+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c7c004010 con 0x7f1c8c100f80 2023-10-14T08:51:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.248+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c00fc10 con 0x7f1c8c100f80 2023-10-14T08:51:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.248+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c78000ff0 con 0x7f1c8c100f80 2023-10-14T08:51:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.251+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f1c7c00f460 con 0x7f1c8c100f80 2023-10-14T08:51:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.251+0000 7f1c88ff9700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c740a1510 0x7f1c740a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.251+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1c7c0ce670 con 0x7f1c8c100f80 2023-10-14T08:51:48.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.251+0000 7f1c8affd700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c740a1510 0x7f1c740a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:48.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.252+0000 7f1c88ff9700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] conn(0x7f1c740aacf0 0x7f1c740ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:48.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.252+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 --> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c740ad7c0 con 0x7f1c740aacf0 2023-10-14T08:51:48.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.252+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c7c0ceb10 con 0x7f1c8c100f80 2023-10-14T08:51:48.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.252+0000 7f1c8affd700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c740a1510 0x7f1c740a39d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0749a0 tx=0x7f1c80005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.252+0000 7f1c8bfff700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] conn(0x7f1c740aacf0 0x7f1c740ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.253+0000 7f1c8bfff700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] conn(0x7f1c740aacf0 0x7f1c740ad110 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.253+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== osd.11 v2:172.21.15.178:6824/1548169216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1c740ad7c0 con 0x7f1c740aacf0 2023-10-14T08:51:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.275+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 --> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c78002d70 con 0x7f1c740aacf0 2023-10-14T08:51:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.276+0000 7f1c88ff9700 1 -- 172.21.15.6:0/1200085802 <== osd.11 v2:172.21.15.178:6824/1548169216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1c78002d70 con 0x7f1c740aacf0 2023-10-14T08:51:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.276+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] conn(0x7f1c740aacf0 msgr2=0x7f1c740ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.276+0000 7f1c91c60700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] conn(0x7f1c740aacf0 0x7f1c740ad110 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c740a1510 msgr2=0x7f1c740a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1c740a1510 0x7f1c740a39d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0749a0 tx=0x7f1c80005c80 comp rx=0 tx=0).stop 2023-10-14T08:51:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 msgr2=0x7f1c8c0731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 --2- 172.21.15.6:0/1200085802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c8c100f80 0x7f1c8c0731b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009990 tx=0x7f1c7c005740 comp rx=0 tx=0).stop 2023-10-14T08:51:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c8bfff700 1 -- 172.21.15.6:0/1200085802 reap_dead start 2023-10-14T08:51:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 shutdown_connections 2023-10-14T08:51:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 >> 172.21.15.6:0/1200085802 conn(0x7f1c8c0780a0 msgr2=0x7f1c8c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:48.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 shutdown_connections 2023-10-14T08:51:48.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:48.277+0000 7f1c91c60700 1 -- 172.21.15.6:0/1200085802 wait complete. 2023-10-14T08:51:48.394 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:48.832 INFO:teuthology.orchestra.run.smithi006.stdout:330712481810 2023-10-14T08:51:48.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-14T08:51:49.169 INFO:teuthology.orchestra.run.smithi006.stdout:77309411385 2023-10-14T08:51:49.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-14T08:51:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:49.403 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:49 smithi006 ceph-mon[99452]: pgmap v274: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-14T08:51:49.508 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:49.510 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:49.610 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:49.611 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:49 smithi178 ceph-mon[103612]: pgmap v274: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-14T08:51:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:49 smithi057 ceph-mon[103313]: pgmap v274: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-14T08:51:51.000 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:51.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/4236657276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f8100c70 msgr2=0x7fa9f8104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:51.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/4236657276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f8100c70 0x7fa9f8104a70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0098f0 tx=0x7fa9ec009c00 comp rx=0 tx=0).stop 2023-10-14T08:51:51.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/4236657276 shutdown_connections 2023-10-14T08:51:51.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/4236657276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9f8105150 0x7fa9f810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/4236657276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9f81002c0 0x7fa9f81006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/4236657276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f8100c70 0x7fa9f8104a70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/4236657276 >> 172.21.15.6:0/4236657276 conn(0x7fa9f8076cf0 msgr2=0x7fa9f8077100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/4236657276 shutdown_connections 2023-10-14T08:51:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.176+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/4236657276 wait complete. 2023-10-14T08:51:51.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 Processor -- start 2023-10-14T08:51:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 -- start start 2023-10-14T08:51:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 0x7fa9f8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9f8100c70 0x7fa9f81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9f8105150 0x7fa9f81a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:51.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8198df0 con 0x7fa9f81002c0 2023-10-14T08:51:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81a3560 con 0x7fa9f8105150 2023-10-14T08:51:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.177+0000 7fa9fd8dd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81a36d0 con 0x7fa9f8100c70 2023-10-14T08:51:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 0x7fa9f8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 0x7fa9f8197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59796/0 (socket says 172.21.15.6:59796) 2023-10-14T08:51:51.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 -- 172.21.15.6:0/3330105415 learned_addr learned my addr 172.21.15.6:0/3330105415 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f77fe700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9f8105150 0x7fa9f81a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f67fc700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9f8100c70 0x7fa9f81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 -- 172.21.15.6:0/3330105415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9f8100c70 msgr2=0x7fa9f81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9f8100c70 0x7fa9f81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 -- 172.21.15.6:0/3330105415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9f8105150 msgr2=0x7fa9f81a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9f8105150 0x7fa9f81a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 -- 172.21.15.6:0/3330105415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec009520 con 0x7fa9f81002c0 2023-10-14T08:51:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9f6ffd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 0x7fa9f8197fa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d980 tx=0x7fa9e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8004220 con 0x7fa9f81002c0 2023-10-14T08:51:51.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9e8007640 con 0x7fa9f81002c0 2023-10-14T08:51:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8005690 con 0x7fa9f81002c0 2023-10-14T08:51:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.178+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f81a39b0 con 0x7fa9f81002c0 2023-10-14T08:51:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.179+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f81a3e80 con 0x7fa9f81002c0 2023-10-14T08:51:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.180+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f804ebb0 con 0x7fa9f81002c0 2023-10-14T08:51:51.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.181+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa9e8004750 con 0x7fa9f81002c0 2023-10-14T08:51:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.181+0000 7fa9fc8db700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa9e00a1590 0x7fa9e00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.181+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa9e80cc9c0 con 0x7fa9f81002c0 2023-10-14T08:51:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.181+0000 7fa9f67fc700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa9e00a1590 0x7fa9e00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.182+0000 7fa9f67fc700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa9e00a1590 0x7fa9e00a3a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009fd0 tx=0x7fa9ec019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:51.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.186+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa9e8096070 con 0x7fa9f81002c0 2023-10-14T08:51:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.395+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9f810fe60 con 0x7fa9f81002c0 2023-10-14T08:51:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.396+0000 7fa9fc8db700 1 -- 172.21.15.6:0/3330105415 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9e8016020 con 0x7fa9f81002c0 2023-10-14T08:51:51.397 INFO:teuthology.orchestra.run.smithi006.stdout:107374182454 2023-10-14T08:51:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.397+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa9e00a1590 msgr2=0x7fa9e00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.397+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa9e00a1590 0x7fa9e00a3a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009fd0 tx=0x7fa9ec019040 comp rx=0 tx=0).stop 2023-10-14T08:51:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 msgr2=0x7fa9f8197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 0x7fa9f8197fa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d980 tx=0x7fa9e800dc90 comp rx=0 tx=0).stop 2023-10-14T08:51:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 shutdown_connections 2023-10-14T08:51:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa9e00a1590 0x7fa9e00a3a50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9f8105150 0x7fa9f81a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9f81002c0 0x7fa9f8197fa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 --2- 172.21.15.6:0/3330105415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9f8100c70 0x7fa9f81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 >> 172.21.15.6:0/3330105415 conn(0x7fa9f8076cf0 msgr2=0x7fa9f80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 shutdown_connections 2023-10-14T08:51:51.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:51.398+0000 7fa9fd8dd700 1 -- 172.21.15.6:0/3330105415 wait complete. 2023-10-14T08:51:51.420 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:51 smithi006 ceph-mon[99452]: pgmap v275: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-10-14T08:51:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:51 smithi178 ceph-mon[103612]: pgmap v275: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-10-14T08:51:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:51 smithi057 ceph-mon[103313]: pgmap v275: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-10-14T08:51:52.274 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:52 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3330105415' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-14T08:51:52.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182452 got 107374182454 for osd.3 2023-10-14T08:51:52.331 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:52.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:52 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3330105415' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-14T08:51:52.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:52 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3330105415' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-14T08:51:53.279 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:53 smithi006 ceph-mon[99452]: pgmap v276: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-14T08:51:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 -- 172.21.15.6:0/3533472329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3440ffe60 msgr2=0x7fb3441002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/3533472329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3440ffe60 0x7fb3441002e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb3380099c0 tx=0x7fb338009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 -- 172.21.15.6:0/3533472329 shutdown_connections 2023-10-14T08:51:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/3533472329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb344100820 0x7fb34410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/3533472329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 0x7fb344106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/3533472329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3440ffe60 0x7fb3441002e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 -- 172.21.15.6:0/3533472329 >> 172.21.15.6:0/3533472329 conn(0x7fb344075e00 msgr2=0x7fb344076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 -- 172.21.15.6:0/3533472329 shutdown_connections 2023-10-14T08:51:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.340+0000 7fb34c1c8700 1 -- 172.21.15.6:0/3533472329 wait complete. 2023-10-14T08:51:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 Processor -- start 2023-10-14T08:51:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 -- start start 2023-10-14T08:51:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3440ffe60 0x7fb344195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 0x7fb3441964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 0x7fb34419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34419af20 con 0x7fb344100820 2023-10-14T08:51:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34419b090 con 0x7fb344105e70 2023-10-14T08:51:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb34c1c8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34419b250 con 0x7fb3440ffe60 2023-10-14T08:51:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb349763700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 0x7fb3441964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb349763700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 0x7fb3441964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59810/0 (socket says 172.21.15.6:59810) 2023-10-14T08:51:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb349763700 1 -- 172.21.15.6:0/2860538835 learned_addr learned my addr 172.21.15.6:0/2860538835 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.341+0000 7fb349f64700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3440ffe60 0x7fb344195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb34a765700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 0x7fb34419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb349763700 1 -- 172.21.15.6:0/2860538835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3440ffe60 msgr2=0x7fb344195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb349763700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3440ffe60 0x7fb344195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb349763700 1 -- 172.21.15.6:0/2860538835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 msgr2=0x7fb34419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb349763700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 0x7fb34419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb349763700 1 -- 172.21.15.6:0/2860538835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380095f0 con 0x7fb344100820 2023-10-14T08:51:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb34a765700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 0x7fb34419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb349763700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 0x7fb3441964a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb338005910 tx=0x7fb3380036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33801f070 con 0x7fb344100820 2023-10-14T08:51:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34419b4d0 con 0x7fb344100820 2023-10-14T08:51:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb33801ad40 con 0x7fb344100820 2023-10-14T08:51:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33800f460 con 0x7fb344100820 2023-10-14T08:51:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.342+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb344068b70 con 0x7fb344100820 2023-10-14T08:51:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.343+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34404ebb0 con 0x7fb344100820 2023-10-14T08:51:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.344+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb338023070 con 0x7fb344100820 2023-10-14T08:51:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.345+0000 7fb342ffd700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb32c0a1510 0x7fb32c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.345+0000 7fb349f64700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb32c0a1510 0x7fb32c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.345+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb3380d00c0 con 0x7fb344100820 2023-10-14T08:51:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.345+0000 7fb349f64700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb32c0a1510 0x7fb32c0a39d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009f20 tx=0x7fb33c0094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.349+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb338099800 con 0x7fb344100820 2023-10-14T08:51:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.555+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb34410fdb0 con 0x7fb344100820 2023-10-14T08:51:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.556+0000 7fb342ffd700 1 -- 172.21.15.6:0/2860538835 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb33809ce20 con 0x7fb344100820 2023-10-14T08:51:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:34359738436 2023-10-14T08:51:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb32c0a1510 msgr2=0x7fb32c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb32c0a1510 0x7fb32c0a39d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009f20 tx=0x7fb33c0094f0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 msgr2=0x7fb3441964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 0x7fb3441964a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb338005910 tx=0x7fb3380036f0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 shutdown_connections 2023-10-14T08:51:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb32c0a1510 0x7fb32c0a39d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb344105e70 0x7fb34419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3440ffe60 0x7fb344195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 --2- 172.21.15.6:0/2860538835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb344100820 0x7fb3441964a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 >> 172.21.15.6:0/2860538835 conn(0x7fb344075e00 msgr2=0x7fb344103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 shutdown_connections 2023-10-14T08:51:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:53.558+0000 7fb34c1c8700 1 -- 172.21.15.6:0/2860538835 wait complete. 2023-10-14T08:51:53.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:53 smithi178 ceph-mon[103612]: pgmap v276: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-14T08:51:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:53 smithi057 ceph-mon[103313]: pgmap v276: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-14T08:51:53.971 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:53.973 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.229+0000 7f5f5736b700 1 -- 172.21.15.6:0/146584067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 msgr2=0x7f5f5010cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.229+0000 7f5f5736b700 1 --2- 172.21.15.6:0/146584067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f5010cc90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b0d0 tx=0x7f5f4800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 -- 172.21.15.6:0/146584067 shutdown_connections 2023-10-14T08:51:54.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 --2- 172.21.15.6:0/146584067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f5010cc90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 --2- 172.21.15.6:0/146584067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50105e70 0x7f5f50106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 --2- 172.21.15.6:0/146584067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f500ffe60 0x7f5f501002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 -- 172.21.15.6:0/146584067 >> 172.21.15.6:0/146584067 conn(0x7f5f50075e00 msgr2=0x7f5f50076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 -- 172.21.15.6:0/146584067 shutdown_connections 2023-10-14T08:51:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.230+0000 7f5f5736b700 1 -- 172.21.15.6:0/146584067 wait complete. 2023-10-14T08:51:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 Processor -- start 2023-10-14T08:51:54.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 -- start start 2023-10-14T08:51:54.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f500ffe60 0x7f5f50194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f50195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50105e70 0x7f5f501997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50199e00 con 0x7f5f50100820 2023-10-14T08:51:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50199f70 con 0x7f5f50105e70 2023-10-14T08:51:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f5736b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5019a130 con 0x7f5f500ffe60 2023-10-14T08:51:54.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f50195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f50195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59824/0 (socket says 172.21.15.6:59824) 2023-10-14T08:51:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 -- 172.21.15.6:0/2901946527 learned_addr learned my addr 172.21.15.6:0/2901946527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f55107700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f500ffe60 0x7f5f50194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f55908700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50105e70 0x7f5f501997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 -- 172.21.15.6:0/2901946527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f500ffe60 msgr2=0x7f5f50194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f500ffe60 0x7f5f50194e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 -- 172.21.15.6:0/2901946527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50105e70 msgr2=0x7f5f501997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.231+0000 7f5f54906700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50105e70 0x7f5f501997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f54906700 1 -- 172.21.15.6:0/2901946527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48009d00 con 0x7f5f50100820 2023-10-14T08:51:54.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f54906700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f50195380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f40011b60 tx=0x7f5f40011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:54.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000f950 con 0x7f5f50100820 2023-10-14T08:51:54.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5019a410 con 0x7f5f50100820 2023-10-14T08:51:54.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f40013040 con 0x7f5f50100820 2023-10-14T08:51:54.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400183a0 con 0x7f5f50100820 2023-10-14T08:51:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.232+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f501a1c70 con 0x7f5f50100820 2023-10-14T08:51:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.233+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5004ebb0 con 0x7f5f50100820 2023-10-14T08:51:54.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.234+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f5f40019590 con 0x7f5f50100820 2023-10-14T08:51:54.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.235+0000 7f5f467fc700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5f3c0a1510 0x7f5f3c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.235+0000 7f5f55107700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5f3c0a1510 0x7f5f3c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.235+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5f400d05b0 con 0x7f5f50100820 2023-10-14T08:51:54.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.235+0000 7f5f55107700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5f3c0a1510 0x7f5f3c0a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00db40 tx=0x7f5f4c00f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:54.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.238+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5f40099c60 con 0x7f5f50100820 2023-10-14T08:51:54.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.450+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f5f5010ee70 con 0x7f5f50100820 2023-10-14T08:51:54.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.450+0000 7f5f467fc700 1 -- 172.21.15.6:0/2901946527 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5f40028020 con 0x7f5f50100820 2023-10-14T08:51:54.452 INFO:teuthology.orchestra.run.smithi006.stdout:296352743447 2023-10-14T08:51:54.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5f3c0a1510 msgr2=0x7f5f3c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5f3c0a1510 0x7f5f3c0a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00db40 tx=0x7f5f4c00f040 comp rx=0 tx=0).stop 2023-10-14T08:51:54.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 msgr2=0x7f5f50195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f50195380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f40011b60 tx=0x7f5f40011e70 comp rx=0 tx=0).stop 2023-10-14T08:51:54.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 shutdown_connections 2023-10-14T08:51:54.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5f3c0a1510 0x7f5f3c0a39d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f50105e70 0x7f5f501997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f500ffe60 0x7f5f50194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 --2- 172.21.15.6:0/2901946527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f50100820 0x7f5f50195380 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 >> 172.21.15.6:0/2901946527 conn(0x7f5f50075e00 msgr2=0x7f5f500fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:54.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 shutdown_connections 2023-10-14T08:51:54.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.453+0000 7f5f5736b700 1 -- 172.21.15.6:0/2901946527 wait complete. 2023-10-14T08:51:54.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:54 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2860538835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-14T08:51:54.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 -- 172.21.15.6:0/3111162134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe580ffe60 msgr2=0x7fbe581002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3111162134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe580ffe60 0x7fbe581002e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0099c0 tx=0x7fbe4c009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 -- 172.21.15.6:0/3111162134 shutdown_connections 2023-10-14T08:51:54.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3111162134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe58100820 0x7fbe5810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3111162134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58105e70 0x7fbe58106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3111162134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe580ffe60 0x7fbe581002e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 -- 172.21.15.6:0/3111162134 >> 172.21.15.6:0/3111162134 conn(0x7fbe58075e00 msgr2=0x7fbe58076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:54.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 -- 172.21.15.6:0/3111162134 shutdown_connections 2023-10-14T08:51:54.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.630+0000 7fbe5e964700 1 -- 172.21.15.6:0/3111162134 wait complete. 2023-10-14T08:51:54.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 Processor -- start 2023-10-14T08:51:54.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 -- start start 2023-10-14T08:51:54.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:54 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2860538835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-14T08:51:54.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe580ffe60 0x7fbe58195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58100820 0x7fbe58196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 0x7fbe5819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5819aea0 con 0x7fbe58105e70 2023-10-14T08:51:54.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5819b010 con 0x7fbe580ffe60 2023-10-14T08:51:54.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.631+0000 7fbe5e964700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5819b1d0 con 0x7fbe58100820 2023-10-14T08:51:54.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 0x7fbe5819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 0x7fbe5819a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59840/0 (socket says 172.21.15.6:59840) 2023-10-14T08:51:54.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 -- 172.21.15.6:0/3424792489 learned_addr learned my addr 172.21.15.6:0/3424792489 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe57fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe580ffe60 0x7fbe58195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe577fe700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58100820 0x7fbe58196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 -- 172.21.15.6:0/3424792489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58100820 msgr2=0x7fbe58196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58100820 0x7fbe58196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 -- 172.21.15.6:0/3424792489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe580ffe60 msgr2=0x7fbe58195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe580ffe60 0x7fbe58195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 -- 172.21.15.6:0/3424792489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48009520 con 0x7fbe58105e70 2023-10-14T08:51:54.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe5cf01700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 0x7fbe5819a890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800ec10 tx=0x7fbe4800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:54.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.632+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48013070 con 0x7fbe58105e70 2023-10-14T08:51:54.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.633+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c0095f0 con 0x7fbe58105e70 2023-10-14T08:51:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.633+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe4800be40 con 0x7fbe58105e70 2023-10-14T08:51:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.633+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48003b40 con 0x7fbe58105e70 2023-10-14T08:51:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.633+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe580689a0 con 0x7fbe58105e70 2023-10-14T08:51:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.635+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5804ebb0 con 0x7fbe58105e70 2023-10-14T08:51:54.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.635+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fbe4800b980 con 0x7fbe58105e70 2023-10-14T08:51:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.636+0000 7fbe557fa700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe400a1510 0x7fbe400a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.636+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbe480ce220 con 0x7fbe58105e70 2023-10-14T08:51:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.636+0000 7fbe57fff700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe400a1510 0x7fbe400a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.637+0000 7fbe57fff700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe400a1510 0x7fbe400a39d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000f540 tx=0x7fbe5000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:54.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.641+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbe48051100 con 0x7fbe58105e70 2023-10-14T08:51:54.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:54 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2860538835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-14T08:51:54.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 -- 172.21.15.6:0/4192951531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069270 msgr2=0x7f9ca40696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 --2- 172.21.15.6:0/4192951531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069270 0x7f9ca40696d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009990 tx=0x7f9c94009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 -- 172.21.15.6:0/4192951531 shutdown_connections 2023-10-14T08:51:54.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 --2- 172.21.15.6:0/4192951531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069c10 0x7f9ca410ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 --2- 172.21.15.6:0/4192951531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 0x7f9ca4107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 --2- 172.21.15.6:0/4192951531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069270 0x7f9ca40696d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 -- 172.21.15.6:0/4192951531 >> 172.21.15.6:0/4192951531 conn(0x7f9ca4076dc0 msgr2=0x7f9ca40771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:54.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 -- 172.21.15.6:0/4192951531 shutdown_connections 2023-10-14T08:51:54.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.817+0000 7f9cac41d700 1 -- 172.21.15.6:0/4192951531 wait complete. 2023-10-14T08:51:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.818+0000 7f9cac41d700 1 Processor -- start 2023-10-14T08:51:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.818+0000 7f9cac41d700 1 -- start start 2023-10-14T08:51:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9cac41d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069270 0x7f9ca4197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9cac41d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 0x7f9ca4197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9cac41d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 0x7f9ca419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9cac41d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca419c000 con 0x7f9ca4069c10 2023-10-14T08:51:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9cac41d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca419c170 con 0x7f9ca4106f80 2023-10-14T08:51:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9cac41d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca419c330 con 0x7f9ca4069270 2023-10-14T08:51:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 0x7f9ca4197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 0x7f9ca4197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59852/0 (socket says 172.21.15.6:59852) 2023-10-14T08:51:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 -- 172.21.15.6:0/2615107466 learned_addr learned my addr 172.21.15.6:0/2615107466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9caa1b9700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069270 0x7f9ca4197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9caa9ba700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 0x7f9ca419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 -- 172.21.15.6:0/2615107466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069270 msgr2=0x7f9ca4197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069270 0x7f9ca4197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 -- 172.21.15.6:0/2615107466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 msgr2=0x7f9ca419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 0x7f9ca419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 -- 172.21.15.6:0/2615107466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940095f0 con 0x7f9ca4069c10 2023-10-14T08:51:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9caa1b9700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069270 0x7f9ca4197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:51:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9caa9ba700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 0x7f9ca419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.819+0000 7f9ca99b8700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 0x7f9ca4197580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.820+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9401d070 con 0x7f9ca4069c10 2023-10-14T08:51:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.820+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c94021410 con 0x7f9ca4069c10 2023-10-14T08:51:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.820+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca419c5b0 con 0x7f9ca4069c10 2023-10-14T08:51:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.820+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94017650 con 0x7f9ca4069c10 2023-10-14T08:51:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.820+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca41a3e70 con 0x7f9ca4069c10 2023-10-14T08:51:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.821+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca404ebb0 con 0x7f9ca4069c10 2023-10-14T08:51:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.822+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f9c94021580 con 0x7f9ca4069c10 2023-10-14T08:51:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.823+0000 7f9c9b7fe700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c900a1510 0x7f9c900a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.823+0000 7f9caa1b9700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c900a1510 0x7f9c900a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.823+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9c940ce790 con 0x7f9ca4069c10 2023-10-14T08:51:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.823+0000 7f9caa1b9700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c900a1510 0x7f9c900a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009fd0 tx=0x7f9ca0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.826+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9c94097ed0 con 0x7f9ca4069c10 2023-10-14T08:51:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.859+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fbe5810fd30 con 0x7fbe58105e70 2023-10-14T08:51:54.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.860+0000 7fbe557fa700 1 -- 172.21.15.6:0/3424792489 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe480978d0 con 0x7fbe58105e70 2023-10-14T08:51:54.861 INFO:teuthology.orchestra.run.smithi006.stdout:274877906971 2023-10-14T08:51:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe400a1510 msgr2=0x7fbe400a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe400a1510 0x7fbe400a39d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000f540 tx=0x7fbe5000b040 comp rx=0 tx=0).stop 2023-10-14T08:51:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 msgr2=0x7fbe5819a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 0x7fbe5819a890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800ec10 tx=0x7fbe4800ef20 comp rx=0 tx=0).stop 2023-10-14T08:51:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 shutdown_connections 2023-10-14T08:51:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe58105e70 0x7fbe5819a890 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbe400a1510 0x7fbe400a39d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe580ffe60 0x7fbe58195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 --2- 172.21.15.6:0/3424792489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58100820 0x7fbe58196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 >> 172.21.15.6:0/3424792489 conn(0x7fbe58075e00 msgr2=0x7fbe580fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:54.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 shutdown_connections 2023-10-14T08:51:54.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:54.862+0000 7fbe5e964700 1 -- 172.21.15.6:0/3424792489 wait complete. 2023-10-14T08:51:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.041+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9ca4110e30 con 0x7f9ca4069c10 2023-10-14T08:51:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.041+0000 7f9c9b7fe700 1 -- 172.21.15.6:0/2615107466 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c9409b4f0 con 0x7f9ca4069c10 2023-10-14T08:51:55.043 INFO:teuthology.orchestra.run.smithi006.stdout:188978561065 2023-10-14T08:51:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c900a1510 msgr2=0x7f9c900a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c900a1510 0x7f9c900a39d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009fd0 tx=0x7f9ca0009260 comp rx=0 tx=0).stop 2023-10-14T08:51:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 msgr2=0x7f9ca4197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 0x7f9ca4197580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94004790 comp rx=0 tx=0).stop 2023-10-14T08:51:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 shutdown_connections 2023-10-14T08:51:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9c900a1510 0x7f9c900a39d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ca4106f80 0x7f9ca419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ca4069270 0x7f9ca4197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 --2- 172.21.15.6:0/2615107466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ca4069c10 0x7f9ca4197580 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 >> 172.21.15.6:0/2615107466 conn(0x7f9ca4076dc0 msgr2=0x7f9ca40fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 shutdown_connections 2023-10-14T08:51:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.044+0000 7f9cac41d700 1 -- 172.21.15.6:0/2615107466 wait complete. 2023-10-14T08:51:55.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:55 smithi006 ceph-mon[99452]: pgmap v277: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-14T08:51:55.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:55 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2901946527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-14T08:51:55.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:55 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3424792489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-14T08:51:55.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:55 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2615107466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-14T08:51:55.503 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738433 got 34359738436 for osd.0 2023-10-14T08:51:55.503 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 -- 172.21.15.6:0/3319334167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21600ffe60 msgr2=0x7f21601002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 --2- 172.21.15.6:0/3319334167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21600ffe60 0x7f21601002e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f21500099c0 tx=0x7f2150009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 -- 172.21.15.6:0/3319334167 shutdown_connections 2023-10-14T08:51:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 --2- 172.21.15.6:0/3319334167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2160100820 0x7f216010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 --2- 172.21.15.6:0/3319334167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2160105e70 0x7f2160106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 --2- 172.21.15.6:0/3319334167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21600ffe60 0x7f21601002e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 -- 172.21.15.6:0/3319334167 >> 172.21.15.6:0/3319334167 conn(0x7f2160075e00 msgr2=0x7f2160076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:55.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 -- 172.21.15.6:0/3319334167 shutdown_connections 2023-10-14T08:51:55.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.384+0000 7f21673cb700 1 -- 172.21.15.6:0/3319334167 wait complete. 2023-10-14T08:51:55.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 Processor -- start 2023-10-14T08:51:55.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 -- start start 2023-10-14T08:51:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21600ffe60 0x7f2160199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 0x7f2160199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2160105e70 0x7f216019dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216019e0d0 con 0x7f2160100820 2023-10-14T08:51:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216019e240 con 0x7f21600ffe60 2023-10-14T08:51:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f21673cb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216019e400 con 0x7f2160105e70 2023-10-14T08:51:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2164966700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 0x7f2160199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2164966700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 0x7f2160199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59866/0 (socket says 172.21.15.6:59866) 2023-10-14T08:51:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2164966700 1 -- 172.21.15.6:0/3520438826 learned_addr learned my addr 172.21.15.6:0/3520438826 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2165167700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21600ffe60 0x7f2160199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2165968700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2160105e70 0x7f216019dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2164966700 1 -- 172.21.15.6:0/3520438826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2160105e70 msgr2=0x7f216019dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2164966700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2160105e70 0x7f216019dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.385+0000 7f2164966700 1 -- 172.21.15.6:0/3520438826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21600ffe60 msgr2=0x7f2160199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f2164966700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21600ffe60 0x7f2160199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f2164966700 1 -- 172.21.15.6:0/3520438826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500095f0 con 0x7f2160100820 2023-10-14T08:51:55.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f2165167700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21600ffe60 0x7f2160199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:51:55.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f2164966700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 0x7f2160199650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f215000b580 tx=0x7f21500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:55.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215001d070 con 0x7f2160100820 2023-10-14T08:51:55.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2150004110 con 0x7f2160100820 2023-10-14T08:51:55.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216019e680 con 0x7f2160100820 2023-10-14T08:51:55.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000f460 con 0x7f2160100820 2023-10-14T08:51:55.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.386+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21601a5f40 con 0x7f2160100820 2023-10-14T08:51:55.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.387+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216004ebb0 con 0x7f2160100820 2023-10-14T08:51:55.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.388+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f2150022670 con 0x7f2160100820 2023-10-14T08:51:55.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.389+0000 7f21567fc700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f214c0a1570 0x7f214c0a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:55.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.389+0000 7f2165167700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f214c0a1570 0x7f214c0a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:55.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.389+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f21500ce6b0 con 0x7f2160100820 2023-10-14T08:51:55.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.389+0000 7f2165167700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f214c0a1570 0x7f214c0a3a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f215c005fd0 tx=0x7f215c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:55.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.392+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2150097df0 con 0x7f2160100820 2023-10-14T08:51:55.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.601+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f216019a470 con 0x7f2160100820 2023-10-14T08:51:55.626 INFO:teuthology.orchestra.run.smithi006.stdout:158913789997 2023-10-14T08:51:55.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.601+0000 7f21567fc700 1 -- 172.21.15.6:0/3520438826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f215009b410 con 0x7f2160100820 2023-10-14T08:51:55.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f214c0a1570 msgr2=0x7f214c0a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f214c0a1570 0x7f214c0a3a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f215c005fd0 tx=0x7f215c005e30 comp rx=0 tx=0).stop 2023-10-14T08:51:55.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 msgr2=0x7f2160199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 0x7f2160199650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f215000b580 tx=0x7f21500057f0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 shutdown_connections 2023-10-14T08:51:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2160105e70 0x7f216019dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f214c0a1570 0x7f214c0a3a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21600ffe60 0x7f2160199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 --2- 172.21.15.6:0/3520438826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2160100820 0x7f2160199650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 >> 172.21.15.6:0/3520438826 conn(0x7f2160075e00 msgr2=0x7f2160103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 shutdown_connections 2023-10-14T08:51:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:55.603+0000 7f21673cb700 1 -- 172.21.15.6:0/3520438826 wait complete. 2023-10-14T08:51:55.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:55 smithi178 ceph-mon[103612]: pgmap v277: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-14T08:51:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:55 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2901946527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-14T08:51:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:55 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3424792489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-14T08:51:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:55 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2615107466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-14T08:51:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:55 smithi057 ceph-mon[103313]: pgmap v277: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-14T08:51:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:55 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2901946527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-14T08:51:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:55 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3424792489' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-14T08:51:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:55 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2615107466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-14T08:51:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:51:56.297 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906969 got 274877906971 for osd.9 2023-10-14T08:51:56.297 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:56.556 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:56 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3520438826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-14T08:51:56.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:56 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3520438826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-14T08:51:56.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:56 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3520438826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-14T08:51:56.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 -- 172.21.15.6:0/2819053566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 msgr2=0x7f7b7c10ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:56.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 --2- 172.21.15.6:0/2819053566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c10ddc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400b0a0 tx=0x7f7b7400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 -- 172.21.15.6:0/2819053566 shutdown_connections 2023-10-14T08:51:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 --2- 172.21.15.6:0/2819053566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c10ddc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 --2- 172.21.15.6:0/2819053566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b7c106f80 0x7f7b7c107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 --2- 172.21.15.6:0/2819053566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c069270 0x7f7b7c0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 -- 172.21.15.6:0/2819053566 >> 172.21.15.6:0/2819053566 conn(0x7f7b7c076dc0 msgr2=0x7f7b7c0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:56.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 -- 172.21.15.6:0/2819053566 shutdown_connections 2023-10-14T08:51:56.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.775+0000 7f7b83efc700 1 -- 172.21.15.6:0/2819053566 wait complete. 2023-10-14T08:51:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 Processor -- start 2023-10-14T08:51:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 -- start start 2023-10-14T08:51:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b7c069270 0x7f7b7c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c106f80 0x7f7b7c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c19c0a0 con 0x7f7b7c069c10 2023-10-14T08:51:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c19c210 con 0x7f7b7c069270 2023-10-14T08:51:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.776+0000 7f7b83efc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c19c3d0 con 0x7f7b7c106f80 2023-10-14T08:51:56.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59880/0 (socket says 172.21.15.6:59880) 2023-10-14T08:51:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 -- 172.21.15.6:0/1097958402 learned_addr learned my addr 172.21.15.6:0/1097958402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81c98700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b7c069270 0x7f7b7c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b82499700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c106f80 0x7f7b7c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 -- 172.21.15.6:0/1097958402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c106f80 msgr2=0x7f7b7c19ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c106f80 0x7f7b7c19ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 -- 172.21.15.6:0/1097958402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b7c069270 msgr2=0x7f7b7c1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b7c069270 0x7f7b7c1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 -- 172.21.15.6:0/1097958402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74009d00 con 0x7f7b7c069c10 2023-10-14T08:51:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b82499700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c106f80 0x7f7b7c19ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b81497700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c197620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00d950 tx=0x7f7b6c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c009940 con 0x7f7b7c069c10 2023-10-14T08:51:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b6c010460 con 0x7f7b7c069c10 2023-10-14T08:51:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c19c6b0 con 0x7f7b7c069c10 2023-10-14T08:51:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c00f620 con 0x7f7b7c069c10 2023-10-14T08:51:56.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.777+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c1a3f10 con 0x7f7b7c069c10 2023-10-14T08:51:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.778+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c04ebb0 con 0x7f7b7c069c10 2023-10-14T08:51:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.779+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f7b6c0108d0 con 0x7f7b7c069c10 2023-10-14T08:51:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.780+0000 7f7b72ffd700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7b680a1590 0x7f7b680a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.780+0000 7f7b81c98700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7b680a1590 0x7f7b680a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.780+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7b6c0ccab0 con 0x7f7b7c069c10 2023-10-14T08:51:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.780+0000 7f7b81c98700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7b680a1590 0x7f7b680a3a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b78005950 tx=0x7f7b7800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:56.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.785+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7b6c096160 con 0x7f7b7c069c10 2023-10-14T08:51:56.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.992+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b7c198440 con 0x7f7b7c069c10 2023-10-14T08:51:56.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.992+0000 7f7b72ffd700 1 -- 172.21.15.6:0/1097958402 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b6c016090 con 0x7f7b7c069c10 2023-10-14T08:51:56.994 INFO:teuthology.orchestra.run.smithi006.stdout:55834574912 2023-10-14T08:51:56.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.994+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7b680a1590 msgr2=0x7f7b680a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:56.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.994+0000 7f7b83efc700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7b680a1590 0x7f7b680a3a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b78005950 tx=0x7f7b7800a300 comp rx=0 tx=0).stop 2023-10-14T08:51:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 msgr2=0x7f7b7c197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c197620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00d950 tx=0x7f7b6c00dc60 comp rx=0 tx=0).stop 2023-10-14T08:51:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 shutdown_connections 2023-10-14T08:51:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b7c106f80 0x7f7b7c19ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7b680a1590 0x7f7b680a3a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b7c069270 0x7f7b7c1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 --2- 172.21.15.6:0/1097958402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b7c069c10 0x7f7b7c197620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 >> 172.21.15.6:0/1097958402 conn(0x7f7b7c076dc0 msgr2=0x7f7b7c104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 shutdown_connections 2023-10-14T08:51:56.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:56.995+0000 7f7b83efc700 1 -- 172.21.15.6:0/1097958402 wait complete. 2023-10-14T08:51:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 -- 172.21.15.6:0/900987524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200ffe60 msgr2=0x7fd1201002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 --2- 172.21.15.6:0/900987524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200ffe60 0x7fd1201002e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd1080099c0 tx=0x7fd108009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 -- 172.21.15.6:0/900987524 shutdown_connections 2023-10-14T08:51:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 --2- 172.21.15.6:0/900987524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 0x7fd12010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 --2- 172.21.15.6:0/900987524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120105e70 0x7fd120106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 --2- 172.21.15.6:0/900987524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200ffe60 0x7fd1201002e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 -- 172.21.15.6:0/900987524 >> 172.21.15.6:0/900987524 conn(0x7fd120075e00 msgr2=0x7fd120076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 -- 172.21.15.6:0/900987524 shutdown_connections 2023-10-14T08:51:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.415+0000 7fd1269e6700 1 -- 172.21.15.6:0/900987524 wait complete. 2023-10-14T08:51:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.416+0000 7fd1269e6700 1 Processor -- start 2023-10-14T08:51:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.416+0000 7fd1269e6700 1 -- start start 2023-10-14T08:51:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1200ffe60 0x7fd120197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 0x7fd120198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd120105e70 0x7fd1201a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120198cb0 con 0x7fd120105e70 2023-10-14T08:51:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201a33f0 con 0x7fd120100820 2023-10-14T08:51:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201a35b0 con 0x7fd1200ffe60 2023-10-14T08:51:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1200ffe60 0x7fd120197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd120105e70 0x7fd1201a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1200ffe60 0x7fd120197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:57294/0 (socket says 172.21.15.6:57294) 2023-10-14T08:51:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11ffff700 1 -- 172.21.15.6:0/67957979 learned_addr learned my addr 172.21.15.6:0/67957979 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11f7fe700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 0x7fd120198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 -- 172.21.15.6:0/67957979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1200ffe60 msgr2=0x7fd120197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1200ffe60 0x7fd120197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 -- 172.21.15.6:0/67957979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 msgr2=0x7fd120198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 0x7fd120198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 -- 172.21.15.6:0/67957979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080095f0 con 0x7fd120105e70 2023-10-14T08:51:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11f7fe700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 0x7fd120198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:51:57.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd124f83700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd120105e70 0x7fd1201a2eb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd11800ab40 tx=0x7fd11800ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800f070 con 0x7fd120105e70 2023-10-14T08:51:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd118007a70 con 0x7fd120105e70 2023-10-14T08:51:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1201a3890 con 0x7fd120105e70 2023-10-14T08:51:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118005280 con 0x7fd120105e70 2023-10-14T08:51:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.417+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1201a3d90 con 0x7fd120105e70 2023-10-14T08:51:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.419+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12004ebb0 con 0x7fd120105e70 2023-10-14T08:51:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.419+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd118004ad0 con 0x7fd120105e70 2023-10-14T08:51:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.420+0000 7fd11d7fa700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd10c0a1590 0x7fd10c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.420+0000 7fd11ffff700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd10c0a1590 0x7fd10c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.420+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd1180cc150 con 0x7fd120105e70 2023-10-14T08:51:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.421+0000 7fd11ffff700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd10c0a1590 0x7fd10c0a3a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd110005950 tx=0x7fd11000b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.424+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd118095890 con 0x7fd120105e70 2023-10-14T08:51:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:57 smithi006 ceph-mon[99452]: pgmap v278: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-14T08:51:57.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:57 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1097958402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-14T08:51:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.628+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd12010ff10 con 0x7fd120105e70 2023-10-14T08:51:57.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.628+0000 7fd11d7fa700 1 -- 172.21.15.6:0/67957979 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd118004dd0 con 0x7fd120105e70 2023-10-14T08:51:57.630 INFO:teuthology.orchestra.run.smithi006.stdout:137438953521 2023-10-14T08:51:57.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.630+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd10c0a1590 msgr2=0x7fd10c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:57.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.630+0000 7fd1269e6700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd10c0a1590 0x7fd10c0a3a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd110005950 tx=0x7fd11000b500 comp rx=0 tx=0).stop 2023-10-14T08:51:57.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.630+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd120105e70 msgr2=0x7fd1201a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.630+0000 7fd1269e6700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd120105e70 0x7fd1201a2eb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd11800ab40 tx=0x7fd11800ae50 comp rx=0 tx=0).stop 2023-10-14T08:51:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 shutdown_connections 2023-10-14T08:51:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd120105e70 0x7fd1201a2eb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1200ffe60 0x7fd120197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd10c0a1590 0x7fd10c0a3a50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 --2- 172.21.15.6:0/67957979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd120100820 0x7fd120198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 >> 172.21.15.6:0/67957979 conn(0x7fd120075e00 msgr2=0x7fd1200fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:57.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 shutdown_connections 2023-10-14T08:51:57.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:57.631+0000 7fd1269e6700 1 -- 172.21.15.6:0/67957979 wait complete. 2023-10-14T08:51:57.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:57 smithi178 ceph-mon[103612]: pgmap v278: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-14T08:51:57.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:57 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1097958402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-14T08:51:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:57 smithi057 ceph-mon[103313]: pgmap v278: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-10-14T08:51:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:57 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1097958402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-14T08:51:57.853 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561063 got 188978561065 for osd.6 2023-10-14T08:51:57.854 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:57.854 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743444 got 296352743447 for osd.10 2023-10-14T08:51:57.854 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:57.903 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789994 got 158913789997 for osd.5 2023-10-14T08:51:57.904 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:58.221 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574910 got 55834574912 for osd.1 2023-10-14T08:51:58.221 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 -- 172.21.15.6:0/2155784087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0300ffe60 msgr2=0x7fc0301002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 --2- 172.21.15.6:0/2155784087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0300ffe60 0x7fc0301002e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc0200099c0 tx=0x7fc020009cd0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 -- 172.21.15.6:0/2155784087 shutdown_connections 2023-10-14T08:51:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 --2- 172.21.15.6:0/2155784087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc030100820 0x7fc03010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 --2- 172.21.15.6:0/2155784087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030105e70 0x7fc030106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 --2- 172.21.15.6:0/2155784087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0300ffe60 0x7fc0301002e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 -- 172.21.15.6:0/2155784087 >> 172.21.15.6:0/2155784087 conn(0x7fc030075e00 msgr2=0x7fc030076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 -- 172.21.15.6:0/2155784087 shutdown_connections 2023-10-14T08:51:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.267+0000 7fc036533700 1 -- 172.21.15.6:0/2155784087 wait complete. 2023-10-14T08:51:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.268+0000 7fc036533700 1 Processor -- start 2023-10-14T08:51:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.268+0000 7fc036533700 1 -- start start 2023-10-14T08:51:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.268+0000 7fc036533700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0300ffe60 0x7fc030197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.268+0000 7fc036533700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 0x7fc0301982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.268+0000 7fc036533700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030105e70 0x7fc0301a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc036533700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc030198c20 con 0x7fc030100820 2023-10-14T08:51:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc036533700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0301a3360 con 0x7fc030105e70 2023-10-14T08:51:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc036533700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0301a3520 con 0x7fc0300ffe60 2023-10-14T08:51:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 0x7fc0301982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 0x7fc0301982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59908/0 (socket says 172.21.15.6:59908) 2023-10-14T08:51:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 -- 172.21.15.6:0/133328750 learned_addr learned my addr 172.21.15.6:0/133328750 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02ffff700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0300ffe60 0x7fc030197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 -- 172.21.15.6:0/133328750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0300ffe60 msgr2=0x7fc030197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0300ffe60 0x7fc030197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 -- 172.21.15.6:0/133328750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030105e70 msgr2=0x7fc0301a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030105e70 0x7fc0301a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 -- 172.21.15.6:0/133328750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200095f0 con 0x7fc030100820 2023-10-14T08:51:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02f7fe700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 0x7fc0301982e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc02000b580 tx=0x7fc0200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02001d070 con 0x7fc030100820 2023-10-14T08:51:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc020004110 con 0x7fc030100820 2023-10-14T08:51:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0301a37a0 con 0x7fc030100820 2023-10-14T08:51:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000f460 con 0x7fc030100820 2023-10-14T08:51:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.269+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0301a3c10 con 0x7fc030100820 2023-10-14T08:51:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.270+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03004ebb0 con 0x7fc030100820 2023-10-14T08:51:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.271+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc020022670 con 0x7fc030100820 2023-10-14T08:51:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.272+0000 7fc02d7fa700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc01c0a1590 0x7fc01c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.272+0000 7fc02ffff700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc01c0a1590 0x7fc01c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.272+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc0200ce760 con 0x7fc030100820 2023-10-14T08:51:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.272+0000 7fc02ffff700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc01c0a1590 0x7fc01c0a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc018006fd0 tx=0x7fc018008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:58.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.275+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc020097ea0 con 0x7fc030100820 2023-10-14T08:51:58.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:58 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/67957979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-14T08:51:58.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.482+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fc030068fb0 con 0x7fc030100820 2023-10-14T08:51:58.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.482+0000 7fc02d7fa700 1 -- 172.21.15.6:0/133328750 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fc02009b4c0 con 0x7fc030100820 2023-10-14T08:51:58.484 INFO:teuthology.orchestra.run.smithi006.stdout:330712481812 2023-10-14T08:51:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.484+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc01c0a1590 msgr2=0x7fc01c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc01c0a1590 0x7fc01c0a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc018006fd0 tx=0x7fc018008040 comp rx=0 tx=0).stop 2023-10-14T08:51:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 msgr2=0x7fc0301982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 0x7fc0301982e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc02000b580 tx=0x7fc0200057f0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 shutdown_connections 2023-10-14T08:51:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc01c0a1590 0x7fc01c0a3a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030105e70 0x7fc0301a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0300ffe60 0x7fc030197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 --2- 172.21.15.6:0/133328750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc030100820 0x7fc0301982e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 >> 172.21.15.6:0/133328750 conn(0x7fc030075e00 msgr2=0x7fc0300fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:58.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 shutdown_connections 2023-10-14T08:51:58.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.485+0000 7fc036533700 1 -- 172.21.15.6:0/133328750 wait complete. 2023-10-14T08:51:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 -- 172.21.15.6:0/973015412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 msgr2=0x7f8360105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 --2- 172.21.15.6:0/973015412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f8360105b60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f834c009990 tx=0x7f834c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 -- 172.21.15.6:0/973015412 shutdown_connections 2023-10-14T08:51:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 --2- 172.21.15.6:0/973015412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8360106240 0x7f836010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 --2- 172.21.15.6:0/973015412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83600ff670 0x7f83600ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 --2- 172.21.15.6:0/973015412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f8360105b60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 -- 172.21.15.6:0/973015412 >> 172.21.15.6:0/973015412 conn(0x7f8360076360 msgr2=0x7f83600fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 -- 172.21.15.6:0/973015412 shutdown_connections 2023-10-14T08:51:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.598+0000 7f8366ed0700 1 -- 172.21.15.6:0/973015412 wait complete. 2023-10-14T08:51:58.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 Processor -- start 2023-10-14T08:51:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 -- start start 2023-10-14T08:51:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83600ff670 0x7f836010cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f836010d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8360106240 0x7f83601a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601a1170 con 0x7f8360100020 2023-10-14T08:51:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601a12e0 con 0x7f83600ff670 2023-10-14T08:51:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f8366ed0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601a14a0 con 0x7f8360106240 2023-10-14T08:51:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f836010d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f836010d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59918/0 (socket says 172.21.15.6:59918) 2023-10-14T08:51:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 -- 172.21.15.6:0/2280893527 learned_addr learned my addr 172.21.15.6:0/2280893527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 -- 172.21.15.6:0/2280893527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8360106240 msgr2=0x7f83601a0b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:51:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8360106240 0x7f83601a0b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 -- 172.21.15.6:0/2280893527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83600ff670 msgr2=0x7f836010cc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:51:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83600ff670 0x7f836010cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.599+0000 7f835ffff700 1 -- 172.21.15.6:0/2280893527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0095f0 con 0x7f8360100020 2023-10-14T08:51:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.600+0000 7f835ffff700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f836010d160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f834c003730 tx=0x7f834c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.600+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c01d070 con 0x7f8360100020 2023-10-14T08:51:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.600+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83601a1720 con 0x7f8360100020 2023-10-14T08:51:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.600+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f834c00fc30 con 0x7f8360100020 2023-10-14T08:51:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.600+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0173f0 con 0x7f8360100020 2023-10-14T08:51:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.600+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83601a1bc0 con 0x7f8360100020 2023-10-14T08:51:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.601+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83600fdee0 con 0x7f8360100020 2023-10-14T08:51:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.603+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f834c022470 con 0x7f8360100020 2023-10-14T08:51:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.603+0000 7f835dffb700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f83500a1510 0x7f83500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.604+0000 7f8364c6c700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f83500a1510 0x7f83500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.604+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f834c0ce450 con 0x7f8360100020 2023-10-14T08:51:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.604+0000 7f8364c6c700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f83500a1510 0x7f83500a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f836010dc90 tx=0x7f835400b3f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.607+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f834c097b90 con 0x7f8360100020 2023-10-14T08:51:58.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:58 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/67957979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-14T08:51:58.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:58 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/67957979' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-14T08:51:58.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.811+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f836004ebb0 con 0x7f8360100020 2023-10-14T08:51:58.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.811+0000 7f835dffb700 1 -- 172.21.15.6:0/2280893527 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f834c09b1b0 con 0x7f8360100020 2023-10-14T08:51:58.813 INFO:teuthology.orchestra.run.smithi006.stdout:210453397541 2023-10-14T08:51:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f83500a1510 msgr2=0x7f83500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f83500a1510 0x7f83500a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f836010dc90 tx=0x7f835400b3f0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 msgr2=0x7f836010d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f836010d160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f834c003730 tx=0x7f834c00f740 comp rx=0 tx=0).stop 2023-10-14T08:51:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 shutdown_connections 2023-10-14T08:51:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8360106240 0x7f83601a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f83500a1510 0x7f83500a39d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83600ff670 0x7f836010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 --2- 172.21.15.6:0/2280893527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8360100020 0x7f836010d160 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 >> 172.21.15.6:0/2280893527 conn(0x7f8360076360 msgr2=0x7f83601058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 shutdown_connections 2023-10-14T08:51:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:58.814+0000 7f8366ed0700 1 -- 172.21.15.6:0/2280893527 wait complete. 2023-10-14T08:51:58.906 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481810 got 330712481812 for osd.11 2023-10-14T08:51:58.906 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:59.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:59 smithi006 ceph-mon[99452]: pgmap v279: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-14T08:51:59.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:59 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/133328750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-14T08:51:59.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:51:59 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2280893527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-14T08:51:59.513 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953520 got 137438953521 for osd.4 2023-10-14T08:51:59.514 DEBUG:teuthology.parallel:result is None 2023-10-14T08:51:59.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 -- 172.21.15.6:0/4179272082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100820 msgr2=0x7fadfc10cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 --2- 172.21.15.6:0/4179272082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100820 0x7fadfc10cc90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadf400b0d0 tx=0x7fadf400b3e0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 -- 172.21.15.6:0/4179272082 shutdown_connections 2023-10-14T08:51:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 --2- 172.21.15.6:0/4179272082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100820 0x7fadfc10cc90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 --2- 172.21.15.6:0/4179272082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadfc105e70 0x7fadfc106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 --2- 172.21.15.6:0/4179272082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 -- 172.21.15.6:0/4179272082 >> 172.21.15.6:0/4179272082 conn(0x7fadfc075e00 msgr2=0x7fadfc076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:59.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 -- 172.21.15.6:0/4179272082 shutdown_connections 2023-10-14T08:51:59.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.559+0000 7fae01969700 1 -- 172.21.15.6:0/4179272082 wait complete. 2023-10-14T08:51:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 Processor -- start 2023-10-14T08:51:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 -- start start 2023-10-14T08:51:59.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadfc100820 0x7fadfc197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc105e70 0x7fadfc19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19c090 con 0x7fadfc0ffe60 2023-10-14T08:51:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19c200 con 0x7fadfc105e70 2023-10-14T08:51:59.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fae01969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19c3c0 con 0x7fadfc100820 2023-10-14T08:51:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fadfaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fadfaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59928/0 (socket says 172.21.15.6:59928) 2023-10-14T08:51:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fadfaffd700 1 -- 172.21.15.6:0/2228864773 learned_addr learned my addr 172.21.15.6:0/2228864773 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:51:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.560+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc105e70 0x7fadfc19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:59.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfa7fc700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadfc100820 0x7fadfc197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfaffd700 1 -- 172.21.15.6:0/2228864773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadfc100820 msgr2=0x7fadfc197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfaffd700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadfc100820 0x7fadfc197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfaffd700 1 -- 172.21.15.6:0/2228864773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc105e70 msgr2=0x7fadfc19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfaffd700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc105e70 0x7fadfc19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfaffd700 1 -- 172.21.15.6:0/2228864773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4009d00 con 0x7fadfc0ffe60 2023-10-14T08:51:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fadfaffd700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1970d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d950 tx=0x7fadec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec009940 con 0x7fadfc0ffe60 2023-10-14T08:51:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc19c6a0 con 0x7fadfc0ffe60 2023-10-14T08:51:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadec010460 con 0x7fadfc0ffe60 2023-10-14T08:51:59.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00f620 con 0x7fadfc0ffe60 2023-10-14T08:51:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.561+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc1a3f00 con 0x7fadfc0ffe60 2023-10-14T08:51:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.562+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc04ebb0 con 0x7fadfc0ffe60 2023-10-14T08:51:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.563+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fadec0108d0 con 0x7fadfc0ffe60 2023-10-14T08:51:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.564+0000 7fae00967700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fade40a1590 0x7fade40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:51:59.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.564+0000 7fadfa7fc700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fade40a1590 0x7fade40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:51:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.564+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fadec0ccab0 con 0x7fadfc0ffe60 2023-10-14T08:51:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.564+0000 7fadfa7fc700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fade40a1590 0x7fade40a3a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadf0005950 tx=0x7fadf00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:51:59.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.567+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadec096060 con 0x7fadfc0ffe60 2023-10-14T08:51:59.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:59 smithi178 ceph-mon[103612]: pgmap v279: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-14T08:51:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:59 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/133328750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-14T08:51:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:51:59 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2280893527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-14T08:51:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:59 smithi057 ceph-mon[103313]: pgmap v279: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 11 op/s 2023-10-14T08:51:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:59 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/133328750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-14T08:51:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:51:59 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2280893527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-14T08:51:59.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.772+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fadfc198430 con 0x7fadfc0ffe60 2023-10-14T08:51:59.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.772+0000 7fae00967700 1 -- 172.21.15.6:0/2228864773 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadec020090 con 0x7fadfc0ffe60 2023-10-14T08:51:59.775 INFO:teuthology.orchestra.run.smithi006.stdout:244813135905 2023-10-14T08:51:59.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fade40a1590 msgr2=0x7fade40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:59.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fade40a1590 0x7fade40a3a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadf0005950 tx=0x7fadf00058e0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 msgr2=0x7fadfc1970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:51:59.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1970d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d950 tx=0x7fadec00dc60 comp rx=0 tx=0).stop 2023-10-14T08:51:59.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 shutdown_connections 2023-10-14T08:51:59.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fade40a1590 0x7fade40a3a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadfc105e70 0x7fadfc19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffe60 0x7fadfc1970d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 --2- 172.21.15.6:0/2228864773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadfc100820 0x7fadfc197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:51:59.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 >> 172.21.15.6:0/2228864773 conn(0x7fadfc075e00 msgr2=0x7fadfc0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:51:59.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 shutdown_connections 2023-10-14T08:51:59.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:51:59.775+0000 7fae01969700 1 -- 172.21.15.6:0/2228864773 wait complete. 2023-10-14T08:51:59.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397538 got 210453397541 for osd.7 2023-10-14T08:51:59.880 DEBUG:teuthology.parallel:result is None 2023-10-14T08:52:00.409 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135903 got 244813135905 for osd.8 2023-10-14T08:52:00.409 DEBUG:teuthology.parallel:result is None 2023-10-14T08:52:00.517 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:00 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2228864773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-14T08:52:00.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:00 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2228864773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-14T08:52:00.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:00 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2228864773' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-14T08:52:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 -- 172.21.15.6:0/1189779453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42541007d0 msgr2=0x7f425410cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 --2- 172.21.15.6:0/1189779453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42541007d0 0x7f425410cc70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f424c00b0a0 tx=0x7f424c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 -- 172.21.15.6:0/1189779453 shutdown_connections 2023-10-14T08:52:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 --2- 172.21.15.6:0/1189779453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42541007d0 0x7f425410cc70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 --2- 172.21.15.6:0/1189779453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4254105ec0 0x7f42541062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 --2- 172.21.15.6:0/1189779453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42540ffe10 0x7f4254100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 -- 172.21.15.6:0/1189779453 >> 172.21.15.6:0/1189779453 conn(0x7f4254076dc0 msgr2=0x7f42540771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 -- 172.21.15.6:0/1189779453 shutdown_connections 2023-10-14T08:52:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.699+0000 7f4259d7c700 1 -- 172.21.15.6:0/1189779453 wait complete. 2023-10-14T08:52:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 Processor -- start 2023-10-14T08:52:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 -- start start 2023-10-14T08:52:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42540ffe10 0x7f42541991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42541007d0 0x7f42541996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 0x7f425419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425419e170 con 0x7f4254105ec0 2023-10-14T08:52:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425419e2e0 con 0x7f42540ffe10 2023-10-14T08:52:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4259d7c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425419e4a0 con 0x7f42541007d0 2023-10-14T08:52:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 0x7f425419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 0x7f425419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59946/0 (socket says 172.21.15.6:59946) 2023-10-14T08:52:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 -- 172.21.15.6:0/3512978612 learned_addr learned my addr 172.21.15.6:0/3512978612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f42537fe700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42540ffe10 0x7f42541991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4252ffd700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42541007d0 0x7f42541996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 -- 172.21.15.6:0/3512978612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42541007d0 msgr2=0x7f42541996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42541007d0 0x7f42541996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 -- 172.21.15.6:0/3512978612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42540ffe10 msgr2=0x7f42541991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42540ffe10 0x7f42541991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.700+0000 7f4253fff700 1 -- 172.21.15.6:0/3512978612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009d00 con 0x7f4254105ec0 2023-10-14T08:52:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.701+0000 7f4253fff700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 0x7f425419db60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f424c00b780 tx=0x7f424c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:00.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.701+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00e040 con 0x7f4254105ec0 2023-10-14T08:52:00.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.701+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425419e720 con 0x7f4254105ec0 2023-10-14T08:52:00.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.701+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f424c004e60 con 0x7f4254105ec0 2023-10-14T08:52:00.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.701+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0052a0 con 0x7f4254105ec0 2023-10-14T08:52:00.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.701+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42541a5fe0 con 0x7f4254105ec0 2023-10-14T08:52:00.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.702+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425404ebb0 con 0x7f4254105ec0 2023-10-14T08:52:00.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.703+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f424c005400 con 0x7f4254105ec0 2023-10-14T08:52:00.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.703+0000 7f4250ff9700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f42400a1510 0x7f42400a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:00.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.704+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f424c0ce970 con 0x7f4254105ec0 2023-10-14T08:52:00.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.704+0000 7f42537fe700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f42400a1510 0x7f42400a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:00.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.704+0000 7f42537fe700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f42400a1510 0x7f42400a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f423c00ac50 tx=0x7f423c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:00.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.707+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f424c0980b0 con 0x7f4254105ec0 2023-10-14T08:52:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.907+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f425410fde0 con 0x7f4254105ec0 2023-10-14T08:52:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.907+0000 7f4250ff9700 1 -- 172.21.15.6:0/3512978612 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f424c09b6d0 con 0x7f4254105ec0 2023-10-14T08:52:00.910 INFO:teuthology.orchestra.run.smithi006.stdout:77309411387 2023-10-14T08:52:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f42400a1510 msgr2=0x7f42400a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f42400a1510 0x7f42400a39d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f423c00ac50 tx=0x7f423c00a380 comp rx=0 tx=0).stop 2023-10-14T08:52:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 msgr2=0x7f425419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 0x7f425419db60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f424c00b780 tx=0x7f424c00bd60 comp rx=0 tx=0).stop 2023-10-14T08:52:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 shutdown_connections 2023-10-14T08:52:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4254105ec0 0x7f425419db60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f42400a1510 0x7f42400a39d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42540ffe10 0x7f42541991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 --2- 172.21.15.6:0/3512978612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42541007d0 0x7f42541996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 >> 172.21.15.6:0/3512978612 conn(0x7f4254076dc0 msgr2=0x7f42540fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 shutdown_connections 2023-10-14T08:52:00.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:00.910+0000 7f4259d7c700 1 -- 172.21.15.6:0/3512978612 wait complete. 2023-10-14T08:52:01.316 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411385 got 77309411387 for osd.2 2023-10-14T08:52:01.316 DEBUG:teuthology.parallel:result is None 2023-10-14T08:52:01.317 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-14T08:52:01.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-14T08:52:01.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:01 smithi178 ceph-mon[103612]: pgmap v280: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-14T08:52:01.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:01 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3512978612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-14T08:52:01.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:01 smithi057 ceph-mon[103313]: pgmap v280: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-14T08:52:01.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:01 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3512978612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-14T08:52:01.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:01 smithi006 ceph-mon[99452]: pgmap v280: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-10-14T08:52:01.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:01 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3512978612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-14T08:52:01.885 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:02.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:02 smithi006 ceph-mon[99452]: pgmap v281: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-14T08:52:02.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:02 smithi178 ceph-mon[103612]: pgmap v281: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-14T08:52:02.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:02 smithi057 ceph-mon[103313]: pgmap v281: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-14T08:52:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.088+0000 7fcbb5b61700 1 -- 172.21.15.6:0/2915722744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb00ffe60 msgr2=0x7fcbb01002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.088+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/2915722744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb00ffe60 0x7fcbb01002e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcba40099c0 tx=0x7fcba4009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 -- 172.21.15.6:0/2915722744 shutdown_connections 2023-10-14T08:52:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/2915722744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0100820 0x7fcbb010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/2915722744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbb0105e70 0x7fcbb0106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/2915722744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb00ffe60 0x7fcbb01002e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 -- 172.21.15.6:0/2915722744 >> 172.21.15.6:0/2915722744 conn(0x7fcbb0075e00 msgr2=0x7fcbb0076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:03.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 -- 172.21.15.6:0/2915722744 shutdown_connections 2023-10-14T08:52:03.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 -- 172.21.15.6:0/2915722744 wait complete. 2023-10-14T08:52:03.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 Processor -- start 2023-10-14T08:52:03.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.089+0000 7fcbb5b61700 1 -- start start 2023-10-14T08:52:03.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbb5b61700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbb00ffe60 0x7fcbb0197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:03.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbb5b61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 0x7fcbb0197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:03.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbb5b61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0105e70 0x7fcbb019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbb5b61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb019bfe0 con 0x7fcbb0100820 2023-10-14T08:52:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbb5b61700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb019c150 con 0x7fcbb0105e70 2023-10-14T08:52:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbb5b61700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb019c310 con 0x7fcbb00ffe60 2023-10-14T08:52:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 0x7fcbb0197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:03.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 0x7fcbb0197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59956/0 (socket says 172.21.15.6:59956) 2023-10-14T08:52:03.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 -- 172.21.15.6:0/3984555330 learned_addr learned my addr 172.21.15.6:0/3984555330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:03.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaf7fe700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbb00ffe60 0x7fcbb0197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:03.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaffff700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0105e70 0x7fcbb019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:03.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 -- 172.21.15.6:0/3984555330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbb00ffe60 msgr2=0x7fcbb0197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:03.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbb00ffe60 0x7fcbb0197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 -- 172.21.15.6:0/3984555330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0105e70 msgr2=0x7fcbb019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0105e70 0x7fcbb019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 -- 172.21.15.6:0/3984555330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40095f0 con 0x7fcbb0100820 2023-10-14T08:52:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaffff700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0105e70 0x7fcbb019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbaeffd700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 0x7fcbb0197560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009990 tx=0x7fcba4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.090+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba401d070 con 0x7fcbb0100820 2023-10-14T08:52:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.091+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb019c590 con 0x7fcbb0100820 2023-10-14T08:52:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.091+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcba4003f90 con 0x7fcbb0100820 2023-10-14T08:52:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.091+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4022ce0 con 0x7fcbb0100820 2023-10-14T08:52:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.091+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb01a3e50 con 0x7fcbb0100820 2023-10-14T08:52:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.091+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb004ebb0 con 0x7fcbb0100820 2023-10-14T08:52:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.093+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fcba4022470 con 0x7fcbb0100820 2023-10-14T08:52:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.093+0000 7fcbacff9700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb980a1510 0x7fcb980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.093+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcba40ce340 con 0x7fcbb0100820 2023-10-14T08:52:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.093+0000 7fcbaf7fe700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb980a1510 0x7fcb980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.094+0000 7fcbaf7fe700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb980a1510 0x7fcb980a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcba0005950 tx=0x7fcba000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.097+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcba4097a80 con 0x7fcbb0100820 2023-10-14T08:52:03.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.291+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbb019c720 con 0x7fcb980a1510 2023-10-14T08:52:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.303+0000 7fcbacff9700 1 -- 172.21.15.6:0/3984555330 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340345 (secure 0 0 0) 0x7fcbb019c720 con 0x7fcb980a1510 2023-10-14T08:52:03.309 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb980a1510 msgr2=0x7fcb980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb980a1510 0x7fcb980a39d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcba0005950 tx=0x7fcba000b410 comp rx=0 tx=0).stop 2023-10-14T08:52:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 msgr2=0x7fcbb0197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 0x7fcbb0197560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009990 tx=0x7fcba4009580 comp rx=0 tx=0).stop 2023-10-14T08:52:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 shutdown_connections 2023-10-14T08:52:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcb980a1510 0x7fcb980a39d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb0105e70 0x7fcbb019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbb00ffe60 0x7fcbb0197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 --2- 172.21.15.6:0/3984555330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbb0100820 0x7fcbb0197560 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 >> 172.21.15.6:0/3984555330 conn(0x7fcbb0075e00 msgr2=0x7fcbb0103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 shutdown_connections 2023-10-14T08:52:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:03.307+0000 7fcbb5b61700 1 -- 172.21.15.6:0/3984555330 wait complete. 2023-10-14T08:52:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:52:03.670 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2023-10-14T08:52:03.670 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-14T08:52:03.671 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-10-14T08:52:03.671 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-14T08:52:03.671 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2023-10-14T08:52:03.671 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2023-10-14T08:52:03.671 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-14T08:52:03.672 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-10-14T08:52:03.672 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:03 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-10-14T08:52:03.732 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2023-10-14T08:52:01.442901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656001,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":525,"num_read_kb":377,"num_write":412,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336812,"kb_used_data":12620,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605012,"statfs":{"total":1151940427776,"available":1151595532288,"internally_reserved":0,"allocated":12922880,"data_stored":7050535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":62,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003116"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943427+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:51:17.943427+0000","last_peered":"2023-10-14T08:51:17.943427+0000","last_clean":"2023-10-14T08:51:17.943427+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:51:17.943427+0000","last_undegraded":"2023-10-14T08:51:17.943427+0000","last_fullsized":"2023-10-14T08:51:17.943427+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303447+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:51:18.303447+0000","last_peered":"2023-10-14T08:51:18.303447+0000","last_clean":"2023-10-14T08:51:18.303447+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:51:18.303447+0000","last_undegraded":"2023-10-14T08:51:18.303447+0000","last_fullsized":"2023-10-14T08:51:18.303447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303393+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:51:18.303393+0000","last_peered":"2023-10-14T08:51:18.303393+0000","last_clean":"2023-10-14T08:51:18.303393+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:51:18.303393+0000","last_undegraded":"2023-10-14T08:51:18.303393+0000","last_fullsized":"2023-10-14T08:51:18.303393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303661+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:51:18.303661+0000","last_peered":"2023-10-14T08:51:18.303661+0000","last_clean":"2023-10-14T08:51:18.303661+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:51:18.303661+0000","last_undegraded":"2023-10-14T08:51:18.303661+0000","last_fullsized":"2023-10-14T08:51:18.303661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792964+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:51:17.792964+0000","last_peered":"2023-10-14T08:51:17.792964+0000","last_clean":"2023-10-14T08:51:17.792964+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:51:17.792964+0000","last_undegraded":"2023-10-14T08:51:17.792964+0000","last_fullsized":"2023-10-14T08:51:17.792964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303906+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:51:18.303906+0000","last_peered":"2023-10-14T08:51:18.303906+0000","last_clean":"2023-10-14T08:51:18.303906+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:51:18.303906+0000","last_undegraded":"2023-10-14T08:51:18.303906+0000","last_fullsized":"2023-10-14T08:51:18.303906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796977+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:51:17.796977+0000","last_peered":"2023-10-14T08:51:17.796977+0000","last_clean":"2023-10-14T08:51:17.796977+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:51:17.796977+0000","last_undegraded":"2023-10-14T08:51:17.796977+0000","last_fullsized":"2023-10-14T08:51:17.796977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864046+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:51:17.864046+0000","last_peered":"2023-10-14T08:51:17.864046+0000","last_clean":"2023-10-14T08:51:17.864046+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:51:17.864046+0000","last_undegraded":"2023-10-14T08:51:17.864046+0000","last_fullsized":"2023-10-14T08:51:17.864046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303385+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:51:18.303385+0000","last_peered":"2023-10-14T08:51:18.303385+0000","last_clean":"2023-10-14T08:51:18.303385+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:51:18.303385+0000","last_undegraded":"2023-10-14T08:51:18.303385+0000","last_fullsized":"2023-10-14T08:51:18.303385+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.304201+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:51:18.304201+0000","last_peered":"2023-10-14T08:51:18.304201+0000","last_clean":"2023-10-14T08:51:18.304201+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:51:18.304201+0000","last_undegraded":"2023-10-14T08:51:18.304201+0000","last_fullsized":"2023-10-14T08:51:18.304201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797358+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:51:17.797358+0000","last_peered":"2023-10-14T08:51:17.797358+0000","last_clean":"2023-10-14T08:51:17.797358+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:51:17.797358+0000","last_undegraded":"2023-10-14T08:51:17.797358+0000","last_fullsized":"2023-10-14T08:51:17.797358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303516+0000","last_change":"2023-10-14T08:51:16.820037+0000","last_active":"2023-10-14T08:51:18.303516+0000","last_peered":"2023-10-14T08:51:18.303516+0000","last_clean":"2023-10-14T08:51:18.303516+0000","last_became_active":"2023-10-14T08:51:16.819251+0000","last_became_peered":"2023-10-14T08:51:16.819251+0000","last_unstale":"2023-10-14T08:51:18.303516+0000","last_undegraded":"2023-10-14T08:51:18.303516+0000","last_fullsized":"2023-10-14T08:51:18.303516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:37.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792932+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:51:17.792932+0000","last_peered":"2023-10-14T08:51:17.792932+0000","last_clean":"2023-10-14T08:51:17.792932+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:51:17.792932+0000","last_undegraded":"2023-10-14T08:51:17.792932+0000","last_fullsized":"2023-10-14T08:51:17.792932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302685+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:51:18.302685+0000","last_peered":"2023-10-14T08:51:18.302685+0000","last_clean":"2023-10-14T08:51:18.302685+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:51:18.302685+0000","last_undegraded":"2023-10-14T08:51:18.302685+0000","last_fullsized":"2023-10-14T08:51:18.302685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302848+0000","last_change":"2023-10-14T08:51:16.819942+0000","last_active":"2023-10-14T08:51:18.302848+0000","last_peered":"2023-10-14T08:51:18.302848+0000","last_clean":"2023-10-14T08:51:18.302848+0000","last_became_active":"2023-10-14T08:51:16.819615+0000","last_became_peered":"2023-10-14T08:51:16.819615+0000","last_unstale":"2023-10-14T08:51:18.302848+0000","last_undegraded":"2023-10-14T08:51:18.302848+0000","last_fullsized":"2023-10-14T08:51:18.302848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:10.523238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302489+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:51:18.302489+0000","last_peered":"2023-10-14T08:51:18.302489+0000","last_clean":"2023-10-14T08:51:18.302489+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:51:18.302489+0000","last_undegraded":"2023-10-14T08:51:18.302489+0000","last_fullsized":"2023-10-14T08:51:18.302489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943598+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:51:17.943598+0000","last_peered":"2023-10-14T08:51:17.943598+0000","last_clean":"2023-10-14T08:51:17.943598+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:51:17.943598+0000","last_undegraded":"2023-10-14T08:51:17.943598+0000","last_fullsized":"2023-10-14T08:51:17.943598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302614+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:51:18.302614+0000","last_peered":"2023-10-14T08:51:18.302614+0000","last_clean":"2023-10-14T08:51:18.302614+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:51:18.302614+0000","last_undegraded":"2023-10-14T08:51:18.302614+0000","last_fullsized":"2023-10-14T08:51:18.302614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302553+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:51:18.302553+0000","last_peered":"2023-10-14T08:51:18.302553+0000","last_clean":"2023-10-14T08:51:18.302553+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:51:18.302553+0000","last_undegraded":"2023-10-14T08:51:18.302553+0000","last_fullsized":"2023-10-14T08:51:18.302553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.220234+0000","last_change":"2023-10-14T08:51:15.861680+0000","last_active":"2023-10-14T08:51:59.220234+0000","last_peered":"2023-10-14T08:51:59.220234+0000","last_clean":"2023-10-14T08:51:59.220234+0000","last_became_active":"2023-10-14T08:51:15.861353+0000","last_became_peered":"2023-10-14T08:51:15.861353+0000","last_unstale":"2023-10-14T08:51:59.220234+0000","last_undegraded":"2023-10-14T08:51:59.220234+0000","last_fullsized":"2023-10-14T08:51:59.220234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:40:24.320642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864587+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:51:17.864587+0000","last_peered":"2023-10-14T08:51:17.864587+0000","last_clean":"2023-10-14T08:51:17.864587+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:51:17.864587+0000","last_undegraded":"2023-10-14T08:51:17.864587+0000","last_fullsized":"2023-10-14T08:51:17.864587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582821+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:51:18.582821+0000","last_peered":"2023-10-14T08:51:18.582821+0000","last_clean":"2023-10-14T08:51:18.582821+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:51:18.582821+0000","last_undegraded":"2023-10-14T08:51:18.582821+0000","last_fullsized":"2023-10-14T08:51:18.582821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303619+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:51:18.303619+0000","last_peered":"2023-10-14T08:51:18.303619+0000","last_clean":"2023-10-14T08:51:18.303619+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:51:18.303619+0000","last_undegraded":"2023-10-14T08:51:18.303619+0000","last_fullsized":"2023-10-14T08:51:18.303619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:24.166708+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:51:24.166708+0000","last_peered":"2023-10-14T08:51:24.166708+0000","last_clean":"2023-10-14T08:51:24.166708+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:51:24.166708+0000","last_undegraded":"2023-10-14T08:51:24.166708+0000","last_fullsized":"2023-10-14T08:51:24.166708+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303392+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:51:18.303392+0000","last_peered":"2023-10-14T08:51:18.303392+0000","last_clean":"2023-10-14T08:51:18.303392+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:51:18.303392+0000","last_undegraded":"2023-10-14T08:51:18.303392+0000","last_fullsized":"2023-10-14T08:51:18.303392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.152590+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:51:23.152590+0000","last_peered":"2023-10-14T08:51:23.152590+0000","last_clean":"2023-10-14T08:51:23.152590+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:51:23.152590+0000","last_undegraded":"2023-10-14T08:51:23.152590+0000","last_fullsized":"2023-10-14T08:51:23.152590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802533+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:51:17.802533+0000","last_peered":"2023-10-14T08:51:17.802533+0000","last_clean":"2023-10-14T08:51:17.802533+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:51:17.802533+0000","last_undegraded":"2023-10-14T08:51:17.802533+0000","last_fullsized":"2023-10-14T08:51:17.802533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:55.161743+0000","last_change":"2023-10-14T08:51:15.860943+0000","last_active":"2023-10-14T08:51:55.161743+0000","last_peered":"2023-10-14T08:51:55.161743+0000","last_clean":"2023-10-14T08:51:55.161743+0000","last_became_active":"2023-10-14T08:51:15.860636+0000","last_became_peered":"2023-10-14T08:51:15.860636+0000","last_unstale":"2023-10-14T08:51:55.161743+0000","last_undegraded":"2023-10-14T08:51:55.161743+0000","last_fullsized":"2023-10-14T08:51:55.161743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:36.037274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792973+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:51:17.792973+0000","last_peered":"2023-10-14T08:51:17.792973+0000","last_clean":"2023-10-14T08:51:17.792973+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:51:17.792973+0000","last_undegraded":"2023-10-14T08:51:17.792973+0000","last_fullsized":"2023-10-14T08:51:17.792973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.146343+0000","last_change":"2023-10-14T08:51:15.864182+0000","last_active":"2023-10-14T08:51:22.146343+0000","last_peered":"2023-10-14T08:51:22.146343+0000","last_clean":"2023-10-14T08:51:22.146343+0000","last_became_active":"2023-10-14T08:51:15.863841+0000","last_became_peered":"2023-10-14T08:51:15.863841+0000","last_unstale":"2023-10-14T08:51:22.146343+0000","last_undegraded":"2023-10-14T08:51:22.146343+0000","last_fullsized":"2023-10-14T08:51:22.146343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:21.974223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802079+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:51:17.802079+0000","last_peered":"2023-10-14T08:51:17.802079+0000","last_clean":"2023-10-14T08:51:17.802079+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:51:17.802079+0000","last_undegraded":"2023-10-14T08:51:17.802079+0000","last_fullsized":"2023-10-14T08:51:17.802079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.116317+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:51:21.116317+0000","last_peered":"2023-10-14T08:51:21.116317+0000","last_clean":"2023-10-14T08:51:21.116317+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:51:21.116317+0000","last_undegraded":"2023-10-14T08:51:21.116317+0000","last_fullsized":"2023-10-14T08:51:21.116317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864335+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:51:17.864335+0000","last_peered":"2023-10-14T08:51:17.864335+0000","last_clean":"2023-10-14T08:51:17.864335+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:51:17.864335+0000","last_undegraded":"2023-10-14T08:51:17.864335+0000","last_fullsized":"2023-10-14T08:51:17.864335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153455+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:51:23.153455+0000","last_peered":"2023-10-14T08:51:23.153455+0000","last_clean":"2023-10-14T08:51:23.153455+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:51:23.153455+0000","last_undegraded":"2023-10-14T08:51:23.153455+0000","last_fullsized":"2023-10-14T08:51:23.153455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302706+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:51:18.302706+0000","last_peered":"2023-10-14T08:51:18.302706+0000","last_clean":"2023-10-14T08:51:18.302706+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:51:18.302706+0000","last_undegraded":"2023-10-14T08:51:18.302706+0000","last_fullsized":"2023-10-14T08:51:18.302706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:56.162587+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:51:56.162587+0000","last_peered":"2023-10-14T08:51:56.162587+0000","last_clean":"2023-10-14T08:51:56.162587+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:51:56.162587+0000","last_undegraded":"2023-10-14T08:51:56.162587+0000","last_fullsized":"2023-10-14T08:51:56.162587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302765+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:51:18.302765+0000","last_peered":"2023-10-14T08:51:18.302765+0000","last_clean":"2023-10-14T08:51:18.302765+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:51:18.302765+0000","last_undegraded":"2023-10-14T08:51:18.302765+0000","last_fullsized":"2023-10-14T08:51:18.302765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153374+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:51:23.153374+0000","last_peered":"2023-10-14T08:51:23.153374+0000","last_clean":"2023-10-14T08:51:23.153374+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:51:23.153374+0000","last_undegraded":"2023-10-14T08:51:23.153374+0000","last_fullsized":"2023-10-14T08:51:23.153374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303623+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:51:18.303623+0000","last_peered":"2023-10-14T08:51:18.303623+0000","last_clean":"2023-10-14T08:51:18.303623+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:51:18.303623+0000","last_undegraded":"2023-10-14T08:51:18.303623+0000","last_fullsized":"2023-10-14T08:51:18.303623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.105721+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:51:21.105721+0000","last_peered":"2023-10-14T08:51:21.105721+0000","last_clean":"2023-10-14T08:51:21.105721+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:51:21.105721+0000","last_undegraded":"2023-10-14T08:51:21.105721+0000","last_fullsized":"2023-10-14T08:51:21.105721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303602+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:51:18.303602+0000","last_peered":"2023-10-14T08:51:18.303602+0000","last_clean":"2023-10-14T08:51:18.303602+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:51:18.303602+0000","last_undegraded":"2023-10-14T08:51:18.303602+0000","last_fullsized":"2023-10-14T08:51:18.303602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:56.167734+0000","last_change":"2023-10-14T08:51:15.865840+0000","last_active":"2023-10-14T08:51:56.167734+0000","last_peered":"2023-10-14T08:51:56.167734+0000","last_clean":"2023-10-14T08:51:56.167734+0000","last_became_active":"2023-10-14T08:51:15.865393+0000","last_became_peered":"2023-10-14T08:51:15.865393+0000","last_unstale":"2023-10-14T08:51:56.167734+0000","last_undegraded":"2023-10-14T08:51:56.167734+0000","last_fullsized":"2023-10-14T08:51:56.167734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:02:17.524700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":96,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.793227+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:51:17.793227+0000","last_peered":"2023-10-14T08:51:17.793227+0000","last_clean":"2023-10-14T08:51:17.793227+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:51:17.793227+0000","last_undegraded":"2023-10-14T08:51:17.793227+0000","last_fullsized":"2023-10-14T08:51:17.793227+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.151843+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:51:23.151843+0000","last_peered":"2023-10-14T08:51:23.151843+0000","last_clean":"2023-10-14T08:51:23.151843+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:51:23.151843+0000","last_undegraded":"2023-10-14T08:51:23.151843+0000","last_fullsized":"2023-10-14T08:51:23.151843+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792895+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:51:17.792895+0000","last_peered":"2023-10-14T08:51:17.792895+0000","last_clean":"2023-10-14T08:51:17.792895+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:51:17.792895+0000","last_undegraded":"2023-10-14T08:51:17.792895+0000","last_fullsized":"2023-10-14T08:51:17.792895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153461+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:51:23.153461+0000","last_peered":"2023-10-14T08:51:23.153461+0000","last_clean":"2023-10-14T08:51:23.153461+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:51:23.153461+0000","last_undegraded":"2023-10-14T08:51:23.153461+0000","last_fullsized":"2023-10-14T08:51:23.153461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797419+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:51:17.797419+0000","last_peered":"2023-10-14T08:51:17.797419+0000","last_clean":"2023-10-14T08:51:17.797419+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:51:17.797419+0000","last_undegraded":"2023-10-14T08:51:17.797419+0000","last_fullsized":"2023-10-14T08:51:17.797419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.223265+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:51:59.223265+0000","last_peered":"2023-10-14T08:51:59.223265+0000","last_clean":"2023-10-14T08:51:59.223265+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:51:59.223265+0000","last_undegraded":"2023-10-14T08:51:59.223265+0000","last_fullsized":"2023-10-14T08:51:59.223265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796933+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:51:17.796933+0000","last_peered":"2023-10-14T08:51:17.796933+0000","last_clean":"2023-10-14T08:51:17.796933+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:51:17.796933+0000","last_undegraded":"2023-10-14T08:51:17.796933+0000","last_fullsized":"2023-10-14T08:51:17.796933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.151078+0000","last_change":"2023-10-14T08:51:15.858977+0000","last_active":"2023-10-14T08:51:23.151078+0000","last_peered":"2023-10-14T08:51:23.151078+0000","last_clean":"2023-10-14T08:51:23.151078+0000","last_became_active":"2023-10-14T08:51:15.858670+0000","last_became_peered":"2023-10-14T08:51:15.858670+0000","last_unstale":"2023-10-14T08:51:23.151078+0000","last_undegraded":"2023-10-14T08:51:23.151078+0000","last_fullsized":"2023-10-14T08:51:23.151078+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:08:34.002214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801980+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:51:17.801980+0000","last_peered":"2023-10-14T08:51:17.801980+0000","last_clean":"2023-10-14T08:51:17.801980+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:51:17.801980+0000","last_undegraded":"2023-10-14T08:51:17.801980+0000","last_fullsized":"2023-10-14T08:51:17.801980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.102259+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:51:21.102259+0000","last_peered":"2023-10-14T08:51:21.102259+0000","last_clean":"2023-10-14T08:51:21.102259+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:51:21.102259+0000","last_undegraded":"2023-10-14T08:51:21.102259+0000","last_fullsized":"2023-10-14T08:51:21.102259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943453+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:51:17.943453+0000","last_peered":"2023-10-14T08:51:17.943453+0000","last_clean":"2023-10-14T08:51:17.943453+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:51:17.943453+0000","last_undegraded":"2023-10-14T08:51:17.943453+0000","last_fullsized":"2023-10-14T08:51:17.943453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302537+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:51:18.302537+0000","last_peered":"2023-10-14T08:51:18.302537+0000","last_clean":"2023-10-14T08:51:18.302537+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:51:18.302537+0000","last_undegraded":"2023-10-14T08:51:18.302537+0000","last_fullsized":"2023-10-14T08:51:18.302537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303927+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:51:18.303927+0000","last_peered":"2023-10-14T08:51:18.303927+0000","last_clean":"2023-10-14T08:51:18.303927+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:51:18.303927+0000","last_undegraded":"2023-10-14T08:51:18.303927+0000","last_fullsized":"2023-10-14T08:51:18.303927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.220949+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:51:59.220949+0000","last_peered":"2023-10-14T08:51:59.220949+0000","last_clean":"2023-10-14T08:51:59.220949+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:51:59.220949+0000","last_undegraded":"2023-10-14T08:51:59.220949+0000","last_fullsized":"2023-10-14T08:51:59.220949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303951+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:51:18.303951+0000","last_peered":"2023-10-14T08:51:18.303951+0000","last_clean":"2023-10-14T08:51:18.303951+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:51:18.303951+0000","last_undegraded":"2023-10-14T08:51:18.303951+0000","last_fullsized":"2023-10-14T08:51:18.303951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801911+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:51:17.801911+0000","last_peered":"2023-10-14T08:51:17.801911+0000","last_clean":"2023-10-14T08:51:17.801911+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:51:17.801911+0000","last_undegraded":"2023-10-14T08:51:17.801911+0000","last_fullsized":"2023-10-14T08:51:17.801911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:58.221305+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:51:58.221305+0000","last_peered":"2023-10-14T08:51:58.221305+0000","last_clean":"2023-10-14T08:51:58.221305+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:51:58.221305+0000","last_undegraded":"2023-10-14T08:51:58.221305+0000","last_fullsized":"2023-10-14T08:51:58.221305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864286+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:51:17.864286+0000","last_peered":"2023-10-14T08:51:17.864286+0000","last_clean":"2023-10-14T08:51:17.864286+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:51:17.864286+0000","last_undegraded":"2023-10-14T08:51:17.864286+0000","last_fullsized":"2023-10-14T08:51:17.864286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:24.165708+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:51:24.165708+0000","last_peered":"2023-10-14T08:51:24.165708+0000","last_clean":"2023-10-14T08:51:24.165708+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:51:24.165708+0000","last_undegraded":"2023-10-14T08:51:24.165708+0000","last_fullsized":"2023-10-14T08:51:24.165708+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.805425+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:51:16.805425+0000","last_peered":"2023-10-14T08:51:16.805425+0000","last_clean":"2023-10-14T08:51:16.805425+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:51:16.805425+0000","last_undegraded":"2023-10-14T08:51:16.805425+0000","last_fullsized":"2023-10-14T08:51:16.805425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792905+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:51:17.792905+0000","last_peered":"2023-10-14T08:51:17.792905+0000","last_clean":"2023-10-14T08:51:17.792905+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:51:17.792905+0000","last_undegraded":"2023-10-14T08:51:17.792905+0000","last_fullsized":"2023-10-14T08:51:17.792905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.115539+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:51:21.115539+0000","last_peered":"2023-10-14T08:51:21.115539+0000","last_clean":"2023-10-14T08:51:21.115539+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:51:21.115539+0000","last_undegraded":"2023-10-14T08:51:21.115539+0000","last_fullsized":"2023-10-14T08:51:21.115539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.144167+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:51:22.144167+0000","last_peered":"2023-10-14T08:51:22.144167+0000","last_clean":"2023-10-14T08:51:22.144167+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:51:22.144167+0000","last_undegraded":"2023-10-14T08:51:22.144167+0000","last_fullsized":"2023-10-14T08:51:22.144167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792944+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:51:17.792944+0000","last_peered":"2023-10-14T08:51:17.792944+0000","last_clean":"2023-10-14T08:51:17.792944+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:51:17.792944+0000","last_undegraded":"2023-10-14T08:51:17.792944+0000","last_fullsized":"2023-10-14T08:51:17.792944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:25.066547+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:51:25.066547+0000","last_peered":"2023-10-14T08:51:25.066547+0000","last_clean":"2023-10-14T08:51:25.066547+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:51:25.066547+0000","last_undegraded":"2023-10-14T08:51:25.066547+0000","last_fullsized":"2023-10-14T08:51:25.066547+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864409+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:51:17.864409+0000","last_peered":"2023-10-14T08:51:17.864409+0000","last_clean":"2023-10-14T08:51:17.864409+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:51:17.864409+0000","last_undegraded":"2023-10-14T08:51:17.864409+0000","last_fullsized":"2023-10-14T08:51:17.864409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153258+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:51:23.153258+0000","last_peered":"2023-10-14T08:51:23.153258+0000","last_clean":"2023-10-14T08:51:23.153258+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:51:23.153258+0000","last_undegraded":"2023-10-14T08:51:23.153258+0000","last_fullsized":"2023-10-14T08:51:23.153258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303483+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:51:18.303483+0000","last_peered":"2023-10-14T08:51:18.303483+0000","last_clean":"2023-10-14T08:51:18.303483+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:51:18.303483+0000","last_undegraded":"2023-10-14T08:51:18.303483+0000","last_fullsized":"2023-10-14T08:51:18.303483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.130834+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:51:20.130834+0000","last_peered":"2023-10-14T08:51:20.130834+0000","last_clean":"2023-10-14T08:51:20.130834+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:51:20.130834+0000","last_undegraded":"2023-10-14T08:51:20.130834+0000","last_fullsized":"2023-10-14T08:51:20.130834+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792916+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:51:17.792916+0000","last_peered":"2023-10-14T08:51:17.792916+0000","last_clean":"2023-10-14T08:51:17.792916+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:51:17.792916+0000","last_undegraded":"2023-10-14T08:51:17.792916+0000","last_fullsized":"2023-10-14T08:51:17.792916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.150634+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:51:23.150634+0000","last_peered":"2023-10-14T08:51:23.150634+0000","last_clean":"2023-10-14T08:51:23.150634+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:51:23.150634+0000","last_undegraded":"2023-10-14T08:51:23.150634+0000","last_fullsized":"2023-10-14T08:51:23.150634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943214+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:51:17.943214+0000","last_peered":"2023-10-14T08:51:17.943214+0000","last_clean":"2023-10-14T08:51:17.943214+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:51:17.943214+0000","last_undegraded":"2023-10-14T08:51:17.943214+0000","last_fullsized":"2023-10-14T08:51:17.943214+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.145536+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:51:22.145536+0000","last_peered":"2023-10-14T08:51:22.145536+0000","last_clean":"2023-10-14T08:51:22.145536+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:51:22.145536+0000","last_undegraded":"2023-10-14T08:51:22.145536+0000","last_fullsized":"2023-10-14T08:51:22.145536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864192+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:51:17.864192+0000","last_peered":"2023-10-14T08:51:17.864192+0000","last_clean":"2023-10-14T08:51:17.864192+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:51:17.864192+0000","last_undegraded":"2023-10-14T08:51:17.864192+0000","last_fullsized":"2023-10-14T08:51:17.864192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:20.131102+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:51:20.131102+0000","last_peered":"2023-10-14T08:51:20.131102+0000","last_clean":"2023-10-14T08:51:20.131102+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:51:20.131102+0000","last_undegraded":"2023-10-14T08:51:20.131102+0000","last_fullsized":"2023-10-14T08:51:20.131102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797314+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:51:17.797314+0000","last_peered":"2023-10-14T08:51:17.797314+0000","last_clean":"2023-10-14T08:51:17.797314+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:51:17.797314+0000","last_undegraded":"2023-10-14T08:51:17.797314+0000","last_fullsized":"2023-10-14T08:51:17.797314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.223404+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:51:59.223404+0000","last_peered":"2023-10-14T08:51:59.223404+0000","last_clean":"2023-10-14T08:51:59.223404+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:51:59.223404+0000","last_undegraded":"2023-10-14T08:51:59.223404+0000","last_fullsized":"2023-10-14T08:51:59.223404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797434+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:51:17.797434+0000","last_peered":"2023-10-14T08:51:17.797434+0000","last_clean":"2023-10-14T08:51:17.797434+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:51:17.797434+0000","last_undegraded":"2023-10-14T08:51:17.797434+0000","last_fullsized":"2023-10-14T08:51:17.797434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.144805+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:51:22.144805+0000","last_peered":"2023-10-14T08:51:22.144805+0000","last_clean":"2023-10-14T08:51:22.144805+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:51:22.144805+0000","last_undegraded":"2023-10-14T08:51:22.144805+0000","last_fullsized":"2023-10-14T08:51:22.144805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797173+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:51:17.797173+0000","last_peered":"2023-10-14T08:51:17.797173+0000","last_clean":"2023-10-14T08:51:17.797173+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:51:17.797173+0000","last_undegraded":"2023-10-14T08:51:17.797173+0000","last_fullsized":"2023-10-14T08:51:17.797173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.149325+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:51:23.149325+0000","last_peered":"2023-10-14T08:51:23.149325+0000","last_clean":"2023-10-14T08:51:23.149325+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:51:23.149325+0000","last_undegraded":"2023-10-14T08:51:23.149325+0000","last_fullsized":"2023-10-14T08:51:23.149325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797270+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:51:17.797270+0000","last_peered":"2023-10-14T08:51:17.797270+0000","last_clean":"2023-10-14T08:51:17.797270+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:51:17.797270+0000","last_undegraded":"2023-10-14T08:51:17.797270+0000","last_fullsized":"2023-10-14T08:51:17.797270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943306+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:51:17.943306+0000","last_peered":"2023-10-14T08:51:17.943306+0000","last_clean":"2023-10-14T08:51:17.943306+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:51:17.943306+0000","last_undegraded":"2023-10-14T08:51:17.943306+0000","last_fullsized":"2023-10-14T08:51:17.943306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302480+0000","last_change":"2023-10-14T08:51:16.819726+0000","last_active":"2023-10-14T08:51:18.302480+0000","last_peered":"2023-10-14T08:51:18.302480+0000","last_clean":"2023-10-14T08:51:18.302480+0000","last_became_active":"2023-10-14T08:51:16.819393+0000","last_became_peered":"2023-10-14T08:51:16.819393+0000","last_unstale":"2023-10-14T08:51:18.302480+0000","last_undegraded":"2023-10-14T08:51:18.302480+0000","last_fullsized":"2023-10-14T08:51:18.302480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:21:29.169157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302481+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:51:18.302481+0000","last_peered":"2023-10-14T08:51:18.302481+0000","last_clean":"2023-10-14T08:51:18.302481+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:51:18.302481+0000","last_undegraded":"2023-10-14T08:51:18.302481+0000","last_fullsized":"2023-10-14T08:51:18.302481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303321+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:51:18.303321+0000","last_peered":"2023-10-14T08:51:18.303321+0000","last_clean":"2023-10-14T08:51:18.303321+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:51:18.303321+0000","last_undegraded":"2023-10-14T08:51:18.303321+0000","last_fullsized":"2023-10-14T08:51:18.303321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792805+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:51:17.792805+0000","last_peered":"2023-10-14T08:51:17.792805+0000","last_clean":"2023-10-14T08:51:17.792805+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:51:17.792805+0000","last_undegraded":"2023-10-14T08:51:17.792805+0000","last_fullsized":"2023-10-14T08:51:17.792805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943505+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:51:17.943505+0000","last_peered":"2023-10-14T08:51:17.943505+0000","last_clean":"2023-10-14T08:51:17.943505+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:51:17.943505+0000","last_undegraded":"2023-10-14T08:51:17.943505+0000","last_fullsized":"2023-10-14T08:51:17.943505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302783+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:51:18.302783+0000","last_peered":"2023-10-14T08:51:18.302783+0000","last_clean":"2023-10-14T08:51:18.302783+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:51:18.302783+0000","last_undegraded":"2023-10-14T08:51:18.302783+0000","last_fullsized":"2023-10-14T08:51:18.302783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864305+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:51:17.864305+0000","last_peered":"2023-10-14T08:51:17.864305+0000","last_clean":"2023-10-14T08:51:17.864305+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:51:17.864305+0000","last_undegraded":"2023-10-14T08:51:17.864305+0000","last_fullsized":"2023-10-14T08:51:17.864305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801856+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:51:17.801856+0000","last_peered":"2023-10-14T08:51:17.801856+0000","last_clean":"2023-10-14T08:51:17.801856+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:51:17.801856+0000","last_undegraded":"2023-10-14T08:51:17.801856+0000","last_fullsized":"2023-10-14T08:51:17.801856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.864142+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:51:17.864142+0000","last_peered":"2023-10-14T08:51:17.864142+0000","last_clean":"2023-10-14T08:51:17.864142+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:51:17.864142+0000","last_undegraded":"2023-10-14T08:51:17.864142+0000","last_fullsized":"2023-10-14T08:51:17.864142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302890+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:51:18.302890+0000","last_peered":"2023-10-14T08:51:18.302890+0000","last_clean":"2023-10-14T08:51:18.302890+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:51:18.302890+0000","last_undegraded":"2023-10-14T08:51:18.302890+0000","last_fullsized":"2023-10-14T08:51:18.302890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.792899+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:51:17.792899+0000","last_peered":"2023-10-14T08:51:17.792899+0000","last_clean":"2023-10-14T08:51:17.792899+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:51:17.792899+0000","last_undegraded":"2023-10-14T08:51:17.792899+0000","last_fullsized":"2023-10-14T08:51:17.792899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.943304+0000","last_change":"2023-10-14T08:51:16.823067+0000","last_active":"2023-10-14T08:51:17.943304+0000","last_peered":"2023-10-14T08:51:17.943304+0000","last_clean":"2023-10-14T08:51:17.943304+0000","last_became_active":"2023-10-14T08:51:16.822703+0000","last_became_peered":"2023-10-14T08:51:16.822703+0000","last_unstale":"2023-10-14T08:51:17.943304+0000","last_undegraded":"2023-10-14T08:51:17.943304+0000","last_fullsized":"2023-10-14T08:51:17.943304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:55:57.159977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65387,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":399,"num_read_kb":268,"num_write":229,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":196161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481813,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":424870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53500000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.68700000000000006}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":9,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.67100000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.753},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.81100000000000005}]}]},{"osd":10,"up_from":69,"seq":296352743448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1074539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66600000000000004}]},{"osd":2,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.80300000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.83899999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.745}]},{"osd":5,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.94699999999999995}]},{"osd":6,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.044}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":1.147},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":1.028}]},{"osd":9,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.91100000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:51:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.1120000000000001}]}]},{"osd":9,"up_from":64,"seq":274877906973,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":424800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68999999999999995,"15min":0.67400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83499999999999996,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.595,"15min":1.595},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0900000000000001,"5min":1.532,"15min":1.532},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.628}]},{"osd":6,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.373},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.434}]},{"osd":7,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.85999999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.01,"5min":1.466,"15min":1.466},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.69499999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.85399999999999998,"15min":0.84499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83899999999999997,"15min":0.85799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0629999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.55000000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73899999999999999}]}]},{"osd":8,"up_from":57,"seq":244813135906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":425178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79700000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53600000000000003}]},{"osd":1,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.5}]},{"osd":2,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67300000000000004}]},{"osd":3,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79200000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.754},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95899999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79000000000000004}]},{"osd":7,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.119,"15min":1.119},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72299999999999998,"15min":0.71099999999999997},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.81399999999999995}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.84799999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.879}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1017701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.624},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.67400000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.874,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70699999999999996}]},{"osd":6,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89700000000000002}]},{"osd":8,"last update":"Sat Oct 14 08:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.503,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.095,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81899999999999995}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.034,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.411,"15min":1.411},"last":0.94499999999999995}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":424523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42099999999999999,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.42799999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.55500000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64800000000000002,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.72599999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.81200000000000006}]},{"osd":8,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.745},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.68799999999999994}]},{"osd":9,"last update":"Sat Oct 14 08:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.8700000000000001,"5min":3.8700000000000001,"15min":3.8700000000000001},"last":0.84399999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.78000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":483732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.50900000000000001,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.504},"min":{"1min":0.34599999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91700000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60799999999999998,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.196,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.46800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.87,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.628},{"interface":"front","average":{"1min":0.628,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.84599999999999997}]},{"osd":5,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93100000000000005,"5min":1.397,"15min":1.397},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.52300000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.01,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.89000000000000001}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.93200000000000005}]},{"osd":7,"last update":"Sat Oct 14 08:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.441,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.089,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.996}]},{"osd":8,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.74199999999999999},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.085},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.73499999999999999,"15min":0.71799999999999997},"min":{"1min":0.58699999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.95599999999999996}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1739999999999999,"5min":1.194,"15min":1.194},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.873}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.032}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":425856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57899999999999996,"15min":0.54200000000000004},"min":{"1min":0.45800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48799999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.504}]},{"osd":6,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45400000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52100000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.53200000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56499999999999995}]},{"osd":11,"last update":"Sat Oct 14 08:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":483556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.48299999999999998},"min":{"1min":0.376,"5min":0.317,"15min":0.317},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Oct 14 08:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:51:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Oct 14 08:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47999999999999998,"15min":0.46899999999999997},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.745},{"interface":"front","average":{"1min":0.5,"5min":0.47499999999999998,"15min":0.46999999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70799999999999996}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.83799999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.94299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":424354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.39200000000000002,"15min":0.35499999999999998},"min":{"1min":0.28799999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.47699999999999998,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.63900000000000001,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.68700000000000006}]},{"osd":2,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.70199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.746,"5min":11.746,"15min":11.746},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59599999999999997,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.751}]},{"osd":5,"last update":"Sat Oct 14 08:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.77700000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.69599999999999995,"15min":0.61599999999999999},"min":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":12.414,"5min":12.414,"15min":12.414},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.872,"15min":0.81200000000000006},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.164,"5min":12.164,"15min":12.164},"last":0.61899999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":424768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.39400000000000002,"15min":0.36799999999999999},"min":{"1min":0.34999999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.33700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Sat Oct 14 08:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.63100000000000001,"15min":0.58099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.54300000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.79000000000000004}]},{"osd":8,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.81799999999999995,"15min":0.80600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.97599999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.0129999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.048},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.0049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1016658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.503},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.443}]},{"osd":1,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.88},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.55700000000000005,"15min":0.53200000000000003},"min":{"1min":0.45000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.627}]},{"osd":2,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39300000000000002,"15min":0.38100000000000001},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.53600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.755}]},{"osd":8,"last update":"Sat Oct 14 08:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.81399999999999995}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78900000000000003}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.3559999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.82899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:52:03.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph pg dump --format=json 2023-10-14T08:52:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2023-10-14T08:52:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-14T08:52:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-10-14T08:52:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-14T08:52:03.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2023-10-14T08:52:03.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2023-10-14T08:52:03.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-14T08:52:03.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-10-14T08:52:03.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:03 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-10-14T08:52:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2023-10-14T08:52:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-10-14T08:52:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-10-14T08:52:03.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]: dispatch 2023-10-14T08:52:03.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2023-10-14T08:52:03.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2023-10-14T08:52:03.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2023-10-14T08:52:03.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2023-10-14T08:52:03.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:03 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2023-10-14T08:52:04.309 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:04.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:04.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: pgmap v282: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-14T08:52:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2023-10-14T08:52:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-14T08:52:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-10-14T08:52:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-14T08:52:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2023-10-14T08:52:04.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2023-10-14T08:52:04.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-14T08:52:04.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-10-14T08:52:04.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-10-14T08:52:04.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: osdmap e83: 12 total, 12 up, 12 in 2023-10-14T08:52:04.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:04 smithi006 ceph-mon[99452]: osdmap e84: 12 total, 12 up, 12 in 2023-10-14T08:52:04.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:04.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: pgmap v282: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-14T08:52:04.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2023-10-14T08:52:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-14T08:52:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-10-14T08:52:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-14T08:52:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2023-10-14T08:52:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2023-10-14T08:52:04.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-14T08:52:04.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-10-14T08:52:04.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-10-14T08:52:04.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: osdmap e83: 12 total, 12 up, 12 in 2023-10-14T08:52:04.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:04 smithi178 ceph-mon[103612]: osdmap e84: 12 total, 12 up, 12 in 2023-10-14T08:52:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: pgmap v282: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-14T08:52:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2023-10-14T08:52:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-10-14T08:52:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-10-14T08:52:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 1]}]': finished 2023-10-14T08:52:04.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2023-10-14T08:52:04.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2023-10-14T08:52:04.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2023-10-14T08:52:04.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2023-10-14T08:52:04.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2023-10-14T08:52:04.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: osdmap e83: 12 total, 12 up, 12 in 2023-10-14T08:52:04.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:04 smithi057 ceph-mon[103313]: osdmap e84: 12 total, 12 up, 12 in 2023-10-14T08:52:05.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 -- 172.21.15.6:0/3751832638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4100f80 msgr2=0x7f9ef4101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/3751832638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4100f80 0x7f9ef4101400 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80099c0 tx=0x7f9ee8009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 -- 172.21.15.6:0/3751832638 shutdown_connections 2023-10-14T08:52:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/3751832638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef4101940 0x7f9ef410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/3751832638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef4106f90 0x7f9ef4107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/3751832638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4100f80 0x7f9ef4101400 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.509+0000 7f9efa6fc700 1 -- 172.21.15.6:0/3751832638 >> 172.21.15.6:0/3751832638 conn(0x7f9ef40780a0 msgr2=0x7f9ef40784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:05.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.510+0000 7f9efa6fc700 1 -- 172.21.15.6:0/3751832638 shutdown_connections 2023-10-14T08:52:05.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.510+0000 7f9efa6fc700 1 -- 172.21.15.6:0/3751832638 wait complete. 2023-10-14T08:52:05.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.510+0000 7f9efa6fc700 1 Processor -- start 2023-10-14T08:52:05.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.510+0000 7f9efa6fc700 1 -- start start 2023-10-14T08:52:05.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9efa6fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef4100f80 0x7f9ef41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:05.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9efa6fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef4101940 0x7f9ef41975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:05.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9efa6fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 0x7f9ef419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:05.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9efa6fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef419c070 con 0x7f9ef4106f90 2023-10-14T08:52:05.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9efa6fc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef419c1e0 con 0x7f9ef4100f80 2023-10-14T08:52:05.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9efa6fc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef419c3a0 con 0x7f9ef4101940 2023-10-14T08:52:05.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 0x7f9ef419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:05.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 0x7f9ef419ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59976/0 (socket says 172.21.15.6:59976) 2023-10-14T08:52:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 -- 172.21.15.6:0/1974893676 learned_addr learned my addr 172.21.15.6:0/1974893676 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef37fe700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef4101940 0x7f9ef41975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef3fff700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef4100f80 0x7f9ef41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 -- 172.21.15.6:0/1974893676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef4101940 msgr2=0x7f9ef41975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:05.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef4101940 0x7f9ef41975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 -- 172.21.15.6:0/1974893676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef4100f80 msgr2=0x7f9ef41970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:05.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef4100f80 0x7f9ef41970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.511+0000 7f9ef8c99700 1 -- 172.21.15.6:0/1974893676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80095f0 con 0x7f9ef4106f90 2023-10-14T08:52:05.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.512+0000 7f9ef8c99700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 0x7f9ef419ba60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00b9e0 tx=0x7f9eec00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:05.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.512+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00d8e0 con 0x7f9ef4106f90 2023-10-14T08:52:05.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.512+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9eec015420 con 0x7f9ef4106f90 2023-10-14T08:52:05.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.512+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef419c680 con 0x7f9ef4106f90 2023-10-14T08:52:05.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.512+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec014630 con 0x7f9ef4106f90 2023-10-14T08:52:05.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.512+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef41a3ee0 con 0x7f9ef4106f90 2023-10-14T08:52:05.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.513+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef404ebb0 con 0x7f9ef4106f90 2023-10-14T08:52:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.514+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f9eec015590 con 0x7f9ef4106f90 2023-10-14T08:52:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.515+0000 7f9ef17fa700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9edc0a1590 0x7f9edc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.515+0000 7f9ef3fff700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9edc0a1590 0x7f9edc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.515+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9eec011070 con 0x7f9ef4106f90 2023-10-14T08:52:05.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.515+0000 7f9ef3fff700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9edc0a1590 0x7f9edc0a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006fd0 tx=0x7f9ee4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:05.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.519+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9eec04f100 con 0x7f9ef4106f90 2023-10-14T08:52:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.714+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ef4111060 con 0x7f9edc0a1590 2023-10-14T08:52:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.726+0000 7f9ef17fa700 1 -- 172.21.15.6:0/1974893676 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340593 (secure 0 0 0) 0x7f9ef4111060 con 0x7f9edc0a1590 2023-10-14T08:52:05.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9edc0a1590 msgr2=0x7f9edc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9edc0a1590 0x7f9edc0a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006fd0 tx=0x7f9ee4008040 comp rx=0 tx=0).stop 2023-10-14T08:52:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 msgr2=0x7f9ef419ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 0x7f9ef419ba60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00b9e0 tx=0x7f9eec00bcf0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 shutdown_connections 2023-10-14T08:52:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ef4106f90 0x7f9ef419ba60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9edc0a1590 0x7f9edc0a3a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ef4100f80 0x7f9ef41970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 --2- 172.21.15.6:0/1974893676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ef4101940 0x7f9ef41975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 >> 172.21.15.6:0/1974893676 conn(0x7f9ef40780a0 msgr2=0x7f9ef4104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 shutdown_connections 2023-10-14T08:52:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:05.729+0000 7f9efa6fc700 1 -- 172.21.15.6:0/1974893676 wait complete. 2023-10-14T08:52:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:52:06.172 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2023-10-14T08:52:05.443895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656001,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":559,"num_read_kb":396,"num_write":412,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336968,"kb_used_data":12748,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604856,"statfs":{"total":1151940427776,"available":1151595372544,"internally_reserved":0,"allocated":13053952,"data_stored":7112322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002140"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.447360+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:52:03.447360+0000","last_peered":"2023-10-14T08:52:03.447360+0000","last_clean":"2023-10-14T08:52:03.447360+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:52:03.447360+0000","last_undegraded":"2023-10-14T08:52:03.447360+0000","last_fullsized":"2023-10-14T08:52:03.447360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303447+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:51:18.303447+0000","last_peered":"2023-10-14T08:51:18.303447+0000","last_clean":"2023-10-14T08:51:18.303447+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:51:18.303447+0000","last_undegraded":"2023-10-14T08:51:18.303447+0000","last_fullsized":"2023-10-14T08:51:18.303447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303393+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:51:18.303393+0000","last_peered":"2023-10-14T08:51:18.303393+0000","last_clean":"2023-10-14T08:51:18.303393+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:51:18.303393+0000","last_undegraded":"2023-10-14T08:51:18.303393+0000","last_fullsized":"2023-10-14T08:51:18.303393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303661+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:51:18.303661+0000","last_peered":"2023-10-14T08:51:18.303661+0000","last_clean":"2023-10-14T08:51:18.303661+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:51:18.303661+0000","last_undegraded":"2023-10-14T08:51:18.303661+0000","last_fullsized":"2023-10-14T08:51:18.303661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.983745+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:51:18.983745+0000","last_peered":"2023-10-14T08:51:18.983745+0000","last_clean":"2023-10-14T08:51:18.983745+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:51:18.983745+0000","last_undegraded":"2023-10-14T08:51:18.983745+0000","last_fullsized":"2023-10-14T08:51:18.983745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303906+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:51:18.303906+0000","last_peered":"2023-10-14T08:51:18.303906+0000","last_clean":"2023-10-14T08:51:18.303906+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:51:18.303906+0000","last_undegraded":"2023-10-14T08:51:18.303906+0000","last_fullsized":"2023-10-14T08:51:18.303906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796977+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:51:17.796977+0000","last_peered":"2023-10-14T08:51:17.796977+0000","last_clean":"2023-10-14T08:51:17.796977+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:51:17.796977+0000","last_undegraded":"2023-10-14T08:51:17.796977+0000","last_fullsized":"2023-10-14T08:51:17.796977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582642+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:51:18.582642+0000","last_peered":"2023-10-14T08:51:18.582642+0000","last_clean":"2023-10-14T08:51:18.582642+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:51:18.582642+0000","last_undegraded":"2023-10-14T08:51:18.582642+0000","last_fullsized":"2023-10-14T08:51:18.582642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.457162+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:52:03.457162+0000","last_peered":"2023-10-14T08:52:03.457162+0000","last_clean":"2023-10-14T08:52:03.457162+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:52:03.457162+0000","last_undegraded":"2023-10-14T08:52:03.457162+0000","last_fullsized":"2023-10-14T08:52:03.457162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.304201+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:51:18.304201+0000","last_peered":"2023-10-14T08:51:18.304201+0000","last_clean":"2023-10-14T08:51:18.304201+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:51:18.304201+0000","last_undegraded":"2023-10-14T08:51:18.304201+0000","last_fullsized":"2023-10-14T08:51:18.304201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797358+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:51:17.797358+0000","last_peered":"2023-10-14T08:51:17.797358+0000","last_clean":"2023-10-14T08:51:17.797358+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:51:17.797358+0000","last_undegraded":"2023-10-14T08:51:17.797358+0000","last_fullsized":"2023-10-14T08:51:17.797358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303516+0000","last_change":"2023-10-14T08:51:16.820037+0000","last_active":"2023-10-14T08:51:18.303516+0000","last_peered":"2023-10-14T08:51:18.303516+0000","last_clean":"2023-10-14T08:51:18.303516+0000","last_became_active":"2023-10-14T08:51:16.819251+0000","last_became_peered":"2023-10-14T08:51:16.819251+0000","last_unstale":"2023-10-14T08:51:18.303516+0000","last_undegraded":"2023-10-14T08:51:18.303516+0000","last_fullsized":"2023-10-14T08:51:18.303516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:32:37.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454850+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:52:03.454850+0000","last_peered":"2023-10-14T08:52:03.454850+0000","last_clean":"2023-10-14T08:52:03.454850+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:52:03.454850+0000","last_undegraded":"2023-10-14T08:52:03.454850+0000","last_fullsized":"2023-10-14T08:52:03.454850+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302685+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:51:18.302685+0000","last_peered":"2023-10-14T08:51:18.302685+0000","last_clean":"2023-10-14T08:51:18.302685+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:51:18.302685+0000","last_undegraded":"2023-10-14T08:51:18.302685+0000","last_fullsized":"2023-10-14T08:51:18.302685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302848+0000","last_change":"2023-10-14T08:51:16.819942+0000","last_active":"2023-10-14T08:51:18.302848+0000","last_peered":"2023-10-14T08:51:18.302848+0000","last_clean":"2023-10-14T08:51:18.302848+0000","last_became_active":"2023-10-14T08:51:16.819615+0000","last_became_peered":"2023-10-14T08:51:16.819615+0000","last_unstale":"2023-10-14T08:51:18.302848+0000","last_undegraded":"2023-10-14T08:51:18.302848+0000","last_fullsized":"2023-10-14T08:51:18.302848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:25:10.523238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456464+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:52:03.456464+0000","last_peered":"2023-10-14T08:52:03.456464+0000","last_clean":"2023-10-14T08:52:03.456464+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:52:03.456464+0000","last_undegraded":"2023-10-14T08:52:03.456464+0000","last_fullsized":"2023-10-14T08:52:03.456464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.447520+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:52:03.447520+0000","last_peered":"2023-10-14T08:52:03.447520+0000","last_clean":"2023-10-14T08:52:03.447520+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:52:03.447520+0000","last_undegraded":"2023-10-14T08:52:03.447520+0000","last_fullsized":"2023-10-14T08:52:03.447520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302614+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:51:18.302614+0000","last_peered":"2023-10-14T08:51:18.302614+0000","last_clean":"2023-10-14T08:51:18.302614+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:51:18.302614+0000","last_undegraded":"2023-10-14T08:51:18.302614+0000","last_fullsized":"2023-10-14T08:51:18.302614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452688+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:52:03.452688+0000","last_peered":"2023-10-14T08:52:03.452688+0000","last_clean":"2023-10-14T08:52:03.452688+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:52:03.452688+0000","last_undegraded":"2023-10-14T08:52:03.452688+0000","last_fullsized":"2023-10-14T08:52:03.452688+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.220234+0000","last_change":"2023-10-14T08:51:15.861680+0000","last_active":"2023-10-14T08:51:59.220234+0000","last_peered":"2023-10-14T08:51:59.220234+0000","last_clean":"2023-10-14T08:51:59.220234+0000","last_became_active":"2023-10-14T08:51:15.861353+0000","last_became_peered":"2023-10-14T08:51:15.861353+0000","last_unstale":"2023-10-14T08:51:59.220234+0000","last_undegraded":"2023-10-14T08:51:59.220234+0000","last_fullsized":"2023-10-14T08:51:59.220234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:40:24.320642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582789+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:51:18.582789+0000","last_peered":"2023-10-14T08:51:18.582789+0000","last_clean":"2023-10-14T08:51:18.582789+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:51:18.582789+0000","last_undegraded":"2023-10-14T08:51:18.582789+0000","last_fullsized":"2023-10-14T08:51:18.582789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.114312+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:51:21.114312+0000","last_peered":"2023-10-14T08:51:21.114312+0000","last_clean":"2023-10-14T08:51:21.114312+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:51:21.114312+0000","last_undegraded":"2023-10-14T08:51:21.114312+0000","last_fullsized":"2023-10-14T08:51:21.114312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303619+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:51:18.303619+0000","last_peered":"2023-10-14T08:51:18.303619+0000","last_clean":"2023-10-14T08:51:18.303619+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:51:18.303619+0000","last_undegraded":"2023-10-14T08:51:18.303619+0000","last_fullsized":"2023-10-14T08:51:18.303619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:24.174546+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:51:24.174546+0000","last_peered":"2023-10-14T08:51:24.174546+0000","last_clean":"2023-10-14T08:51:24.174546+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:51:24.174546+0000","last_undegraded":"2023-10-14T08:51:24.174546+0000","last_fullsized":"2023-10-14T08:51:24.174546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.457062+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:52:03.457062+0000","last_peered":"2023-10-14T08:52:03.457062+0000","last_clean":"2023-10-14T08:52:03.457062+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:52:03.457062+0000","last_undegraded":"2023-10-14T08:52:03.457062+0000","last_fullsized":"2023-10-14T08:52:03.457062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:24.170481+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:51:24.170481+0000","last_peered":"2023-10-14T08:51:24.170481+0000","last_clean":"2023-10-14T08:51:24.170481+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:51:24.170481+0000","last_undegraded":"2023-10-14T08:51:24.170481+0000","last_fullsized":"2023-10-14T08:51:24.170481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802533+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:51:17.802533+0000","last_peered":"2023-10-14T08:51:17.802533+0000","last_clean":"2023-10-14T08:51:17.802533+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:51:17.802533+0000","last_undegraded":"2023-10-14T08:51:17.802533+0000","last_fullsized":"2023-10-14T08:51:17.802533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:52:00.169942+0000","last_change":"2023-10-14T08:51:15.860943+0000","last_active":"2023-10-14T08:52:00.169942+0000","last_peered":"2023-10-14T08:52:00.169942+0000","last_clean":"2023-10-14T08:52:00.169942+0000","last_became_active":"2023-10-14T08:51:15.860636+0000","last_became_peered":"2023-10-14T08:51:15.860636+0000","last_unstale":"2023-10-14T08:52:00.169942+0000","last_undegraded":"2023-10-14T08:52:00.169942+0000","last_fullsized":"2023-10-14T08:52:00.169942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:36.037274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.983735+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:51:18.983735+0000","last_peered":"2023-10-14T08:51:18.983735+0000","last_clean":"2023-10-14T08:51:18.983735+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:51:18.983735+0000","last_undegraded":"2023-10-14T08:51:18.983735+0000","last_fullsized":"2023-10-14T08:51:18.983735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.146343+0000","last_change":"2023-10-14T08:51:15.864182+0000","last_active":"2023-10-14T08:51:22.146343+0000","last_peered":"2023-10-14T08:51:22.146343+0000","last_clean":"2023-10-14T08:51:22.146343+0000","last_became_active":"2023-10-14T08:51:15.863841+0000","last_became_peered":"2023-10-14T08:51:15.863841+0000","last_unstale":"2023-10-14T08:51:22.146343+0000","last_undegraded":"2023-10-14T08:51:22.146343+0000","last_fullsized":"2023-10-14T08:51:22.146343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:21.974223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.802079+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:51:17.802079+0000","last_peered":"2023-10-14T08:51:17.802079+0000","last_clean":"2023-10-14T08:51:17.802079+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:51:17.802079+0000","last_undegraded":"2023-10-14T08:51:17.802079+0000","last_fullsized":"2023-10-14T08:51:17.802079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454545+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:52:03.454545+0000","last_peered":"2023-10-14T08:52:03.454545+0000","last_clean":"2023-10-14T08:52:03.454545+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:52:03.454545+0000","last_undegraded":"2023-10-14T08:52:03.454545+0000","last_fullsized":"2023-10-14T08:52:03.454545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582606+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:51:18.582606+0000","last_peered":"2023-10-14T08:51:18.582606+0000","last_clean":"2023-10-14T08:51:18.582606+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:51:18.582606+0000","last_undegraded":"2023-10-14T08:51:18.582606+0000","last_fullsized":"2023-10-14T08:51:18.582606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153455+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:51:23.153455+0000","last_peered":"2023-10-14T08:51:23.153455+0000","last_clean":"2023-10-14T08:51:23.153455+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:51:23.153455+0000","last_undegraded":"2023-10-14T08:51:23.153455+0000","last_fullsized":"2023-10-14T08:51:23.153455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302706+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:51:18.302706+0000","last_peered":"2023-10-14T08:51:18.302706+0000","last_clean":"2023-10-14T08:51:18.302706+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:51:18.302706+0000","last_undegraded":"2023-10-14T08:51:18.302706+0000","last_fullsized":"2023-10-14T08:51:18.302706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:52:01.170873+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:52:01.170873+0000","last_peered":"2023-10-14T08:52:01.170873+0000","last_clean":"2023-10-14T08:52:01.170873+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:52:01.170873+0000","last_undegraded":"2023-10-14T08:52:01.170873+0000","last_fullsized":"2023-10-14T08:52:01.170873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456811+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:52:03.456811+0000","last_peered":"2023-10-14T08:52:03.456811+0000","last_clean":"2023-10-14T08:52:03.456811+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:52:03.456811+0000","last_undegraded":"2023-10-14T08:52:03.456811+0000","last_fullsized":"2023-10-14T08:52:03.456811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153374+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:51:23.153374+0000","last_peered":"2023-10-14T08:51:23.153374+0000","last_clean":"2023-10-14T08:51:23.153374+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:51:23.153374+0000","last_undegraded":"2023-10-14T08:51:23.153374+0000","last_fullsized":"2023-10-14T08:51:23.153374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303623+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:51:18.303623+0000","last_peered":"2023-10-14T08:51:18.303623+0000","last_clean":"2023-10-14T08:51:18.303623+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:51:18.303623+0000","last_undegraded":"2023-10-14T08:51:18.303623+0000","last_fullsized":"2023-10-14T08:51:18.303623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.105721+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:51:21.105721+0000","last_peered":"2023-10-14T08:51:21.105721+0000","last_clean":"2023-10-14T08:51:21.105721+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:51:21.105721+0000","last_undegraded":"2023-10-14T08:51:21.105721+0000","last_fullsized":"2023-10-14T08:51:21.105721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.457255+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:52:03.457255+0000","last_peered":"2023-10-14T08:52:03.457255+0000","last_clean":"2023-10-14T08:52:03.457255+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:52:03.457255+0000","last_undegraded":"2023-10-14T08:52:03.457255+0000","last_fullsized":"2023-10-14T08:52:03.457255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":132,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:52:01.175222+0000","last_change":"2023-10-14T08:51:15.865840+0000","last_active":"2023-10-14T08:52:01.175222+0000","last_peered":"2023-10-14T08:52:01.175222+0000","last_clean":"2023-10-14T08:52:01.175222+0000","last_became_active":"2023-10-14T08:51:15.865393+0000","last_became_peered":"2023-10-14T08:51:15.865393+0000","last_unstale":"2023-10-14T08:52:01.175222+0000","last_undegraded":"2023-10-14T08:52:01.175222+0000","last_fullsized":"2023-10-14T08:52:01.175222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:02:17.524700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58575,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":90,"num_read_kb":101,"num_write":31,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.983781+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:51:18.983781+0000","last_peered":"2023-10-14T08:51:18.983781+0000","last_clean":"2023-10-14T08:51:18.983781+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:51:18.983781+0000","last_undegraded":"2023-10-14T08:51:18.983781+0000","last_fullsized":"2023-10-14T08:51:18.983781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452996+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:52:03.452996+0000","last_peered":"2023-10-14T08:52:03.452996+0000","last_clean":"2023-10-14T08:52:03.452996+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:52:03.452996+0000","last_undegraded":"2023-10-14T08:52:03.452996+0000","last_fullsized":"2023-10-14T08:52:03.452996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454892+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:52:03.454892+0000","last_peered":"2023-10-14T08:52:03.454892+0000","last_clean":"2023-10-14T08:52:03.454892+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:52:03.454892+0000","last_undegraded":"2023-10-14T08:52:03.454892+0000","last_fullsized":"2023-10-14T08:52:03.454892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153461+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:51:23.153461+0000","last_peered":"2023-10-14T08:51:23.153461+0000","last_clean":"2023-10-14T08:51:23.153461+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:51:23.153461+0000","last_undegraded":"2023-10-14T08:51:23.153461+0000","last_fullsized":"2023-10-14T08:51:23.153461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797419+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:51:17.797419+0000","last_peered":"2023-10-14T08:51:17.797419+0000","last_clean":"2023-10-14T08:51:17.797419+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:51:17.797419+0000","last_undegraded":"2023-10-14T08:51:17.797419+0000","last_fullsized":"2023-10-14T08:51:17.797419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.223265+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:51:59.223265+0000","last_peered":"2023-10-14T08:51:59.223265+0000","last_clean":"2023-10-14T08:51:59.223265+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:51:59.223265+0000","last_undegraded":"2023-10-14T08:51:59.223265+0000","last_fullsized":"2023-10-14T08:51:59.223265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.796933+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:51:17.796933+0000","last_peered":"2023-10-14T08:51:17.796933+0000","last_clean":"2023-10-14T08:51:17.796933+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:51:17.796933+0000","last_undegraded":"2023-10-14T08:51:17.796933+0000","last_fullsized":"2023-10-14T08:51:17.796933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.469743+0000","last_change":"2023-10-14T08:52:04.469342+0000","last_active":"2023-10-14T08:52:04.469743+0000","last_peered":"2023-10-14T08:52:04.469743+0000","last_clean":"2023-10-14T08:52:04.469743+0000","last_became_active":"2023-10-14T08:52:04.454202+0000","last_became_peered":"2023-10-14T08:52:04.454202+0000","last_unstale":"2023-10-14T08:52:04.469743+0000","last_undegraded":"2023-10-14T08:52:04.469743+0000","last_fullsized":"2023-10-14T08:52:04.469743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.377924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801980+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:51:17.801980+0000","last_peered":"2023-10-14T08:51:17.801980+0000","last_clean":"2023-10-14T08:51:17.801980+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:51:17.801980+0000","last_undegraded":"2023-10-14T08:51:17.801980+0000","last_fullsized":"2023-10-14T08:51:17.801980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.755110+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:51:22.755110+0000","last_peered":"2023-10-14T08:51:22.755110+0000","last_clean":"2023-10-14T08:51:22.755110+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:51:22.755110+0000","last_undegraded":"2023-10-14T08:51:22.755110+0000","last_fullsized":"2023-10-14T08:51:22.755110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.447266+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:52:03.447266+0000","last_peered":"2023-10-14T08:52:03.447266+0000","last_clean":"2023-10-14T08:52:03.447266+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:52:03.447266+0000","last_undegraded":"2023-10-14T08:52:03.447266+0000","last_fullsized":"2023-10-14T08:52:03.447266+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.302537+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:51:18.302537+0000","last_peered":"2023-10-14T08:51:18.302537+0000","last_clean":"2023-10-14T08:51:18.302537+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:51:18.302537+0000","last_undegraded":"2023-10-14T08:51:18.302537+0000","last_fullsized":"2023-10-14T08:51:18.302537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303927+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:51:18.303927+0000","last_peered":"2023-10-14T08:51:18.303927+0000","last_clean":"2023-10-14T08:51:18.303927+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:51:18.303927+0000","last_undegraded":"2023-10-14T08:51:18.303927+0000","last_fullsized":"2023-10-14T08:51:18.303927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":56,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:59.220949+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:51:59.220949+0000","last_peered":"2023-10-14T08:51:59.220949+0000","last_clean":"2023-10-14T08:51:59.220949+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:51:59.220949+0000","last_undegraded":"2023-10-14T08:51:59.220949+0000","last_fullsized":"2023-10-14T08:51:59.220949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303951+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:51:18.303951+0000","last_peered":"2023-10-14T08:51:18.303951+0000","last_clean":"2023-10-14T08:51:18.303951+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:51:18.303951+0000","last_undegraded":"2023-10-14T08:51:18.303951+0000","last_fullsized":"2023-10-14T08:51:18.303951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801911+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:51:17.801911+0000","last_peered":"2023-10-14T08:51:17.801911+0000","last_clean":"2023-10-14T08:51:17.801911+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:51:17.801911+0000","last_undegraded":"2023-10-14T08:51:17.801911+0000","last_fullsized":"2023-10-14T08:51:17.801911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.229741+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:52:04.229741+0000","last_peered":"2023-10-14T08:52:04.229741+0000","last_clean":"2023-10-14T08:52:04.229741+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:52:04.229741+0000","last_undegraded":"2023-10-14T08:52:04.229741+0000","last_fullsized":"2023-10-14T08:52:04.229741+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582732+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:51:18.582732+0000","last_peered":"2023-10-14T08:51:18.582732+0000","last_clean":"2023-10-14T08:51:18.582732+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:51:18.582732+0000","last_undegraded":"2023-10-14T08:51:18.582732+0000","last_fullsized":"2023-10-14T08:51:18.582732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:24.165708+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:51:24.165708+0000","last_peered":"2023-10-14T08:51:24.165708+0000","last_clean":"2023-10-14T08:51:24.165708+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:51:24.165708+0000","last_undegraded":"2023-10-14T08:51:24.165708+0000","last_fullsized":"2023-10-14T08:51:24.165708+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":308,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-10-14T08:51:16.805425+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:51:16.805425+0000","last_peered":"2023-10-14T08:51:16.805425+0000","last_clean":"2023-10-14T08:51:16.805425+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:51:16.805425+0000","last_undegraded":"2023-10-14T08:51:16.805425+0000","last_fullsized":"2023-10-14T08:51:16.805425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454321+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:52:03.454321+0000","last_peered":"2023-10-14T08:52:03.454321+0000","last_clean":"2023-10-14T08:52:03.454321+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:52:03.454321+0000","last_undegraded":"2023-10-14T08:52:03.454321+0000","last_fullsized":"2023-10-14T08:52:03.454321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.115539+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:51:21.115539+0000","last_peered":"2023-10-14T08:51:21.115539+0000","last_clean":"2023-10-14T08:51:21.115539+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:51:21.115539+0000","last_undegraded":"2023-10-14T08:51:21.115539+0000","last_fullsized":"2023-10-14T08:51:21.115539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.151860+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:51:23.151860+0000","last_peered":"2023-10-14T08:51:23.151860+0000","last_clean":"2023-10-14T08:51:23.151860+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:51:23.151860+0000","last_undegraded":"2023-10-14T08:51:23.151860+0000","last_fullsized":"2023-10-14T08:51:23.151860+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454787+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:52:03.454787+0000","last_peered":"2023-10-14T08:52:03.454787+0000","last_clean":"2023-10-14T08:52:03.454787+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:52:03.454787+0000","last_undegraded":"2023-10-14T08:52:03.454787+0000","last_fullsized":"2023-10-14T08:52:03.454787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:25.066547+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:51:25.066547+0000","last_peered":"2023-10-14T08:51:25.066547+0000","last_clean":"2023-10-14T08:51:25.066547+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:51:25.066547+0000","last_undegraded":"2023-10-14T08:51:25.066547+0000","last_fullsized":"2023-10-14T08:51:25.066547+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582882+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:51:18.582882+0000","last_peered":"2023-10-14T08:51:18.582882+0000","last_clean":"2023-10-14T08:51:18.582882+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:51:18.582882+0000","last_undegraded":"2023-10-14T08:51:18.582882+0000","last_fullsized":"2023-10-14T08:51:18.582882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.153258+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:51:23.153258+0000","last_peered":"2023-10-14T08:51:23.153258+0000","last_clean":"2023-10-14T08:51:23.153258+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:51:23.153258+0000","last_undegraded":"2023-10-14T08:51:23.153258+0000","last_fullsized":"2023-10-14T08:51:23.153258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303483+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:51:18.303483+0000","last_peered":"2023-10-14T08:51:18.303483+0000","last_clean":"2023-10-14T08:51:18.303483+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:51:18.303483+0000","last_undegraded":"2023-10-14T08:51:18.303483+0000","last_fullsized":"2023-10-14T08:51:18.303483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456628+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:52:03.456628+0000","last_peered":"2023-10-14T08:52:03.456628+0000","last_clean":"2023-10-14T08:52:03.456628+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:52:03.456628+0000","last_undegraded":"2023-10-14T08:52:03.456628+0000","last_fullsized":"2023-10-14T08:52:03.456628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.983721+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:51:18.983721+0000","last_peered":"2023-10-14T08:51:18.983721+0000","last_clean":"2023-10-14T08:51:18.983721+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:51:18.983721+0000","last_undegraded":"2023-10-14T08:51:18.983721+0000","last_fullsized":"2023-10-14T08:51:18.983721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:23.150862+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:51:23.150862+0000","last_peered":"2023-10-14T08:51:23.150862+0000","last_clean":"2023-10-14T08:51:23.150862+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:51:23.150862+0000","last_undegraded":"2023-10-14T08:51:23.150862+0000","last_fullsized":"2023-10-14T08:51:23.150862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.447003+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:52:03.447003+0000","last_peered":"2023-10-14T08:52:03.447003+0000","last_clean":"2023-10-14T08:52:03.447003+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:52:03.447003+0000","last_undegraded":"2023-10-14T08:52:03.447003+0000","last_fullsized":"2023-10-14T08:52:03.447003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453327+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:52:03.453327+0000","last_peered":"2023-10-14T08:52:03.453327+0000","last_clean":"2023-10-14T08:52:03.453327+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:52:03.453327+0000","last_undegraded":"2023-10-14T08:52:03.453327+0000","last_fullsized":"2023-10-14T08:52:03.453327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582758+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:51:18.582758+0000","last_peered":"2023-10-14T08:51:18.582758+0000","last_clean":"2023-10-14T08:51:18.582758+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:51:18.582758+0000","last_undegraded":"2023-10-14T08:51:18.582758+0000","last_fullsized":"2023-10-14T08:51:18.582758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:21.102121+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:51:21.102121+0000","last_peered":"2023-10-14T08:51:21.102121+0000","last_clean":"2023-10-14T08:51:21.102121+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:51:21.102121+0000","last_undegraded":"2023-10-14T08:51:21.102121+0000","last_fullsized":"2023-10-14T08:51:21.102121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797314+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:51:17.797314+0000","last_peered":"2023-10-14T08:51:17.797314+0000","last_clean":"2023-10-14T08:51:17.797314+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:51:17.797314+0000","last_undegraded":"2023-10-14T08:51:17.797314+0000","last_fullsized":"2023-10-14T08:51:17.797314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":64,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.449586+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:52:04.449586+0000","last_peered":"2023-10-14T08:52:04.449586+0000","last_clean":"2023-10-14T08:52:04.449586+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:52:04.449586+0000","last_undegraded":"2023-10-14T08:52:04.449586+0000","last_fullsized":"2023-10-14T08:52:04.449586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797434+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:51:17.797434+0000","last_peered":"2023-10-14T08:51:17.797434+0000","last_clean":"2023-10-14T08:51:17.797434+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:51:17.797434+0000","last_undegraded":"2023-10-14T08:51:17.797434+0000","last_fullsized":"2023-10-14T08:51:17.797434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:22.144805+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:51:22.144805+0000","last_peered":"2023-10-14T08:51:22.144805+0000","last_clean":"2023-10-14T08:51:22.144805+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:51:22.144805+0000","last_undegraded":"2023-10-14T08:51:22.144805+0000","last_fullsized":"2023-10-14T08:51:22.144805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797173+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:51:17.797173+0000","last_peered":"2023-10-14T08:51:17.797173+0000","last_clean":"2023-10-14T08:51:17.797173+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:51:17.797173+0000","last_undegraded":"2023-10-14T08:51:17.797173+0000","last_fullsized":"2023-10-14T08:51:17.797173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454918+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:52:03.454918+0000","last_peered":"2023-10-14T08:52:03.454918+0000","last_clean":"2023-10-14T08:52:03.454918+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:52:03.454918+0000","last_undegraded":"2023-10-14T08:52:03.454918+0000","last_fullsized":"2023-10-14T08:52:03.454918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.797270+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:51:17.797270+0000","last_peered":"2023-10-14T08:51:17.797270+0000","last_clean":"2023-10-14T08:51:17.797270+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:51:17.797270+0000","last_undegraded":"2023-10-14T08:51:17.797270+0000","last_fullsized":"2023-10-14T08:51:17.797270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.447076+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:52:03.447076+0000","last_peered":"2023-10-14T08:52:03.447076+0000","last_clean":"2023-10-14T08:52:03.447076+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:52:03.447076+0000","last_undegraded":"2023-10-14T08:52:03.447076+0000","last_fullsized":"2023-10-14T08:52:03.447076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.831658+0000","last_change":"2023-10-14T08:52:04.831658+0000","last_active":"2023-10-14T08:52:04.831658+0000","last_peered":"2023-10-14T08:52:04.831658+0000","last_clean":"2023-10-14T08:52:04.831658+0000","last_became_active":"2023-10-14T08:52:04.831331+0000","last_became_peered":"2023-10-14T08:52:04.831331+0000","last_unstale":"2023-10-14T08:52:04.831658+0000","last_undegraded":"2023-10-14T08:52:04.831658+0000","last_fullsized":"2023-10-14T08:52:04.831658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:48:52.884720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452589+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:52:03.452589+0000","last_peered":"2023-10-14T08:52:03.452589+0000","last_clean":"2023-10-14T08:52:03.452589+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:52:03.452589+0000","last_undegraded":"2023-10-14T08:52:03.452589+0000","last_fullsized":"2023-10-14T08:52:03.452589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.303321+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:51:18.303321+0000","last_peered":"2023-10-14T08:51:18.303321+0000","last_clean":"2023-10-14T08:51:18.303321+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:51:18.303321+0000","last_undegraded":"2023-10-14T08:51:18.303321+0000","last_fullsized":"2023-10-14T08:51:18.303321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454711+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:52:03.454711+0000","last_peered":"2023-10-14T08:52:03.454711+0000","last_clean":"2023-10-14T08:52:03.454711+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:52:03.454711+0000","last_undegraded":"2023-10-14T08:52:03.454711+0000","last_fullsized":"2023-10-14T08:52:03.454711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.447250+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:52:03.447250+0000","last_peered":"2023-10-14T08:52:03.447250+0000","last_clean":"2023-10-14T08:52:03.447250+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:52:03.447250+0000","last_undegraded":"2023-10-14T08:52:03.447250+0000","last_fullsized":"2023-10-14T08:52:03.447250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454951+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:52:03.454951+0000","last_peered":"2023-10-14T08:52:03.454951+0000","last_clean":"2023-10-14T08:52:03.454951+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:52:03.454951+0000","last_undegraded":"2023-10-14T08:52:03.454951+0000","last_fullsized":"2023-10-14T08:52:03.454951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582853+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:51:18.582853+0000","last_peered":"2023-10-14T08:51:18.582853+0000","last_clean":"2023-10-14T08:51:18.582853+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:51:18.582853+0000","last_undegraded":"2023-10-14T08:51:18.582853+0000","last_fullsized":"2023-10-14T08:51:18.582853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:17.801856+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:51:17.801856+0000","last_peered":"2023-10-14T08:51:17.801856+0000","last_clean":"2023-10-14T08:51:17.801856+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:51:17.801856+0000","last_undegraded":"2023-10-14T08:51:17.801856+0000","last_fullsized":"2023-10-14T08:51:17.801856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-10-14T08:51:18.582702+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:51:18.582702+0000","last_peered":"2023-10-14T08:51:18.582702+0000","last_clean":"2023-10-14T08:51:18.582702+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:51:18.582702+0000","last_undegraded":"2023-10-14T08:51:18.582702+0000","last_fullsized":"2023-10-14T08:51:18.582702+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456687+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:52:03.456687+0000","last_peered":"2023-10-14T08:52:03.456687+0000","last_clean":"2023-10-14T08:52:03.456687+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:52:03.456687+0000","last_undegraded":"2023-10-14T08:52:03.456687+0000","last_fullsized":"2023-10-14T08:52:03.456687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454768+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:52:03.454768+0000","last_peered":"2023-10-14T08:52:03.454768+0000","last_clean":"2023-10-14T08:52:03.454768+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:52:03.454768+0000","last_undegraded":"2023-10-14T08:52:03.454768+0000","last_fullsized":"2023-10-14T08:52:03.454768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.456448+0000","last_change":"2023-10-14T08:52:04.456448+0000","last_active":"2023-10-14T08:52:04.456448+0000","last_peered":"2023-10-14T08:52:04.456448+0000","last_clean":"2023-10-14T08:52:04.456448+0000","last_became_active":"2023-10-14T08:52:04.456002+0000","last_became_peered":"2023-10-14T08:52:04.456002+0000","last_unstale":"2023-10-14T08:52:04.456448+0000","last_undegraded":"2023-10-14T08:52:04.456448+0000","last_fullsized":"2023-10-14T08:52:04.456448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:00.467295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65387,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":433,"num_read_kb":287,"num_write":229,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":138370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481814,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":443104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.434}]},{"osd":1,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.622}]},{"osd":5,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.70699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58699999999999997}]},{"osd":10,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.82399999999999995}]}]},{"osd":10,"up_from":69,"seq":296352743449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1074539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.89300000000000002}]},{"osd":3,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.62},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.58599999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56000000000000005}]},{"osd":5,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.70599999999999996}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.81499999999999995}]},{"osd":9,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.751}]},{"osd":11,"last update":"Sat Oct 14 08:51:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.85999999999999999}]}]},{"osd":9,"up_from":64,"seq":274877906973,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":424800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68999999999999995,"15min":0.67400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83499999999999996,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.33700000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.595,"15min":1.595},"last":0.64500000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0900000000000001,"5min":1.532,"15min":1.532},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.628}]},{"osd":6,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.373},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.434}]},{"osd":7,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.85999999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.01,"5min":1.466,"15min":1.466},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.69499999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.85399999999999998,"15min":0.84499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83899999999999997,"15min":0.85799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0629999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.55000000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73899999999999999}]}]},{"osd":8,"up_from":57,"seq":244813135907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":433879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58099999999999996,"15min":0.58899999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79700000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58699999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.752}]},{"osd":2,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.309,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34599999999999997}]},{"osd":3,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.60399999999999998},"min":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79200000000000004,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.47199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.76400000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.45500000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95899999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0349999999999999,"5min":1.119,"15min":1.119},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72299999999999998,"15min":0.71099999999999997},"min":{"1min":0.52000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.73299999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66800000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1511424,"data_stored":1017701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.435,"15min":0.436},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.43099999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.751,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.624},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63800000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.67400000000000004}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.874,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.436,"15min":0.436},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70699999999999996}]},{"osd":6,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89700000000000002}]},{"osd":8,"last update":"Sat Oct 14 08:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.503,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.095,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81899999999999995}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.034,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.411,"15min":1.411},"last":0.94499999999999995}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561068,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":441973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42099999999999999,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.42199999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64800000000000002,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.68799999999999994}]},{"osd":7,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.68200000000000005},"min":{"1min":0.53100000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":3.73,"5min":3.73,"15min":3.73},"last":0.56299999999999994}]},{"osd":8,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.74399999999999999,"15min":0.73699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.5489999999999999,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.66800000000000004}]},{"osd":9,"last update":"Sat Oct 14 08:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.8700000000000001,"5min":3.8700000000000001,"15min":3.8700000000000001},"last":0.65200000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.70499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":492433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.58299999999999996,"15min":0.52300000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.59899999999999998,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.5019999999999998,"5min":7.5019999999999998,"15min":7.5019999999999998},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.61899999999999999,"15min":0.59899999999999998},"min":{"1min":0.45600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.59799999999999998},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91700000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60799999999999998,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.196,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93100000000000005,"5min":1.397,"15min":1.397},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.52300000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.01,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.80600000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.746}]},{"osd":7,"last update":"Sat Oct 14 08:51:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.441,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.089,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.623,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83099999999999996}]},{"osd":8,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.76200000000000001,"15min":0.74199999999999999},"min":{"1min":0.61099999999999999,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.73499999999999999,"15min":0.71799999999999997},"min":{"1min":0.58699999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.76700000000000002}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1739999999999999,"5min":1.194,"15min":1.194},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.877,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.85499999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.90100000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":425856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:51:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83499999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:51:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.55900000000000005,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.57899999999999996,"15min":0.54200000000000004},"min":{"1min":0.45800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:49:42 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.41599999999999998,"15min":0.41199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59999999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.34599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.379,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82999999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48799999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.504}]},{"osd":6,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.45400000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:51:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52100000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.79000000000000004},"min":{"1min":0.53200000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57999999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56499999999999995}]},{"osd":11,"last update":"Sat Oct 14 08:51:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":492257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.48299999999999998},"min":{"1min":0.376,"5min":0.317,"15min":0.317},"max":{"1min":0.70799999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Sat Oct 14 08:51:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54700000000000004,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71299999999999997}]},{"osd":3,"last update":"Sat Oct 14 08:51:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.76700000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:51:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73999999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.751}]},{"osd":5,"last update":"Sat Oct 14 08:51:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.47999999999999998,"15min":0.46899999999999997},"min":{"1min":0.318,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.47499999999999998,"15min":0.46999999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:51:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64800000000000002}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.91700000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.94299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":424354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.39200000000000002,"15min":0.35499999999999998},"min":{"1min":0.28799999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.47699999999999998,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.63900000000000001,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.70199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.746,"5min":11.746,"15min":11.746},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59599999999999997,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.61099999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65100000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63900000000000001,"15min":0.63300000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.501},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61899999999999999,"15min":0.61799999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79700000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42499999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.69599999999999995,"15min":0.61599999999999999},"min":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":12.414,"5min":12.414,"15min":12.414},"last":0.46200000000000002}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.629},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53800000000000003}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.872,"15min":0.81200000000000006},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.164,"5min":12.164,"15min":12.164},"last":0.67000000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.80100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":424768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.39400000000000002,"15min":0.36799999999999999},"min":{"1min":0.34999999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"min":{"1min":0.33700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.73899999999999999,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.56699999999999995,"15min":0.55200000000000005},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.45800000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85499999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Sat Oct 14 08:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.63100000000000001,"15min":0.58099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Sat Oct 14 08:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.54300000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.47599999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.79000000000000004}]},{"osd":8,"last update":"Sat Oct 14 08:51:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.67900000000000005,"15min":0.67100000000000004},"min":{"1min":0.51100000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.81799999999999995,"15min":0.80600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.97599999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.0129999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.048},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1.0049999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1519616,"data_stored":1016658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.503},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.42499999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.55700000000000005,"15min":0.53200000000000003},"min":{"1min":0.45000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.66000000000000003}]},{"osd":2,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.39300000000000002,"15min":0.38100000000000001},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78500000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.75600000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47199999999999998}]},{"osd":4,"last update":"Sat Oct 14 08:51:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.53600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60099999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63500000000000001,"15min":0.62},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59099999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:51:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.55000000000000004},"min":{"1min":0.42499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67700000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.74199999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.3559999999999999,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:52:06.180 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-14T08:52:06.180 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T08:52:06.180 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-14T08:52:06.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph health --format=json 2023-10-14T08:52:06.748 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:07.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:07 smithi057 ceph-mon[103313]: pgmap v285: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 0 objects/s recovering 2023-10-14T08:52:07.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:07 smithi057 ceph-mon[103313]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:07.275 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:07 smithi006 ceph-mon[99452]: pgmap v285: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 0 objects/s recovering 2023-10-14T08:52:07.276 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:07 smithi006 ceph-mon[99452]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:07.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:07 smithi178 ceph-mon[103612]: pgmap v285: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 0 objects/s recovering 2023-10-14T08:52:07.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:07 smithi178 ceph-mon[103612]: from='client.14943 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:07.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 -- 172.21.15.6:0/927681012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 msgr2=0x7f4ae4106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:07.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 --2- 172.21.15.6:0/927681012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae4106250 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80099c0 tx=0x7f4ad8009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:07.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 -- 172.21.15.6:0/927681012 shutdown_connections 2023-10-14T08:52:07.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 --2- 172.21.15.6:0/927681012 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ae4100820 0x7f4ae410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:07.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 --2- 172.21.15.6:0/927681012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae4106250 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:07.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 --2- 172.21.15.6:0/927681012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae40ffe60 0x7f4ae41002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 -- 172.21.15.6:0/927681012 >> 172.21.15.6:0/927681012 conn(0x7f4ae4075e00 msgr2=0x7f4ae4076210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 -- 172.21.15.6:0/927681012 shutdown_connections 2023-10-14T08:52:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 -- 172.21.15.6:0/927681012 wait complete. 2023-10-14T08:52:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 Processor -- start 2023-10-14T08:52:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.975+0000 7f4aead25700 1 -- start start 2023-10-14T08:52:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4aead25700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ae40ffe60 0x7f4ae4101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4aead25700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4100820 0x7f4ae4102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4aead25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae41026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:07.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4aead25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41a5350 con 0x7f4ae4105e70 2023-10-14T08:52:07.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4aead25700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41a54c0 con 0x7f4ae40ffe60 2023-10-14T08:52:07.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4aead25700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41a5680 con 0x7f4ae4100820 2023-10-14T08:52:07.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae41026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae41026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59988/0 (socket says 172.21.15.6:59988) 2023-10-14T08:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 -- 172.21.15.6:0/1406206529 learned_addr learned my addr 172.21.15.6:0/1406206529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae8ac1700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ae40ffe60 0x7f4ae4101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae3fff700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4100820 0x7f4ae4102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 -- 172.21.15.6:0/1406206529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4100820 msgr2=0x7f4ae4102170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4100820 0x7f4ae4102170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 -- 172.21.15.6:0/1406206529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ae40ffe60 msgr2=0x7f4ae4101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ae40ffe60 0x7f4ae4101c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 -- 172.21.15.6:0/1406206529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80095f0 con 0x7f4ae4105e70 2023-10-14T08:52:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae92c2700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae41026f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4adc007ee0 tx=0x7f4adc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00ddd0 con 0x7f4ae4105e70 2023-10-14T08:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.976+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4adc00f040 con 0x7f4ae4105e70 2023-10-14T08:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.977+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae41a5960 con 0x7f4ae4105e70 2023-10-14T08:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.977+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc015400 con 0x7f4ae4105e70 2023-10-14T08:52:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.977+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae41a5e60 con 0x7f4ae4105e70 2023-10-14T08:52:07.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.978+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae404ebb0 con 0x7f4ae4105e70 2023-10-14T08:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.979+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4adc004020 con 0x7f4ae4105e70 2023-10-14T08:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.979+0000 7f4ae1ffb700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ad40a1590 0x7f4ad40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.980+0000 7f4ae8ac1700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ad40a1590 0x7f4ad40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.980+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4adc0cc810 con 0x7f4ae4105e70 2023-10-14T08:52:07.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.980+0000 7f4ae8ac1700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ad40a1590 0x7f4ad40a3a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000c00 tx=0x7f4ad8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:07.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:07.984+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4adc04f100 con 0x7f4ae4105e70 2023-10-14T08:52:08.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.231+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4ae410ff20 con 0x7f4ae4105e70 2023-10-14T08:52:08.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.232+0000 7f4ae1ffb700 1 -- 172.21.15.6:0/1406206529 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4adc095cd0 con 0x7f4ae4105e70 2023-10-14T08:52:08.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:08.234 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T08:52:08.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ad40a1590 msgr2=0x7f4ad40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ad40a1590 0x7f4ad40a3a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000c00 tx=0x7f4ad8005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 msgr2=0x7f4ae41026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae41026f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4adc007ee0 tx=0x7f4adc00d3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 shutdown_connections 2023-10-14T08:52:08.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ae4105e70 0x7f4ae41026f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ad40a1590 0x7f4ad40a3a50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ae40ffe60 0x7f4ae4101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 --2- 172.21.15.6:0/1406206529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4100820 0x7f4ae4102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 >> 172.21.15.6:0/1406206529 conn(0x7f4ae4075e00 msgr2=0x7f4ae4103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:08.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 shutdown_connections 2023-10-14T08:52:08.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.234+0000 7f4aead25700 1 -- 172.21.15.6:0/1406206529 wait complete. 2023-10-14T08:52:08.608 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-14T08:52:08.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 -- 172.21.15.6:0/434089640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec100e90 msgr2=0x7fe1ec1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 --2- 172.21.15.6:0/434089640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec100e90 0x7fe1ec1012b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009990 tx=0x7fe1e8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 -- 172.21.15.6:0/434089640 shutdown_connections 2023-10-14T08:52:08.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 --2- 172.21.15.6:0/434089640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1ec102a30 0x7fe1ec109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 --2- 172.21.15.6:0/434089640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec100e90 0x7fe1ec1012b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 --2- 172.21.15.6:0/434089640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 0x7fe1ec1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 -- 172.21.15.6:0/434089640 >> 172.21.15.6:0/434089640 conn(0x7fe1ec0fc430 msgr2=0x7fe1ec0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:08.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 -- 172.21.15.6:0/434089640 shutdown_connections 2023-10-14T08:52:08.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.737+0000 7fe1f4584700 1 -- 172.21.15.6:0/434089640 wait complete. 2023-10-14T08:52:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 Processor -- start 2023-10-14T08:52:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 -- start start 2023-10-14T08:52:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1ec100e90 0x7fe1ec198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:08.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 0x7fe1ec1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 0x7fe1ec1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec1a0a30 con 0x7fe1ec102a30 2023-10-14T08:52:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec1a0b70 con 0x7fe1ec102070 2023-10-14T08:52:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f4584700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec1a0d00 con 0x7fe1ec100e90 2023-10-14T08:52:08.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 0x7fe1ec1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 0x7fe1ec1a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60000/0 (socket says 172.21.15.6:60000) 2023-10-14T08:52:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 -- 172.21.15.6:0/1011157282 learned_addr learned my addr 172.21.15.6:0/1011157282 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2320700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1ec100e90 0x7fe1ec198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f1b1f700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 0x7fe1ec1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 -- 172.21.15.6:0/1011157282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1ec100e90 msgr2=0x7fe1ec198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1ec100e90 0x7fe1ec198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 -- 172.21.15.6:0/1011157282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 msgr2=0x7fe1ec1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 0x7fe1ec1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 -- 172.21.15.6:0/1011157282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80095f0 con 0x7fe1ec102a30 2023-10-14T08:52:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f1b1f700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 0x7fe1ec1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.738+0000 7fe1f2b21700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 0x7fe1ec1a0460 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4007ee0 tx=0x7fe1e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.739+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4017070 con 0x7fe1ec102a30 2023-10-14T08:52:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.739+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e400f040 con 0x7fe1ec102a30 2023-10-14T08:52:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.739+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec1a0fe0 con 0x7fe1ec102a30 2023-10-14T08:52:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.739+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4005740 con 0x7fe1ec102a30 2023-10-14T08:52:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.739+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec1a1410 con 0x7fe1ec102a30 2023-10-14T08:52:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.740+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec193590 con 0x7fe1ec102a30 2023-10-14T08:52:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.741+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fe1e40058a0 con 0x7fe1ec102a30 2023-10-14T08:52:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.741+0000 7fe1e37fe700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1d80a1510 0x7fe1d80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.742+0000 7fe1f2320700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1d80a1510 0x7fe1d80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.742+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1e40ccda0 con 0x7fe1ec102a30 2023-10-14T08:52:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.742+0000 7fe1f2320700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1d80a1510 0x7fe1d80a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8006010 tx=0x7fe1e800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:08.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.745+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe1e4096260 con 0x7fe1ec102a30 2023-10-14T08:52:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.948+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ec10c7a0 con 0x7fe1ec102a30 2023-10-14T08:52:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.949+0000 7fe1e37fe700 1 -- 172.21.15.6:0/1011157282 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7fe1e4099880 con 0x7fe1ec102a30 2023-10-14T08:52:08.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:08.952 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.951+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1d80a1510 msgr2=0x7fe1d80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.951+0000 7fe1f4584700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1d80a1510 0x7fe1d80a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8006010 tx=0x7fe1e800b540 comp rx=0 tx=0).stop 2023-10-14T08:52:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.951+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 msgr2=0x7fe1ec1a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 0x7fe1ec1a0460 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4007ee0 tx=0x7fe1e400d3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 shutdown_connections 2023-10-14T08:52:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1ec102a30 0x7fe1ec1a0460 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1ec100e90 0x7fe1ec198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1d80a1510 0x7fe1d80a39d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 --2- 172.21.15.6:0/1011157282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1ec102070 0x7fe1ec1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 >> 172.21.15.6:0/1011157282 conn(0x7fe1ec0fc430 msgr2=0x7fe1ec1079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 shutdown_connections 2023-10-14T08:52:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:08.952+0000 7fe1f4584700 1 -- 172.21.15.6:0/1011157282 wait complete. 2023-10-14T08:52:08.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:08.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:09.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 -- 172.21.15.6:0/3984308402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101a30 msgr2=0x7f2a58108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/3984308402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101a30 0x7f2a58108350 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000b0a0 tx=0x7f2a5000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 -- 172.21.15.6:0/3984308402 shutdown_connections 2023-10-14T08:52:09.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/3984308402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101a30 0x7f2a58108350 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/3984308402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580ffe90 0x7f2a581002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/3984308402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101070 0x7f2a581014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.094+0000 7f2a5eb45700 1 -- 172.21.15.6:0/3984308402 >> 172.21.15.6:0/3984308402 conn(0x7f2a580fb450 msgr2=0x7f2a580fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:09.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 -- 172.21.15.6:0/3984308402 shutdown_connections 2023-10-14T08:52:09.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 -- 172.21.15.6:0/3984308402 wait complete. 2023-10-14T08:52:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 Processor -- start 2023-10-14T08:52:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 -- start start 2023-10-14T08:52:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580ffe90 0x7f2a58069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 0x7f2a5819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101a30 0x7f2a5819e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5819e890 con 0x7f2a58101070 2023-10-14T08:52:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5819ea00 con 0x7f2a580ffe90 2023-10-14T08:52:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a5eb45700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5819ebc0 con 0x7f2a58101a30 2023-10-14T08:52:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 0x7f2a5819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 0x7f2a5819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60012/0 (socket says 172.21.15.6:60012) 2023-10-14T08:52:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.095+0000 7f2a57fff700 1 -- 172.21.15.6:0/561641608 learned_addr learned my addr 172.21.15.6:0/561641608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a5c8e1700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580ffe90 0x7f2a58069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a5d0e2700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101a30 0x7f2a5819e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a57fff700 1 -- 172.21.15.6:0/561641608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101a30 msgr2=0x7f2a5819e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a57fff700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101a30 0x7f2a5819e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a57fff700 1 -- 172.21.15.6:0/561641608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580ffe90 msgr2=0x7f2a58069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a57fff700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580ffe90 0x7f2a58069a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a57fff700 1 -- 172.21.15.6:0/561641608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009d00 con 0x7f2a58101070 2023-10-14T08:52:09.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a5d0e2700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101a30 0x7f2a5819e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:09.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a57fff700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 0x7f2a5819ba70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400d980 tx=0x7f2a4400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:09.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44004020 con 0x7f2a58101070 2023-10-14T08:52:09.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a44009730 con 0x7f2a58101070 2023-10-14T08:52:09.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44003a80 con 0x7f2a58101070 2023-10-14T08:52:09.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5819eea0 con 0x7f2a58101070 2023-10-14T08:52:09.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.096+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5819f320 con 0x7f2a58101070 2023-10-14T08:52:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.097+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5810b700 con 0x7f2a58101070 2023-10-14T08:52:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.098+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f2a440098a0 con 0x7f2a58101070 2023-10-14T08:52:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.099+0000 7f2a55ffb700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2a480a1590 0x7f2a480a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.099+0000 7f2a5c8e1700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2a480a1590 0x7f2a480a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.099+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2a440ccae0 con 0x7f2a58101070 2023-10-14T08:52:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.100+0000 7f2a5c8e1700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2a480a1590 0x7f2a480a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2a58100be0 tx=0x7f2a4c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:09.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.104+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2a44095fe0 con 0x7f2a58101070 2023-10-14T08:52:09.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:09 smithi006 ceph-mon[99452]: pgmap v286: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:09.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:09 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1406206529' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-14T08:52:09.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:09 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1011157282' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.306+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a58106d20 con 0x7f2a58101070 2023-10-14T08:52:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.307+0000 7f2a55ffb700 1 -- 172.21.15.6:0/561641608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a44099600 con 0x7f2a58101070 2023-10-14T08:52:09.309 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2a480a1590 msgr2=0x7f2a480a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2a480a1590 0x7f2a480a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2a58100be0 tx=0x7f2a4c00b410 comp rx=0 tx=0).stop 2023-10-14T08:52:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 msgr2=0x7f2a5819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 0x7f2a5819ba70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400d980 tx=0x7f2a4400dc90 comp rx=0 tx=0).stop 2023-10-14T08:52:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 shutdown_connections 2023-10-14T08:52:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58101a30 0x7f2a5819e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2a480a1590 0x7f2a480a3a50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a580ffe90 0x7f2a58069a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 --2- 172.21.15.6:0/561641608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a58101070 0x7f2a5819ba70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 >> 172.21.15.6:0/561641608 conn(0x7f2a580fb450 msgr2=0x7f2a580fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 shutdown_connections 2023-10-14T08:52:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.309+0000 7f2a5eb45700 1 -- 172.21.15.6:0/561641608 wait complete. 2023-10-14T08:52:09.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:09.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:09 smithi178 ceph-mon[103612]: pgmap v286: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:09 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1406206529' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-14T08:52:09.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:09 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1011157282' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:09 smithi057 ceph-mon[103313]: pgmap v286: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:09 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1406206529' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-14T08:52:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:09 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1011157282' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 -- 172.21.15.6:0/426166094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 msgr2=0x7f48a01002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/426166094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a01002c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4894009990 tx=0x7f4894009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 -- 172.21.15.6:0/426166094 shutdown_connections 2023-10-14T08:52:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/426166094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a01019b0 0x7f48a01082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/426166094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a01002c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/426166094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48a0100ff0 0x7f48a0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 -- 172.21.15.6:0/426166094 >> 172.21.15.6:0/426166094 conn(0x7f48a00fb430 msgr2=0x7f48a00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 -- 172.21.15.6:0/426166094 shutdown_connections 2023-10-14T08:52:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 -- 172.21.15.6:0/426166094 wait complete. 2023-10-14T08:52:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.451+0000 7f48a6e2c700 1 Processor -- start 2023-10-14T08:52:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 -- start start 2023-10-14T08:52:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0100ff0 0x7f48a0197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48a01019b0 0x7f48a019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a019e830 con 0x7f48a00ffea0 2023-10-14T08:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a019e9a0 con 0x7f48a01019b0 2023-10-14T08:52:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a019eb60 con 0x7f48a0100ff0 2023-10-14T08:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a0196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60024/0 (socket says 172.21.15.6:60024) 2023-10-14T08:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 -- 172.21.15.6:0/449716571 learned_addr learned my addr 172.21.15.6:0/449716571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f489ffff700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0100ff0 0x7f48a0197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 -- 172.21.15.6:0/449716571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0100ff0 msgr2=0x7f48a0197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0100ff0 0x7f48a0197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 -- 172.21.15.6:0/449716571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48a01019b0 msgr2=0x7f48a019e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48a01019b0 0x7f48a019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 -- 172.21.15.6:0/449716571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940095f0 con 0x7f48a00ffea0 2023-10-14T08:52:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f489ffff700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0100ff0 0x7f48a0197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:09.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a4bc8700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a0196cf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4894005910 tx=0x7f4894005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:09.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489401d070 con 0x7f48a00ffea0 2023-10-14T08:52:09.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4894004060 con 0x7f48a00ffea0 2023-10-14T08:52:09.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894022e10 con 0x7f48a00ffea0 2023-10-14T08:52:09.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.452+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a019ede0 con 0x7f48a00ffea0 2023-10-14T08:52:09.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.453+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a019f1b0 con 0x7f48a00ffea0 2023-10-14T08:52:09.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.454+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a0108010 con 0x7f48a00ffea0 2023-10-14T08:52:09.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.455+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4894022470 con 0x7f48a00ffea0 2023-10-14T08:52:09.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.455+0000 7f489dffb700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f48900a1590 0x7f48900a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.455+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f48940ce2b0 con 0x7f48a00ffea0 2023-10-14T08:52:09.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.455+0000 7f489ffff700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f48900a1590 0x7f48900a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.456+0000 7f489ffff700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f48900a1590 0x7f48900a3a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f488c005fd0 tx=0x7f488c005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.460+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f48940978d0 con 0x7f48a00ffea0 2023-10-14T08:52:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.662+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48a010b950 con 0x7f48a00ffea0 2023-10-14T08:52:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.663+0000 7f489dffb700 1 -- 172.21.15.6:0/449716571 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4894027020 con 0x7f48a00ffea0 2023-10-14T08:52:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f48900a1590 msgr2=0x7f48900a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f48900a1590 0x7f48900a3a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f488c005fd0 tx=0x7f488c005ee0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 msgr2=0x7f48a0196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a0196cf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4894005910 tx=0x7f4894005e80 comp rx=0 tx=0).stop 2023-10-14T08:52:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 shutdown_connections 2023-10-14T08:52:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f48900a1590 0x7f48900a3a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48a01019b0 0x7f48a019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48a00ffea0 0x7f48a0196cf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 --2- 172.21.15.6:0/449716571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0100ff0 0x7f48a0197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 >> 172.21.15.6:0/449716571 conn(0x7f48a00fb430 msgr2=0x7f48a00fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 shutdown_connections 2023-10-14T08:52:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.665+0000 7f48a6e2c700 1 -- 172.21.15.6:0/449716571 wait complete. 2023-10-14T08:52:09.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 -- 172.21.15.6:0/1164158882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 msgr2=0x7f5cfc1002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1164158882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc1002d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009990 tx=0x7f5cf0009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 -- 172.21.15.6:0/1164158882 shutdown_connections 2023-10-14T08:52:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1164158882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cfc101a50 0x7f5cfc108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1164158882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc1002d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1164158882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101090 0x7f5cfc101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 -- 172.21.15.6:0/1164158882 >> 172.21.15.6:0/1164158882 conn(0x7f5cfc0fb450 msgr2=0x7f5cfc0fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 -- 172.21.15.6:0/1164158882 shutdown_connections 2023-10-14T08:52:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 -- 172.21.15.6:0/1164158882 wait complete. 2023-10-14T08:52:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.807+0000 7f5d0303e700 1 Processor -- start 2023-10-14T08:52:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 -- start start 2023-10-14T08:52:09.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cfc101090 0x7f5cfc199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101a50 0x7f5cfc1a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1a0aa0 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1a0be0 con 0x7f5cfc101090 2023-10-14T08:52:09.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d0303e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1a0d70 con 0x7f5cfc101a50 2023-10-14T08:52:09.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60038/0 (socket says 172.21.15.6:60038) 2023-10-14T08:52:09.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 -- 172.21.15.6:0/1258828584 learned_addr learned my addr 172.21.15.6:0/1258828584 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:09.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5cfbfff700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cfc101090 0x7f5cfc199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 -- 172.21.15.6:0/1258828584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101a50 msgr2=0x7f5cfc1a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d015db700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101a50 0x7f5cfc1a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101a50 0x7f5cfc1a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 -- 172.21.15.6:0/1258828584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cfc101090 msgr2=0x7f5cfc199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cfc101090 0x7f5cfc199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 -- 172.21.15.6:0/1258828584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00095f0 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d015db700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101a50 0x7f5cfc1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5d00dda700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc198f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00095c0 tx=0x7f5cf000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.808+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf001d070 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.809+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cf0022470 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.809+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc1a0ff0 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.809+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0017650 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.809+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc1a1360 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.810+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc10b6b0 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.811+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f5cf000fad0 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.811+0000 7f5cf9ffb700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5cec0a1510 0x7f5cec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:09.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.812+0000 7f5cfbfff700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5cec0a1510 0x7f5cec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:09.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.812+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5cf00ce140 con 0x7f5cfc0ffeb0 2023-10-14T08:52:09.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.812+0000 7f5cfbfff700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5cec0a1510 0x7f5cec0a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0ffbd0 tx=0x7f5ce800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:09.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:09.816+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5cf00977f0 con 0x7f5cfc0ffeb0 2023-10-14T08:52:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.016+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5cfc1a1550 con 0x7f5cfc0ffeb0 2023-10-14T08:52:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.016+0000 7f5cf9ffb700 1 -- 172.21.15.6:0/1258828584 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cf0027020 con 0x7f5cfc0ffeb0 2023-10-14T08:52:10.018 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.018+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5cec0a1510 msgr2=0x7f5cec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.018+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5cec0a1510 0x7f5cec0a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0ffbd0 tx=0x7f5ce800b410 comp rx=0 tx=0).stop 2023-10-14T08:52:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.018+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 msgr2=0x7f5cfc198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.018+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc198f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00095c0 tx=0x7f5cf000f690 comp rx=0 tx=0).stop 2023-10-14T08:52:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 shutdown_connections 2023-10-14T08:52:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc101a50 0x7f5cfc1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cfc0ffeb0 0x7f5cfc198f20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5cec0a1510 0x7f5cec0a39d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 --2- 172.21.15.6:0/1258828584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cfc101090 0x7f5cfc199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 >> 172.21.15.6:0/1258828584 conn(0x7f5cfc0fb450 msgr2=0x7f5cfc069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 shutdown_connections 2023-10-14T08:52:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.019+0000 7f5d0303e700 1 -- 172.21.15.6:0/1258828584 wait complete. 2023-10-14T08:52:10.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:10.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 -- 172.21.15.6:0/1605511231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102a30 msgr2=0x7ff068109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/1605511231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102a30 0x7ff068109350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff060009990 tx=0x7ff060009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 -- 172.21.15.6:0/1605511231 shutdown_connections 2023-10-14T08:52:10.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/1605511231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102a30 0x7ff068109350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/1605511231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068100f20 0x7ff068101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/1605511231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff068102070 0x7ff0681024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 -- 172.21.15.6:0/1605511231 >> 172.21.15.6:0/1605511231 conn(0x7ff0680fc470 msgr2=0x7ff0680fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 -- 172.21.15.6:0/1605511231 shutdown_connections 2023-10-14T08:52:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 -- 172.21.15.6:0/1605511231 wait complete. 2023-10-14T08:52:10.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.159+0000 7ff06e1c0700 1 Processor -- start 2023-10-14T08:52:10.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 -- start start 2023-10-14T08:52:10.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff068100f20 0x7ff068196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 0x7ff0681971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068102a30 0x7ff06819e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06819e7c0 con 0x7ff068102070 2023-10-14T08:52:10.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06819e930 con 0x7ff068102a30 2023-10-14T08:52:10.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06819eaf0 con 0x7ff068100f20 2023-10-14T08:52:10.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 0x7ff0681971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 0x7ff0681971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60054/0 (socket says 172.21.15.6:60054) 2023-10-14T08:52:10.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 -- 172.21.15.6:0/3550691530 learned_addr learned my addr 172.21.15.6:0/3550691530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:10.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff0677fe700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff068100f20 0x7ff068196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff067fff700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068102a30 0x7ff06819e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 -- 172.21.15.6:0/3550691530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff068100f20 msgr2=0x7ff068196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff068100f20 0x7ff068196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 -- 172.21.15.6:0/3550691530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068102a30 msgr2=0x7ff06819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068102a30 0x7ff06819e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 -- 172.21.15.6:0/3550691530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600095f0 con 0x7ff068102070 2023-10-14T08:52:10.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff067fff700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068102a30 0x7ff06819e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:10.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff066ffd700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 0x7ff0681971c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff05800ba50 tx=0x7ff05800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:10.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800cab0 con 0x7ff068102070 2023-10-14T08:52:10.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06819edd0 con 0x7ff068102070 2023-10-14T08:52:10.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff05800cc10 con 0x7ff068102070 2023-10-14T08:52:10.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580075d0 con 0x7ff068102070 2023-10-14T08:52:10.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.160+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06819f2d0 con 0x7ff068102070 2023-10-14T08:52:10.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.162+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06810c9b0 con 0x7ff068102070 2023-10-14T08:52:10.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.163+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7ff058014440 con 0x7ff068102070 2023-10-14T08:52:10.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.163+0000 7ff064ff9700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff0500a1510 0x7ff0500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.163+0000 7ff0677fe700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff0500a1510 0x7ff0500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.163+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff058006e40 con 0x7ff068102070 2023-10-14T08:52:10.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.164+0000 7ff0677fe700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff0500a1510 0x7ff0500a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff05c006fd0 tx=0x7ff05c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:10.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.168+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff058095c40 con 0x7ff068102070 2023-10-14T08:52:10.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/561641608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/449716571' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1258828584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.420+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff068107da0 con 0x7ff068102070 2023-10-14T08:52:10.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.421+0000 7ff064ff9700 1 -- 172.21.15.6:0/3550691530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7ff058099260 con 0x7ff068102070 2023-10-14T08:52:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:10.423 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff0500a1510 msgr2=0x7ff0500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff0500a1510 0x7ff0500a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff05c006fd0 tx=0x7ff05c008040 comp rx=0 tx=0).stop 2023-10-14T08:52:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 msgr2=0x7ff0681971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 0x7ff0681971c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff05800ba50 tx=0x7ff05800be10 comp rx=0 tx=0).stop 2023-10-14T08:52:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 shutdown_connections 2023-10-14T08:52:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff0500a1510 0x7ff0500a39d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff068102a30 0x7ff06819e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff068100f20 0x7ff068196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 --2- 172.21.15.6:0/3550691530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff068102070 0x7ff0681971c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 >> 172.21.15.6:0/3550691530 conn(0x7ff0680fc470 msgr2=0x7ff0680fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.423+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 shutdown_connections 2023-10-14T08:52:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.424+0000 7ff06e1c0700 1 -- 172.21.15.6:0/3550691530 wait complete. 2023-10-14T08:52:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:10.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/561641608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/449716571' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1258828584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:10.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:10 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/561641608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:10 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/449716571' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:10 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1258828584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 -- 172.21.15.6:0/1041402385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68900ffde0 msgr2=0x7f6890100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 --2- 172.21.15.6:0/1041402385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68900ffde0 0x7f6890100200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68800099c0 tx=0x7f6880009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 -- 172.21.15.6:0/1041402385 shutdown_connections 2023-10-14T08:52:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 --2- 172.21.15.6:0/1041402385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6890101970 0x7f6890108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 --2- 172.21.15.6:0/1041402385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68900ffde0 0x7f6890100200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 --2- 172.21.15.6:0/1041402385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890100fd0 0x7f6890101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 -- 172.21.15.6:0/1041402385 >> 172.21.15.6:0/1041402385 conn(0x7f68900fb310 msgr2=0x7f68900fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:10.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 -- 172.21.15.6:0/1041402385 shutdown_connections 2023-10-14T08:52:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.563+0000 7f6896238700 1 -- 172.21.15.6:0/1041402385 wait complete. 2023-10-14T08:52:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 Processor -- start 2023-10-14T08:52:10.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 -- start start 2023-10-14T08:52:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68900ffde0 0x7f6890068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 0x7f689019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890101970 0x7f689019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019e780 con 0x7f6890100fd0 2023-10-14T08:52:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019e8f0 con 0x7f68900ffde0 2023-10-14T08:52:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f6896238700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689019eab0 con 0x7f6890101970 2023-10-14T08:52:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 0x7f689019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 0x7f689019b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60068/0 (socket says 172.21.15.6:60068) 2023-10-14T08:52:10.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 -- 172.21.15.6:0/3977468583 learned_addr learned my addr 172.21.15.6:0/3977468583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688f7fe700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68900ffde0 0x7f6890068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688ffff700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890101970 0x7f689019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 -- 172.21.15.6:0/3977468583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890101970 msgr2=0x7f689019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890101970 0x7f689019dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 -- 172.21.15.6:0/3977468583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68900ffde0 msgr2=0x7f6890068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68900ffde0 0x7f6890068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688effd700 1 -- 172.21.15.6:0/3977468583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800095f0 con 0x7f6890100fd0 2023-10-14T08:52:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.564+0000 7f688ffff700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890101970 0x7f689019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.565+0000 7f688effd700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 0x7f689019b960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f687800c920 tx=0x7f687800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.565+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878007b00 con 0x7f6890100fd0 2023-10-14T08:52:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.565+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f687800ce70 con 0x7f6890100fd0 2023-10-14T08:52:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.565+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689019ed90 con 0x7f6890100fd0 2023-10-14T08:52:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.565+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780054e0 con 0x7f6890100fd0 2023-10-14T08:52:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.565+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689019f260 con 0x7f6890100fd0 2023-10-14T08:52:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.566+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689010b640 con 0x7f6890100fd0 2023-10-14T08:52:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.567+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f6878004750 con 0x7f6890100fd0 2023-10-14T08:52:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.567+0000 7f688cff9700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f687c0a1590 0x7f687c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.568+0000 7f688f7fe700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f687c0a1590 0x7f687c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.568+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f68780ccdd0 con 0x7f6890100fd0 2023-10-14T08:52:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.568+0000 7f688f7fe700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f687c0a1590 0x7f687c0a3a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f688000b580 tx=0x7f6880009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.571+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6878096310 con 0x7f6890100fd0 2023-10-14T08:52:10.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.773+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6890106d60 con 0x7f6890100fd0 2023-10-14T08:52:10.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.775+0000 7f688cff9700 1 -- 172.21.15.6:0/3977468583 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f687801d070 con 0x7f6890100fd0 2023-10-14T08:52:10.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:10.777 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:10.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f687c0a1590 msgr2=0x7f687c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f687c0a1590 0x7f687c0a3a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f688000b580 tx=0x7f6880009f10 comp rx=0 tx=0).stop 2023-10-14T08:52:10.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 msgr2=0x7f689019b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 0x7f689019b960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f687800c920 tx=0x7f687800cc30 comp rx=0 tx=0).stop 2023-10-14T08:52:10.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 shutdown_connections 2023-10-14T08:52:10.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6890101970 0x7f689019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f687c0a1590 0x7f687c0a3a50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68900ffde0 0x7f6890068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 --2- 172.21.15.6:0/3977468583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6890100fd0 0x7f689019b960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 >> 172.21.15.6:0/3977468583 conn(0x7f68900fb310 msgr2=0x7f68900fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:10.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 shutdown_connections 2023-10-14T08:52:10.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.777+0000 7f6896238700 1 -- 172.21.15.6:0/3977468583 wait complete. 2023-10-14T08:52:10.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:10.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 -- 172.21.15.6:0/1155381952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868101530 msgr2=0x7f5868101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 --2- 172.21.15.6:0/1155381952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868101530 0x7f5868101950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5858009990 tx=0x7f5858009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 -- 172.21.15.6:0/1155381952 shutdown_connections 2023-10-14T08:52:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 --2- 172.21.15.6:0/1155381952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5868100ab0 0x7f5868108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 --2- 172.21.15.6:0/1155381952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868101530 0x7f5868101950 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 --2- 172.21.15.6:0/1155381952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58681000f0 0x7f5868100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 -- 172.21.15.6:0/1155381952 >> 172.21.15.6:0/1155381952 conn(0x7f58680fab80 msgr2=0x7f58680fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 -- 172.21.15.6:0/1155381952 shutdown_connections 2023-10-14T08:52:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.919+0000 7f587055c700 1 -- 172.21.15.6:0/1155381952 wait complete. 2023-10-14T08:52:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 Processor -- start 2023-10-14T08:52:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 -- start start 2023-10-14T08:52:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58681000f0 0x7f58680ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 0x7f586819de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5868101530 0x7f58681a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58681a0a00 con 0x7f5868100ab0 2023-10-14T08:52:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58681a0b70 con 0x7f5868101530 2023-10-14T08:52:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f587055c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58681a0d30 con 0x7f58681000f0 2023-10-14T08:52:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 0x7f586819de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 0x7f586819de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60082/0 (socket says 172.21.15.6:60082) 2023-10-14T08:52:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 -- 172.21.15.6:0/1130255177 learned_addr learned my addr 172.21.15.6:0/1130255177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586eaf9700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5868101530 0x7f58681a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586e2f8700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58681000f0 0x7f58680ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 -- 172.21.15.6:0/1130255177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58681000f0 msgr2=0x7f58680ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58681000f0 0x7f58680ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 -- 172.21.15.6:0/1130255177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5868101530 msgr2=0x7f58681a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:10.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5868101530 0x7f58681a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:10.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 -- 172.21.15.6:0/1130255177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580095f0 con 0x7f5868100ab0 2023-10-14T08:52:10.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.920+0000 7f586daf7700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 0x7f586819de00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f586400d980 tx=0x7f586400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:10.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.921+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864004220 con 0x7f5868100ab0 2023-10-14T08:52:10.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.921+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5864007640 con 0x7f5868100ab0 2023-10-14T08:52:10.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.921+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58681a0fb0 con 0x7f5868100ab0 2023-10-14T08:52:10.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.921+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864005610 con 0x7f5868100ab0 2023-10-14T08:52:10.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.921+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58681a1490 con 0x7f5868100ab0 2023-10-14T08:52:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.922+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586810b6f0 con 0x7f5868100ab0 2023-10-14T08:52:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.923+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f5864004750 con 0x7f5868100ab0 2023-10-14T08:52:10.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.923+0000 7f585f7fe700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58540a1510 0x7f58540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.923+0000 7f586e2f8700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58540a1510 0x7f58540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.923+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f58640cd210 con 0x7f5868100ab0 2023-10-14T08:52:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.924+0000 7f586e2f8700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58540a1510 0x7f58540a39d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f585800b5c0 tx=0x7f5858005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:10.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:10.927+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5864096710 con 0x7f5868100ab0 2023-10-14T08:52:11.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.129+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5868106e60 con 0x7f5868100ab0 2023-10-14T08:52:11.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.129+0000 7f585f7fe700 1 -- 172.21.15.6:0/1130255177 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5864016020 con 0x7f5868100ab0 2023-10-14T08:52:11.131 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58540a1510 msgr2=0x7f58540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58540a1510 0x7f58540a39d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f585800b5c0 tx=0x7f5858005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 msgr2=0x7f586819de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 0x7f586819de00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f586400d980 tx=0x7f586400dc90 comp rx=0 tx=0).stop 2023-10-14T08:52:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 shutdown_connections 2023-10-14T08:52:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f58540a1510 0x7f58540a39d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5868101530 0x7f58681a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58681000f0 0x7f58680ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 --2- 172.21.15.6:0/1130255177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5868100ab0 0x7f586819de00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 >> 172.21.15.6:0/1130255177 conn(0x7f58680fab80 msgr2=0x7f58680fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 shutdown_connections 2023-10-14T08:52:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.132+0000 7f587055c700 1 -- 172.21.15.6:0/1130255177 wait complete. 2023-10-14T08:52:11.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 -- 172.21.15.6:0/1108165571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c101a80 msgr2=0x7f612c103e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 --2- 172.21.15.6:0/1108165571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c101a80 0x7f612c103e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f611c009990 tx=0x7f611c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 -- 172.21.15.6:0/1108165571 shutdown_connections 2023-10-14T08:52:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 --2- 172.21.15.6:0/1108165571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c106ce0 0x7f612c1090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 --2- 172.21.15.6:0/1108165571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c101a80 0x7f612c103e70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 --2- 172.21.15.6:0/1108165571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 0x7f612c1067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 -- 172.21.15.6:0/1108165571 >> 172.21.15.6:0/1108165571 conn(0x7f612c0fb430 msgr2=0x7f612c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 -- 172.21.15.6:0/1108165571 shutdown_connections 2023-10-14T08:52:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 -- 172.21.15.6:0/1108165571 wait complete. 2023-10-14T08:52:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.274+0000 7f6132151700 1 Processor -- start 2023-10-14T08:52:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 -- start start 2023-10-14T08:52:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c101a80 0x7f612c1013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 0x7f612c0ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 0x7f612c0fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c100710 con 0x7f612c106ce0 2023-10-14T08:52:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c100880 con 0x7f612c101a80 2023-10-14T08:52:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1a0c40 con 0x7f612c1043b0 2023-10-14T08:52:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 0x7f612c0fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 0x7f612c0fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60098/0 (socket says 172.21.15.6:60098) 2023-10-14T08:52:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 -- 172.21.15.6:0/1690640954 learned_addr learned my addr 172.21.15.6:0/1690640954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612b7fe700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c101a80 0x7f612c1013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612affd700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 0x7f612c0ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 -- 172.21.15.6:0/1690640954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 msgr2=0x7f612c0ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 0x7f612c0ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 -- 172.21.15.6:0/1690640954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c101a80 msgr2=0x7f612c1013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c101a80 0x7f612c1013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 -- 172.21.15.6:0/1690640954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0095f0 con 0x7f612c106ce0 2023-10-14T08:52:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612affd700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 0x7f612c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612b7fe700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c101a80 0x7f612c1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f612bfff700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 0x7f612c0fff70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6124007d70 tx=0x7f612400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612400ad40 con 0x7f612c106ce0 2023-10-14T08:52:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61240128e0 con 0x7f612c106ce0 2023-10-14T08:52:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c1a0f20 con 0x7f612c106ce0 2023-10-14T08:52:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.275+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124011780 con 0x7f612c106ce0 2023-10-14T08:52:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.276+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c1a1350 con 0x7f612c106ce0 2023-10-14T08:52:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.277+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c0fcfb0 con 0x7f612c106ce0 2023-10-14T08:52:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.278+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f6124012a50 con 0x7f612c106ce0 2023-10-14T08:52:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.278+0000 7f6128ff9700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61140a1510 0x7f61140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.279+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f61240cd0e0 con 0x7f612c106ce0 2023-10-14T08:52:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.279+0000 7f612b7fe700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61140a1510 0x7f61140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.279+0000 7f612b7fe700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61140a1510 0x7f61140a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f611c006010 tx=0x7f611c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.283+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f61240966f0 con 0x7f612c106ce0 2023-10-14T08:52:11.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:11 smithi178 ceph-mon[103612]: pgmap v287: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:11 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3550691530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:11 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3977468583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:11 smithi057 ceph-mon[103313]: pgmap v287: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:11 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3550691530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:11 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3977468583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:11 smithi006 ceph-mon[99452]: pgmap v287: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:11 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3550691530' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:11 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3977468583' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:11.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.487+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f612c10c9d0 con 0x7f612c106ce0 2023-10-14T08:52:11.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.487+0000 7f6128ff9700 1 -- 172.21.15.6:0/1690640954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6124099d10 con 0x7f612c106ce0 2023-10-14T08:52:11.489 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61140a1510 msgr2=0x7f61140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61140a1510 0x7f61140a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f611c006010 tx=0x7f611c00b540 comp rx=0 tx=0).stop 2023-10-14T08:52:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 msgr2=0x7f612c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 0x7f612c0fff70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6124007d70 tx=0x7f612400a340 comp rx=0 tx=0).stop 2023-10-14T08:52:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 shutdown_connections 2023-10-14T08:52:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f612c106ce0 0x7f612c0fff70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61140a1510 0x7f61140a39d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f612c101a80 0x7f612c1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 --2- 172.21.15.6:0/1690640954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c1043b0 0x7f612c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 >> 172.21.15.6:0/1690640954 conn(0x7f612c0fb430 msgr2=0x7f612c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 shutdown_connections 2023-10-14T08:52:11.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.490+0000 7f6132151700 1 -- 172.21.15.6:0/1690640954 wait complete. 2023-10-14T08:52:11.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:11.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.630+0000 7f844f16b700 1 -- 172.21.15.6:0/2836273293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 msgr2=0x7f8448101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.630+0000 7f844f16b700 1 --2- 172.21.15.6:0/2836273293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f8448101470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8434009990 tx=0x7f8434009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- 172.21.15.6:0/2836273293 shutdown_connections 2023-10-14T08:52:11.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 --2- 172.21.15.6:0/2836273293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84481019b0 0x7f84481082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 --2- 172.21.15.6:0/2836273293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84480ffea0 0x7f84481002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 --2- 172.21.15.6:0/2836273293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f8448101470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- 172.21.15.6:0/2836273293 >> 172.21.15.6:0/2836273293 conn(0x7f84480fb430 msgr2=0x7f84480fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:11.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- 172.21.15.6:0/2836273293 shutdown_connections 2023-10-14T08:52:11.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- 172.21.15.6:0/2836273293 wait complete. 2023-10-14T08:52:11.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 Processor -- start 2023-10-14T08:52:11.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- start start 2023-10-14T08:52:11.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84480ffea0 0x7f8448068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f844819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84481019b0 0x7f844819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844819e810 con 0x7f8448100ff0 2023-10-14T08:52:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844819e980 con 0x7f84481019b0 2023-10-14T08:52:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.631+0000 7f844f16b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844819eb40 con 0x7f84480ffea0 2023-10-14T08:52:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f844819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f844819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60110/0 (socket says 172.21.15.6:60110) 2023-10-14T08:52:11.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 -- 172.21.15.6:0/2268500899 learned_addr learned my addr 172.21.15.6:0/2268500899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:11.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f844cf07700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84480ffea0 0x7f8448068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f844d708700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84481019b0 0x7f844819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 -- 172.21.15.6:0/2268500899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84480ffea0 msgr2=0x7f8448068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84480ffea0 0x7f8448068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 -- 172.21.15.6:0/2268500899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84481019b0 msgr2=0x7f844819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84481019b0 0x7f844819e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 -- 172.21.15.6:0/2268500899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340095f0 con 0x7f8448100ff0 2023-10-14T08:52:11.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8447fff700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f844819ba30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f843400c010 tx=0x7f8434005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:11.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843401d070 con 0x7f8448100ff0 2023-10-14T08:52:11.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844819edc0 con 0x7f8448100ff0 2023-10-14T08:52:11.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8434004ca0 con 0x7f8448100ff0 2023-10-14T08:52:11.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340055e0 con 0x7f8448100ff0 2023-10-14T08:52:11.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.632+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844819f190 con 0x7f8448100ff0 2023-10-14T08:52:11.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.633+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844810b6f0 con 0x7f8448100ff0 2023-10-14T08:52:11.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.635+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f843400fc70 con 0x7f8448100ff0 2023-10-14T08:52:11.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.635+0000 7f8445ffb700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84380a1510 0x7f84380a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.635+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f84340ce680 con 0x7f8448100ff0 2023-10-14T08:52:11.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.635+0000 7f844cf07700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84380a1510 0x7f84380a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.636+0000 7f844cf07700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84380a1510 0x7f84380a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f843c009bf0 tx=0x7f843c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:11.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.639+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8434097bd0 con 0x7f8448100ff0 2023-10-14T08:52:11.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.838+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f844819f3e0 con 0x7f8448100ff0 2023-10-14T08:52:11.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.838+0000 7f8445ffb700 1 -- 172.21.15.6:0/2268500899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8434005740 con 0x7f8448100ff0 2023-10-14T08:52:11.840 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:11.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84380a1510 msgr2=0x7f84380a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84380a1510 0x7f84380a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f843c009bf0 tx=0x7f843c009260 comp rx=0 tx=0).stop 2023-10-14T08:52:11.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 msgr2=0x7f844819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f844819ba30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f843400c010 tx=0x7f8434005e80 comp rx=0 tx=0).stop 2023-10-14T08:52:11.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 shutdown_connections 2023-10-14T08:52:11.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84380a1510 0x7f84380a39d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84481019b0 0x7f844819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84480ffea0 0x7f8448068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 --2- 172.21.15.6:0/2268500899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8448100ff0 0x7f844819ba30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 >> 172.21.15.6:0/2268500899 conn(0x7f84480fb430 msgr2=0x7f84480fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:11.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 shutdown_connections 2023-10-14T08:52:11.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.841+0000 7f844f16b700 1 -- 172.21.15.6:0/2268500899 wait complete. 2023-10-14T08:52:11.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:11.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 -- 172.21.15.6:0/461687350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200ff8c0 msgr2=0x7fa520109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 --2- 172.21.15.6:0/461687350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200ff8c0 0x7fa520109490 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa51800b0d0 tx=0x7fa51800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 -- 172.21.15.6:0/461687350 shutdown_connections 2023-10-14T08:52:11.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 --2- 172.21.15.6:0/461687350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200ff8c0 0x7fa520109490 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 --2- 172.21.15.6:0/461687350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5201024b0 0x7fa5201028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 --2- 172.21.15.6:0/461687350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5200fef20 0x7fa5200ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 -- 172.21.15.6:0/461687350 >> 172.21.15.6:0/461687350 conn(0x7fa5200faa80 msgr2=0x7fa5200fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 -- 172.21.15.6:0/461687350 shutdown_connections 2023-10-14T08:52:11.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 -- 172.21.15.6:0/461687350 wait complete. 2023-10-14T08:52:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.981+0000 7fa52770c700 1 Processor -- start 2023-10-14T08:52:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 -- start start 2023-10-14T08:52:11.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 0x7fa520196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5200ff8c0 0x7fa520197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5201024b0 0x7fa52019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52019e740 con 0x7fa5200fef20 2023-10-14T08:52:11.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52019e880 con 0x7fa5201024b0 2023-10-14T08:52:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52019ea10 con 0x7fa5200ff8c0 2023-10-14T08:52:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 0x7fa520196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 0x7fa520196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60120/0 (socket says 172.21.15.6:60120) 2023-10-14T08:52:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 -- 172.21.15.6:0/631505913 learned_addr learned my addr 172.21.15.6:0/631505913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:11.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa524ca7700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5200ff8c0 0x7fa520197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa525ca9700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5201024b0 0x7fa52019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 -- 172.21.15.6:0/631505913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5200ff8c0 msgr2=0x7fa520197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5200ff8c0 0x7fa520197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 -- 172.21.15.6:0/631505913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5201024b0 msgr2=0x7fa52019e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:11.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5201024b0 0x7fa52019e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 -- 172.21.15.6:0/631505913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa518009d00 con 0x7fa5200fef20 2023-10-14T08:52:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa525ca9700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5201024b0 0x7fa52019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5254a8700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 0x7fa520196bc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa51000c990 tx=0x7fa51000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510007b00 con 0x7fa5200fef20 2023-10-14T08:52:11.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa510007c60 con 0x7fa5200fef20 2023-10-14T08:52:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52019ecf0 con 0x7fa5200fef20 2023-10-14T08:52:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510018660 con 0x7fa5200fef20 2023-10-14T08:52:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.982+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52019f1b0 con 0x7fa5200fef20 2023-10-14T08:52:11.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.983+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52010c6e0 con 0x7fa5200fef20 2023-10-14T08:52:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.985+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fa51000f450 con 0x7fa5200fef20 2023-10-14T08:52:11.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.985+0000 7fa5167fc700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa50c0a1510 0x7fa50c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:11.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.985+0000 7fa524ca7700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa50c0a1510 0x7fa50c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:11.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.985+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa5100cced0 con 0x7fa5200fef20 2023-10-14T08:52:11.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.986+0000 7fa524ca7700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa50c0a1510 0x7fa50c0a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa51c005950 tx=0x7fa51c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:11.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:11.989+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa510096460 con 0x7fa5200fef20 2023-10-14T08:52:12.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.241+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa520107e10 con 0x7fa5200fef20 2023-10-14T08:52:12.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.242+0000 7fa5167fc700 1 -- 172.21.15.6:0/631505913 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7fa510099a80 con 0x7fa5200fef20 2023-10-14T08:52:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:12.244 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.244+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa50c0a1510 msgr2=0x7fa50c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.244+0000 7fa52770c700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa50c0a1510 0x7fa50c0a39d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa51c005950 tx=0x7fa51c00a300 comp rx=0 tx=0).stop 2023-10-14T08:52:12.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.244+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 msgr2=0x7fa520196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.244+0000 7fa52770c700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 0x7fa520196bc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa51000c990 tx=0x7fa51000cca0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 shutdown_connections 2023-10-14T08:52:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa50c0a1510 0x7fa50c0a39d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5201024b0 0x7fa52019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5200fef20 0x7fa520196bc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 --2- 172.21.15.6:0/631505913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5200ff8c0 0x7fa520197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 >> 172.21.15.6:0/631505913 conn(0x7fa5200faa80 msgr2=0x7fa5200fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:12.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 shutdown_connections 2023-10-14T08:52:12.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.245+0000 7fa52770c700 1 -- 172.21.15.6:0/631505913 wait complete. 2023-10-14T08:52:12.249 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:12.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.382+0000 7f12b63bc700 1 -- 172.21.15.6:0/2413206524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102070 msgr2=0x7f12b01024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.382+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2413206524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102070 0x7f12b01024f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1298009990 tx=0x7f1298009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 -- 172.21.15.6:0/2413206524 shutdown_connections 2023-10-14T08:52:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2413206524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0102a30 0x7f12b0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2413206524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b0100e90 0x7f12b01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2413206524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102070 0x7f12b01024f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 -- 172.21.15.6:0/2413206524 >> 172.21.15.6:0/2413206524 conn(0x7f12b00fc430 msgr2=0x7f12b00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 -- 172.21.15.6:0/2413206524 shutdown_connections 2023-10-14T08:52:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 -- 172.21.15.6:0/2413206524 wait complete. 2023-10-14T08:52:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 Processor -- start 2023-10-14T08:52:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 -- start start 2023-10-14T08:52:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0100e90 0x7f12b0196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.383+0000 7f12b63bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b0102070 0x7f12b0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b63bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 0x7f12b019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b63bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b019e870 con 0x7f12b0102a30 2023-10-14T08:52:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b63bc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b019e9e0 con 0x7f12b0100e90 2023-10-14T08:52:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b63bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b019eba0 con 0x7f12b0102070 2023-10-14T08:52:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 0x7f12b019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 0x7f12b019e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60138/0 (socket says 172.21.15.6:60138) 2023-10-14T08:52:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 -- 172.21.15.6:0/2935895721 learned_addr learned my addr 172.21.15.6:0/2935895721 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12affff700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0100e90 0x7f12b0196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12af7fe700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b0102070 0x7f12b0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 -- 172.21.15.6:0/2935895721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b0102070 msgr2=0x7f12b0197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b0102070 0x7f12b0197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 -- 172.21.15.6:0/2935895721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0100e90 msgr2=0x7f12b0196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0100e90 0x7f12b0196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 -- 172.21.15.6:0/2935895721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980095f0 con 0x7f12b0102a30 2023-10-14T08:52:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12affff700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0100e90 0x7f12b0196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b4959700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 0x7f12b019e2a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b970 tx=0x7f12a800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800c9b0 con 0x7f12b0102a30 2023-10-14T08:52:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12a8014440 con 0x7f12b0102a30 2023-10-14T08:52:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b019ee80 con 0x7f12b0102a30 2023-10-14T08:52:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80075d0 con 0x7f12b0102a30 2023-10-14T08:52:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.384+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b019f320 con 0x7f12b0102a30 2023-10-14T08:52:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.385+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b01084d0 con 0x7f12b0102a30 2023-10-14T08:52:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.387+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f12a80145b0 con 0x7f12b0102a30 2023-10-14T08:52:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.387+0000 7f12ad7fa700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f129c0a1590 0x7f129c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.387+0000 7f12affff700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f129c0a1590 0x7f129c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.387+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f12a8006e40 con 0x7f12b0102a30 2023-10-14T08:52:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.388+0000 7f12affff700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f129c0a1590 0x7f129c0a3a50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f12b0198200 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.391+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f12a8095e60 con 0x7f12b0102a30 2023-10-14T08:52:12.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:12 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1130255177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:12 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1690640954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:12 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2268500899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1130255177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1690640954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2268500899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.595+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12b010ca40 con 0x7f12b0102a30 2023-10-14T08:52:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.597+0000 7f12ad7fa700 1 -- 172.21.15.6:0/2935895721 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f12a8023090 con 0x7f12b0102a30 2023-10-14T08:52:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:12.599 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f129c0a1590 msgr2=0x7f129c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f129c0a1590 0x7f129c0a3a50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f12b0198200 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2023-10-14T08:52:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 msgr2=0x7f12b019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 0x7f12b019e2a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b970 tx=0x7f12a800bd30 comp rx=0 tx=0).stop 2023-10-14T08:52:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 shutdown_connections 2023-10-14T08:52:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12b0102a30 0x7f12b019e2a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f129c0a1590 0x7f129c0a3a50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12b0100e90 0x7f12b0196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 --2- 172.21.15.6:0/2935895721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b0102070 0x7f12b0197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 >> 172.21.15.6:0/2935895721 conn(0x7f12b00fc430 msgr2=0x7f12b0105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 shutdown_connections 2023-10-14T08:52:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.599+0000 7f12b63bc700 1 -- 172.21.15.6:0/2935895721 wait complete. 2023-10-14T08:52:12.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:12.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:12 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1130255177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:12 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1690640954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:12 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2268500899' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:12.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 -- 172.21.15.6:0/2801327178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c102a30 msgr2=0x7fb77c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 --2- 172.21.15.6:0/2801327178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c102a30 0x7fb77c109350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb77400b0a0 tx=0x7fb77400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 -- 172.21.15.6:0/2801327178 shutdown_connections 2023-10-14T08:52:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 --2- 172.21.15.6:0/2801327178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c102a30 0x7fb77c109350 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 --2- 172.21.15.6:0/2801327178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c100e90 0x7fb77c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 --2- 172.21.15.6:0/2801327178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102070 0x7fb77c1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 -- 172.21.15.6:0/2801327178 >> 172.21.15.6:0/2801327178 conn(0x7fb77c0fc430 msgr2=0x7fb77c0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 -- 172.21.15.6:0/2801327178 shutdown_connections 2023-10-14T08:52:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.738+0000 7fb78309f700 1 -- 172.21.15.6:0/2801327178 wait complete. 2023-10-14T08:52:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 Processor -- start 2023-10-14T08:52:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 -- start start 2023-10-14T08:52:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 0x7fb77c074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c102070 0x7fb77c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102a30 0x7fb77c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c073f80 con 0x7fb77c100e90 2023-10-14T08:52:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0740f0 con 0x7fb77c102070 2023-10-14T08:52:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1a0cf0 con 0x7fb77c102a30 2023-10-14T08:52:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 0x7fb77c074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 0x7fb77c074c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60148/0 (socket says 172.21.15.6:60148) 2023-10-14T08:52:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 -- 172.21.15.6:0/1325332291 learned_addr learned my addr 172.21.15.6:0/1325332291 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78163c700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102a30 0x7fb77c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 -- 172.21.15.6:0/1325332291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102a30 msgr2=0x7fb77c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102a30 0x7fb77c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 -- 172.21.15.6:0/1325332291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c102070 msgr2=0x7fb77c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c102070 0x7fb77c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 -- 172.21.15.6:0/1325332291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009d00 con 0x7fb77c100e90 2023-10-14T08:52:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78163c700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102a30 0x7fb77c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb780e3b700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 0x7fb77c074c60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb77000d980 tx=0x7fb77000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000bb60 con 0x7fb77c100e90 2023-10-14T08:52:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb770007620 con 0x7fb77c100e90 2023-10-14T08:52:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000f620 con 0x7fb77c100e90 2023-10-14T08:52:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.739+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c1a0fd0 con 0x7fb77c100e90 2023-10-14T08:52:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.740+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c1a1400 con 0x7fb77c100e90 2023-10-14T08:52:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.741+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c10c730 con 0x7fb77c100e90 2023-10-14T08:52:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.742+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb770010460 con 0x7fb77c100e90 2023-10-14T08:52:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.742+0000 7fb779ffb700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb76c0a1590 0x7fb76c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.742+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb7700cce80 con 0x7fb77c100e90 2023-10-14T08:52:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.742+0000 7fb77bfff700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb76c0a1590 0x7fb76c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.743+0000 7fb77bfff700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb76c0a1590 0x7fb76c0a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb768005fd0 tx=0x7fb768005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:12.747+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb770096380 con 0x7fb77c100e90 2023-10-14T08:52:13.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.000+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb77c107da0 con 0x7fb77c100e90 2023-10-14T08:52:13.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.001+0000 7fb779ffb700 1 -- 172.21.15.6:0/1325332291 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7fb77000de60 con 0x7fb77c100e90 2023-10-14T08:52:13.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:13.002 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb76c0a1590 msgr2=0x7fb76c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb76c0a1590 0x7fb76c0a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb768005fd0 tx=0x7fb768005f00 comp rx=0 tx=0).stop 2023-10-14T08:52:13.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 msgr2=0x7fb77c074c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 0x7fb77c074c60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb77000d980 tx=0x7fb77000dd40 comp rx=0 tx=0).stop 2023-10-14T08:52:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 shutdown_connections 2023-10-14T08:52:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb77c102a30 0x7fb77c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb77c100e90 0x7fb77c074c60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb76c0a1590 0x7fb76c0a3a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 --2- 172.21.15.6:0/1325332291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c102070 0x7fb77c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 >> 172.21.15.6:0/1325332291 conn(0x7fb77c0fc430 msgr2=0x7fb77c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 shutdown_connections 2023-10-14T08:52:13.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.003+0000 7fb78309f700 1 -- 172.21.15.6:0/1325332291 wait complete. 2023-10-14T08:52:13.007 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:13.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-14T08:51:16.279910+0000', 'modified': '2023-10-14T08:51:24.158921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24508, 'mds_1': 24506, 'mds_2': 24473, 'mds_3': 24455, 'mds_4': 24434}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/977658940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 977658940}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 977658940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/4202282219', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 4202282219}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 4202282219}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24433': {'gid': 24433, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6833/3050202963', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 3050202963}, {'type': 'v1', 'addr': '172.21.15.178:6833', 'nonce': 3050202963}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.57:6833/1834864415', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1834864415}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1834864415}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.57:6835/2935762756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2935762756}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2935762756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.57:6837/1275682296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 1275682296}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 1275682296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/4072673445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 4072673445}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 4072673445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6837/4069767165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 4069767165}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 4069767165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6839/2236865036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 2236865036}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 2236865036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.178:6839/1495241908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 1495241908}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 1495241908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T08:52:13.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-14T08:52:13.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-10-14T08:52:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 -- 172.21.15.6:0/94714107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb41021a0 msgr2=0x7f4bb4102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 --2- 172.21.15.6:0/94714107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb41021a0 0x7f4bb4102600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80099c0 tx=0x7f4ba8009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 -- 172.21.15.6:0/94714107 shutdown_connections 2023-10-14T08:52:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 --2- 172.21.15.6:0/94714107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4102b40 0x7f4bb41093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 --2- 172.21.15.6:0/94714107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bb4100fb0 0x7f4bb41013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 --2- 172.21.15.6:0/94714107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb41021a0 0x7f4bb4102600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 -- 172.21.15.6:0/94714107 >> 172.21.15.6:0/94714107 conn(0x7f4bb40fc520 msgr2=0x7f4bb40fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 -- 172.21.15.6:0/94714107 shutdown_connections 2023-10-14T08:52:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.146+0000 7f4bbb654700 1 -- 172.21.15.6:0/94714107 wait complete. 2023-10-14T08:52:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 Processor -- start 2023-10-14T08:52:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 -- start start 2023-10-14T08:52:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4100fb0 0x7f4bb4074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bb41021a0 0x7f4bb40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 0x7f4bb40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4073f80 con 0x7f4bb4102b40 2023-10-14T08:52:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40740f0 con 0x7f4bb4100fb0 2023-10-14T08:52:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bbb654700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb41a0d40 con 0x7f4bb41021a0 2023-10-14T08:52:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 0x7f4bb40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 0x7f4bb40737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60166/0 (socket says 172.21.15.6:60166) 2023-10-14T08:52:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/3149315723 learned_addr learned my addr 172.21.15.6:0/3149315723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bb41021a0 0x7f4bb40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4100fb0 0x7f4bb4074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/3149315723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bb41021a0 msgr2=0x7f4bb40732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bb41021a0 0x7f4bb40732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/3149315723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4100fb0 msgr2=0x7f4bb4074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4100fb0 0x7f4bb4074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/3149315723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80095f0 con 0x7f4bb4102b40 2023-10-14T08:52:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.147+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4100fb0 0x7f4bb4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.148+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 0x7f4bb40737e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b970 tx=0x7f4bac00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.148+0000 7f4ba67fc700 1 -- 172.21.15.6:0/3149315723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00c930 con 0x7f4bb4102b40 2023-10-14T08:52:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.148+0000 7f4ba67fc700 1 -- 172.21.15.6:0/3149315723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bac014440 con 0x7f4bb4102b40 2023-10-14T08:52:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.148+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb41a0fc0 con 0x7f4bb4102b40 2023-10-14T08:52:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.148+0000 7f4ba67fc700 1 -- 172.21.15.6:0/3149315723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0075d0 con 0x7f4bb4102b40 2023-10-14T08:52:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.148+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb41a1450 con 0x7f4bb4102b40 2023-10-14T08:52:13.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.150+0000 7f4ba67fc700 1 -- 172.21.15.6:0/3149315723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f4bac0145b0 con 0x7f4bb4102b40 2023-10-14T08:52:13.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.150+0000 7f4ba67fc700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ba00a1510 0x7f4ba00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.151+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ba00a1510 0x7f4ba00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.151+0000 7f4ba67fc700 1 -- 172.21.15.6:0/3149315723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4bac006e40 con 0x7f4bb4102b40 2023-10-14T08:52:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.151+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ba00a1510 0x7f4ba00a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4102000 tx=0x7f4bb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.151+0000 7f4bc783eb80 1 Processor -- start 2023-10-14T08:52:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 -- start start 2023-10-14T08:52:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x5612554341f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255434ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x561255435a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612553a8c20 con 0x561255433dd0 2023-10-14T08:52:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56125538dc10 con 0x5612554355d0 2023-10-14T08:52:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56125538b530 con 0x561255434730 2023-10-14T08:52:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x5612554341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x5612554341f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60170/0 (socket says 172.21.15.6:60170) 2023-10-14T08:52:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 -- 172.21.15.6:0/776513856 learned_addr learned my addr 172.21.15.6:0/776513856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x561255435a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 -- 172.21.15.6:0/776513856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 msgr2=0x561255434ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255434ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255434ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 -- 172.21.15.6:0/776513856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 msgr2=0x561255435a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x561255435a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 -- 172.21.15.6:0/776513856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612553443a0 con 0x561255433dd0 2023-10-14T08:52:13.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.152+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x5612554341f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0011ed0 tx=0x7f4bb0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b708ca526aee8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4b9f7fe700 1 -- 172.21.15.6:0/776513856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0012dc0 con 0x561255433dd0 2023-10-14T08:52:13.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4b9f7fe700 1 -- 172.21.15.6:0/776513856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bb0016070 con 0x561255433dd0 2023-10-14T08:52:13.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4b9f7fe700 1 -- 172.21.15.6:0/776513856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb001d5f0 con 0x561255433dd0 2023-10-14T08:52:13.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 -- 172.21.15.6:0/776513856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 msgr2=0x5612554341f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x5612554341f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0011ed0 tx=0x7f4bb0014000 comp rx=0 tx=0).stop 2023-10-14T08:52:13.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 -- 172.21.15.6:0/776513856 shutdown_connections 2023-10-14T08:52:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x561255435a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x5612554341f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/776513856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255434ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 -- 172.21.15.6:0/776513856 >> 172.21.15.6:0/776513856 conn(0x561255361d80 msgr2=0x56125542ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 -- 172.21.15.6:0/776513856 shutdown_connections 2023-10-14T08:52:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.153+0000 7f4bc783eb80 1 -- 172.21.15.6:0/776513856 wait complete. 2023-10-14T08:52:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 -- start start 2023-10-14T08:52:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 Processor -- start 2023-10-14T08:52:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255433dd0 0x56125543dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255434730 0x56125543e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255445170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561255386e20 con 0x5612554355d0 2023-10-14T08:52:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612553236c0 con 0x561255434730 2023-10-14T08:52:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561255323360 con 0x561255433dd0 2023-10-14T08:52:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bc783eb80 10 client.0 _ll_register_callbacks cb 0x5612551807b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bb9bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255445170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bb9bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255445170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60180/0 (socket says 172.21.15.6:60180) 2023-10-14T08:52:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/1756976006 learned_addr learned my addr 172.21.15.6:0/1756976006 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.154+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255434730 0x56125543e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255433dd0 0x56125543dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/1756976006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255433dd0 msgr2=0x56125543dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255433dd0 0x56125543dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255434730 msgr2=0x56125543e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255434730 0x56125543e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/1756976006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb0011c60 con 0x5612554355d0 2023-10-14T08:52:13.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255434730 0x56125543e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:52:13.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255445170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bac095450 tx=0x7f4bac099e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be20d468c231f191 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4b9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4b9cff9700 1 -- 172.21.15.6:0/1756976006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b1070 con 0x5612554355d0 2023-10-14T08:52:13.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4b9cff9700 1 -- 172.21.15.6:0/1756976006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4bac0b3060 con 0x5612554355d0 2023-10-14T08:52:13.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56125538bea0 con 0x5612554355d0 2023-10-14T08:52:13.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4b9cff9700 1 -- 172.21.15.6:0/1756976006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bac0996d0 con 0x5612554355d0 2023-10-14T08:52:13.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bc783eb80 10 client.15033 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5612551b1d90 con 0x5612554355d0 2023-10-14T08:52:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.155+0000 7f4b9cff9700 1 -- 172.21.15.6:0/1756976006 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bac07c020 con 0x5612554355d0 2023-10-14T08:52:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4b9cff9700 1 -- 172.21.15.6:0/1756976006 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4bac0b7030 con 0x5612554355d0 2023-10-14T08:52:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bc783eb80 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bc783eb80 10 client.15033 resolve_mds: resolved name 'k' to daemon mds.k 2023-10-14T08:52:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bc783eb80 20 client.15033 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554497f0 0x561255448320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bc783eb80 4 client.15033 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:13.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561255403bc0 con 0x5612554497f0 2023-10-14T08:52:13.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.156+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554497f0 0x561255448320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554497f0 0x561255448320 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2e77564b7fa84749 server_cookie=1b7cea9f5e2bce74 in_seq=0 out_seq=0 2023-10-14T08:52:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4b9cff9700 10 client.15033 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4b9cff9700 1 -- 172.21.15.6:0/1756976006 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561255403bc0 con 0x5612554497f0 2023-10-14T08:52:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4b9cff9700 10 client.15033 handle_command_reply: tid=0 2023-10-14T08:52:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4bc783eb80 1 client.15033 shutdown 2023-10-14T08:52:13.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 msgr2=0x561255445170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.157+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255445170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bac095450 tx=0x7f4bac099e50 comp rx=0 tx=0).stop 2023-10-14T08:52:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 shutdown_connections 2023-10-14T08:52:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255445170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255433dd0 0x56125543dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554497f0 0x561255448320 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/1756976006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255434730 0x56125543e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4b9cff9700 0 client.15033 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:13.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 >> 172.21.15.6:0/1756976006 conn(0x561255361d80 msgr2=0x56125542eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 shutdown_connections 2023-10-14T08:52:13.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 1 -- 172.21.15.6:0/1756976006 wait complete. 2023-10-14T08:52:13.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.158+0000 7f4bc783eb80 20 client.15033 trim_cache size 0 max 16384 2023-10-14T08:52:13.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.175+0000 7f4bc783eb80 1 Processor -- start 2023-10-14T08:52:13.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.175+0000 7f4bc783eb80 1 -- start start 2023-10-14T08:52:13.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.175+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x56125542ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.175+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255445090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.175+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x56125543b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612552078d0 con 0x561255433dd0 2023-10-14T08:52:13.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561255403bc0 con 0x5612554355d0 2023-10-14T08:52:13.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612553880b0 con 0x561255434730 2023-10-14T08:52:13.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x56125542ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x56125542ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60184/0 (socket says 172.21.15.6:60184) 2023-10-14T08:52:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 -- 172.21.15.6:0/3797809374 learned_addr learned my addr 172.21.15.6:0/3797809374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x56125543b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255445090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 -- 172.21.15.6:0/3797809374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 msgr2=0x561255445090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255445090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 -- 172.21.15.6:0/3797809374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 msgr2=0x56125543b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x56125543b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 -- 172.21.15.6:0/3797809374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56125519ac10 con 0x561255433dd0 2023-10-14T08:52:13.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x56125543b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x56125542ead0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0011a50 tx=0x7f4bb0005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916a237ed8daa06a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4b9ffff700 1 -- 172.21.15.6:0/3797809374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb002d070 con 0x561255433dd0 2023-10-14T08:52:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4b9ffff700 1 -- 172.21.15.6:0/3797809374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bb002e040 con 0x561255433dd0 2023-10-14T08:52:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.176+0000 7f4b9ffff700 1 -- 172.21.15.6:0/3797809374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0034420 con 0x561255433dd0 2023-10-14T08:52:13.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 -- 172.21.15.6:0/3797809374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 msgr2=0x56125542ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x56125542ead0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0011a50 tx=0x7f4bb0005960 comp rx=0 tx=0).stop 2023-10-14T08:52:13.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 -- 172.21.15.6:0/3797809374 shutdown_connections 2023-10-14T08:52:13.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5612554355d0 0x56125543b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561255433dd0 0x56125542ead0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/3797809374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255445090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 -- 172.21.15.6:0/3797809374 >> 172.21.15.6:0/3797809374 conn(0x561255361d80 msgr2=0x56125542e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 -- 172.21.15.6:0/3797809374 shutdown_connections 2023-10-14T08:52:13.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 -- 172.21.15.6:0/3797809374 wait complete. 2023-10-14T08:52:13.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 -- start start 2023-10-14T08:52:13.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.177+0000 7f4bc783eb80 1 Processor -- start 2023-10-14T08:52:13.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255433dd0 0x5612554420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255444610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255444c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612554453b0 con 0x5612554355d0 2023-10-14T08:52:13.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561255445520 con 0x561255433dd0 2023-10-14T08:52:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56125549d230 con 0x561255434730 2023-10-14T08:52:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 10 client.0 _ll_register_callbacks cb 0x7f4bac099030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255444c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255444c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60194/0 (socket says 172.21.15.6:60194) 2023-10-14T08:52:13.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/831828212 learned_addr learned my addr 172.21.15.6:0/831828212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255444610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255433dd0 0x5612554420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/831828212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 msgr2=0x561255444610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255444610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255433dd0 msgr2=0x5612554420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255433dd0 0x5612554420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 -- 172.21.15.6:0/831828212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612553443a0 con 0x5612554355d0 2023-10-14T08:52:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb8bef700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255444610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bb9bf1700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255444c70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0cc4e0 tx=0x7f4bac095b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba2422824c6a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4b9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4b9cff9700 1 -- 172.21.15.6:0/831828212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b1040 con 0x5612554355d0 2023-10-14T08:52:13.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4b9cff9700 1 -- 172.21.15.6:0/831828212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4bac07d080 con 0x5612554355d0 2023-10-14T08:52:13.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bb0016070 con 0x5612554355d0 2023-10-14T08:52:13.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4b9cff9700 1 -- 172.21.15.6:0/831828212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bac0996d0 con 0x5612554355d0 2023-10-14T08:52:13.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 10 client.15039 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.178+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5612551d8200 con 0x5612554355d0 2023-10-14T08:52:13.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4b9cff9700 1 -- 172.21.15.6:0/831828212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bb0016070 con 0x5612554355d0 2023-10-14T08:52:13.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4b9cff9700 1 -- 172.21.15.6:0/831828212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4bac0aa080 con 0x5612554355d0 2023-10-14T08:52:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bc783eb80 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bc783eb80 10 client.15039 resolve_mds: resolved name 'k' to daemon mds.k 2023-10-14T08:52:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bc783eb80 20 client.15039 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554a20d0 0x56125549e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bc783eb80 4 client.15039 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56125537fe00 con 0x5612554a20d0 2023-10-14T08:52:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554a20d0 0x56125549e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4b9cff9700 10 client.15039 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.179+0000 7f4bb93f0700 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554a20d0 0x56125549e550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=92fd8c583c1e3d67 server_cookie=47ab834b7bc4e670 in_seq=0 out_seq=0 2023-10-14T08:52:13.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4b9cff9700 1 -- 172.21.15.6:0/831828212 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56125537fe00 con 0x5612554a20d0 2023-10-14T08:52:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4b9cff9700 10 client.15039 handle_command_reply: tid=0 2023-10-14T08:52:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 client.15039 shutdown 2023-10-14T08:52:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 msgr2=0x561255444c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255444c70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0cc4e0 tx=0x7f4bac095b40 comp rx=0 tx=0).stop 2023-10-14T08:52:13.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 shutdown_connections 2023-10-14T08:52:13.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612554355d0 0x561255444c70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x5612554a20d0 0x56125549e550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561255433dd0 0x5612554420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 --2- 172.21.15.6:0/831828212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561255434730 0x561255444610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4b9cff9700 0 client.15039 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:13.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 >> 172.21.15.6:0/831828212 conn(0x561255361d80 msgr2=0x56125542ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 shutdown_connections 2023-10-14T08:52:13.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 1 -- 172.21.15.6:0/831828212 wait complete. 2023-10-14T08:52:13.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.180+0000 7f4bc783eb80 20 client.15039 trim_cache size 0 max 16384 2023-10-14T08:52:13.207 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2023-10-14T08:52:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24434, 2023-10-14T08:52:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 50.038360566999998, 2023-10-14T08:52:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 84.010879318999997 2023-10-14T08:52:13.209 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ba00a1510 msgr2=0x7f4ba00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ba00a1510 0x7f4ba00a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4102000 tx=0x7f4bb0009260 comp rx=0 tx=0).stop 2023-10-14T08:52:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 msgr2=0x7f4bb40737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 0x7f4bb40737e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b970 tx=0x7f4bac00bc80 comp rx=0 tx=0).stop 2023-10-14T08:52:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 shutdown_connections 2023-10-14T08:52:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4102b40 0x7f4bb40737e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4ba00a1510 0x7f4ba00a39d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bb4100fb0 0x7f4bb4074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 --2- 172.21.15.6:0/3149315723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bb41021a0 0x7f4bb40732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 >> 172.21.15.6:0/3149315723 conn(0x7f4bb40fc520 msgr2=0x7f4bb4105680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 shutdown_connections 2023-10-14T08:52:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.181+0000 7f4bbb654700 1 -- 172.21.15.6:0/3149315723 wait complete. 2023-10-14T08:52:13.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-14T08:52:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 -- 172.21.15.6:0/356696763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 msgr2=0x7fb45c100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 --2- 172.21.15.6:0/356696763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c100560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb450009990 tx=0x7fb450009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 -- 172.21.15.6:0/356696763 shutdown_connections 2023-10-14T08:52:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 --2- 172.21.15.6:0/356696763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb45c100aa0 0x7fb45c108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 --2- 172.21.15.6:0/356696763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 0x7fb45c101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 --2- 172.21.15.6:0/356696763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c100560 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 -- 172.21.15.6:0/356696763 >> 172.21.15.6:0/356696763 conn(0x7fb45c0fab90 msgr2=0x7fb45c0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 -- 172.21.15.6:0/356696763 shutdown_connections 2023-10-14T08:52:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.339+0000 7fb460ba5700 1 -- 172.21.15.6:0/356696763 wait complete. 2023-10-14T08:52:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 Processor -- start 2023-10-14T08:52:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 -- start start 2023-10-14T08:52:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb45c100aa0 0x7fb45c1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 0x7fb45c19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c19e7e0 con 0x7fb45c1000e0 2023-10-14T08:52:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c19e950 con 0x7fb45c101520 2023-10-14T08:52:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb460ba5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c19eb10 con 0x7fb45c100aa0 2023-10-14T08:52:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60204/0 (socket says 172.21.15.6:60204) 2023-10-14T08:52:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb45a59c700 1 -- 172.21.15.6:0/196278236 learned_addr learned my addr 172.21.15.6:0/196278236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb459d9b700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb45c100aa0 0x7fb45c1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.340+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 0x7fb45c19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45a59c700 1 -- 172.21.15.6:0/196278236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb45c100aa0 msgr2=0x7fb45c1971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45a59c700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb45c100aa0 0x7fb45c1971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45a59c700 1 -- 172.21.15.6:0/196278236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 msgr2=0x7fb45c19e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45a59c700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 0x7fb45c19e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45a59c700 1 -- 172.21.15.6:0/196278236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500095f0 con 0x7fb45c1000e0 2023-10-14T08:52:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 0x7fb45c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb45a59c700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c196c70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00c920 tx=0x7fb44c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb44b7fe700 1 -- 172.21.15.6:0/196278236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c007b00 con 0x7fb45c1000e0 2023-10-14T08:52:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c19edf0 con 0x7fb45c1000e0 2023-10-14T08:52:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb44b7fe700 1 -- 172.21.15.6:0/196278236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb44c00ce70 con 0x7fb45c1000e0 2023-10-14T08:52:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb44b7fe700 1 -- 172.21.15.6:0/196278236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c005460 con 0x7fb45c1000e0 2023-10-14T08:52:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.341+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c19f210 con 0x7fb45c1000e0 2023-10-14T08:52:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.343+0000 7fb44b7fe700 1 -- 172.21.15.6:0/196278236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb44c004750 con 0x7fb45c1000e0 2023-10-14T08:52:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.344+0000 7fb44b7fe700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4440a1510 0x7fb4440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.344+0000 7fb459d9b700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4440a1510 0x7fb4440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.344+0000 7fb44b7fe700 1 -- 172.21.15.6:0/196278236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb44c0ccab0 con 0x7fb45c1000e0 2023-10-14T08:52:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.344+0000 7fb459d9b700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4440a1510 0x7fb4440a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb45c198170 tx=0x7fb450005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 Processor -- start 2023-10-14T08:52:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 -- start start 2023-10-14T08:52:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f775dd0 0x561c0f7761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 0x561c0f776ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f777a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f6eac20 con 0x561c0f776730 2023-10-14T08:52:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f6cfc10 con 0x561c0f7775d0 2023-10-14T08:52:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f6cd530 con 0x561c0f775dd0 2023-10-14T08:52:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 0x561c0f776ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 0x561c0f776ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60214/0 (socket says 172.21.15.6:60214) 2023-10-14T08:52:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 -- 172.21.15.6:0/1421131758 learned_addr learned my addr 172.21.15.6:0/1421131758 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb45a59c700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f775dd0 0x561c0f7761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f777a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 -- 172.21.15.6:0/1421131758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f775dd0 msgr2=0x561c0f7761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f775dd0 0x561c0f7761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 -- 172.21.15.6:0/1421131758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 msgr2=0x561c0f777a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.345+0000 7fb459d9b700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f777a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb459d9b700 1 -- 172.21.15.6:0/1421131758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c0f6863a0 con 0x561c0f776730 2023-10-14T08:52:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb45a59c700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f775dd0 0x561c0f7761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:52:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f777a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb459d9b700 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 0x561c0f776ff0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb45000bac0 tx=0x7fb450020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ce0ac713139b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb448ff9700 1 -- 172.21.15.6:0/1421131758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45002a070 con 0x561c0f776730 2023-10-14T08:52:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb448ff9700 1 -- 172.21.15.6:0/1421131758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb45001e040 con 0x561c0f776730 2023-10-14T08:52:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.346+0000 7fb448ff9700 1 -- 172.21.15.6:0/1421131758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450023bd0 con 0x561c0f776730 2023-10-14T08:52:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/1421131758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 msgr2=0x561c0f776ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 0x561c0f776ff0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb45000bac0 tx=0x7fb450020000 comp rx=0 tx=0).stop 2023-10-14T08:52:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/1421131758 shutdown_connections 2023-10-14T08:52:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f777a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f775dd0 0x561c0f7761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/1421131758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f776730 0x561c0f776ff0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/1421131758 >> 172.21.15.6:0/1421131758 conn(0x561c0f6a3d80 msgr2=0x561c0f770f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/1421131758 shutdown_connections 2023-10-14T08:52:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/1421131758 wait complete. 2023-10-14T08:52:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- start start 2023-10-14T08:52:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 Processor -- start 2023-10-14T08:52:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f77fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f776730 0x561c0f7800b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f7775d0 0x561c0f7870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f6c8e20 con 0x561c0f775dd0 2023-10-14T08:52:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f6656c0 con 0x561c0f776730 2023-10-14T08:52:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f665360 con 0x561c0f7775d0 2023-10-14T08:52:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb46cd8fb80 10 client.0 _ll_register_callbacks cb 0x561c0f4c27b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.347+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f77fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f77fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60218/0 (socket says 172.21.15.6:60218) 2023-10-14T08:52:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 -- 172.21.15.6:0/2902435944 learned_addr learned my addr 172.21.15.6:0/2902435944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f7775d0 0x561c0f7870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 -- 172.21.15.6:0/2902435944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f7775d0 msgr2=0x561c0f7870f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f7775d0 0x561c0f7870f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 -- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f776730 msgr2=0x561c0f7800b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb459d9b700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f776730 0x561c0f7800b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f776730 0x561c0f7800b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 -- 172.21.15.6:0/2902435944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c19f210 con 0x561c0f775dd0 2023-10-14T08:52:13.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb45a59c700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f77fb70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0074a0 tx=0x7fb44c09a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da034c2634ef26bf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb441ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb441ffb700 1 -- 172.21.15.6:0/2902435944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b1070 con 0x561c0f775dd0 2023-10-14T08:52:13.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb441ffb700 1 -- 172.21.15.6:0/2902435944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb44c0a2000 con 0x561c0f775dd0 2023-10-14T08:52:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c0f6cdea0 con 0x561c0f775dd0 2023-10-14T08:52:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb441ffb700 1 -- 172.21.15.6:0/2902435944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb44c099ed0 con 0x561c0f775dd0 2023-10-14T08:52:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb46cd8fb80 10 client.15051 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fb45c108cf0 con 0x561c0f775dd0 2023-10-14T08:52:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.348+0000 7fb441ffb700 1 -- 172.21.15.6:0/2902435944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561c0f6cdea0 con 0x561c0f775dd0 2023-10-14T08:52:13.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb441ffb700 1 -- 172.21.15.6:0/2902435944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb44c0a1b70 con 0x561c0f775dd0 2023-10-14T08:52:13.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb46cd8fb80 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb46cd8fb80 10 client.15051 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-14T08:52:13.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb46cd8fb80 20 client.15051 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f78a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb46cd8fb80 4 client.15051 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:13.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c0f745bc0 con 0x561c0f78b570 2023-10-14T08:52:13.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb459d9b700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f78a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb441ffb700 10 client.15051 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:13.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.349+0000 7fb459d9b700 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f78a0a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b2acdbdf9a7db192 server_cookie=60b23e38a95e9143 in_seq=0 out_seq=0 2023-10-14T08:52:13.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb441ffb700 1 -- 172.21.15.6:0/2902435944 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c0f745bc0 con 0x561c0f78b570 2023-10-14T08:52:13.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb441ffb700 10 client.15051 handle_command_reply: tid=0 2023-10-14T08:52:13.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 client.15051 shutdown 2023-10-14T08:52:13.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 msgr2=0x561c0f77fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f77fb70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0074a0 tx=0x7fb44c09a420 comp rx=0 tx=0).stop 2023-10-14T08:52:13.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 shutdown_connections 2023-10-14T08:52:13.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f78a0a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f7775d0 0x561c0f7870f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb441ffb700 0 client.15051 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:13.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f77fb70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2902435944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f776730 0x561c0f7800b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.350+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 >> 172.21.15.6:0/2902435944 conn(0x561c0f6a3d80 msgr2=0x561c0f770ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.351+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 shutdown_connections 2023-10-14T08:52:13.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.351+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2902435944 wait complete. 2023-10-14T08:52:13.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.351+0000 7fb46cd8fb80 20 client.15051 trim_cache size 0 max 16384 2023-10-14T08:52:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 Processor -- start 2023-10-14T08:52:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 -- start start 2023-10-14T08:52:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f775dd0 0x561c0f77a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f77aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 0x561c0f7870b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f5498d0 con 0x561c0f7775d0 2023-10-14T08:52:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f771d20 con 0x561c0f775dd0 2023-10-14T08:52:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f745bc0 con 0x561c0f776730 2023-10-14T08:52:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 0x561c0f7870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 0x561c0f7870b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60230/0 (socket says 172.21.15.6:60230) 2023-10-14T08:52:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 -- 172.21.15.6:0/178098310 learned_addr learned my addr 172.21.15.6:0/178098310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb459d9b700 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f77aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45a59c700 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f775dd0 0x561c0f77a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 -- 172.21.15.6:0/178098310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 msgr2=0x561c0f77aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f77aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 -- 172.21.15.6:0/178098310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f775dd0 msgr2=0x561c0f77a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f775dd0 0x561c0f77a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 -- 172.21.15.6:0/178098310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c0f4f3d90 con 0x561c0f7775d0 2023-10-14T08:52:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.369+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 0x561c0f7870b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb4540084a0 tx=0x7fb45400a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0caae7eb1ee202 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb4497fa700 1 -- 172.21.15.6:0/178098310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45401a070 con 0x561c0f7775d0 2023-10-14T08:52:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb4497fa700 1 -- 172.21.15.6:0/178098310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb454004020 con 0x561c0f7775d0 2023-10-14T08:52:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb4497fa700 1 -- 172.21.15.6:0/178098310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454016420 con 0x561c0f7775d0 2023-10-14T08:52:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/178098310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 msgr2=0x561c0f7870b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 0x561c0f7870b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb4540084a0 tx=0x7fb45400a040 comp rx=0 tx=0).stop 2023-10-14T08:52:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/178098310 shutdown_connections 2023-10-14T08:52:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f7775d0 0x561c0f7870b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f775dd0 0x561c0f77a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/178098310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f77aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/178098310 >> 172.21.15.6:0/178098310 conn(0x561c0f6a3d80 msgr2=0x561c0f76f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/178098310 shutdown_connections 2023-10-14T08:52:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.370+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/178098310 wait complete. 2023-10-14T08:52:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 -- start start 2023-10-14T08:52:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 Processor -- start 2023-10-14T08:52:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f787030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f783ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f784010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f7846a0 con 0x561c0f775dd0 2023-10-14T08:52:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f7def60 con 0x561c0f7775d0 2023-10-14T08:52:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0f7df0a0 con 0x561c0f776730 2023-10-14T08:52:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb46cd8fb80 10 client.0 _ll_register_callbacks cb 0x7fb44c0997d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f787030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f787030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60232/0 (socket says 172.21.15.6:60232) 2023-10-14T08:52:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 -- 172.21.15.6:0/2907451674 learned_addr learned my addr 172.21.15.6:0/2907451674 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb459d9b700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f783ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45ad9d700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f784010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 -- 172.21.15.6:0/2907451674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 msgr2=0x561c0f783ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f783ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 -- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 msgr2=0x561c0f784010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f784010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.371+0000 7fb45a59c700 1 -- 172.21.15.6:0/2907451674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb454012040 con 0x561c0f775dd0 2023-10-14T08:52:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb45a59c700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f787030 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005950 tx=0x7fb44c00a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da07cd6e84645d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb441ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb441ffb700 1 -- 172.21.15.6:0/2907451674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b1040 con 0x561c0f775dd0 2023-10-14T08:52:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb441ffb700 1 -- 172.21.15.6:0/2907451674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb44c0a2000 con 0x561c0f775dd0 2023-10-14T08:52:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb45001e040 con 0x561c0f775dd0 2023-10-14T08:52:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb441ffb700 1 -- 172.21.15.6:0/2907451674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb44c004b20 con 0x561c0f775dd0 2023-10-14T08:52:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 10 client.15057 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561c0f4dcc10 con 0x561c0f775dd0 2023-10-14T08:52:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb441ffb700 1 -- 172.21.15.6:0/2907451674 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb45001e040 con 0x561c0f775dd0 2023-10-14T08:52:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb441ffb700 1 -- 172.21.15.6:0/2907451674 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb44c078c10 con 0x561c0f775dd0 2023-10-14T08:52:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 10 client.15057 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 10 client.15057 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-14T08:52:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 20 client.15057 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f7e0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 4 client.15057 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.372+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561c0f6c1e00 con 0x561c0f78b570 2023-10-14T08:52:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb459d9b700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f7e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb441ffb700 10 client.15057 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb459d9b700 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f7e0410 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=34df6a881c191cd8 server_cookie=de23d4110be3b5e9 in_seq=0 out_seq=0 2023-10-14T08:52:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb441ffb700 1 -- 172.21.15.6:0/2907451674 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x561c0f6c1e00 con 0x561c0f78b570 2023-10-14T08:52:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb441ffb700 10 client.15057 handle_command_reply: tid=0 2023-10-14T08:52:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 client.15057 shutdown 2023-10-14T08:52:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 msgr2=0x561c0f787030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f787030 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005950 tx=0x7fb44c00a670 comp rx=0 tx=0).stop 2023-10-14T08:52:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 shutdown_connections 2023-10-14T08:52:13.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x561c0f78b570 0x561c0f7e0410 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c0f7775d0 0x561c0f784010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb441ffb700 0 client.15057 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:13.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0f775dd0 0x561c0f787030 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 --2- 172.21.15.6:0/2907451674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c0f776730 0x561c0f783ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.373+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 >> 172.21.15.6:0/2907451674 conn(0x561c0f6a3d80 msgr2=0x561c0f77a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 shutdown_connections 2023-10-14T08:52:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb46cd8fb80 1 -- 172.21.15.6:0/2907451674 wait complete. 2023-10-14T08:52:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb46cd8fb80 20 client.15057 trim_cache size 0 max 16384 2023-10-14T08:52:13.399 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2023-10-14T08:52:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24455, 2023-10-14T08:52:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 51.239953098999997, 2023-10-14T08:52:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 77.479721534999996 2023-10-14T08:52:13.402 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4440a1510 msgr2=0x7fb4440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4440a1510 0x7fb4440a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb45c198170 tx=0x7fb450005fd0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 msgr2=0x7fb45c196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c196c70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00c920 tx=0x7fb44c00cc30 comp rx=0 tx=0).stop 2023-10-14T08:52:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 shutdown_connections 2023-10-14T08:52:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb4440a1510 0x7fb4440a39d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb45c101520 0x7fb45c19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb45c1000e0 0x7fb45c196c70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 --2- 172.21.15.6:0/196278236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb45c100aa0 0x7fb45c1971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 >> 172.21.15.6:0/196278236 conn(0x7fb45c0fab90 msgr2=0x7fb45c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 shutdown_connections 2023-10-14T08:52:13.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.374+0000 7fb460ba5700 1 -- 172.21.15.6:0/196278236 wait complete. 2023-10-14T08:52:13.407 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:13 smithi006 ceph-mon[99452]: pgmap v288: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:13.407 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/631505913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.408 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2935895721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.408 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:13 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1325332291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-14T08:52:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:13 smithi057 ceph-mon[103313]: pgmap v288: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/631505913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2935895721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:13 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1325332291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 -- 172.21.15.6:0/1660886093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 msgr2=0x7f63ac103e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 --2- 172.21.15.6:0/1660886093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac103e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f639c009990 tx=0x7f639c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 -- 172.21.15.6:0/1660886093 shutdown_connections 2023-10-14T08:52:13.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 --2- 172.21.15.6:0/1660886093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 0x7f63ac1090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 --2- 172.21.15.6:0/1660886093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac103e60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 --2- 172.21.15.6:0/1660886093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 0x7f63ac106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 -- 172.21.15.6:0/1660886093 >> 172.21.15.6:0/1660886093 conn(0x7f63ac0fb420 msgr2=0x7f63ac0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 -- 172.21.15.6:0/1660886093 shutdown_connections 2023-10-14T08:52:13.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.535+0000 7f63b2081700 1 -- 172.21.15.6:0/1660886093 wait complete. 2023-10-14T08:52:13.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 Processor -- start 2023-10-14T08:52:13.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 -- start start 2023-10-14T08:52:13.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 0x7f63ac197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 0x7f63ac19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac19e770 con 0x7f63ac101a70 2023-10-14T08:52:13.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac19e8e0 con 0x7f63ac1043a0 2023-10-14T08:52:13.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63b2081700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac19eaa0 con 0x7f63ac106cd0 2023-10-14T08:52:13.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60246/0 (socket says 172.21.15.6:60246) 2023-10-14T08:52:13.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.536+0000 7f63ab7fe700 1 -- 172.21.15.6:0/207092788 learned_addr learned my addr 172.21.15.6:0/207092788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63aaffd700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 0x7f63ac197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63abfff700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 0x7f63ac19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63ab7fe700 1 -- 172.21.15.6:0/207092788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 msgr2=0x7f63ac19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 0x7f63ac19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63ab7fe700 1 -- 172.21.15.6:0/207092788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 msgr2=0x7f63ac197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 0x7f63ac197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63ab7fe700 1 -- 172.21.15.6:0/207092788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c0095f0 con 0x7f63ac101a70 2023-10-14T08:52:13.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63abfff700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 0x7f63ac19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:13.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63aaffd700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 0x7f63ac197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac196c30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f639c0059d0 tx=0x7f639c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63a8ff9700 1 -- 172.21.15.6:0/207092788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c01d070 con 0x7f63ac101a70 2023-10-14T08:52:13.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63a8ff9700 1 -- 172.21.15.6:0/207092788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f639c00fd60 con 0x7f63ac101a70 2023-10-14T08:52:13.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac19ed20 con 0x7f63ac101a70 2023-10-14T08:52:13.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63a8ff9700 1 -- 172.21.15.6:0/207092788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c017650 con 0x7f63ac101a70 2023-10-14T08:52:13.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.537+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac19f1a0 con 0x7f63ac101a70 2023-10-14T08:52:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.539+0000 7f63a8ff9700 1 -- 172.21.15.6:0/207092788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f639c0177b0 con 0x7f63ac101a70 2023-10-14T08:52:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.540+0000 7f63a8ff9700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f63940a1590 0x7f63940a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.540+0000 7f63aaffd700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f63940a1590 0x7f63940a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.540+0000 7f63a8ff9700 1 -- 172.21.15.6:0/207092788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f639c0ce3e0 con 0x7f63ac101a70 2023-10-14T08:52:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.540+0000 7f63aaffd700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f63940a1590 0x7f63940a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005950 tx=0x7f63a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 Processor -- start 2023-10-14T08:52:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 -- start start 2023-10-14T08:52:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d01b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d01bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d01ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cf8fc20 con 0x55f72d01b730 2023-10-14T08:52:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cf74c10 con 0x55f72d01c5d0 2023-10-14T08:52:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63be26bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cf72530 con 0x55f72d01add0 2023-10-14T08:52:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d01bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d01bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60256/0 (socket says 172.21.15.6:60256) 2023-10-14T08:52:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 -- 172.21.15.6:0/2041637816 learned_addr learned my addr 172.21.15.6:0/2041637816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d01b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 -- 172.21.15.6:0/2041637816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 msgr2=0x55f72d01b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d01b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 -- 172.21.15.6:0/2041637816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 msgr2=0x55f72d01ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d01ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63aaffd700 1 -- 172.21.15.6:0/2041637816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72cf2b3a0 con 0x55f72d01b730 2023-10-14T08:52:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.541+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d01b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63aaffd700 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d01bff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f63a000ff00 tx=0x7f63a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdbb1efa190a84d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f6391ffb700 1 -- 172.21.15.6:0/2041637816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0017040 con 0x55f72d01b730 2023-10-14T08:52:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f6391ffb700 1 -- 172.21.15.6:0/2041637816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63a0003b40 con 0x55f72d01b730 2023-10-14T08:52:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f6391ffb700 1 -- 172.21.15.6:0/2041637816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a001fcb0 con 0x55f72d01b730 2023-10-14T08:52:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 -- 172.21.15.6:0/2041637816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 msgr2=0x55f72d01bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d01bff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f63a000ff00 tx=0x7f63a0012000 comp rx=0 tx=0).stop 2023-10-14T08:52:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 -- 172.21.15.6:0/2041637816 shutdown_connections 2023-10-14T08:52:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d01ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d01b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 --2- 172.21.15.6:0/2041637816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d01bff0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.542+0000 7f63be26bb80 1 -- 172.21.15.6:0/2041637816 >> 172.21.15.6:0/2041637816 conn(0x55f72cf48d80 msgr2=0x55f72d015f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.543+0000 7f63be26bb80 1 -- 172.21.15.6:0/2041637816 shutdown_connections 2023-10-14T08:52:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.543+0000 7f63be26bb80 1 -- 172.21.15.6:0/2041637816 wait complete. 2023-10-14T08:52:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.543+0000 7f63be26bb80 1 -- start start 2023-10-14T08:52:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.543+0000 7f63be26bb80 1 Processor -- start 2023-10-14T08:52:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d024c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01b730 0x55f72d0251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 0x55f72d02c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cf6de20 con 0x55f72d01c5d0 2023-10-14T08:52:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cf0a6c0 con 0x55f72d01add0 2023-10-14T08:52:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cf0a360 con 0x55f72d01b730 2023-10-14T08:52:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 10 client.0 _ll_register_callbacks cb 0x55f72cd677b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 0x55f72d02c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 0x55f72d02c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60264/0 (socket says 172.21.15.6:60264) 2023-10-14T08:52:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 -- 172.21.15.6:0/543384925 learned_addr learned my addr 172.21.15.6:0/543384925 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d024c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63aaffd700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01b730 0x55f72d0251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 -- 172.21.15.6:0/543384925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01b730 msgr2=0x55f72d0251c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01b730 0x55f72d0251c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 -- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 msgr2=0x55f72d024c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d024c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 -- 172.21.15.6:0/543384925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a000fbe0 con 0x55f72d01c5d0 2023-10-14T08:52:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63abfff700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 0x55f72d02c200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63a4007af0 tx=0x7f63a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530b5112cbc38446 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f638affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f638affd700 1 -- 172.21.15.6:0/543384925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a401a070 con 0x55f72d01c5d0 2023-10-14T08:52:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f638affd700 1 -- 172.21.15.6:0/543384925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f63a400f890 con 0x55f72d01c5d0 2023-10-14T08:52:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f72cf72ea0 con 0x55f72d01c5d0 2023-10-14T08:52:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.544+0000 7f638affd700 1 -- 172.21.15.6:0/543384925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63a400fa50 con 0x55f72d01c5d0 2023-10-14T08:52:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 10 client.15069 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f72cd98d90 con 0x55f72d01c5d0 2023-10-14T08:52:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f638affd700 1 -- 172.21.15.6:0/543384925 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f72cf72ea0 con 0x55f72d01c5d0 2023-10-14T08:52:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f638affd700 1 -- 172.21.15.6:0/543384925 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f63a401d030 con 0x55f72d01c5d0 2023-10-14T08:52:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 10 client.15069 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 10 client.15069 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-14T08:52:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 20 client.15069 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d0308c0 0x55f72d02f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 4 client.15069 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f72cfeabc0 con 0x55f72d0308c0 2023-10-14T08:52:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.545+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d0308c0 0x55f72d02f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.546+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d0308c0 0x55f72d02f360 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95c8fb5a24ba1b33 server_cookie=b11f9705dd6c7c9c in_seq=0 out_seq=0 2023-10-14T08:52:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.546+0000 7f638affd700 10 client.15069 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f638affd700 1 -- 172.21.15.6:0/543384925 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f72cfeabc0 con 0x55f72d0308c0 2023-10-14T08:52:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f638affd700 10 client.15069 handle_command_reply: tid=0 2023-10-14T08:52:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 client.15069 shutdown 2023-10-14T08:52:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 msgr2=0x55f72d02c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 0x55f72d02c200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63a4007af0 tx=0x7f63a4007e00 comp rx=0 tx=0).stop 2023-10-14T08:52:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 shutdown_connections 2023-10-14T08:52:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d0308c0 0x55f72d02f360 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01c5d0 0x55f72d02c200 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d024c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 --2- 172.21.15.6:0/543384925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01b730 0x55f72d0251c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f638affd700 0 client.15069 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 >> 172.21.15.6:0/543384925 conn(0x55f72cf48d80 msgr2=0x55f72d015ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 shutdown_connections 2023-10-14T08:52:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 1 -- 172.21.15.6:0/543384925 wait complete. 2023-10-14T08:52:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.547+0000 7f63be26bb80 20 client.15069 trim_cache size 0 max 16384 2023-10-14T08:52:13.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 Processor -- start 2023-10-14T08:52:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 -- start start 2023-10-14T08:52:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d017b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01c5d0 0x55f72d0229f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72cdee8d0 con 0x55f72d01b730 2023-10-14T08:52:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72d016590 con 0x55f72d01add0 2023-10-14T08:52:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63be26bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72d025e70 con 0x55f72d01c5d0 2023-10-14T08:52:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60270/0 (socket says 172.21.15.6:60270) 2023-10-14T08:52:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 -- 172.21.15.6:0/3285867032 learned_addr learned my addr 172.21.15.6:0/3285867032 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63abfff700 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01c5d0 0x55f72d0229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d017b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 -- 172.21.15.6:0/3285867032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01c5d0 msgr2=0x55f72d0229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01c5d0 0x55f72d0229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 -- 172.21.15.6:0/3285867032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 msgr2=0x55f72d017b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d017b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.565+0000 7f63aaffd700 1 -- 172.21.15.6:0/3285867032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72d0394f0 con 0x55f72d01b730 2023-10-14T08:52:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63aaffd700 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02c120 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005820 tx=0x7f63a000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d44a20094c83a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63927fc700 1 -- 172.21.15.6:0/3285867032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a001f460 con 0x55f72d01b730 2023-10-14T08:52:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63927fc700 1 -- 172.21.15.6:0/3285867032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63a001f5c0 con 0x55f72d01b730 2023-10-14T08:52:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63927fc700 1 -- 172.21.15.6:0/3285867032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00052b0 con 0x55f72d01b730 2023-10-14T08:52:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 -- 172.21.15.6:0/3285867032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 msgr2=0x55f72d02c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02c120 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005820 tx=0x7f63a000bdd0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 -- 172.21.15.6:0/3285867032 shutdown_connections 2023-10-14T08:52:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01c5d0 0x55f72d0229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01add0 0x55f72d017b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 --2- 172.21.15.6:0/3285867032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02c120 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 -- 172.21.15.6:0/3285867032 >> 172.21.15.6:0/3285867032 conn(0x55f72cf48d80 msgr2=0x55f72d0238d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.566+0000 7f63be26bb80 1 -- 172.21.15.6:0/3285867032 shutdown_connections 2023-10-14T08:52:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 -- 172.21.15.6:0/3285867032 wait complete. 2023-10-14T08:52:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 -- start start 2023-10-14T08:52:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 Processor -- start 2023-10-14T08:52:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d0293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d02bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72d0842b0 con 0x55f72d01b730 2023-10-14T08:52:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72d084420 con 0x55f72d01c5d0 2023-10-14T08:52:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72d0845e0 con 0x55f72d01add0 2023-10-14T08:52:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63be26bb80 10 client.0 _ll_register_callbacks cb 0x7f63a4009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63ab7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d0293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63abfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d02bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60276/0 (socket says 172.21.15.6:60276) 2023-10-14T08:52:13.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63ab7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d0293a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:57676/0 (socket says 172.21.15.6:57676) 2023-10-14T08:52:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.567+0000 7f63aaffd700 1 -- 172.21.15.6:0/151006161 learned_addr learned my addr 172.21.15.6:0/151006161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63aaffd700 1 -- 172.21.15.6:0/151006161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 msgr2=0x55f72d0293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63aaffd700 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d0293a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63aaffd700 1 -- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 msgr2=0x55f72d02bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63aaffd700 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d02bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63aaffd700 1 -- 172.21.15.6:0/151006161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f72cf2b3a0 con 0x55f72d01b730 2023-10-14T08:52:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63aaffd700 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02b8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f63a000bb80 tx=0x7f63a0003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a91f192bcf7202 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f638affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f638affd700 1 -- 172.21.15.6:0/151006161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0003680 con 0x55f72d01b730 2023-10-14T08:52:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f638affd700 1 -- 172.21.15.6:0/151006161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f63a00037e0 con 0x55f72d01b730 2023-10-14T08:52:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63a0003b40 con 0x55f72d01b730 2023-10-14T08:52:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f638affd700 1 -- 172.21.15.6:0/151006161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63a00039a0 con 0x55f72d01b730 2023-10-14T08:52:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63be26bb80 10 client.15075 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f72cd81c10 con 0x55f72d01b730 2023-10-14T08:52:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f638affd700 1 -- 172.21.15.6:0/151006161 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63a0003b40 con 0x55f72d01b730 2023-10-14T08:52:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.568+0000 7f638affd700 1 -- 172.21.15.6:0/151006161 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f63a0033030 con 0x55f72d01b730 2023-10-14T08:52:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63be26bb80 10 client.15075 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63be26bb80 10 client.15075 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-14T08:52:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63be26bb80 20 client.15075 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63be26bb80 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d089390 0x55f72d085830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63be26bb80 4 client.15075 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f72cf66e00 con 0x55f72d089390 2023-10-14T08:52:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d089390 0x55f72d085830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f638affd700 10 client.15075 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.569+0000 7f63ab7fe700 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d089390 0x55f72d085830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bc7d95a8bfee447 server_cookie=9b3d9b16662dc2c9 in_seq=0 out_seq=0 2023-10-14T08:52:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f638affd700 1 -- 172.21.15.6:0/151006161 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f72cf66e00 con 0x55f72d089390 2023-10-14T08:52:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f638affd700 10 client.15075 handle_command_reply: tid=0 2023-10-14T08:52:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 client.15075 shutdown 2023-10-14T08:52:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 msgr2=0x55f72d02b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02b8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f63a000bb80 tx=0x7f63a0003cb0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 shutdown_connections 2023-10-14T08:52:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x55f72d089390 0x55f72d085830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f72d01c5d0 0x55f72d02bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f638affd700 0 client.15075 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f72d01add0 0x55f72d0293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 --2- 172.21.15.6:0/151006161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f72d01b730 0x55f72d02b8f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 >> 172.21.15.6:0/151006161 conn(0x55f72cf48d80 msgr2=0x55f72d02ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 shutdown_connections 2023-10-14T08:52:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 1 -- 172.21.15.6:0/151006161 wait complete. 2023-10-14T08:52:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63be26bb80 20 client.15075 trim_cache size 0 max 16384 2023-10-14T08:52:13.593 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2023-10-14T08:52:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24473, 2023-10-14T08:52:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 52.464846094999999, 2023-10-14T08:52:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:13.596 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 70.820008087000005 2023-10-14T08:52:13.596 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f63940a1590 msgr2=0x7f63940a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63b2081700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f63940a1590 0x7f63940a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005950 tx=0x7f63a00058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 msgr2=0x7f63ac196c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.570+0000 7f63b2081700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac196c30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f639c0059d0 tx=0x7f639c00f510 comp rx=0 tx=0).stop 2023-10-14T08:52:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 shutdown_connections 2023-10-14T08:52:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ac106cd0 0x7f63ac19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ac101a70 0x7f63ac196c30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f63940a1590 0x7f63940a3a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 --2- 172.21.15.6:0/207092788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f63ac1043a0 0x7f63ac197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 >> 172.21.15.6:0/207092788 conn(0x7f63ac0fb420 msgr2=0x7f63ac1026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 shutdown_connections 2023-10-14T08:52:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.571+0000 7f63b2081700 1 -- 172.21.15.6:0/207092788 wait complete. 2023-10-14T08:52:13.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T08:52:13.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:13 smithi178 ceph-mon[103612]: pgmap v288: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 7.3 KiB/s, 3 objects/s recovering 2023-10-14T08:52:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/631505913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2935895721' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:13 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1325332291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:13.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 -- 172.21.15.6:0/437185329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 msgr2=0x7f25201013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 --2- 172.21.15.6:0/437185329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f25201013d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f25100099c0 tx=0x7f2510009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 -- 172.21.15.6:0/437185329 shutdown_connections 2023-10-14T08:52:13.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 --2- 172.21.15.6:0/437185329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2520102b40 0x7f25201093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 --2- 172.21.15.6:0/437185329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f25201013d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 --2- 172.21.15.6:0/437185329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25201021a0 0x7f2520102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 -- 172.21.15.6:0/437185329 >> 172.21.15.6:0/437185329 conn(0x7f25200fc520 msgr2=0x7f25200fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 -- 172.21.15.6:0/437185329 shutdown_connections 2023-10-14T08:52:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 -- 172.21.15.6:0/437185329 wait complete. 2023-10-14T08:52:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.726+0000 7f2524bbc700 1 Processor -- start 2023-10-14T08:52:13.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 -- start start 2023-10-14T08:52:13.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f2520198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25201021a0 0x7f25201993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2520102b40 0x7f25201a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25201a09f0 con 0x7f2520100fb0 2023-10-14T08:52:13.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25201a0b30 con 0x7f25201021a0 2023-10-14T08:52:13.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25201a0cc0 con 0x7f2520102b40 2023-10-14T08:52:13.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f2520198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f2520198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60288/0 (socket says 172.21.15.6:60288) 2023-10-14T08:52:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 -- 172.21.15.6:0/1240254928 learned_addr learned my addr 172.21.15.6:0/1240254928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251ed9d700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2520102b40 0x7f25201a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251dd9b700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25201021a0 0x7f25201993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 -- 172.21.15.6:0/1240254928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2520102b40 msgr2=0x7f25201a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2520102b40 0x7f25201a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 -- 172.21.15.6:0/1240254928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25201021a0 msgr2=0x7f25201993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25201021a0 0x7f25201993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 -- 172.21.15.6:0/1240254928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100095f0 con 0x7f2520100fb0 2023-10-14T08:52:13.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f251e59c700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f2520198e70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f250f7fe700 1 -- 172.21.15.6:0/1240254928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251001d070 con 0x7f2520100fb0 2023-10-14T08:52:13.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f250f7fe700 1 -- 172.21.15.6:0/1240254928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2510004090 con 0x7f2520100fb0 2023-10-14T08:52:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25201a0f40 con 0x7f2520100fb0 2023-10-14T08:52:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.727+0000 7f250f7fe700 1 -- 172.21.15.6:0/1240254928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510022d00 con 0x7f2520100fb0 2023-10-14T08:52:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.728+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25201a1300 con 0x7f2520100fb0 2023-10-14T08:52:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.730+0000 7f250f7fe700 1 -- 172.21.15.6:0/1240254928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f2510022470 con 0x7f2520100fb0 2023-10-14T08:52:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.730+0000 7f250f7fe700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25080a1590 0x7f25080a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.730+0000 7f251dd9b700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25080a1590 0x7f25080a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.730+0000 7f250f7fe700 1 -- 172.21.15.6:0/1240254928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f25100ce0f0 con 0x7f2520100fb0 2023-10-14T08:52:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.731+0000 7f251dd9b700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25080a1590 0x7f25080a3a50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2514005950 tx=0x7f2514005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.731+0000 7f2530da6b80 1 Processor -- start 2023-10-14T08:52:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.731+0000 7f2530da6b80 1 -- start start 2023-10-14T08:52:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.731+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.731+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 0x55686a560ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.731+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a561a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f2530da6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a4d4c20 con 0x55686a560730 2023-10-14T08:52:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f2530da6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a4b9c10 con 0x55686a55fdd0 2023-10-14T08:52:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f2530da6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a4b7530 con 0x55686a5615d0 2023-10-14T08:52:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 0x55686a560ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 0x55686a560ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60296/0 (socket says 172.21.15.6:60296) 2023-10-14T08:52:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 -- 172.21.15.6:0/2600280544 learned_addr learned my addr 172.21.15.6:0/2600280544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251e59c700 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251ed9d700 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a561a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 -- 172.21.15.6:0/2600280544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 msgr2=0x55686a561a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a561a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 -- 172.21.15.6:0/2600280544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 msgr2=0x55686a5601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 -- 172.21.15.6:0/2600280544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55686a4703a0 con 0x55686a560730 2023-10-14T08:52:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251ed9d700 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a561a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f251dd9b700 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 0x55686a560ff0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f251400dbe0 tx=0x7f2514010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f8dded8783790d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f250cff9700 1 -- 172.21.15.6:0/2600280544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514004a30 con 0x55686a560730 2023-10-14T08:52:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f250cff9700 1 -- 172.21.15.6:0/2600280544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f251400fc70 con 0x55686a560730 2023-10-14T08:52:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.732+0000 7f250cff9700 1 -- 172.21.15.6:0/2600280544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514005520 con 0x55686a560730 2023-10-14T08:52:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 -- 172.21.15.6:0/2600280544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 msgr2=0x55686a560ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 0x55686a560ff0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f251400dbe0 tx=0x7f2514010000 comp rx=0 tx=0).stop 2023-10-14T08:52:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 -- 172.21.15.6:0/2600280544 shutdown_connections 2023-10-14T08:52:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a561a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 --2- 172.21.15.6:0/2600280544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a560730 0x55686a560ff0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 -- 172.21.15.6:0/2600280544 >> 172.21.15.6:0/2600280544 conn(0x55686a48dd80 msgr2=0x55686a55af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 -- 172.21.15.6:0/2600280544 shutdown_connections 2023-10-14T08:52:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 -- 172.21.15.6:0/2600280544 wait complete. 2023-10-14T08:52:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.733+0000 7f2530da6b80 1 -- start start 2023-10-14T08:52:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 Processor -- start 2023-10-14T08:52:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a569c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a56a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a4b2e20 con 0x55686a5615d0 2023-10-14T08:52:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a44f6c0 con 0x55686a55fdd0 2023-10-14T08:52:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a44f360 con 0x55686a560730 2023-10-14T08:52:13.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f2530da6b80 10 client.0 _ll_register_callbacks cb 0x55686a2ac7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60306/0 (socket says 172.21.15.6:60306) 2023-10-14T08:52:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 -- 172.21.15.6:0/3582264224 learned_addr learned my addr 172.21.15.6:0/3582264224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251dd9b700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a56a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251e59c700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a569c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 -- 172.21.15.6:0/3582264224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 msgr2=0x55686a56a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a56a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 -- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 msgr2=0x55686a569c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a569c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.734+0000 7f251ed9d700 1 -- 172.21.15.6:0/3582264224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251400d890 con 0x55686a5615d0 2023-10-14T08:52:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f251ed9d700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5711a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f25180043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342e5145c8fb090f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2505ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2505ffb700 1 -- 172.21.15.6:0/3582264224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518004bb0 con 0x55686a5615d0 2023-10-14T08:52:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2505ffb700 1 -- 172.21.15.6:0/3582264224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2518004d10 con 0x55686a5615d0 2023-10-14T08:52:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55686a4b7ea0 con 0x55686a5615d0 2023-10-14T08:52:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2505ffb700 1 -- 172.21.15.6:0/3582264224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25180077d0 con 0x55686a5615d0 2023-10-14T08:52:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 10 client.15087 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55686a2ddd90 con 0x55686a5615d0 2023-10-14T08:52:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2505ffb700 1 -- 172.21.15.6:0/3582264224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2518024020 con 0x55686a5615d0 2023-10-14T08:52:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2505ffb700 1 -- 172.21.15.6:0/3582264224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2518014070 con 0x55686a5615d0 2023-10-14T08:52:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 10 client.15087 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T08:52:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 20 client.15087 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a575810 0x55686a574270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 4 client.15087 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.735+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55686a52fbc0 con 0x55686a575810 2023-10-14T08:52:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.736+0000 7f251e59c700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a575810 0x55686a574270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.736+0000 7f2505ffb700 10 client.15087 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.736+0000 7f251e59c700 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a575810 0x55686a574270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8050238c199a005 server_cookie=a7cdee3b62720904 in_seq=0 out_seq=0 2023-10-14T08:52:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2505ffb700 1 -- 172.21.15.6:0/3582264224 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55686a52fbc0 con 0x55686a575810 2023-10-14T08:52:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2505ffb700 10 client.15087 handle_command_reply: tid=0 2023-10-14T08:52:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 client.15087 shutdown 2023-10-14T08:52:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 msgr2=0x55686a5711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5711a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f25180043d0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 shutdown_connections 2023-10-14T08:52:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a575810 0x55686a574270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5711a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a569c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2505ffb700 0 client.15087 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 --2- 172.21.15.6:0/3582264224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a56a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 >> 172.21.15.6:0/3582264224 conn(0x55686a48dd80 msgr2=0x55686a55aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 shutdown_connections 2023-10-14T08:52:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 1 -- 172.21.15.6:0/3582264224 wait complete. 2023-10-14T08:52:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.737+0000 7f2530da6b80 20 client.15087 trim_cache size 0 max 16384 2023-10-14T08:52:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 Processor -- start 2023-10-14T08:52:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 -- start start 2023-10-14T08:52:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a5649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a5697f0 con 0x55686a5615d0 2023-10-14T08:52:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a3338d0 con 0x55686a55fdd0 2023-10-14T08:52:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f2530da6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a471590 con 0x55686a560730 2023-10-14T08:52:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f251ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f251ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60314/0 (socket says 172.21.15.6:60314) 2023-10-14T08:52:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.755+0000 7f251ed9d700 1 -- 172.21.15.6:0/158002239 learned_addr learned my addr 172.21.15.6:0/158002239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251e59c700 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251dd9b700 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a5649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251ed9d700 1 -- 172.21.15.6:0/158002239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 msgr2=0x55686a5649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251ed9d700 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a5649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251ed9d700 1 -- 172.21.15.6:0/158002239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 msgr2=0x55686a5644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251ed9d700 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251ed9d700 1 -- 172.21.15.6:0/158002239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55686a2c6c10 con 0x55686a5615d0 2023-10-14T08:52:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251dd9b700 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a5649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f251ed9d700 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5710c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2518003b90 tx=0x7f2518003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7ce296c40f411f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f250d7fa700 1 -- 172.21.15.6:0/158002239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801ee20 con 0x55686a5615d0 2023-10-14T08:52:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f250d7fa700 1 -- 172.21.15.6:0/158002239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2518024070 con 0x55686a5615d0 2023-10-14T08:52:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f250d7fa700 1 -- 172.21.15.6:0/158002239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518007a70 con 0x55686a5615d0 2023-10-14T08:52:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f2530da6b80 1 -- 172.21.15.6:0/158002239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 msgr2=0x55686a5710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f2530da6b80 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5710c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2518003b90 tx=0x7f2518003bc0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f2530da6b80 1 -- 172.21.15.6:0/158002239 shutdown_connections 2023-10-14T08:52:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f2530da6b80 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a5615d0 0x55686a5710c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f2530da6b80 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a55fdd0 0x55686a5644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.756+0000 7f2530da6b80 1 --2- 172.21.15.6:0/158002239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a560730 0x55686a5649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- 172.21.15.6:0/158002239 >> 172.21.15.6:0/158002239 conn(0x55686a48dd80 msgr2=0x55686a571970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- 172.21.15.6:0/158002239 shutdown_connections 2023-10-14T08:52:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- 172.21.15.6:0/158002239 wait complete. 2023-10-14T08:52:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- start start 2023-10-14T08:52:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 Processor -- start 2023-10-14T08:52:13.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 0x55686a56c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a560730 0x55686a56c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a56f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a56fc90 con 0x55686a55fdd0 2023-10-14T08:52:13.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a56fe00 con 0x55686a560730 2023-10-14T08:52:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686a56ffc0 con 0x55686a5615d0 2023-10-14T08:52:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f2530da6b80 10 client.0 _ll_register_callbacks cb 0x7f25180098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f251e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 0x55686a56c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f251e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 0x55686a56c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60316/0 (socket says 172.21.15.6:60316) 2023-10-14T08:52:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f251e59c700 1 -- 172.21.15.6:0/420737154 learned_addr learned my addr 172.21.15.6:0/420737154 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.757+0000 7f251dd9b700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a560730 0x55686a56c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251ed9d700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a56f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251e59c700 1 -- 172.21.15.6:0/420737154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 msgr2=0x55686a56f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251e59c700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a56f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251e59c700 1 -- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a560730 msgr2=0x55686a56c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251e59c700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a560730 0x55686a56c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251e59c700 1 -- 172.21.15.6:0/420737154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55686a2ddd90 con 0x55686a55fdd0 2023-10-14T08:52:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251dd9b700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a560730 0x55686a56c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f251e59c700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 0x55686a56c1f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2510005f50 tx=0x7f25100227a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61985a772c56b7c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2505ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2505ffb700 1 -- 172.21.15.6:0/420737154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251009b560 con 0x55686a55fdd0 2023-10-14T08:52:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2505ffb700 1 -- 172.21.15.6:0/420737154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f25100a1040 con 0x55686a55fdd0 2023-10-14T08:52:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f251400fc70 con 0x55686a55fdd0 2023-10-14T08:52:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2505ffb700 1 -- 172.21.15.6:0/420737154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f251009b6c0 con 0x55686a55fdd0 2023-10-14T08:52:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2530da6b80 10 client.15093 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55686a304200 con 0x55686a55fdd0 2023-10-14T08:52:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2505ffb700 1 -- 172.21.15.6:0/420737154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f251400fc70 con 0x55686a55fdd0 2023-10-14T08:52:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2505ffb700 1 -- 172.21.15.6:0/420737154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f25100a3170 con 0x55686a55fdd0 2023-10-14T08:52:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2530da6b80 10 client.15093 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.758+0000 7f2530da6b80 10 client.15093 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T08:52:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 20 client.15093 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a5ce950 0x55686a5cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 4 client.15093 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55686a4abe00 con 0x55686a5ce950 2023-10-14T08:52:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f251dd9b700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a5ce950 0x55686a5cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f251dd9b700 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a5ce950 0x55686a5cb210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29b78865f9da4d93 server_cookie=77d15b84445b04f3 in_seq=0 out_seq=0 2023-10-14T08:52:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2505ffb700 10 client.15093 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2505ffb700 1 -- 172.21.15.6:0/420737154 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55686a4abe00 con 0x55686a5ce950 2023-10-14T08:52:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2505ffb700 10 client.15093 handle_command_reply: tid=0 2023-10-14T08:52:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 1 client.15093 shutdown 2023-10-14T08:52:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 msgr2=0x55686a56c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.759+0000 7f2530da6b80 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 0x55686a56c1f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2510005f50 tx=0x7f25100227a0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 shutdown_connections 2023-10-14T08:52:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55686a5ce950 0x55686a5cb210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55686a5615d0 0x55686a56f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55686a55fdd0 0x55686a56c1f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 --2- 172.21.15.6:0/420737154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55686a560730 0x55686a56c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2505ffb700 0 client.15093 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 >> 172.21.15.6:0/420737154 conn(0x55686a48dd80 msgr2=0x55686a569bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 shutdown_connections 2023-10-14T08:52:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 1 -- 172.21.15.6:0/420737154 wait complete. 2023-10-14T08:52:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2530da6b80 20 client.15093 trim_cache size 0 max 16384 2023-10-14T08:52:13.785 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2023-10-14T08:52:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24506, 2023-10-14T08:52:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 53.640159697000001, 2023-10-14T08:52:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 62.085315039999998 2023-10-14T08:52:13.788 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25080a1590 msgr2=0x7f25080a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25080a1590 0x7f25080a3a50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2514005950 tx=0x7f2514005cf0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 msgr2=0x7f2520198e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f2520198e70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510004730 comp rx=0 tx=0).stop 2023-10-14T08:52:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 shutdown_connections 2023-10-14T08:52:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2520102b40 0x7f25201a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2520100fb0 0x7f2520198e70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25080a1590 0x7f25080a3a50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 --2- 172.21.15.6:0/1240254928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25201021a0 0x7f25201993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 >> 172.21.15.6:0/1240254928 conn(0x7f25200fc520 msgr2=0x7f25200fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 shutdown_connections 2023-10-14T08:52:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.760+0000 7f2524bbc700 1 -- 172.21.15.6:0/1240254928 wait complete. 2023-10-14T08:52:13.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-14T08:52:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 -- 172.21.15.6:0/1888638669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2500100fb0 msgr2=0x7f2500101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 --2- 172.21.15.6:0/1888638669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2500100fb0 0x7f2500101430 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009990 tx=0x7f24f0009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 -- 172.21.15.6:0/1888638669 shutdown_connections 2023-10-14T08:52:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 --2- 172.21.15.6:0/1888638669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2500101970 0x7f2500108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 --2- 172.21.15.6:0/1888638669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25000ffe60 0x7f2500100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 --2- 172.21.15.6:0/1888638669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2500100fb0 0x7f2500101430 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 -- 172.21.15.6:0/1888638669 >> 172.21.15.6:0/1888638669 conn(0x7f25000fb390 msgr2=0x7f25000fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 -- 172.21.15.6:0/1888638669 shutdown_connections 2023-10-14T08:52:13.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 -- 172.21.15.6:0/1888638669 wait complete. 2023-10-14T08:52:13.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 Processor -- start 2023-10-14T08:52:13.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.918+0000 7f250568d700 1 -- start start 2023-10-14T08:52:13.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 0x7f2500195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2500100fb0 0x7f25001960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2500101970 0x7f250019d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250019d6f0 con 0x7f25000ffe60 2023-10-14T08:52:13.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250019d830 con 0x7f2500101970 2023-10-14T08:52:13.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250019d9c0 con 0x7f2500100fb0 2023-10-14T08:52:13.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 0x7f2500195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 0x7f2500195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60330/0 (socket says 172.21.15.6:60330) 2023-10-14T08:52:13.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 -- 172.21.15.6:0/427984502 learned_addr learned my addr 172.21.15.6:0/427984502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2500101970 0x7f250019d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2500100fb0 0x7f25001960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 -- 172.21.15.6:0/427984502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2500100fb0 msgr2=0x7f25001960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2500100fb0 0x7f25001960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 -- 172.21.15.6:0/427984502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2500101970 msgr2=0x7f250019d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2500101970 0x7f250019d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 -- 172.21.15.6:0/427984502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f00095f0 con 0x7f25000ffe60 2023-10-14T08:52:13.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24feffd700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 0x7f2500195b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f24e800e9a0 tx=0x7f24e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24f7fff700 1 -- 172.21.15.6:0/427984502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8009790 con 0x7f25000ffe60 2023-10-14T08:52:13.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250019dca0 con 0x7f25000ffe60 2023-10-14T08:52:13.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24f7fff700 1 -- 172.21.15.6:0/427984502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24e800cbd0 con 0x7f25000ffe60 2023-10-14T08:52:13.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.919+0000 7f24f7fff700 1 -- 172.21.15.6:0/427984502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e8018680 con 0x7f25000ffe60 2023-10-14T08:52:13.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.920+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250019e1b0 con 0x7f25000ffe60 2023-10-14T08:52:13.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.922+0000 7f24f7fff700 1 -- 172.21.15.6:0/427984502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f24e800cd40 con 0x7f25000ffe60 2023-10-14T08:52:13.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.922+0000 7f24f7fff700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24ec0a1510 0x7f24ec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.923+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24ec0a1510 0x7f24ec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.923+0000 7f24f7fff700 1 -- 172.21.15.6:0/427984502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24e8014070 con 0x7f25000ffe60 2023-10-14T08:52:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.923+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24ec0a1510 0x7f24ec0a39d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b2e0 tx=0x7f24f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.923+0000 7f2511877b80 1 Processor -- start 2023-10-14T08:52:13.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.923+0000 7f2511877b80 1 -- start start 2023-10-14T08:52:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f2511877b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0a6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f2511877b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f2511877b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f2511877b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d3a018c20 con 0x563d3a0a6940 2023-10-14T08:52:13.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f2511877b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39ffdc10 con 0x563d3a0a77e0 2023-10-14T08:52:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f2511877b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39ffb530 con 0x563d3a0a5fe0 2023-10-14T08:52:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60340/0 (socket says 172.21.15.6:60340) 2023-10-14T08:52:13.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 -- 172.21.15.6:0/463602568 learned_addr learned my addr 172.21.15.6:0/463602568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24feffd700 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 -- 172.21.15.6:0/463602568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 msgr2=0x563d3a0a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0a6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 -- 172.21.15.6:0/463602568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 msgr2=0x563d3a0a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24fe7fc700 1 -- 172.21.15.6:0/463602568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d39fb43a0 con 0x563d3a0a6940 2023-10-14T08:52:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.924+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0a7200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f24f0015000 tx=0x7f24f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50f059086345ac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f24f57fa700 1 -- 172.21.15.6:0/463602568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f002b070 con 0x563d3a0a6940 2023-10-14T08:52:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f24f57fa700 1 -- 172.21.15.6:0/463602568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24f001e040 con 0x563d3a0a6940 2023-10-14T08:52:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f24f57fa700 1 -- 172.21.15.6:0/463602568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0004e80 con 0x563d3a0a6940 2023-10-14T08:52:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 -- 172.21.15.6:0/463602568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 msgr2=0x563d3a0a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0a7200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f24f0015000 tx=0x7f24f001f000 comp rx=0 tx=0).stop 2023-10-14T08:52:13.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 -- 172.21.15.6:0/463602568 shutdown_connections 2023-10-14T08:52:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 --2- 172.21.15.6:0/463602568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0a7200 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.925+0000 7f2511877b80 1 -- 172.21.15.6:0/463602568 >> 172.21.15.6:0/463602568 conn(0x563d39fd1d80 msgr2=0x563d3a09ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 -- 172.21.15.6:0/463602568 shutdown_connections 2023-10-14T08:52:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 -- 172.21.15.6:0/463602568 wait complete. 2023-10-14T08:52:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 -- start start 2023-10-14T08:52:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 Processor -- start 2023-10-14T08:52:13.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39ff6e20 con 0x563d3a0a6940 2023-10-14T08:52:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39f936c0 con 0x563d3a0a77e0 2023-10-14T08:52:13.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f2511877b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39f93360 con 0x563d3a0a5fe0 2023-10-14T08:52:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.926+0000 7f24fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f2511877b80 10 client.0 _ll_register_callbacks cb 0x563d39df07b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60346/0 (socket says 172.21.15.6:60346) 2023-10-14T08:52:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 -- 172.21.15.6:0/3070912300 learned_addr learned my addr 172.21.15.6:0/3070912300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24feffd700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 -- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 msgr2=0x563d3a0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 -- 172.21.15.6:0/3070912300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 msgr2=0x563d3a0b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 -- 172.21.15.6:0/3070912300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2500108bc0 con 0x563d3a0a6940 2023-10-14T08:52:13.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:13.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0b0320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005c50 tx=0x7f24f000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaa81f413cc7deb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24e67fc700 1 -- 172.21.15.6:0/3070912300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f002b040 con 0x563d3a0a6940 2023-10-14T08:52:13.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24e67fc700 1 -- 172.21.15.6:0/3070912300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24f000f700 con 0x563d3a0a6940 2023-10-14T08:52:13.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d39ffbea0 con 0x563d3a0a6940 2023-10-14T08:52:13.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f24e67fc700 1 -- 172.21.15.6:0/3070912300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f000f8c0 con 0x563d3a0a6940 2023-10-14T08:52:13.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f2511877b80 10 client.15105 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.927+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563d39e21d90 con 0x563d3a0a6940 2023-10-14T08:52:13.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f24e67fc700 1 -- 172.21.15.6:0/3070912300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563d39ffbea0 con 0x563d3a0a6940 2023-10-14T08:52:13.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f24e67fc700 1 -- 172.21.15.6:0/3070912300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f24f0024a50 con 0x563d3a0a6940 2023-10-14T08:52:13.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f2511877b80 10 client.15105 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f2511877b80 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-14T08:52:13.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f2511877b80 20 client.15105 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f2511877b80 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a0bb510 0x563d3a0ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f2511877b80 4 client.15105 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d3a073bc0 con 0x563d3a0bb510 2023-10-14T08:52:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f24feffd700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a0bb510 0x563d3a0ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f24e67fc700 10 client.15105 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.928+0000 7f24feffd700 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a0bb510 0x563d3a0ba290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc788643678ecca6 server_cookie=8bc706cfc0068166 in_seq=0 out_seq=0 2023-10-14T08:52:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.929+0000 7f24e67fc700 1 -- 172.21.15.6:0/3070912300 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563d3a073bc0 con 0x563d3a0bb510 2023-10-14T08:52:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.929+0000 7f24e67fc700 10 client.15105 handle_command_reply: tid=0 2023-10-14T08:52:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.929+0000 7f2511877b80 1 client.15105 shutdown 2023-10-14T08:52:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 msgr2=0x563d3a0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0b0320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005c50 tx=0x7f24f000be60 comp rx=0 tx=0).stop 2023-10-14T08:52:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 shutdown_connections 2023-10-14T08:52:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a0bb510 0x563d3a0ba290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f24e67fc700 0 client.15105 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 --2- 172.21.15.6:0/3070912300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0b0320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 >> 172.21.15.6:0/3070912300 conn(0x563d39fd1d80 msgr2=0x563d3a09eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 shutdown_connections 2023-10-14T08:52:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 1 -- 172.21.15.6:0/3070912300 wait complete. 2023-10-14T08:52:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.930+0000 7f2511877b80 20 client.15105 trim_cache size 0 max 16384 2023-10-14T08:52:13.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.947+0000 7f2511877b80 1 Processor -- start 2023-10-14T08:52:13.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.947+0000 7f2511877b80 1 -- start start 2023-10-14T08:52:13.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f2511877b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f2511877b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f2511877b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f2511877b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39e778d0 con 0x563d3a0a6940 2023-10-14T08:52:13.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f2511877b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39fae720 con 0x563d3a0a77e0 2023-10-14T08:52:13.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f2511877b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d39ff80b0 con 0x563d3a0a5fe0 2023-10-14T08:52:13.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0ba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60352/0 (socket says 172.21.15.6:60352) 2023-10-14T08:52:13.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 -- 172.21.15.6:0/1684712484 learned_addr learned my addr 172.21.15.6:0/1684712484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24feffd700 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 -- 172.21.15.6:0/1684712484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 msgr2=0x563d3a0ba290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0ba290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 -- 172.21.15.6:0/1684712484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 msgr2=0x563d3a0b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 -- 172.21.15.6:0/1684712484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d39e0ac10 con 0x563d3a0a6940 2023-10-14T08:52:13.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0ba7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005c20 tx=0x7f24f0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccb223c653d8c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.948+0000 7f24f5ffb700 1 -- 172.21.15.6:0/1684712484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f002b040 con 0x563d3a0a6940 2023-10-14T08:52:13.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f24f5ffb700 1 -- 172.21.15.6:0/1684712484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24f000bc00 con 0x563d3a0a6940 2023-10-14T08:52:13.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f24f5ffb700 1 -- 172.21.15.6:0/1684712484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0024970 con 0x563d3a0a6940 2023-10-14T08:52:13.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 -- 172.21.15.6:0/1684712484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 msgr2=0x563d3a0ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0ba7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f24f0005c20 tx=0x7f24f0005e80 comp rx=0 tx=0).stop 2023-10-14T08:52:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 -- 172.21.15.6:0/1684712484 shutdown_connections 2023-10-14T08:52:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a77e0 0x563d3a0b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a5fe0 0x563d3a0ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 --2- 172.21.15.6:0/1684712484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a6940 0x563d3a0ba7d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 -- 172.21.15.6:0/1684712484 >> 172.21.15.6:0/1684712484 conn(0x563d39fd1d80 msgr2=0x563d3a09e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 -- 172.21.15.6:0/1684712484 shutdown_connections 2023-10-14T08:52:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.949+0000 7f2511877b80 1 -- 172.21.15.6:0/1684712484 wait complete. 2023-10-14T08:52:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 -- start start 2023-10-14T08:52:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 Processor -- start 2023-10-14T08:52:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a5fe0 0x563d3a0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a6940 0x563d3a0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 0x563d3a0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d3a0b46b0 con 0x563d3a0a77e0 2023-10-14T08:52:13.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d3a0b4820 con 0x563d3a0a5fe0 2023-10-14T08:52:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d3a10ef80 con 0x563d3a0a6940 2023-10-14T08:52:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f2511877b80 10 client.0 _ll_register_callbacks cb 0x7f24e8096630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 0x563d3a0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 0x563d3a0b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60360/0 (socket says 172.21.15.6:60360) 2023-10-14T08:52:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 -- 172.21.15.6:0/4272585169 learned_addr learned my addr 172.21.15.6:0/4272585169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24feffd700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a5fe0 0x563d3a0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24fe7fc700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a6940 0x563d3a0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 -- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a6940 msgr2=0x563d3a0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a6940 0x563d3a0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 -- 172.21.15.6:0/4272585169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a5fe0 msgr2=0x563d3a0b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a5fe0 0x563d3a0b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 -- 172.21.15.6:0/4272585169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d39e21d90 con 0x563d3a0a77e0 2023-10-14T08:52:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24ff7fe700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 0x563d3a0b40e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f24f8008b80 tx=0x7f24f8008bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d2902c06a6e3e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.950+0000 7f24e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f24e67fc700 1 -- 172.21.15.6:0/4272585169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800e040 con 0x563d3a0a77e0 2023-10-14T08:52:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f24e67fc700 1 -- 172.21.15.6:0/4272585169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24f80186d0 con 0x563d3a0a77e0 2023-10-14T08:52:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24f001e040 con 0x563d3a0a77e0 2023-10-14T08:52:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f24e67fc700 1 -- 172.21.15.6:0/4272585169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f8018890 con 0x563d3a0a77e0 2023-10-14T08:52:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 10 client.15111 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563d39e48200 con 0x563d3a0a77e0 2023-10-14T08:52:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f24e67fc700 1 -- 172.21.15.6:0/4272585169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24f001e040 con 0x563d3a0a77e0 2023-10-14T08:52:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f24e67fc700 1 -- 172.21.15.6:0/4272585169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f24f8004680 con 0x563d3a0a77e0 2023-10-14T08:52:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 10 client.15111 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:13.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 10 client.15111 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-14T08:52:13.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 20 client.15111 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:13.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a114340 0x563d3a1107c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:13.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 4 client.15111 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:13.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563d39fefe00 con 0x563d3a114340 2023-10-14T08:52:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.951+0000 7f24feffd700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a114340 0x563d3a1107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f24e67fc700 10 client.15111 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f24feffd700 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a114340 0x563d3a1107c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247bd17f67ff346e server_cookie=9ebd65414d9237ce in_seq=0 out_seq=0 2023-10-14T08:52:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f24e67fc700 1 -- 172.21.15.6:0/4272585169 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x563d39fefe00 con 0x563d3a114340 2023-10-14T08:52:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f24e67fc700 10 client.15111 handle_command_reply: tid=0 2023-10-14T08:52:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 client.15111 shutdown 2023-10-14T08:52:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 msgr2=0x563d3a0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 0x563d3a0b40e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f24f8008b80 tx=0x7f24f8008bb0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 shutdown_connections 2023-10-14T08:52:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563d3a114340 0x563d3a1107c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563d3a0a77e0 0x563d3a0b40e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f24e67fc700 0 client.15111 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563d3a0a5fe0 0x563d3a0b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 --2- 172.21.15.6:0/4272585169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563d3a0a6940 0x563d3a0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 >> 172.21.15.6:0/4272585169 conn(0x563d39fd1d80 msgr2=0x563d3a0aa780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 shutdown_connections 2023-10-14T08:52:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 1 -- 172.21.15.6:0/4272585169 wait complete. 2023-10-14T08:52:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.952+0000 7f2511877b80 20 client.15111 trim_cache size 0 max 16384 2023-10-14T08:52:13.978 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-14T08:52:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24508, 2023-10-14T08:52:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 56.856138420000001, 2023-10-14T08:52:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 68.890719959999998 2023-10-14T08:52:13.980 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24ec0a1510 msgr2=0x7f24ec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24ec0a1510 0x7f24ec0a39d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b2e0 tx=0x7f24f0005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 msgr2=0x7f2500195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 0x7f2500195b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f24e800e9a0 tx=0x7f24e800ecb0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 shutdown_connections 2023-10-14T08:52:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24ec0a1510 0x7f24ec0a39d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2500101970 0x7f250019d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25000ffe60 0x7f2500195b70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 --2- 172.21.15.6:0/427984502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2500100fb0 0x7f25001960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 >> 172.21.15.6:0/427984502 conn(0x7f25000fb390 msgr2=0x7f25000fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 shutdown_connections 2023-10-14T08:52:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:13.953+0000 7f250568d700 1 -- 172.21.15.6:0/427984502 wait complete. 2023-10-14T08:52:13.985 INFO:tasks.cephadm:Setup complete, yielding 2023-10-14T08:52:13.985 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-14T08:52:13.996 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T08:52:13.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-14T08:52:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:15 smithi057 ceph-mon[103313]: pgmap v289: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 5.9 KiB/s, 2 objects/s recovering 2023-10-14T08:52:15.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:15 smithi006 ceph-mon[99452]: pgmap v289: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 5.9 KiB/s, 2 objects/s recovering 2023-10-14T08:52:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:15 smithi178 ceph-mon[103612]: pgmap v289: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 5.9 KiB/s, 2 objects/s recovering 2023-10-14T08:52:15.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 -- 172.21.15.6:0/645329502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3048100fd0 msgr2=0x7f3048101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 --2- 172.21.15.6:0/645329502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3048100fd0 0x7f3048101450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3038009990 tx=0x7f3038009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 -- 172.21.15.6:0/645329502 shutdown_connections 2023-10-14T08:52:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 --2- 172.21.15.6:0/645329502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048101990 0x7f30481082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 --2- 172.21.15.6:0/645329502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30480ffe70 0x7f3048100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 --2- 172.21.15.6:0/645329502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3048100fd0 0x7f3048101450 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 -- 172.21.15.6:0/645329502 >> 172.21.15.6:0/645329502 conn(0x7f30480fb3f0 msgr2=0x7f30480fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 -- 172.21.15.6:0/645329502 shutdown_connections 2023-10-14T08:52:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.763+0000 7f304e651700 1 -- 172.21.15.6:0/645329502 wait complete. 2023-10-14T08:52:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 Processor -- start 2023-10-14T08:52:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 -- start start 2023-10-14T08:52:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 0x7f3048196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048100fd0 0x7f30481971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3048101990 0x7f304819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304819e830 con 0x7f30480ffe70 2023-10-14T08:52:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304819e970 con 0x7f3048101990 2023-10-14T08:52:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f304e651700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304819eb30 con 0x7f3048100fd0 2023-10-14T08:52:15.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f3047fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 0x7f3048196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:15.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f3047fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 0x7f3048196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60368/0 (socket says 172.21.15.6:60368) 2023-10-14T08:52:15.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.764+0000 7f3047fff700 1 -- 172.21.15.6:0/3703587072 learned_addr learned my addr 172.21.15.6:0/3703587072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:15.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f304cbee700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3048101990 0x7f304819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:15.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f30477fe700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048100fd0 0x7f30481971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f3047fff700 1 -- 172.21.15.6:0/3703587072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048100fd0 msgr2=0x7f30481971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f3047fff700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048100fd0 0x7f30481971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f3047fff700 1 -- 172.21.15.6:0/3703587072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3048101990 msgr2=0x7f304819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f3047fff700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3048101990 0x7f304819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f3047fff700 1 -- 172.21.15.6:0/3703587072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30380095f0 con 0x7f30480ffe70 2023-10-14T08:52:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f30477fe700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048100fd0 0x7f30481971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f304cbee700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3048101990 0x7f304819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f3047fff700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 0x7f3048196cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f303000d950 tx=0x7f303000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030009b40 con 0x7f30480ffe70 2023-10-14T08:52:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3030009ca0 con 0x7f30480ffe70 2023-10-14T08:52:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304819ee10 con 0x7f30480ffe70 2023-10-14T08:52:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303000f620 con 0x7f30480ffe70 2023-10-14T08:52:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.765+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304819f220 con 0x7f30480ffe70 2023-10-14T08:52:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.766+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304810b6f0 con 0x7f30480ffe70 2023-10-14T08:52:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.768+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f3030010460 con 0x7f30480ffe70 2023-10-14T08:52:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.768+0000 7f30457fa700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f30340a1510 0x7f30340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.769+0000 7f30477fe700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f30340a1510 0x7f30340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:15.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.769+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f30300cd290 con 0x7f30480ffe70 2023-10-14T08:52:15.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.769+0000 7f30477fe700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f30340a1510 0x7f30340a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3038000c00 tx=0x7f3038005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:15.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.772+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3030096750 con 0x7f30480ffe70 2023-10-14T08:52:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.989+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3048069130 con 0x7f30340a1510 2023-10-14T08:52:15.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.990+0000 7f30457fa700 1 -- 172.21.15.6:0/3703587072 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3048069130 con 0x7f30340a1510 2023-10-14T08:52:15.992 INFO:teuthology.orchestra.run.smithi006.stdout:Backend: cephadm 2023-10-14T08:52:15.992 INFO:teuthology.orchestra.run.smithi006.stdout:Available: Yes 2023-10-14T08:52:15.992 INFO:teuthology.orchestra.run.smithi006.stdout:Paused: No 2023-10-14T08:52:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.992+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f30340a1510 msgr2=0x7f30340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.992+0000 7f304e651700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f30340a1510 0x7f30340a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3038000c00 tx=0x7f3038005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.992+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 msgr2=0x7f3048196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.992+0000 7f304e651700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 0x7f3048196cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f303000d950 tx=0x7f303000dd10 comp rx=0 tx=0).stop 2023-10-14T08:52:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 shutdown_connections 2023-10-14T08:52:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f30340a1510 0x7f30340a39d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3048101990 0x7f304819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30480ffe70 0x7f3048196cb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 --2- 172.21.15.6:0/3703587072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3048100fd0 0x7f30481971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 >> 172.21.15.6:0/3703587072 conn(0x7f30480fb3f0 msgr2=0x7f3048068a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 shutdown_connections 2023-10-14T08:52:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:15.993+0000 7f304e651700 1 -- 172.21.15.6:0/3703587072 wait complete. 2023-10-14T08:52:16.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-14T08:52:16.996 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:17 smithi057 ceph-mon[103313]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 5.3 KiB/s, 2 objects/s recovering 2023-10-14T08:52:17.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:17 smithi057 ceph-mon[103313]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:17 smithi006 ceph-mon[99452]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 5.3 KiB/s, 2 objects/s recovering 2023-10-14T08:52:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:17 smithi006 ceph-mon[99452]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:17 smithi178 ceph-mon[103612]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 5.3 KiB/s, 2 objects/s recovering 2023-10-14T08:52:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:17 smithi178 ceph-mon[103612]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 -- 172.21.15.6:0/1131094258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2100ffe70 msgr2=0x7fe210100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:18.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 --2- 172.21.15.6:0/1131094258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2100ffe70 0x7fe210100290 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009990 tx=0x7fe20c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 -- 172.21.15.6:0/1131094258 shutdown_connections 2023-10-14T08:52:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 --2- 172.21.15.6:0/1131094258 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe210101990 0x7fe2101082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 --2- 172.21.15.6:0/1131094258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2100ffe70 0x7fe210100290 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 --2- 172.21.15.6:0/1131094258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe210100fd0 0x7fe210101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 -- 172.21.15.6:0/1131094258 >> 172.21.15.6:0/1131094258 conn(0x7fe2100fb3f0 msgr2=0x7fe2100fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 -- 172.21.15.6:0/1131094258 shutdown_connections 2023-10-14T08:52:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 -- 172.21.15.6:0/1131094258 wait complete. 2023-10-14T08:52:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 Processor -- start 2023-10-14T08:52:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.292+0000 7fe21803f700 1 -- start start 2023-10-14T08:52:18.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2100ffe70 0x7fe210069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 0x7fe21019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe210101990 0x7fe21019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21019e780 con 0x7fe210100fd0 2023-10-14T08:52:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21019e8f0 con 0x7fe2100ffe70 2023-10-14T08:52:18.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21019eab0 con 0x7fe210101990 2023-10-14T08:52:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 0x7fe21019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 0x7fe21019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60382/0 (socket says 172.21.15.6:60382) 2023-10-14T08:52:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 -- 172.21.15.6:0/2013015742 learned_addr learned my addr 172.21.15.6:0/2013015742 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe215ddb700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2100ffe70 0x7fe210069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:18.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2165dc700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe210101990 0x7fe21019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 -- 172.21.15.6:0/2013015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe210101990 msgr2=0x7fe21019dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe210101990 0x7fe21019dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 -- 172.21.15.6:0/2013015742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2100ffe70 msgr2=0x7fe210069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2100ffe70 0x7fe210069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 -- 172.21.15.6:0/2013015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0095f0 con 0x7fe210100fd0 2023-10-14T08:52:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe2155da700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 0x7fe21019b9a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe20000d950 tx=0x7fe20000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200009940 con 0x7fe210100fd0 2023-10-14T08:52:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe200010460 con 0x7fe210100fd0 2023-10-14T08:52:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21019ed90 con 0x7fe210100fd0 2023-10-14T08:52:18.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000f620 con 0x7fe210100fd0 2023-10-14T08:52:18.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.293+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21019f230 con 0x7fe210100fd0 2023-10-14T08:52:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.295+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe210107450 con 0x7fe210100fd0 2023-10-14T08:52:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.295+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fe2000108d0 con 0x7fe210100fd0 2023-10-14T08:52:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.296+0000 7fe206ffd700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1fc0a1510 0x7fe1fc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.296+0000 7fe215ddb700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1fc0a1510 0x7fe1fc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:18.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.296+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe2000ccfd0 con 0x7fe210100fd0 2023-10-14T08:52:18.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.297+0000 7fe215ddb700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1fc0a1510 0x7fe1fc0a39d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00b5c0 tx=0x7fe20c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:18.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.301+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe200096590 con 0x7fe210100fd0 2023-10-14T08:52:18.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.509+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe21002d1c0 con 0x7fe1fc0a1510 2023-10-14T08:52:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.530+0000 7fe206ffd700 1 -- 172.21.15.6:0/2013015742 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fe21002d1c0 con 0x7fe1fc0a1510 2023-10-14T08:52:18.532 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-14T08:52:18.532 INFO:teuthology.orchestra.run.smithi006.stdout:mds.a smithi006 running (69s) 59s ago 69s 14.0M - 18.0.0-6730-g4ba8a190 6c414e27a22d ceec0bf7d2c6 2023-10-14T08:52:18.532 INFO:teuthology.orchestra.run.smithi006.stdout:mds.b smithi057 running (67s) 59s ago 66s 15.7M - 18.0.0-6730-g4ba8a190 6c414e27a22d d6a104350c91 2023-10-14T08:52:18.533 INFO:teuthology.orchestra.run.smithi006.stdout:mds.c smithi178 running (78s) 59s ago 77s 15.8M - 18.0.0-6730-g4ba8a190 6c414e27a22d f3ba4991d742 2023-10-14T08:52:18.533 INFO:teuthology.orchestra.run.smithi006.stdout:mds.d smithi006 running (85s) 59s ago 84s 15.7M - 18.0.0-6730-g4ba8a190 6c414e27a22d 213ee11070cf 2023-10-14T08:52:18.533 INFO:teuthology.orchestra.run.smithi006.stdout:mds.e smithi057 running (83s) 59s ago 82s 15.8M - 18.0.0-6730-g4ba8a190 6c414e27a22d 10f59e8e1ddf 2023-10-14T08:52:18.533 INFO:teuthology.orchestra.run.smithi006.stdout:mds.f smithi178 running (80s) 59s ago 80s 14.4M - 18.0.0-6730-g4ba8a190 6c414e27a22d 7131aaf1f5a7 2023-10-14T08:52:18.533 INFO:teuthology.orchestra.run.smithi006.stdout:mds.g smithi006 running (71s) 59s ago 71s 15.7M - 18.0.0-6730-g4ba8a190 6c414e27a22d 9c38f192d262 2023-10-14T08:52:18.534 INFO:teuthology.orchestra.run.smithi006.stdout:mds.h smithi057 running (76s) 59s ago 75s 15.7M - 18.0.0-6730-g4ba8a190 6c414e27a22d c480398994dd 2023-10-14T08:52:18.534 INFO:teuthology.orchestra.run.smithi006.stdout:mds.i smithi178 running (73s) 59s ago 73s 15.7M - 18.0.0-6730-g4ba8a190 6c414e27a22d e45f2816f16d 2023-10-14T08:52:18.534 INFO:teuthology.orchestra.run.smithi006.stdout:mds.j smithi006 running (87s) 59s ago 87s 16.9M - 18.0.0-6730-g4ba8a190 6c414e27a22d 82b5c9f5669c 2023-10-14T08:52:18.534 INFO:teuthology.orchestra.run.smithi006.stdout:mds.k smithi057 running (89s) 59s ago 89s 14.2M - 18.0.0-6730-g4ba8a190 6c414e27a22d 3f98560be857 2023-10-14T08:52:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:mds.l smithi178 running (92s) 59s ago 91s 13.5M - 18.0.0-6730-g4ba8a190 6c414e27a22d bb926148098c 2023-10-14T08:52:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.x smithi006 *:9283,8765 running (8m) 59s ago 8m 515M - 18.0.0-6730-g4ba8a190 6c414e27a22d b194b901c56b 2023-10-14T08:52:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.y smithi057 *:8443,8765 running (6m) 59s ago 6m 449M - 18.0.0-6730-g4ba8a190 6c414e27a22d 298526152a15 2023-10-14T08:52:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.z smithi178 *:8443,8765 running (6m) 59s ago 6m 451M - 18.0.0-6730-g4ba8a190 6c414e27a22d b4c9c4838440 2023-10-14T08:52:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a smithi006 running (8m) 59s ago 8m 85.8M 2048M 18.0.0-6730-g4ba8a190 6c414e27a22d 7de318dbf138 2023-10-14T08:52:18.535 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b smithi057 running (6m) 59s ago 6m 61.7M 2048M 18.0.0-6730-g4ba8a190 6c414e27a22d 3dd5f3f92137 2023-10-14T08:52:18.536 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c smithi178 running (6m) 59s ago 6m 60.9M 2048M 18.0.0-6730-g4ba8a190 6c414e27a22d 98002c1e3789 2023-10-14T08:52:18.536 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (5m) 59s ago 5m 59.6M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d 3f1cf6fddc1a 2023-10-14T08:52:18.536 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi057 running (5m) 59s ago 5m 61.0M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d cc62a50963b5 2023-10-14T08:52:18.536 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi178 running (5m) 59s ago 5m 57.4M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 87168a31a166 2023-10-14T08:52:18.536 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi006 running (4m) 59s ago 4m 54.0M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d 3454d2b2028f 2023-10-14T08:52:18.537 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi057 running (4m) 59s ago 4m 49.2M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d 2429154b71ac 2023-10-14T08:52:18.537 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi178 running (4m) 59s ago 4m 54.4M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 85f2cccbc826 2023-10-14T08:52:18.537 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 smithi006 running (3m) 59s ago 3m 48.4M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d 34224b2c1bf8 2023-10-14T08:52:18.537 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 smithi057 running (3m) 59s ago 3m 59.4M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d f7a3a6d6b80c 2023-10-14T08:52:18.537 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 smithi178 running (2m) 59s ago 2m 52.8M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 6c06c87ba0b6 2023-10-14T08:52:18.538 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 smithi006 running (2m) 59s ago 2m 48.6M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d 2f2bc642c7d5 2023-10-14T08:52:18.538 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 smithi057 running (2m) 59s ago 2m 53.6M 4293M 18.0.0-6730-g4ba8a190 6c414e27a22d 5b1ede2c4011 2023-10-14T08:52:18.538 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 smithi178 running (110s) 59s ago 110s 46.6M 4292M 18.0.0-6730-g4ba8a190 6c414e27a22d 5ecff932a68d 2023-10-14T08:52:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1fc0a1510 msgr2=0x7fe1fc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1fc0a1510 0x7fe1fc0a39d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00b5c0 tx=0x7fe20c005960 comp rx=0 tx=0).stop 2023-10-14T08:52:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 msgr2=0x7fe21019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 0x7fe21019b9a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe20000d950 tx=0x7fe20000dc60 comp rx=0 tx=0).stop 2023-10-14T08:52:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 shutdown_connections 2023-10-14T08:52:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe210101990 0x7fe21019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1fc0a1510 0x7fe1fc0a39d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2100ffe70 0x7fe210069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 --2- 172.21.15.6:0/2013015742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210100fd0 0x7fe21019b9a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 >> 172.21.15.6:0/2013015742 conn(0x7fe2100fb3f0 msgr2=0x7fe210104590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 shutdown_connections 2023-10-14T08:52:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:18.532+0000 7fe21803f700 1 -- 172.21.15.6:0/2013015742 wait complete. 2023-10-14T08:52:18.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-14T08:52:19.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:19 smithi006 ceph-mon[99452]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s; 4.9 KiB/s, 1 objects/s recovering 2023-10-14T08:52:19.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:19 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:52:19.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:19 smithi057 ceph-mon[103313]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s; 4.9 KiB/s, 1 objects/s recovering 2023-10-14T08:52:19.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:19 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:52:19.529 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:19 smithi178 ceph-mon[103612]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s; 4.9 KiB/s, 1 objects/s recovering 2023-10-14T08:52:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:19 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:52:20.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:20 smithi057 ceph-mon[103313]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:20.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:20 smithi006 ceph-mon[99452]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:20.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:20 smithi178 ceph-mon[103612]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 -- 172.21.15.6:0/1813292069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 msgr2=0x7fc03c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 --2- 172.21.15.6:0/1813292069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c1082b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc03400b0a0 tx=0x7fc03400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 -- 172.21.15.6:0/1813292069 shutdown_connections 2023-10-14T08:52:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 --2- 172.21.15.6:0/1813292069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c1082b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 --2- 172.21.15.6:0/1813292069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 0x7fc03c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 --2- 172.21.15.6:0/1813292069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c100fd0 0x7fc03c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 -- 172.21.15.6:0/1813292069 >> 172.21.15.6:0/1813292069 conn(0x7fc03c0fb3f0 msgr2=0x7fc03c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 -- 172.21.15.6:0/1813292069 shutdown_connections 2023-10-14T08:52:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.034+0000 7fc04352e700 1 -- 172.21.15.6:0/1813292069 wait complete. 2023-10-14T08:52:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 Processor -- start 2023-10-14T08:52:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 -- start start 2023-10-14T08:52:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 0x7fc03c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c100fd0 0x7fc03c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c19e870 con 0x7fc03c101990 2023-10-14T08:52:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c19e9e0 con 0x7fc03c0ffe70 2023-10-14T08:52:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc04352e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c19eba0 con 0x7fc03c100fd0 2023-10-14T08:52:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc0412ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 0x7fc03c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc041acb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc0412ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 0x7fc03c069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:59152/0 (socket says 172.21.15.6:59152) 2023-10-14T08:52:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc0412ca700 1 -- 172.21.15.6:0/3787699902 learned_addr learned my addr 172.21.15.6:0/3787699902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc040ac9700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c100fd0 0x7fc03c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc041acb700 1 -- 172.21.15.6:0/3787699902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c100fd0 msgr2=0x7fc03c19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc041acb700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c100fd0 0x7fc03c19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc041acb700 1 -- 172.21.15.6:0/3787699902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 msgr2=0x7fc03c069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc041acb700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 0x7fc03c069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.035+0000 7fc041acb700 1 -- 172.21.15.6:0/3787699902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009d00 con 0x7fc03c101990 2023-10-14T08:52:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.036+0000 7fc041acb700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c19e0d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc03400b0a0 tx=0x7fc03400bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.036+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400e040 con 0x7fc03c101990 2023-10-14T08:52:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.036+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc034004c60 con 0x7fc03c101990 2023-10-14T08:52:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.036+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c19ee20 con 0x7fc03c101990 2023-10-14T08:52:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.036+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03401b6b0 con 0x7fc03c101990 2023-10-14T08:52:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.036+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03c19f230 con 0x7fc03c101990 2023-10-14T08:52:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.037+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc03c107420 con 0x7fc03c101990 2023-10-14T08:52:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.038+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc03401d480 con 0x7fc03c101990 2023-10-14T08:52:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.038+0000 7fc0327fc700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc0280a1590 0x7fc0280a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.039+0000 7fc0412ca700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc0280a1590 0x7fc0280a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.039+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc0340ce640 con 0x7fc03c101990 2023-10-14T08:52:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.039+0000 7fc0412ca700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc0280a1590 0x7fc0280a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d20 tx=0x7fc038009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.043+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc034097bd0 con 0x7fc03c101990 2023-10-14T08:52:21.161 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:21 smithi006 ceph-mon[99452]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-14T08:52:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.274+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc03c02d350 con 0x7fc0280a1590 2023-10-14T08:52:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.283+0000 7fc0327fc700 1 -- 172.21.15.6:0/3787699902 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fc03c02d350 con 0x7fc0280a1590 2023-10-14T08:52:21.284 INFO:teuthology.orchestra.run.smithi006.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-14T08:52:21.285 INFO:teuthology.orchestra.run.smithi006.stdout:mds.all 12/12 62s ago 97s smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi057=b;smithi057=e;smithi057=h;smithi057=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2023-10-14T08:52:21.285 INFO:teuthology.orchestra.run.smithi006.stdout:mgr 3/3 62s ago 6m smithi006=x;smithi057=y;smithi178=z;count:3 2023-10-14T08:52:21.285 INFO:teuthology.orchestra.run.smithi006.stdout:mon 3/3 62s ago 6m smithi006:172.21.15.6=a;smithi057:172.21.15.57=b;smithi178:172.21.15.178=c;count:3 2023-10-14T08:52:21.285 INFO:teuthology.orchestra.run.smithi006.stdout:osd 12 62s ago - 2023-10-14T08:52:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc0280a1590 msgr2=0x7fc0280a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc0280a1590 0x7fc0280a3a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d20 tx=0x7fc038009260 comp rx=0 tx=0).stop 2023-10-14T08:52:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 msgr2=0x7fc03c19e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c19e0d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc03400b0a0 tx=0x7fc03400bd00 comp rx=0 tx=0).stop 2023-10-14T08:52:21.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 shutdown_connections 2023-10-14T08:52:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc03c101990 0x7fc03c19e0d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc0280a1590 0x7fc0280a3a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc03c0ffe70 0x7fc03c069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 --2- 172.21.15.6:0/3787699902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c100fd0 0x7fc03c19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 >> 172.21.15.6:0/3787699902 conn(0x7fc03c0fb3f0 msgr2=0x7fc03c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 shutdown_connections 2023-10-14T08:52:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:21.285+0000 7fc04352e700 1 -- 172.21.15.6:0/3787699902 wait complete. 2023-10-14T08:52:21.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:21 smithi057 ceph-mon[103313]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-14T08:52:21.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:21 smithi178 ceph-mon[103612]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-10-14T08:52:21.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-14T08:52:22.255 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:22.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:22.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-10-14T08:52:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:22 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:22.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-10-14T08:52:22.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:22 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2023-10-14T08:52:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:22.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:22 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:23.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 -- 172.21.15.6:0/325383609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 msgr2=0x7f1d04109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:23.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/325383609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d04109110 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00b0a0 tx=0x7f1cfc00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 -- 172.21.15.6:0/325383609 shutdown_connections 2023-10-14T08:52:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/325383609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d04109110 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/325383609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d04101ac0 0x7f1d04103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/325383609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d041043f0 0x7f1d041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 -- 172.21.15.6:0/325383609 >> 172.21.15.6:0/325383609 conn(0x7f1d040fb3f0 msgr2=0x7f1d040fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 -- 172.21.15.6:0/325383609 shutdown_connections 2023-10-14T08:52:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.434+0000 7f1d0aa52700 1 -- 172.21.15.6:0/325383609 wait complete. 2023-10-14T08:52:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 Processor -- start 2023-10-14T08:52:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 -- start start 2023-10-14T08:52:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d04101ac0 0x7f1d04101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d041043f0 0x7f1d040ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d040fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04100730 con 0x7f1d04106d20 2023-10-14T08:52:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041008a0 con 0x7f1d041043f0 2023-10-14T08:52:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d0aa52700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041a0d30 con 0x7f1d04101ac0 2023-10-14T08:52:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d040fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d040fffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60410/0 (socket says 172.21.15.6:60410) 2023-10-14T08:52:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d03fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d04101ac0 0x7f1d04101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 -- 172.21.15.6:0/4112387844 learned_addr learned my addr 172.21.15.6:0/4112387844 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d037fe700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d041043f0 0x7f1d040ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 -- 172.21.15.6:0/4112387844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d04101ac0 msgr2=0x7f1d04101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d04101ac0 0x7f1d04101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 -- 172.21.15.6:0/4112387844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d041043f0 msgr2=0x7f1d040ffa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d041043f0 0x7f1d040ffa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d08fef700 1 -- 172.21.15.6:0/4112387844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009d00 con 0x7f1d04106d20 2023-10-14T08:52:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.435+0000 7f1d037fe700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d041043f0 0x7f1d040ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.436+0000 7f1d08fef700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d040fffb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0062a0 tx=0x7f1cfc004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.436+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00e040 con 0x7f1d04106d20 2023-10-14T08:52:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.436+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d041a0fb0 con 0x7f1d04106d20 2023-10-14T08:52:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.436+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cfc00cec0 con 0x7f1d04106d20 2023-10-14T08:52:23.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.436+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc004020 con 0x7f1d04106d20 2023-10-14T08:52:23.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.436+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d041a13d0 con 0x7f1d04106d20 2023-10-14T08:52:23.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.437+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d040fcf70 con 0x7f1d04106d20 2023-10-14T08:52:23.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.438+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f1cfc01d690 con 0x7f1d04106d20 2023-10-14T08:52:23.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.439+0000 7f1d017fa700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1cec0a1510 0x7f1cec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.439+0000 7f1d03fff700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1cec0a1510 0x7f1cec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.439+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1cfc0ceda0 con 0x7f1d04106d20 2023-10-14T08:52:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.439+0000 7f1d03fff700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1cec0a1510 0x7f1cec0a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4005950 tx=0x7f1cf400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.442+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1cfc0982f0 con 0x7f1d04106d20 2023-10-14T08:52:23.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.650+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0402d2b0 con 0x7f1cec0a1510 2023-10-14T08:52:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.652+0000 7f1d017fa700 1 -- 172.21.15.6:0/4112387844 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f1d0402d2b0 con 0x7f1cec0a1510 2023-10-14T08:52:23.654 INFO:teuthology.orchestra.run.smithi006.stdout:HOST ADDR LABELS STATUS 2023-10-14T08:52:23.654 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 172.21.15.6 2023-10-14T08:52:23.654 INFO:teuthology.orchestra.run.smithi006.stdout:smithi057 172.21.15.57 2023-10-14T08:52:23.654 INFO:teuthology.orchestra.run.smithi006.stdout:smithi178 172.21.15.178 2023-10-14T08:52:23.654 INFO:teuthology.orchestra.run.smithi006.stdout:3 hosts in cluster 2023-10-14T08:52:23.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1cec0a1510 msgr2=0x7f1cec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1cec0a1510 0x7f1cec0a39d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4005950 tx=0x7f1cf400b410 comp rx=0 tx=0).stop 2023-10-14T08:52:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 msgr2=0x7f1d040fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d040fffb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0062a0 tx=0x7f1cfc004d00 comp rx=0 tx=0).stop 2023-10-14T08:52:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 shutdown_connections 2023-10-14T08:52:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d04106d20 0x7f1d040fffb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d04101ac0 0x7f1d04101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1cec0a1510 0x7f1cec0a39d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 --2- 172.21.15.6:0/4112387844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d041043f0 0x7f1d040ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 >> 172.21.15.6:0/4112387844 conn(0x7f1d040fb3f0 msgr2=0x7f1d04102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 shutdown_connections 2023-10-14T08:52:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:23.654+0000 7f1d0aa52700 1 -- 172.21.15.6:0/4112387844 wait complete. 2023-10-14T08:52:23.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:52:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:52:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:52:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:52:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:23.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:52:23.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:52:23.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:52:24.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-14T08:52:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:25.025 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:24 smithi006 ceph-mon[99452]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-14T08:52:25.025 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:24 smithi006 ceph-mon[99452]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:25.133 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:24 smithi178 ceph-mon[103612]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-14T08:52:25.171 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:24 smithi178 ceph-mon[103612]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:25.193 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:24 smithi057 ceph-mon[103313]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2023-10-14T08:52:25.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:24 smithi057 ceph-mon[103313]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:25.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 -- 172.21.15.6:0/2717970243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 msgr2=0x7efec01082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:25.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 --2- 172.21.15.6:0/2717970243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec01082b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efeb800b0a0 tx=0x7efeb800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:25.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 -- 172.21.15.6:0/2717970243 shutdown_connections 2023-10-14T08:52:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 --2- 172.21.15.6:0/2717970243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec01082b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 --2- 172.21.15.6:0/2717970243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec00ffe70 0x7efec0100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 --2- 172.21.15.6:0/2717970243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec0100fd0 0x7efec0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 -- 172.21.15.6:0/2717970243 >> 172.21.15.6:0/2717970243 conn(0x7efec00fb3f0 msgr2=0x7efec00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 -- 172.21.15.6:0/2717970243 shutdown_connections 2023-10-14T08:52:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.847+0000 7efec8545700 1 -- 172.21.15.6:0/2717970243 wait complete. 2023-10-14T08:52:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 Processor -- start 2023-10-14T08:52:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 -- start start 2023-10-14T08:52:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00ffe70 0x7efec0069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec0100fd0 0x7efec019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec019e7e0 con 0x7efec0101990 2023-10-14T08:52:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec019e950 con 0x7efec00ffe70 2023-10-14T08:52:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec8545700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec019eb10 con 0x7efec0100fd0 2023-10-14T08:52:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec6ae2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec6ae2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec019e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60424/0 (socket says 172.21.15.6:60424) 2023-10-14T08:52:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec6ae2700 1 -- 172.21.15.6:0/3960921756 learned_addr learned my addr 172.21.15.6:0/3960921756 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec5ae0700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec0100fd0 0x7efec019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.848+0000 7efec62e1700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00ffe70 0x7efec0069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec6ae2700 1 -- 172.21.15.6:0/3960921756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec0100fd0 msgr2=0x7efec019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec6ae2700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec0100fd0 0x7efec019ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec6ae2700 1 -- 172.21.15.6:0/3960921756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00ffe70 msgr2=0x7efec0069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec6ae2700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00ffe70 0x7efec0069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec6ae2700 1 -- 172.21.15.6:0/3960921756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8009d00 con 0x7efec0101990 2023-10-14T08:52:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec6ae2700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec019e040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efeb800b830 tx=0x7efeb8004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb800e040 con 0x7efec0101990 2023-10-14T08:52:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efeb801dd50 con 0x7efec0101990 2023-10-14T08:52:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb801bdc0 con 0x7efec0101990 2023-10-14T08:52:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec019ed90 con 0x7efec0101990 2023-10-14T08:52:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.849+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec019f1b0 con 0x7efec0101990 2023-10-14T08:52:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.850+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec0107370 con 0x7efec0101990 2023-10-14T08:52:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.851+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7efeb801b450 con 0x7efec0101990 2023-10-14T08:52:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.852+0000 7efeb37fe700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efeac0a1510 0x7efeac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.852+0000 7efec62e1700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efeac0a1510 0x7efeac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:25.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.852+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7efeb80cf160 con 0x7efec0101990 2023-10-14T08:52:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.853+0000 7efec62e1700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efeac0a1510 0x7efeac0a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efebc005950 tx=0x7efebc005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:25.856+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efeb80986f0 con 0x7efec0101990 2023-10-14T08:52:26.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.069+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efec002d270 con 0x7efeac0a1510 2023-10-14T08:52:26.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.071+0000 7efeb37fe700 1 -- 172.21.15.6:0/3960921756 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7efec002d270 con 0x7efeac0a1510 2023-10-14T08:52:26.072 INFO:teuthology.orchestra.run.smithi006.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-14T08:52:26.073 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330000H400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-14T08:52:26.073 INFO:teuthology.orchestra.run.smithi006.stdout:smithi057 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN 3726G No 2m ago Has a FileSystem, LVM detected 2023-10-14T08:52:26.073 INFO:teuthology.orchestra.run.smithi006.stdout:smithi178 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130029480DGN 447G No 111s ago Has a FileSystem, LVM detected 2023-10-14T08:52:26.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efeac0a1510 msgr2=0x7efeac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:26.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efeac0a1510 0x7efeac0a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efebc005950 tx=0x7efebc005eb0 comp rx=0 tx=0).stop 2023-10-14T08:52:26.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 msgr2=0x7efec019e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:26.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec019e040 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efeb800b830 tx=0x7efeb8004db0 comp rx=0 tx=0).stop 2023-10-14T08:52:26.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 shutdown_connections 2023-10-14T08:52:26.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec0101990 0x7efec019e040 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:26.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efeac0a1510 0x7efeac0a39d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:26.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00ffe70 0x7efec0069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:26.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 --2- 172.21.15.6:0/3960921756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec0100fd0 0x7efec019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:26.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 >> 172.21.15.6:0/3960921756 conn(0x7efec00fb3f0 msgr2=0x7efec01044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:26.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.073+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 shutdown_connections 2023-10-14T08:52:26.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:26.074+0000 7efec8545700 1 -- 172.21.15.6:0/3960921756 wait complete. 2023-10-14T08:52:26.630 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-14T08:52:26.640 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T08:52:26.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-14T08:52:27.207 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:27.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:27 smithi178 ceph-mon[103612]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-14T08:52:27.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:27 smithi178 ceph-mon[103612]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:27.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:27 smithi006 ceph-mon[99452]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-14T08:52:27.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:27 smithi006 ceph-mon[99452]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:27 smithi057 ceph-mon[103313]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-14T08:52:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:27 smithi057 ceph-mon[103313]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-14T08:52:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 -- 172.21.15.6:0/3170333154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38102170 msgr2=0x7f3b381025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/3170333154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38102170 0x7f3b381025d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3b340099c0 tx=0x7f3b34009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 -- 172.21.15.6:0/3170333154 shutdown_connections 2023-10-14T08:52:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/3170333154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b38102b10 0x7f3b381093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/3170333154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b38100f70 0x7f3b38101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/3170333154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38102170 0x7f3b381025d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 -- 172.21.15.6:0/3170333154 >> 172.21.15.6:0/3170333154 conn(0x7f3b380fc4d0 msgr2=0x7f3b380fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 -- 172.21.15.6:0/3170333154 shutdown_connections 2023-10-14T08:52:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 -- 172.21.15.6:0/3170333154 wait complete. 2023-10-14T08:52:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.271+0000 7f3b3fa57700 1 Processor -- start 2023-10-14T08:52:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 -- start start 2023-10-14T08:52:28.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 0x7f3b38074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:28.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b38102170 0x7f3b380732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b38102b10 0x7f3b380737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38073f60 con 0x7f3b38100f70 2023-10-14T08:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380740d0 con 0x7f3b38102170 2023-10-14T08:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3fa57700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b381a0cc0 con 0x7f3b38102b10 2023-10-14T08:52:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 0x7f3b38074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 0x7f3b38074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60434/0 (socket says 172.21.15.6:60434) 2023-10-14T08:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 -- 172.21.15.6:0/866334815 learned_addr learned my addr 172.21.15.6:0/866334815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3dff4700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b38102b10 0x7f3b380737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 -- 172.21.15.6:0/866334815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b38102b10 msgr2=0x7f3b380737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b38102b10 0x7f3b380737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 -- 172.21.15.6:0/866334815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b38102170 msgr2=0x7f3b380732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3cff2700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b38102170 0x7f3b380732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b38102170 0x7f3b380732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 -- 172.21.15.6:0/866334815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b340095f0 con 0x7f3b38100f70 2023-10-14T08:52:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b3d7f3700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 0x7f3b38074c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800e950 tx=0x7f3b2800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.272+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28009770 con 0x7f3b38100f70 2023-10-14T08:52:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.273+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b280044f0 con 0x7f3b38100f70 2023-10-14T08:52:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.273+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b381a0fa0 con 0x7f3b38100f70 2023-10-14T08:52:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.273+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28003e00 con 0x7f3b38100f70 2023-10-14T08:52:28.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.273+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b381a13b0 con 0x7f3b38100f70 2023-10-14T08:52:28.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.273+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3810c800 con 0x7f3b38100f70 2023-10-14T08:52:28.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.275+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f3b2800cd40 con 0x7f3b38100f70 2023-10-14T08:52:28.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.276+0000 7f3b2e7fc700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b240a1590 0x7f3b240a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:28.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.276+0000 7f3b3cff2700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b240a1590 0x7f3b240a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:28.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.276+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3b28014070 con 0x7f3b38100f70 2023-10-14T08:52:28.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.276+0000 7f3b3cff2700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b240a1590 0x7f3b240a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b340098e0 tx=0x7f3b34019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:28.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.279+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b28051100 con 0x7f3b38100f70 2023-10-14T08:52:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.525+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b38107f10 con 0x7f3b38100f70 2023-10-14T08:52:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.525+0000 7f3b2e7fc700 1 -- 172.21.15.6:0/866334815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2960 (secure 0 0 0) 0x7f3b28096770 con 0x7f3b38100f70 2023-10-14T08:52:28.527 INFO:teuthology.orchestra.run.smithi006.stdout:e27 2023-10-14T08:52:28.527 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-14T08:52:28.528 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-14T08:52:28.528 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2023-10-14T08:52:28.528 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:28.528 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2023-10-14T08:52:28.528 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2023-10-14T08:52:28.529 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 27 2023-10-14T08:52:28.529 INFO:teuthology.orchestra.run.smithi006.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-14T08:52:28.529 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-10-14T08:51:16.279910+0000 2023-10-14T08:52:28.529 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2023-10-14T08:51:24.158921+0000 2023-10-14T08:52:28.529 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2023-10-14T08:52:28.530 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2023-10-14T08:52:28.530 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 300 2023-10-14T08:52:28.530 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2023-10-14T08:52:28.530 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2023-10-14T08:52:28.530 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2023-10-14T08:52:28.531 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2023-10-14T08:52:28.531 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2023-10-14T08:52:28.531 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2023-10-14T08:52:28.531 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-14T08:52:28.531 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 5 2023-10-14T08:52:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1,2,3,4 2023-10-14T08:52:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=24508,1=24506,2=24473,3=24455,4=24434} 2023-10-14T08:52:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2023-10-14T08:52:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2023-10-14T08:52:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2023-10-14T08:52:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2023-10-14T08:52:28.533 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2023-10-14T08:52:28.533 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2023-10-14T08:52:28.533 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2023-10-14T08:52:28.533 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2023-10-14T08:52:28.533 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 0 2023-10-14T08:52:28.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.i{0:24508} state up:active seq 5 addr [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c{0:24493} state up:standby-replay seq 1 addr [v2:172.21.15.178:6836/4069767165,v1:172.21.15.178:6837/4069767165] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b{1:24506} state up:active seq 4 addr [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f{1:24481} state up:standby-replay seq 1 addr [v2:172.21.15.178:6834/4072673445,v1:172.21.15.178:6835/4072673445] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.534 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.h{2:24473} state up:active seq 6 addr [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.535 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.l{2:24433} state up:standby-replay seq 1 addr [v2:172.21.15.178:6832/3050202963,v1:172.21.15.178:6833/3050202963] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.535 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e{3:24455} state up:active seq 8 addr [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.535 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a{3:14625} state up:standby-replay seq 1 addr [v2:172.21.15.6:6840/4202282219,v1:172.21.15.6:6841/4202282219] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.535 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.k{4:24434} state up:active seq 10 addr [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.535 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.g{4:14613} state up:standby-replay seq 1 addr [v2:172.21.15.6:6838/977658940,v1:172.21.15.6:6839/977658940] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.536 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:28.536 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:28.536 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2023-10-14T08:52:28.536 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:28.536 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.j{-1:14535} state up:standby seq 1 addr [v2:172.21.15.6:6834/2026844490,v1:172.21.15.6:6835/2026844490] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.537 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.6:6836/1177003632,v1:172.21.15.6:6837/1177003632] compat {c=[1],r=[1],i=[fff]}] 2023-10-14T08:52:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b240a1590 msgr2=0x7f3b240a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b240a1590 0x7f3b240a3a50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b340098e0 tx=0x7f3b34019040 comp rx=0 tx=0).stop 2023-10-14T08:52:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 msgr2=0x7f3b38074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 0x7f3b38074c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800e950 tx=0x7f3b2800ed10 comp rx=0 tx=0).stop 2023-10-14T08:52:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 shutdown_connections 2023-10-14T08:52:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b38102b10 0x7f3b380737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b38100f70 0x7f3b38074c50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b240a1590 0x7f3b240a3a50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 --2- 172.21.15.6:0/866334815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b38102170 0x7f3b380732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.527+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 >> 172.21.15.6:0/866334815 conn(0x7f3b380fc4d0 msgr2=0x7f3b380fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:28.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.528+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 shutdown_connections 2023-10-14T08:52:28.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:28.528+0000 7f3b3fa57700 1 -- 172.21.15.6:0/866334815 wait complete. 2023-10-14T08:52:28.540 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:29.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-14T08:52:29.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:29 smithi178 ceph-mon[103612]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-14T08:52:29.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:29 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/866334815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-14T08:52:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:29 smithi057 ceph-mon[103313]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-14T08:52:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:29 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/866334815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-14T08:52:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:29 smithi006 ceph-mon[99452]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-14T08:52:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:29 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/866334815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-14T08:52:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 -- 172.21.15.6:0/379762945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc101990 msgr2=0x7f99dc1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:30.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 --2- 172.21.15.6:0/379762945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc101990 0x7f99dc1082b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f99d400b0a0 tx=0x7f99d400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:30.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 -- 172.21.15.6:0/379762945 shutdown_connections 2023-10-14T08:52:30.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 --2- 172.21.15.6:0/379762945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc101990 0x7f99dc1082b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 --2- 172.21.15.6:0/379762945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc0ffe70 0x7f99dc100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 --2- 172.21.15.6:0/379762945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99dc100fd0 0x7f99dc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 -- 172.21.15.6:0/379762945 >> 172.21.15.6:0/379762945 conn(0x7f99dc0fb3f0 msgr2=0x7f99dc0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 -- 172.21.15.6:0/379762945 shutdown_connections 2023-10-14T08:52:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.828+0000 7f99e331e700 1 -- 172.21.15.6:0/379762945 wait complete. 2023-10-14T08:52:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 Processor -- start 2023-10-14T08:52:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 -- start start 2023-10-14T08:52:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99dc0ffe70 0x7f99dc069df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 0x7f99dc19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc101990 0x7f99dc19e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19e850 con 0x7f99dc100fd0 2023-10-14T08:52:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19e9c0 con 0x7f99dc0ffe70 2023-10-14T08:52:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e331e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99dc19eb80 con 0x7f99dc101990 2023-10-14T08:52:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e08b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 0x7f99dc19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e08b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 0x7f99dc19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60450/0 (socket says 172.21.15.6:60450) 2023-10-14T08:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e08b9700 1 -- 172.21.15.6:0/1613806462 learned_addr learned my addr 172.21.15.6:0/1613806462 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e18bb700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc101990 0x7f99dc19e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e10ba700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99dc0ffe70 0x7f99dc069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e08b9700 1 -- 172.21.15.6:0/1613806462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc101990 msgr2=0x7f99dc19e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e08b9700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc101990 0x7f99dc19e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.829+0000 7f99e08b9700 1 -- 172.21.15.6:0/1613806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99dc0ffe70 msgr2=0x7f99dc069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99e08b9700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99dc0ffe70 0x7f99dc069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99e08b9700 1 -- 172.21.15.6:0/1613806462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4009d00 con 0x7f99dc100fd0 2023-10-14T08:52:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99e18bb700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc101990 0x7f99dc19e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99e08b9700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 0x7f99dc19ba20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00c920 tx=0x7f99cc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc007b00 con 0x7f99dc100fd0 2023-10-14T08:52:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99cc004cf0 con 0x7f99dc100fd0 2023-10-14T08:52:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99dc19ee60 con 0x7f99dc100fd0 2023-10-14T08:52:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc005610 con 0x7f99dc100fd0 2023-10-14T08:52:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.830+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99dc19f320 con 0x7f99dc100fd0 2023-10-14T08:52:30.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.831+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99dc1073b0 con 0x7f99dc100fd0 2023-10-14T08:52:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.832+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f99cc004750 con 0x7f99dc100fd0 2023-10-14T08:52:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.833+0000 7f99d27fc700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99c80a1590 0x7f99c80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.833+0000 7f99e10ba700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99c80a1590 0x7f99c80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.833+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f99cc0ccde0 con 0x7f99dc100fd0 2023-10-14T08:52:30.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.833+0000 7f99e10ba700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99c80a1590 0x7f99c80a3a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005950 tx=0x7f99d80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:30.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:30.836+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f99cc096320 con 0x7f99dc100fd0 2023-10-14T08:52:31.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.036+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f99dc10b8d0 con 0x7f99dc100fd0 2023-10-14T08:52:31.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.037+0000 7f99d27fc700 1 -- 172.21.15.6:0/1613806462 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) v1 ==== 56+0+5274 (secure 0 0 0) 0x7f99cc01d020 con 0x7f99dc100fd0 2023-10-14T08:52:31.038 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 84 2023-10-14T08:52:31.039 INFO:teuthology.orchestra.run.smithi006.stdout:fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T08:52:31.039 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-10-14T08:44:01.633089+0000 2023-10-14T08:52:31.039 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2023-10-14T08:52:04.444514+0000 2023-10-14T08:52:31.039 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-14T08:52:31.039 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 26 2023-10-14T08:52:31.040 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2023-10-14T08:52:31.040 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2023-10-14T08:52:31.040 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2023-10-14T08:52:31.040 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2023-10-14T08:52:31.040 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client luminous 2023-10-14T08:52:31.041 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release reef 2023-10-14T08:52:31.041 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2023-10-14T08:52:31.041 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-14T08:52:31.041 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-14T08:52:31.041 INFO:teuthology.orchestra.run.smithi006.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-14T08:52:31.042 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 12 2023-10-14T08:52:31.042 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6802/3964100626,v1:172.21.15.6:6803/3964100626] [v2:172.21.15.6:6804/3964100626,v1:172.21.15.6:6805/3964100626] exists,up 6ef84fd5-07bb-4e54-aaaa-b818f688ee47 2023-10-14T08:52:31.042 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/3505442152,v1:172.21.15.57:6801/3505442152] [v2:172.21.15.57:6802/3505442152,v1:172.21.15.57:6803/3505442152] exists,up b566713f-39eb-446e-b9e4-e730ef64ecd0 2023-10-14T08:52:31.042 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6800/1191550997,v1:172.21.15.178:6801/1191550997] [v2:172.21.15.178:6802/1191550997,v1:172.21.15.178:6803/1191550997] exists,up 9ced53ca-e0e9-427a-9b59-8647d5cf2525 2023-10-14T08:52:31.042 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6810/3136263459,v1:172.21.15.6:6811/3136263459] [v2:172.21.15.6:6812/3136263459,v1:172.21.15.6:6813/3136263459] exists,up c5d6f475-b22e-4032-8ec3-a0f06769ba76 2023-10-14T08:52:31.043 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 up in weight 1 up_from 32 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6808/4030613729,v1:172.21.15.57:6809/4030613729] [v2:172.21.15.57:6810/4030613729,v1:172.21.15.57:6811/4030613729] exists,up 9b0fd0d1-1684-4766-9608-c2922016f050 2023-10-14T08:52:31.043 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 up in weight 1 up_from 37 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6808/1403706440,v1:172.21.15.178:6809/1403706440] [v2:172.21.15.178:6810/1403706440,v1:172.21.15.178:6811/1403706440] exists,up 12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd 2023-10-14T08:52:31.043 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 up in weight 1 up_from 44 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6818/1891012119,v1:172.21.15.6:6819/1891012119] [v2:172.21.15.6:6820/1891012119,v1:172.21.15.6:6821/1891012119] exists,up 82017fe0-ae29-42fc-be07-a8a180d4d969 2023-10-14T08:52:31.043 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 up in weight 1 up_from 49 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6816/2223075763,v1:172.21.15.57:6817/2223075763] [v2:172.21.15.57:6818/2223075763,v1:172.21.15.57:6819/2223075763] exists,up f93b9770-08f4-4f9b-8141-317e455fd3a0 2023-10-14T08:52:31.043 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 up in weight 1 up_from 57 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6816/3668822662,v1:172.21.15.178:6817/3668822662] [v2:172.21.15.178:6818/3668822662,v1:172.21.15.178:6819/3668822662] exists,up ea8d4216-d791-4f3f-9448-c81af655c2ba 2023-10-14T08:52:31.044 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6826/1885446684,v1:172.21.15.6:6827/1885446684] [v2:172.21.15.6:6828/1885446684,v1:172.21.15.6:6829/1885446684] exists,up 2b54f460-3337-4f4a-8d74-02a945a81158 2023-10-14T08:52:31.044 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 up in weight 1 up_from 69 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6824/104741011,v1:172.21.15.57:6825/104741011] [v2:172.21.15.57:6826/104741011,v1:172.21.15.57:6827/104741011] exists,up 9a907667-59dc-4633-8f3d-735c2ed0fb6b 2023-10-14T08:52:31.044 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 up in weight 1 up_from 77 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6824/1548169216,v1:172.21.15.178:6825/1548169216] [v2:172.21.15.178:6826/1548169216,v1:172.21.15.178:6827/1548169216] exists,up 38288845-23b4-43cf-a07e-8a0e1e52342e 2023-10-14T08:52:31.044 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.10 [8,11] 2023-10-14T08:52:31.044 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.14 [2,4] 2023-10-14T08:52:31.045 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1a [8,4] 2023-10-14T08:52:31.045 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1b [2,1] 2023-10-14T08:52:31.045 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1f [7,11] 2023-10-14T08:52:31.045 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.21 [5,9] 2023-10-14T08:52:31.045 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.2c [4,9] 2023-10-14T08:52:31.046 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.31 [4,8] 2023-10-14T08:52:31.046 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.34 [4,9] 2023-10-14T08:52:31.046 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/866757067 expires 2023-10-15T08:45:03.352994+0000 2023-10-14T08:52:31.046 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/3649860650 expires 2023-10-15T08:45:03.352994+0000 2023-10-14T08:52:31.046 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/516951061 expires 2023-10-15T08:45:03.352994+0000 2023-10-14T08:52:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/516951061 expires 2023-10-15T08:45:03.352994+0000 2023-10-14T08:52:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/3410563111 expires 2023-10-15T08:44:36.985351+0000 2023-10-14T08:52:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/3410563111 expires 2023-10-15T08:44:36.985351+0000 2023-10-14T08:52:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/103686796 expires 2023-10-15T08:44:36.985351+0000 2023-10-14T08:52:31.047 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1911805339 expires 2023-10-15T08:44:36.985351+0000 2023-10-14T08:52:31.048 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/571590378 expires 2023-10-15T08:44:36.985351+0000 2023-10-14T08:52:31.048 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/2188319244 expires 2023-10-15T08:45:03.352994+0000 2023-10-14T08:52:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99c80a1590 msgr2=0x7f99c80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99c80a1590 0x7f99c80a3a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005950 tx=0x7f99d80058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 msgr2=0x7f99dc19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 0x7f99dc19ba20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00c920 tx=0x7f99cc00cce0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 shutdown_connections 2023-10-14T08:52:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99dc101990 0x7f99dc19e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99c80a1590 0x7f99c80a3a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99dc0ffe70 0x7f99dc069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 --2- 172.21.15.6:0/1613806462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99dc100fd0 0x7f99dc19ba20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 >> 172.21.15.6:0/1613806462 conn(0x7f99dc0fb3f0 msgr2=0x7f99dc1044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:31.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 shutdown_connections 2023-10-14T08:52:31.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.039+0000 7f99e331e700 1 -- 172.21.15.6:0/1613806462 wait complete. 2023-10-14T08:52:31.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:31 smithi006 ceph-mon[99452]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-14T08:52:31.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:31 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1613806462' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-14T08:52:31.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:31 smithi178 ceph-mon[103612]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-14T08:52:31.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:31 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1613806462' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-14T08:52:31.385 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-14T08:52:31.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:31 smithi057 ceph-mon[103313]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-14T08:52:31.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:31 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1613806462' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-14T08:52:31.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 -- 172.21.15.6:0/3148722729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00ff8c0 msgr2=0x7fc9b0109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 --2- 172.21.15.6:0/3148722729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00ff8c0 0x7fc9b0109490 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800b0d0 tx=0x7fc9a800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 -- 172.21.15.6:0/3148722729 shutdown_connections 2023-10-14T08:52:31.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 --2- 172.21.15.6:0/3148722729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00ff8c0 0x7fc9b0109490 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 --2- 172.21.15.6:0/3148722729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9b01024b0 0x7fc9b01028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 --2- 172.21.15.6:0/3148722729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b00fef20 0x7fc9b00ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 -- 172.21.15.6:0/3148722729 >> 172.21.15.6:0/3148722729 conn(0x7fc9b00faa80 msgr2=0x7fc9b00fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:31.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 -- 172.21.15.6:0/3148722729 shutdown_connections 2023-10-14T08:52:31.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.556+0000 7fc9b496a700 1 -- 172.21.15.6:0/3148722729 wait complete. 2023-10-14T08:52:31.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 Processor -- start 2023-10-14T08:52:31.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 -- start start 2023-10-14T08:52:31.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 0x7fc9b0101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b00ff8c0 0x7fc9b01001f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9b01024b0 0x7fc9b0100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0100ed0 con 0x7fc9b00fef20 2023-10-14T08:52:31.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0101040 con 0x7fc9b01024b0 2023-10-14T08:52:31.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9b496a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b01a0cc0 con 0x7fc9b00ff8c0 2023-10-14T08:52:31.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 0x7fc9b0101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.557+0000 7fc9ae59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 0x7fc9b0101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60460/0 (socket says 172.21.15.6:60460) 2023-10-14T08:52:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 -- 172.21.15.6:0/351018969 learned_addr learned my addr 172.21.15.6:0/351018969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9aed9d700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9b01024b0 0x7fc9b0100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9add9b700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b00ff8c0 0x7fc9b01001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 -- 172.21.15.6:0/351018969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b00ff8c0 msgr2=0x7fc9b01001f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b00ff8c0 0x7fc9b01001f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 -- 172.21.15.6:0/351018969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9b01024b0 msgr2=0x7fc9b0100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9b01024b0 0x7fc9b0100730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 -- 172.21.15.6:0/351018969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8009d00 con 0x7fc9b00fef20 2023-10-14T08:52:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9ae59c700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 0x7fc9b0101bb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400c970 tx=0x7fc9a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4004220 con 0x7fc9b00fef20 2023-10-14T08:52:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9a4007d60 con 0x7fc9b00fef20 2023-10-14T08:52:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b01a0fa0 con 0x7fc9b00fef20 2023-10-14T08:52:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4003c90 con 0x7fc9b00fef20 2023-10-14T08:52:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.558+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b01a13c0 con 0x7fc9b00fef20 2023-10-14T08:52:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.559+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b010c750 con 0x7fc9b00fef20 2023-10-14T08:52:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.560+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc9a4004380 con 0x7fc9b00fef20 2023-10-14T08:52:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.561+0000 7fc99f7fe700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9980a1510 0x7fc9980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.561+0000 7fc9add9b700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9980a1510 0x7fc9980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.561+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc9a40cce40 con 0x7fc9b00fef20 2023-10-14T08:52:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.561+0000 7fc9add9b700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9980a1510 0x7fc9980a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0005950 tx=0x7fc9a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.564+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9a4096300 con 0x7fc9b00fef20 2023-10-14T08:52:31.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.773+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9b0107eb0 con 0x7fc9b00fef20 2023-10-14T08:52:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.775+0000 7fc99f7fe700 1 -- 172.21.15.6:0/351018969 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7fc9a401d090 con 0x7fc9b00fef20 2023-10-14T08:52:31.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:31.777 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:31.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9980a1510 msgr2=0x7fc9980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9980a1510 0x7fc9980a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0005950 tx=0x7fc9a00058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 msgr2=0x7fc9b0101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 0x7fc9b0101bb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400c970 tx=0x7fc9a400cc80 comp rx=0 tx=0).stop 2023-10-14T08:52:31.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 shutdown_connections 2023-10-14T08:52:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9980a1510 0x7fc9980a39d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9b01024b0 0x7fc9b0100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9b00fef20 0x7fc9b0101bb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 --2- 172.21.15.6:0/351018969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b00ff8c0 0x7fc9b01001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 >> 172.21.15.6:0/351018969 conn(0x7fc9b00faa80 msgr2=0x7fc9b00fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 shutdown_connections 2023-10-14T08:52:31.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.777+0000 7fc9b496a700 1 -- 172.21.15.6:0/351018969 wait complete. 2023-10-14T08:52:31.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:31.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:31.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- 172.21.15.6:0/4039717750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0106cc0 msgr2=0x7fb1b0109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/4039717750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0106cc0 0x7fb1b0109130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800b0a0 tx=0x7fb1a800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- 172.21.15.6:0/4039717750 shutdown_connections 2023-10-14T08:52:31.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/4039717750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0106cc0 0x7fb1b0109130 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/4039717750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b0101a60 0x7fb1b0103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/4039717750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0104390 0x7fb1b0106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- 172.21.15.6:0/4039717750 >> 172.21.15.6:0/4039717750 conn(0x7fb1b00fb450 msgr2=0x7fb1b00fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- 172.21.15.6:0/4039717750 shutdown_connections 2023-10-14T08:52:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- 172.21.15.6:0/4039717750 wait complete. 2023-10-14T08:52:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 Processor -- start 2023-10-14T08:52:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- start start 2023-10-14T08:52:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 0x7fb1b0196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b0104390 0x7fb1b0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0106cc0 0x7fb1b019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b019e870 con 0x7fb1b0101a60 2023-10-14T08:52:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b019e9e0 con 0x7fb1b0106cc0 2023-10-14T08:52:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.920+0000 7fb1b6f43700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b019eba0 con 0x7fb1b0104390 2023-10-14T08:52:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 0x7fb1b0196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 0x7fb1b0196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60474/0 (socket says 172.21.15.6:60474) 2023-10-14T08:52:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 -- 172.21.15.6:0/3815020679 learned_addr learned my addr 172.21.15.6:0/3815020679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b54e0700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0106cc0 0x7fb1b019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1affff700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b0104390 0x7fb1b0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 -- 172.21.15.6:0/3815020679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b0104390 msgr2=0x7fb1b0197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b0104390 0x7fb1b0197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 -- 172.21.15.6:0/3815020679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0106cc0 msgr2=0x7fb1b019e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:31.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0106cc0 0x7fb1b019e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:31.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 -- 172.21.15.6:0/3815020679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8009d00 con 0x7fb1b0101a60 2023-10-14T08:52:31.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b4cdf700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 0x7fb1b0196d30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400c920 tx=0x7fb1a400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:31.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4007b00 con 0x7fb1b0101a60 2023-10-14T08:52:31.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a400ce70 con 0x7fb1b0101a60 2023-10-14T08:52:31.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b019ee80 con 0x7fb1b0101a60 2023-10-14T08:52:31.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.921+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40054e0 con 0x7fb1b0101a60 2023-10-14T08:52:31.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.922+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b019f2a0 con 0x7fb1b0101a60 2023-10-14T08:52:31.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.922+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b00fcfd0 con 0x7fb1b0101a60 2023-10-14T08:52:31.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.923+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fb1a4004750 con 0x7fb1b0101a60 2023-10-14T08:52:31.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.924+0000 7fb1adffb700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1a00a1510 0x7fb1a00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:31.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.924+0000 7fb1affff700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1a00a1510 0x7fb1a00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:31.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.924+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb1a40cca30 con 0x7fb1b0101a60 2023-10-14T08:52:31.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.925+0000 7fb1affff700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1a00a1510 0x7fb1a00a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb19c005950 tx=0x7fb19c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:31.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:31.929+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb1a4095f30 con 0x7fb1b0101a60 2023-10-14T08:52:32.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.128+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1b010c7c0 con 0x7fb1b0101a60 2023-10-14T08:52:32.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.131+0000 7fb1adffb700 1 -- 172.21.15.6:0/3815020679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1a401d0a0 con 0x7fb1b0101a60 2023-10-14T08:52:32.133 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:32.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1a00a1510 msgr2=0x7fb1a00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1a00a1510 0x7fb1a00a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb19c005950 tx=0x7fb19c0058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 msgr2=0x7fb1b0196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 0x7fb1b0196d30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400c920 tx=0x7fb1a400cc30 comp rx=0 tx=0).stop 2023-10-14T08:52:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 shutdown_connections 2023-10-14T08:52:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb1a00a1510 0x7fb1a00a39d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1b0106cc0 0x7fb1b019e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b0101a60 0x7fb1b0196d30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 --2- 172.21.15.6:0/3815020679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b0104390 0x7fb1b0197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 >> 172.21.15.6:0/3815020679 conn(0x7fb1b00fb450 msgr2=0x7fb1b01026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:32.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 shutdown_connections 2023-10-14T08:52:32.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.134+0000 7fb1b6f43700 1 -- 172.21.15.6:0/3815020679 wait complete. 2023-10-14T08:52:32.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 -- 172.21.15.6:0/2777410196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c101070 msgr2=0x7fc17c1014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 --2- 172.21.15.6:0/2777410196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c101070 0x7fc17c1014f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc178009990 tx=0x7fc178009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 -- 172.21.15.6:0/2777410196 shutdown_connections 2023-10-14T08:52:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 --2- 172.21.15.6:0/2777410196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 0x7fc17c108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 --2- 172.21.15.6:0/2777410196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c0ffe90 0x7fc17c1002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 --2- 172.21.15.6:0/2777410196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c101070 0x7fc17c1014f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 -- 172.21.15.6:0/2777410196 >> 172.21.15.6:0/2777410196 conn(0x7fc17c0fb410 msgr2=0x7fc17c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 -- 172.21.15.6:0/2777410196 shutdown_connections 2023-10-14T08:52:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.277+0000 7fc183a8d700 1 -- 172.21.15.6:0/2777410196 wait complete. 2023-10-14T08:52:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 Processor -- start 2023-10-14T08:52:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 -- start start 2023-10-14T08:52:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 0x7fc17c103ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c101070 0x7fc17c1024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 0x7fc17c102a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1031c0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c103330 con 0x7fc17c101070 2023-10-14T08:52:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1a0cc0 con 0x7fc17c101a30 2023-10-14T08:52:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 0x7fc17c103ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 0x7fc17c103ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60488/0 (socket says 172.21.15.6:60488) 2023-10-14T08:52:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 -- 172.21.15.6:0/3087814943 learned_addr learned my addr 172.21.15.6:0/3087814943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc18202a700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 0x7fc17c102a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181028700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c101070 0x7fc17c1024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 -- 172.21.15.6:0/3087814943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 msgr2=0x7fc17c102a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 0x7fc17c102a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 -- 172.21.15.6:0/3087814943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c101070 msgr2=0x7fc17c1024e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c101070 0x7fc17c1024e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 -- 172.21.15.6:0/3087814943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780095f0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc18202a700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 0x7fc17c102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181028700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c101070 0x7fc17c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc181829700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 0x7fc17c103ea0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c990 tx=0x7fc16c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c007b00 con 0x7fc17c0ffe90 2023-10-14T08:52:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc16c007c60 con 0x7fc17c0ffe90 2023-10-14T08:52:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.278+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1a0fa0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.279+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c018660 con 0x7fc17c0ffe90 2023-10-14T08:52:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.279+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c1a13c0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.280+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c10b6e0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.281+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fc16c004020 con 0x7fc17c0ffe90 2023-10-14T08:52:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.281+0000 7fc172ffd700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc1680a1510 0x7fc1680a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.281+0000 7fc181028700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc1680a1510 0x7fc1680a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.281+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc16c0ccff0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.282+0000 7fc181028700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc1680a1510 0x7fc1680a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc178005f50 tx=0x7fc178005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.285+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc16c0964f0 con 0x7fc17c0ffe90 2023-10-14T08:52:32.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:32 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/351018969' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:32.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:32 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/351018969' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:32.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:32 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/351018969' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.483+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc17c1a1640 con 0x7fc17c0ffe90 2023-10-14T08:52:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.484+0000 7fc172ffd700 1 -- 172.21.15.6:0/3087814943 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc16c099b10 con 0x7fc17c0ffe90 2023-10-14T08:52:32.485 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.485+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc1680a1510 msgr2=0x7fc1680a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.485+0000 7fc183a8d700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc1680a1510 0x7fc1680a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc178005f50 tx=0x7fc178005e80 comp rx=0 tx=0).stop 2023-10-14T08:52:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.485+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 msgr2=0x7fc17c103ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.485+0000 7fc183a8d700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 0x7fc17c103ea0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c990 tx=0x7fc16c00cd50 comp rx=0 tx=0).stop 2023-10-14T08:52:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 shutdown_connections 2023-10-14T08:52:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17c101a30 0x7fc17c102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc17c0ffe90 0x7fc17c103ea0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc1680a1510 0x7fc1680a39d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 --2- 172.21.15.6:0/3087814943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc17c101070 0x7fc17c1024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 >> 172.21.15.6:0/3087814943 conn(0x7fc17c0fb410 msgr2=0x7fc17c0692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 shutdown_connections 2023-10-14T08:52:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.486+0000 7fc183a8d700 1 -- 172.21.15.6:0/3087814943 wait complete. 2023-10-14T08:52:32.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:32.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.627+0000 7fbd6722d700 1 -- 172.21.15.6:0/3337891875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101050 msgr2=0x7fbd601014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.627+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3337891875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101050 0x7fbd601014d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009990 tx=0x7fbd4c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- 172.21.15.6:0/3337891875 shutdown_connections 2023-10-14T08:52:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3337891875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd60101a10 0x7fbd60108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3337891875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd600ffe70 0x7fbd60100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3337891875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101050 0x7fbd601014d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- 172.21.15.6:0/3337891875 >> 172.21.15.6:0/3337891875 conn(0x7fbd600fb410 msgr2=0x7fbd600fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- 172.21.15.6:0/3337891875 shutdown_connections 2023-10-14T08:52:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- 172.21.15.6:0/3337891875 wait complete. 2023-10-14T08:52:32.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 Processor -- start 2023-10-14T08:52:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- start start 2023-10-14T08:52:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd600ffe70 0x7fbd60103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd60101050 0x7fbd601024c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 0x7fbd60102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601031a0 con 0x7fbd60101a10 2023-10-14T08:52:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60103310 con 0x7fbd600ffe70 2023-10-14T08:52:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.628+0000 7fbd6722d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601a0d40 con 0x7fbd60101050 2023-10-14T08:52:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 0x7fbd60102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 0x7fbd60102a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60506/0 (socket says 172.21.15.6:60506) 2023-10-14T08:52:32.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 -- 172.21.15.6:0/3161337832 learned_addr learned my addr 172.21.15.6:0/3161337832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd5ffff700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd60101050 0x7fbd601024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd64fc9700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd600ffe70 0x7fbd60103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 -- 172.21.15.6:0/3161337832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd60101050 msgr2=0x7fbd601024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd60101050 0x7fbd601024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 -- 172.21.15.6:0/3161337832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd600ffe70 msgr2=0x7fbd60103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd600ffe70 0x7fbd60103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 -- 172.21.15.6:0/3161337832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0095f0 con 0x7fbd60101a10 2023-10-14T08:52:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd657ca700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 0x7fbd60102a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800ef30 tx=0x7fbd5800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58018070 con 0x7fbd60101a10 2023-10-14T08:52:32.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd5800f040 con 0x7fbd60101a10 2023-10-14T08:52:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd601a0fc0 con 0x7fbd60101a10 2023-10-14T08:52:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.629+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003dc0 con 0x7fbd60101a10 2023-10-14T08:52:32.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.630+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd601a13f0 con 0x7fbd60101a10 2023-10-14T08:52:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.630+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6010b730 con 0x7fbd60101a10 2023-10-14T08:52:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.631+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fbd5800caa0 con 0x7fbd60101a10 2023-10-14T08:52:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.632+0000 7fbd5dffb700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd500a1510 0x7fbd500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.632+0000 7fbd64fc9700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd500a1510 0x7fbd500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.632+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd580cd4f0 con 0x7fbd60101a10 2023-10-14T08:52:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.633+0000 7fbd64fc9700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd500a1510 0x7fbd500a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005950 tx=0x7fbd540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.636+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd58096a40 con 0x7fbd60101a10 2023-10-14T08:52:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.838+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd601a15e0 con 0x7fbd60101a10 2023-10-14T08:52:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.838+0000 7fbd5dffb700 1 -- 172.21.15.6:0/3161337832 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd5809a060 con 0x7fbd60101a10 2023-10-14T08:52:32.841 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd500a1510 msgr2=0x7fbd500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd500a1510 0x7fbd500a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd54005950 tx=0x7fbd540058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 msgr2=0x7fbd60102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 0x7fbd60102a00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800ef30 tx=0x7fbd5800c450 comp rx=0 tx=0).stop 2023-10-14T08:52:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 shutdown_connections 2023-10-14T08:52:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60101a10 0x7fbd60102a00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd500a1510 0x7fbd500a39d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd600ffe70 0x7fbd60103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 --2- 172.21.15.6:0/3161337832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd60101050 0x7fbd601024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 >> 172.21.15.6:0/3161337832 conn(0x7fbd600fb410 msgr2=0x7fbd60068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 shutdown_connections 2023-10-14T08:52:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.841+0000 7fbd6722d700 1 -- 172.21.15.6:0/3161337832 wait complete. 2023-10-14T08:52:32.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:32.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.978+0000 7fd40341f700 1 -- 172.21.15.6:0/1833092744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc100f70 msgr2=0x7fd3fc1013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.978+0000 7fd40341f700 1 --2- 172.21.15.6:0/1833092744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc100f70 0x7fd3fc1013f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009990 tx=0x7fd3ec009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- 172.21.15.6:0/1833092744 shutdown_connections 2023-10-14T08:52:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 --2- 172.21.15.6:0/1833092744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3fc101930 0x7fd3fc108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 --2- 172.21.15.6:0/1833092744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc0ffe20 0x7fd3fc100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 --2- 172.21.15.6:0/1833092744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc100f70 0x7fd3fc1013f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- 172.21.15.6:0/1833092744 >> 172.21.15.6:0/1833092744 conn(0x7fd3fc0fb370 msgr2=0x7fd3fc0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- 172.21.15.6:0/1833092744 shutdown_connections 2023-10-14T08:52:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- 172.21.15.6:0/1833092744 wait complete. 2023-10-14T08:52:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 Processor -- start 2023-10-14T08:52:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- start start 2023-10-14T08:52:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc0ffe20 0x7fd3fc196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3fc100f70 0x7fd3fc1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 0x7fd3fc19e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc19e720 con 0x7fd3fc101930 2023-10-14T08:52:32.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc19e860 con 0x7fd3fc0ffe20 2023-10-14T08:52:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.979+0000 7fd40341f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc19e9f0 con 0x7fd3fc100f70 2023-10-14T08:52:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 0x7fd3fc19e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 0x7fd3fc19e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60520/0 (socket says 172.21.15.6:60520) 2023-10-14T08:52:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 -- 172.21.15.6:0/1953921560 learned_addr learned my addr 172.21.15.6:0/1953921560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:32.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4011bb700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc0ffe20 0x7fd3fc196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4009ba700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3fc100f70 0x7fd3fc1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 -- 172.21.15.6:0/1953921560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3fc100f70 msgr2=0x7fd3fc1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3fc100f70 0x7fd3fc1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 -- 172.21.15.6:0/1953921560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc0ffe20 msgr2=0x7fd3fc196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc0ffe20 0x7fd3fc196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 -- 172.21.15.6:0/1953921560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0095f0 con 0x7fd3fc101930 2023-10-14T08:52:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd4019bc700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 0x7fd3fc19e150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007ee0 tx=0x7fd3f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4017070 con 0x7fd3fc101930 2023-10-14T08:52:32.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3f400f040 con 0x7fd3fc101930 2023-10-14T08:52:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc19ecd0 con 0x7fd3fc101930 2023-10-14T08:52:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4005580 con 0x7fd3fc101930 2023-10-14T08:52:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.980+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc19f1d0 con 0x7fd3fc101930 2023-10-14T08:52:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.981+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc10b650 con 0x7fd3fc101930 2023-10-14T08:52:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.982+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7fd3f400db20 con 0x7fd3fc101930 2023-10-14T08:52:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.983+0000 7fd3f27fc700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3e80a1590 0x7fd3e80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.983+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd3f40ccac0 con 0x7fd3fc101930 2023-10-14T08:52:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.983+0000 7fd4011bb700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3e80a1590 0x7fd3e80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.983+0000 7fd4011bb700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3e80a1590 0x7fd3e80a3a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007c60 tx=0x7fd3f80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:32.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:32.986+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3f4095fc0 con 0x7fd3fc101930 2023-10-14T08:52:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.236+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3fc19f3c0 con 0x7fd3fc101930 2023-10-14T08:52:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.236+0000 7fd3f27fc700 1 -- 172.21.15.6:0/1953921560 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7fd3f40995e0 con 0x7fd3fc101930 2023-10-14T08:52:33.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:33.239 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3e80a1590 msgr2=0x7fd3e80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3e80a1590 0x7fd3e80a3a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007c60 tx=0x7fd3f80073d0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 msgr2=0x7fd3fc19e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 0x7fd3fc19e150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007ee0 tx=0x7fd3f400d3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 shutdown_connections 2023-10-14T08:52:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3fc101930 0x7fd3fc19e150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3e80a1590 0x7fd3e80a3a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3fc0ffe20 0x7fd3fc196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 --2- 172.21.15.6:0/1953921560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3fc100f70 0x7fd3fc1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 >> 172.21.15.6:0/1953921560 conn(0x7fd3fc0fb370 msgr2=0x7fd3fc068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 shutdown_connections 2023-10-14T08:52:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.239+0000 7fd40341f700 1 -- 172.21.15.6:0/1953921560 wait complete. 2023-10-14T08:52:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:33.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.377+0000 7f200c6a5700 1 -- 172.21.15.6:0/2925065721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20040ffe20 msgr2=0x7f2004100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.377+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2925065721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20040ffe20 0x7f2004100240 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2000009990 tx=0x7f2000009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- 172.21.15.6:0/2925065721 shutdown_connections 2023-10-14T08:52:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2925065721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2004101930 0x7f2004108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2925065721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20040ffe20 0x7f2004100240 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2925065721 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004100f70 0x7f20041013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- 172.21.15.6:0/2925065721 >> 172.21.15.6:0/2925065721 conn(0x7f20040fb370 msgr2=0x7f20040fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- 172.21.15.6:0/2925065721 shutdown_connections 2023-10-14T08:52:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- 172.21.15.6:0/2925065721 wait complete. 2023-10-14T08:52:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 Processor -- start 2023-10-14T08:52:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- start start 2023-10-14T08:52:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20040ffe20 0x7f2004103da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 0x7f20041023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004101930 0x7f2004102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20041030c0 con 0x7f2004100f70 2023-10-14T08:52:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004103230 con 0x7f2004101930 2023-10-14T08:52:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f200c6a5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20041a0c00 con 0x7f20040ffe20 2023-10-14T08:52:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.378+0000 7f2009c40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 0x7f20041023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 0x7f20041023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60532/0 (socket says 172.21.15.6:60532) 2023-10-14T08:52:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 -- 172.21.15.6:0/2676180437 learned_addr learned my addr 172.21.15.6:0/2676180437 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f200ac42700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004101930 0x7f2004102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 -- 172.21.15.6:0/2676180437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20040ffe20 msgr2=0x7f2004103da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f200a441700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20040ffe20 0x7f2004103da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20040ffe20 0x7f2004103da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 -- 172.21.15.6:0/2676180437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004101930 msgr2=0x7f2004102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004101930 0x7f2004102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 -- 172.21.15.6:0/2676180437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000095f0 con 0x7f2004100f70 2023-10-14T08:52:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f200ac42700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004101930 0x7f2004102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f2009c40700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 0x7f20041023e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c920 tx=0x7f1ff400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4007b00 con 0x7f2004100f70 2023-10-14T08:52:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20041a0ee0 con 0x7f2004100f70 2023-10-14T08:52:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ff4004cf0 con 0x7f2004100f70 2023-10-14T08:52:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4005520 con 0x7f2004100f70 2023-10-14T08:52:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.379+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20041a1360 con 0x7f2004100f70 2023-10-14T08:52:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.380+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200410b620 con 0x7f2004100f70 2023-10-14T08:52:33.394 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:33 smithi178 ceph-mon[103612]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-14T08:52:33.395 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:33 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3815020679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.395 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:33 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3087814943' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.395 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:33 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3161337832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.381+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f1ff4004750 con 0x7f2004100f70 2023-10-14T08:52:33.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.382+0000 7f1ffb7fe700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1ff00a1510 0x7f1ff00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.382+0000 7f200a441700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1ff00a1510 0x7f1ff00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.382+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1ff40cced0 con 0x7f2004100f70 2023-10-14T08:52:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.382+0000 7f200a441700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1ff00a1510 0x7f1ff00a39d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f200000b5c0 tx=0x7f2000005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.385+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ff4096390 con 0x7f2004100f70 2023-10-14T08:52:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:33 smithi057 ceph-mon[103313]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-14T08:52:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:33 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3815020679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:33 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3087814943' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:33 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3161337832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:33 smithi006 ceph-mon[99452]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2023-10-14T08:52:33.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:33 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3815020679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:33 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3087814943' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:33 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3161337832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.615+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20041a15e0 con 0x7f2004100f70 2023-10-14T08:52:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.617+0000 7f1ffb7fe700 1 -- 172.21.15.6:0/2676180437 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f1ff401d020 con 0x7f2004100f70 2023-10-14T08:52:33.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:33.619 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1ff00a1510 msgr2=0x7f1ff00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1ff00a1510 0x7f1ff00a39d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f200000b5c0 tx=0x7f2000005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 msgr2=0x7f20041023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 0x7f20041023e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c920 tx=0x7f1ff400cce0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 shutdown_connections 2023-10-14T08:52:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1ff00a1510 0x7f1ff00a39d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2004101930 0x7f2004102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20040ffe20 0x7f2004103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 --2- 172.21.15.6:0/2676180437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2004100f70 0x7f20041023e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 >> 172.21.15.6:0/2676180437 conn(0x7f20040fb370 msgr2=0x7f2004068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 shutdown_connections 2023-10-14T08:52:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.619+0000 7f200c6a5700 1 -- 172.21.15.6:0/2676180437 wait complete. 2023-10-14T08:52:33.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:33.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 -- 172.21.15.6:0/2096786226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 msgr2=0x7f87f4101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 --2- 172.21.15.6:0/2096786226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4101470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009990 tx=0x7f87e8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 -- 172.21.15.6:0/2096786226 shutdown_connections 2023-10-14T08:52:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 --2- 172.21.15.6:0/2096786226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 0x7f87f41082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 --2- 172.21.15.6:0/2096786226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f40ffea0 0x7f87f41002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 --2- 172.21.15.6:0/2096786226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4101470 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 -- 172.21.15.6:0/2096786226 >> 172.21.15.6:0/2096786226 conn(0x7f87f40fb430 msgr2=0x7f87f40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 -- 172.21.15.6:0/2096786226 shutdown_connections 2023-10-14T08:52:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.761+0000 7f87f8b00700 1 -- 172.21.15.6:0/2096786226 wait complete. 2023-10-14T08:52:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 Processor -- start 2023-10-14T08:52:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 -- start start 2023-10-14T08:52:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f40ffea0 0x7f87f4196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 0x7f87f419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f419e880 con 0x7f87f4100ff0 2023-10-14T08:52:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f419e9f0 con 0x7f87f40ffea0 2023-10-14T08:52:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f8b00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f419ebb0 con 0x7f87f41019b0 2023-10-14T08:52:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60546/0 (socket says 172.21.15.6:60546) 2023-10-14T08:52:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 -- 172.21.15.6:0/1152678873 learned_addr learned my addr 172.21.15.6:0/1152678873 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f259c700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f40ffea0 0x7f87f4196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f2d9d700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 0x7f87f419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 -- 172.21.15.6:0/1152678873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 msgr2=0x7f87f419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 0x7f87f419e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 -- 172.21.15.6:0/1152678873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f40ffea0 msgr2=0x7f87f4196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f40ffea0 0x7f87f4196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.762+0000 7f87f1d9b700 1 -- 172.21.15.6:0/1152678873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80095f0 con 0x7f87f4100ff0 2023-10-14T08:52:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87f2d9d700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 0x7f87f419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87f1d9b700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4197280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f87e8005910 tx=0x7f87e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:33.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e801d070 con 0x7f87f4100ff0 2023-10-14T08:52:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87e8003f60 con 0x7f87f4100ff0 2023-10-14T08:52:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f419ee30 con 0x7f87f4100ff0 2023-10-14T08:52:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8022da0 con 0x7f87f4100ff0 2023-10-14T08:52:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.763+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f419f1a0 con 0x7f87f4100ff0 2023-10-14T08:52:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.764+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f410c890 con 0x7f87f4100ff0 2023-10-14T08:52:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.765+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f87e8003aa0 con 0x7f87f4100ff0 2023-10-14T08:52:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.766+0000 7f87e37fe700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f87dc0a1510 0x7f87dc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.766+0000 7f87f259c700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f87dc0a1510 0x7f87dc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.766+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f87e80ceaa0 con 0x7f87f4100ff0 2023-10-14T08:52:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.766+0000 7f87f259c700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f87dc0a1510 0x7f87dc0a39d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87f4198210 tx=0x7f87e400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.769+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f87e8097ff0 con 0x7f87f4100ff0 2023-10-14T08:52:33.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.970+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87f4106e20 con 0x7f87f4100ff0 2023-10-14T08:52:33.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.970+0000 7f87e37fe700 1 -- 172.21.15.6:0/1152678873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87e809b610 con 0x7f87f4100ff0 2023-10-14T08:52:33.972 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f87dc0a1510 msgr2=0x7f87dc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f87dc0a1510 0x7f87dc0a39d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87f4198210 tx=0x7f87e400b410 comp rx=0 tx=0).stop 2023-10-14T08:52:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 msgr2=0x7f87f4197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4197280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f87e8005910 tx=0x7f87e8004730 comp rx=0 tx=0).stop 2023-10-14T08:52:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 shutdown_connections 2023-10-14T08:52:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87f41019b0 0x7f87f419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f87dc0a1510 0x7f87dc0a39d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f40ffea0 0x7f87f4196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.972+0000 7f87f8b00700 1 --2- 172.21.15.6:0/1152678873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87f4100ff0 0x7f87f4197280 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.973+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 >> 172.21.15.6:0/1152678873 conn(0x7f87f40fb430 msgr2=0x7f87f40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.973+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 shutdown_connections 2023-10-14T08:52:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:33.973+0000 7f87f8b00700 1 -- 172.21.15.6:0/1152678873 wait complete. 2023-10-14T08:52:33.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 -- 172.21.15.6:0/971144158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d40ffea0 msgr2=0x7f69d41002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/971144158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d40ffea0 0x7f69d41002c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009990 tx=0x7f69c4009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 -- 172.21.15.6:0/971144158 shutdown_connections 2023-10-14T08:52:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/971144158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69d41019b0 0x7f69d41082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/971144158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d40ffea0 0x7f69d41002c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/971144158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d4100ff0 0x7f69d4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 -- 172.21.15.6:0/971144158 >> 172.21.15.6:0/971144158 conn(0x7f69d40fb430 msgr2=0x7f69d40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 -- 172.21.15.6:0/971144158 shutdown_connections 2023-10-14T08:52:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 -- 172.21.15.6:0/971144158 wait complete. 2023-10-14T08:52:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 Processor -- start 2023-10-14T08:52:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.114+0000 7f69d8bd1700 1 -- start start 2023-10-14T08:52:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69d40ffea0 0x7f69d4196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 0x7f69d41971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d41019b0 0x7f69d419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419e800 con 0x7f69d4100ff0 2023-10-14T08:52:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419e970 con 0x7f69d40ffea0 2023-10-14T08:52:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419eb30 con 0x7f69d41019b0 2023-10-14T08:52:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 0x7f69d41971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 0x7f69d41971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60560/0 (socket says 172.21.15.6:60560) 2023-10-14T08:52:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 -- 172.21.15.6:0/1294860397 learned_addr learned my addr 172.21.15.6:0/1294860397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d259c700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69d40ffea0 0x7f69d4196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d2d9d700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d41019b0 0x7f69d419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 -- 172.21.15.6:0/1294860397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d41019b0 msgr2=0x7f69d419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d41019b0 0x7f69d419e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 -- 172.21.15.6:0/1294860397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69d40ffea0 msgr2=0x7f69d4196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69d40ffea0 0x7f69d4196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 -- 172.21.15.6:0/1294860397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40095f0 con 0x7f69d4100ff0 2023-10-14T08:52:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d1d9b700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 0x7f69d41971d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f69c800e9a0 tx=0x7f69c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8009790 con 0x7f69d4100ff0 2023-10-14T08:52:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d419ee10 con 0x7f69d4100ff0 2023-10-14T08:52:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69c8010430 con 0x7f69d4100ff0 2023-10-14T08:52:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.115+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8018680 con 0x7f69d4100ff0 2023-10-14T08:52:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.116+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d419f290 con 0x7f69d4100ff0 2023-10-14T08:52:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.117+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d410b6f0 con 0x7f69d4100ff0 2023-10-14T08:52:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.118+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 136053+0+0 (secure 0 0 0) 0x7f69c80105a0 con 0x7f69d4100ff0 2023-10-14T08:52:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.118+0000 7f69c37fe700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f69bc0a1510 0x7f69bc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.118+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f69c8014070 con 0x7f69d4100ff0 2023-10-14T08:52:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.118+0000 7f69d259c700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f69bc0a1510 0x7f69bc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.119+0000 7f69d259c700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f69bc0a1510 0x7f69bc0a39d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b2e0 tx=0x7f69c4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.122+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f69c8096720 con 0x7f69d4100ff0 2023-10-14T08:52:34.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.148+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f69c8010880 con 0x7f69d4100ff0 2023-10-14T08:52:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.328+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69d419f480 con 0x7f69d4100ff0 2023-10-14T08:52:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.329+0000 7f69c37fe700 1 -- 172.21.15.6:0/1294860397 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69c80c0750 con 0x7f69d4100ff0 2023-10-14T08:52:34.331 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f69bc0a1510 msgr2=0x7f69bc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f69bc0a1510 0x7f69bc0a39d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b2e0 tx=0x7f69c4005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 msgr2=0x7f69d41971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 0x7f69d41971d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f69c800e9a0 tx=0x7f69c800ecb0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 shutdown_connections 2023-10-14T08:52:34.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d41019b0 0x7f69d419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f69bc0a1510 0x7f69bc0a39d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69d40ffea0 0x7f69d4196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 --2- 172.21.15.6:0/1294860397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69d4100ff0 0x7f69d41971d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 >> 172.21.15.6:0/1294860397 conn(0x7f69d40fb430 msgr2=0x7f69d40681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 shutdown_connections 2023-10-14T08:52:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.331+0000 7f69d8bd1700 1 -- 172.21.15.6:0/1294860397 wait complete. 2023-10-14T08:52:34.343 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:34 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1953921560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:34.344 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:34 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2676180437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:34.344 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:34 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1152678873' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:34.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:34.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:34 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1953921560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:34.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:34 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2676180437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:34.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:34 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1152678873' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:34.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:34 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1953921560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:34.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:34 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2676180437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:34.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:34 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1152678873' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 -- 172.21.15.6:0/4131421261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85041043f0 msgr2=0x7f85041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 --2- 172.21.15.6:0/4131421261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85041043f0 0x7f85041067e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8500009990 tx=0x7f8500009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 -- 172.21.15.6:0/4131421261 shutdown_connections 2023-10-14T08:52:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 --2- 172.21.15.6:0/4131421261 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 0x7f8504109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 --2- 172.21.15.6:0/4131421261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8504101ac0 0x7f8504103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 --2- 172.21.15.6:0/4131421261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85041043f0 0x7f85041067e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 -- 172.21.15.6:0/4131421261 >> 172.21.15.6:0/4131421261 conn(0x7f85040fb410 msgr2=0x7f85040fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 -- 172.21.15.6:0/4131421261 shutdown_connections 2023-10-14T08:52:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.472+0000 7f850b993700 1 -- 172.21.15.6:0/4131421261 wait complete. 2023-10-14T08:52:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 Processor -- start 2023-10-14T08:52:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 -- start start 2023-10-14T08:52:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 0x7f8504196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85041043f0 0x7f85041971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 0x7f850419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850419e7b0 con 0x7f8504101ac0 2023-10-14T08:52:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850419e920 con 0x7f8504106d20 2023-10-14T08:52:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850b993700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850419eae0 con 0x7f85041043f0 2023-10-14T08:52:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 0x7f8504196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 0x7f8504196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60570/0 (socket says 172.21.15.6:60570) 2023-10-14T08:52:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 -- 172.21.15.6:0/3762559312 learned_addr learned my addr 172.21.15.6:0/3762559312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f8508f2e700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85041043f0 0x7f85041971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f8509f30700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 0x7f850419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 -- 172.21.15.6:0/3762559312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85041043f0 msgr2=0x7f85041971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85041043f0 0x7f85041971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 -- 172.21.15.6:0/3762559312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 msgr2=0x7f850419e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 0x7f850419e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f850972f700 1 -- 172.21.15.6:0/3762559312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000095f0 con 0x7f8504101ac0 2023-10-14T08:52:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f8509f30700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 0x7f850419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.473+0000 7f8508f2e700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85041043f0 0x7f85041971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.474+0000 7f850972f700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 0x7f8504196c70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f84f400d950 tx=0x7f84f400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.474+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4009b40 con 0x7f8504101ac0 2023-10-14T08:52:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.474+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850419edc0 con 0x7f8504101ac0 2023-10-14T08:52:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.474+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84f4009ca0 con 0x7f8504101ac0 2023-10-14T08:52:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.474+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400f620 con 0x7f8504101ac0 2023-10-14T08:52:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.474+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850419f1f0 con 0x7f8504101ac0 2023-10-14T08:52:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.475+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850410c760 con 0x7f8504101ac0 2023-10-14T08:52:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.476+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f84f4010460 con 0x7f8504101ac0 2023-10-14T08:52:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.477+0000 7f84fa7fc700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84f00a1480 0x7f84f00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.477+0000 7f8508f2e700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84f00a1480 0x7f84f00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.477+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f84f40cd070 con 0x7f8504101ac0 2023-10-14T08:52:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.478+0000 7f8508f2e700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84f00a1480 0x7f84f00a3940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f850000b2e0 tx=0x7f8500005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.481+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f84f4096690 con 0x7f8504101ac0 2023-10-14T08:52:34.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.682+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f850419f3e0 con 0x7f8504101ac0 2023-10-14T08:52:34.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.682+0000 7f84fa7fc700 1 -- 172.21.15.6:0/3762559312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84f4020020 con 0x7f8504101ac0 2023-10-14T08:52:34.684 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84f00a1480 msgr2=0x7f84f00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84f00a1480 0x7f84f00a3940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f850000b2e0 tx=0x7f8500005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 msgr2=0x7f8504196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 0x7f8504196c70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f84f400d950 tx=0x7f84f400dd10 comp rx=0 tx=0).stop 2023-10-14T08:52:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 shutdown_connections 2023-10-14T08:52:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f84f00a1480 0x7f84f00a3940 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8504106d20 0x7f850419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8504101ac0 0x7f8504196c70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 --2- 172.21.15.6:0/3762559312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85041043f0 0x7f85041971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.684+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 >> 172.21.15.6:0/3762559312 conn(0x7f85040fb410 msgr2=0x7f8504102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.685+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 shutdown_connections 2023-10-14T08:52:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.685+0000 7f850b993700 1 -- 172.21.15.6:0/3762559312 wait complete. 2023-10-14T08:52:34.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:34.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 -- 172.21.15.6:0/953565649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc101980 msgr2=0x7f9ebc108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/953565649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc101980 0x7f9ebc108230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400b0d0 tx=0x7f9eb400b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 -- 172.21.15.6:0/953565649 shutdown_connections 2023-10-14T08:52:34.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/953565649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc101980 0x7f9ebc108230 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/953565649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/953565649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ebc100fe0 0x7f9ebc101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 -- 172.21.15.6:0/953565649 >> 172.21.15.6:0/953565649 conn(0x7f9ebc0fb320 msgr2=0x7f9ebc0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:34.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 -- 172.21.15.6:0/953565649 shutdown_connections 2023-10-14T08:52:34.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.823+0000 7f9ec1f96700 1 -- 172.21.15.6:0/953565649 wait complete. 2023-10-14T08:52:34.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 Processor -- start 2023-10-14T08:52:34.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 -- start start 2023-10-14T08:52:34.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ebc100fe0 0x7f9ebc1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ebc101980 0x7f9ebc19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc19e7f0 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc19e960 con 0x7f9ebc101980 2023-10-14T08:52:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ec1f96700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc19eb20 con 0x7f9ebc100fe0 2023-10-14T08:52:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ebb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ebb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60584/0 (socket says 172.21.15.6:60584) 2023-10-14T08:52:34.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ebb7fe700 1 -- 172.21.15.6:0/2009079026 learned_addr learned my addr 172.21.15.6:0/2009079026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.824+0000 7f9ebbfff700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ebc101980 0x7f9ebc19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebaffd700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ebc100fe0 0x7f9ebc1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebb7fe700 1 -- 172.21.15.6:0/2009079026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ebc100fe0 msgr2=0x7f9ebc1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebb7fe700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ebc100fe0 0x7f9ebc1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebb7fe700 1 -- 172.21.15.6:0/2009079026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ebc101980 msgr2=0x7f9ebc19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:34.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebb7fe700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ebc101980 0x7f9ebc19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:34.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebb7fe700 1 -- 172.21.15.6:0/2009079026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4009d00 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ebb7fe700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc196c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00d980 tx=0x7f9eac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:34.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac004020 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9eac009730 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc19ee00 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac003a80 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.825+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc19f230 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.826+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc10b610 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.827+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9eac0098a0 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.828+0000 7f9eb8ff9700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ea40a1480 0x7f9ea40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.828+0000 7f9ebaffd700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ea40a1480 0x7f9ea40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.828+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9eac0cc9d0 con 0x7f9ebc0ffdf0 2023-10-14T08:52:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.828+0000 7f9ebaffd700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ea40a1480 0x7f9ea40a3940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc198180 tx=0x7f9eb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:34.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:34.832+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9eac096030 con 0x7f9ebc0ffdf0 2023-10-14T08:52:35.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.083+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ebc19f480 con 0x7f9ebc0ffdf0 2023-10-14T08:52:35.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.083+0000 7f9eb8ff9700 1 -- 172.21.15.6:0/2009079026 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7f9eac099650 con 0x7f9ebc0ffdf0 2023-10-14T08:52:35.085 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:35.085 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ea40a1480 msgr2=0x7f9ea40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ea40a1480 0x7f9ea40a3940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc198180 tx=0x7f9eb0009260 comp rx=0 tx=0).stop 2023-10-14T08:52:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 msgr2=0x7f9ebc196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc196c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00d980 tx=0x7f9eac00dc90 comp rx=0 tx=0).stop 2023-10-14T08:52:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 shutdown_connections 2023-10-14T08:52:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ea40a1480 0x7f9ea40a3940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ebc101980 0x7f9ebc19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0ffdf0 0x7f9ebc196c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 --2- 172.21.15.6:0/2009079026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ebc100fe0 0x7f9ebc1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 >> 172.21.15.6:0/2009079026 conn(0x7f9ebc0fb320 msgr2=0x7f9ebc068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 shutdown_connections 2023-10-14T08:52:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.086+0000 7f9ec1f96700 1 -- 172.21.15.6:0/2009079026 wait complete. 2023-10-14T08:52:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:35.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:35.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 -- 172.21.15.6:0/2117742009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228101970 msgr2=0x7f2228108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 --2- 172.21.15.6:0/2117742009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228101970 0x7f2228108220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f222000b0d0 tx=0x7f222000b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 -- 172.21.15.6:0/2117742009 shutdown_connections 2023-10-14T08:52:35.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 --2- 172.21.15.6:0/2117742009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228101970 0x7f2228108220 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 --2- 172.21.15.6:0/2117742009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280ffde0 0x7f2228100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 --2- 172.21.15.6:0/2117742009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2228100fd0 0x7f2228101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 -- 172.21.15.6:0/2117742009 >> 172.21.15.6:0/2117742009 conn(0x7f22280fb310 msgr2=0x7f22280fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 -- 172.21.15.6:0/2117742009 shutdown_connections 2023-10-14T08:52:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.225+0000 7f222fd00700 1 -- 172.21.15.6:0/2117742009 wait complete. 2023-10-14T08:52:35.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 Processor -- start 2023-10-14T08:52:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 -- start start 2023-10-14T08:52:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22280ffde0 0x7f2228196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 0x7f2228197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2228101970 0x7f222819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222819e760 con 0x7f2228100fd0 2023-10-14T08:52:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222819e8d0 con 0x7f2228101970 2023-10-14T08:52:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222fd00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222819ea90 con 0x7f22280ffde0 2023-10-14T08:52:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222d29b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 0x7f2228197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222d29b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 0x7f2228197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60600/0 (socket says 172.21.15.6:60600) 2023-10-14T08:52:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222d29b700 1 -- 172.21.15.6:0/3179024702 learned_addr learned my addr 172.21.15.6:0/3179024702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222da9c700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22280ffde0 0x7f2228196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.226+0000 7f222e29d700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2228101970 0x7f222819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222d29b700 1 -- 172.21.15.6:0/3179024702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22280ffde0 msgr2=0x7f2228196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222d29b700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22280ffde0 0x7f2228196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222d29b700 1 -- 172.21.15.6:0/3179024702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2228101970 msgr2=0x7f222819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222d29b700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2228101970 0x7f222819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222d29b700 1 -- 172.21.15.6:0/3179024702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009d00 con 0x7f2228100fd0 2023-10-14T08:52:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222e29d700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2228101970 0x7f222819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222d29b700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 0x7f2228197160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f221c00d980 tx=0x7f221c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c009b40 con 0x7f2228100fd0 2023-10-14T08:52:35.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f221c00de60 con 0x7f2228100fd0 2023-10-14T08:52:35.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222819ed70 con 0x7f2228100fd0 2023-10-14T08:52:35.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c005580 con 0x7f2228100fd0 2023-10-14T08:52:35.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.227+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222819f1d0 con 0x7f2228100fd0 2023-10-14T08:52:35.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.228+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2228106bd0 con 0x7f2228100fd0 2023-10-14T08:52:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.229+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f221c004750 con 0x7f2228100fd0 2023-10-14T08:52:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.229+0000 7f221affd700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f22140a1480 0x7f22140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.230+0000 7f222da9c700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f22140a1480 0x7f22140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.230+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f221c0cd0f0 con 0x7f2228100fd0 2023-10-14T08:52:35.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.230+0000 7f222da9c700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f22140a1480 0x7f22140a3940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f22281980f0 tx=0x7f222400a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.233+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f221c096750 con 0x7f2228100fd0 2023-10-14T08:52:35.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.437+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f222810c8f0 con 0x7f2228100fd0 2023-10-14T08:52:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.439+0000 7f221affd700 1 -- 172.21.15.6:0/3179024702 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f221c017070 con 0x7f2228100fd0 2023-10-14T08:52:35.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:35.441 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f22140a1480 msgr2=0x7f22140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f22140a1480 0x7f22140a3940 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f22281980f0 tx=0x7f222400a5e0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 msgr2=0x7f2228197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 0x7f2228197160 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f221c00d980 tx=0x7f221c00dd40 comp rx=0 tx=0).stop 2023-10-14T08:52:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 shutdown_connections 2023-10-14T08:52:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f22140a1480 0x7f22140a3940 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2228101970 0x7f222819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22280ffde0 0x7f2228196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 --2- 172.21.15.6:0/3179024702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2228100fd0 0x7f2228197160 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 >> 172.21.15.6:0/3179024702 conn(0x7f22280fb310 msgr2=0x7f22280fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 shutdown_connections 2023-10-14T08:52:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.441+0000 7f222fd00700 1 -- 172.21.15.6:0/3179024702 wait complete. 2023-10-14T08:52:35.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:35 smithi057 ceph-mon[103313]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-14T08:52:35.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:35 smithi057 ceph-mon[103313]: mgrmap e18: x(active, since 7m), standbys: y, z 2023-10-14T08:52:35.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:35 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1294860397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:35.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:35 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3762559312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:35.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:35 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2009079026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:35.453 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:35 smithi006 ceph-mon[99452]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-14T08:52:35.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:35 smithi006 ceph-mon[99452]: mgrmap e18: x(active, since 7m), standbys: y, z 2023-10-14T08:52:35.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:35 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1294860397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:35.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:35 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3762559312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:35.454 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:35 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2009079026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:35.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-14T08:51:16.279910+0000', 'modified': '2023-10-14T08:51:24.158921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24508, 'mds_1': 24506, 'mds_2': 24473, 'mds_3': 24455, 'mds_4': 24434}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/977658940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 977658940}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 977658940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/4202282219', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 4202282219}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 4202282219}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24433': {'gid': 24433, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6833/3050202963', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 3050202963}, {'type': 'v1', 'addr': '172.21.15.178:6833', 'nonce': 3050202963}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24434': {'gid': 24434, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.57:6833/1834864415', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1834864415}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1834864415}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.57:6835/2935762756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 2935762756}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2935762756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.57:6837/1275682296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 1275682296}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 1275682296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/4072673445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 4072673445}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 4072673445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24493': {'gid': 24493, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6837/4069767165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 4069767165}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 4069767165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6839/2236865036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6838', 'nonce': 2236865036}, {'type': 'v1', 'addr': '172.21.15.57:6839', 'nonce': 2236865036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24508': {'gid': 24508, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.178:6839/1495241908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 1495241908}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 1495241908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T08:52:35.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-14T08:52:35.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-10-14T08:52:35.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 -- 172.21.15.6:0/2949658840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54100fb0 msgr2=0x7fac541013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 --2- 172.21.15.6:0/2949658840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54100fb0 0x7fac541013d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fac440099c0 tx=0x7fac44009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 -- 172.21.15.6:0/2949658840 shutdown_connections 2023-10-14T08:52:35.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 --2- 172.21.15.6:0/2949658840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac54102b40 0x7fac541093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 --2- 172.21.15.6:0/2949658840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54100fb0 0x7fac541013d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 --2- 172.21.15.6:0/2949658840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 0x7fac54102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 -- 172.21.15.6:0/2949658840 >> 172.21.15.6:0/2949658840 conn(0x7fac540fc520 msgr2=0x7fac540fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 -- 172.21.15.6:0/2949658840 shutdown_connections 2023-10-14T08:52:35.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.583+0000 7fac5b457700 1 -- 172.21.15.6:0/2949658840 wait complete. 2023-10-14T08:52:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 Processor -- start 2023-10-14T08:52:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 -- start start 2023-10-14T08:52:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac54100fb0 0x7fac54196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 0x7fac54197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 0x7fac5419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5419e770 con 0x7fac54102b40 2023-10-14T08:52:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5419e8b0 con 0x7fac541021a0 2023-10-14T08:52:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac5b457700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5419ea40 con 0x7fac54100fb0 2023-10-14T08:52:35.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 0x7fac5419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 0x7fac5419e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60616/0 (socket says 172.21.15.6:60616) 2023-10-14T08:52:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 -- 172.21.15.6:0/3404091128 learned_addr learned my addr 172.21.15.6:0/3404091128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac591f3700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac54100fb0 0x7fac54196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac589f2700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 0x7fac54197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 -- 172.21.15.6:0/3404091128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac54100fb0 msgr2=0x7fac54196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac54100fb0 0x7fac54196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 -- 172.21.15.6:0/3404091128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 msgr2=0x7fac54197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 0x7fac54197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 -- 172.21.15.6:0/3404091128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440095f0 con 0x7fac54102b40 2023-10-14T08:52:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac589f2700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 0x7fac54197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.584+0000 7fac599f4700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 0x7fac5419e1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00ef30 tx=0x7fac4c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.585+0000 7fac4a7fc700 1 -- 172.21.15.6:0/3404091128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c018070 con 0x7fac54102b40 2023-10-14T08:52:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.585+0000 7fac4a7fc700 1 -- 172.21.15.6:0/3404091128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac4c00f040 con 0x7fac54102b40 2023-10-14T08:52:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.585+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5419ecc0 con 0x7fac54102b40 2023-10-14T08:52:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.585+0000 7fac4a7fc700 1 -- 172.21.15.6:0/3404091128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c003dc0 con 0x7fac54102b40 2023-10-14T08:52:35.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.585+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5419f1d0 con 0x7fac54102b40 2023-10-14T08:52:35.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.587+0000 7fac4a7fc700 1 -- 172.21.15.6:0/3404091128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fac4c00caa0 con 0x7fac54102b40 2023-10-14T08:52:35.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.587+0000 7fac4a7fc700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac400a1480 0x7fac400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac591f3700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac400a1480 0x7fac400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac4a7fc700 1 -- 172.21.15.6:0/3404091128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fac4c0cc9b0 con 0x7fac54102b40 2023-10-14T08:52:35.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac591f3700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac400a1480 0x7fac400a3940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac44009990 tx=0x7fac4401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac67641b80 1 Processor -- start 2023-10-14T08:52:35.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac67641b80 1 -- start start 2023-10-14T08:52:35.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac67641b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4546b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac67641b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4546bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.588+0000 7fac67641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4546ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac67641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de453dfc20 con 0x55de4546c5d0 2023-10-14T08:52:35.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac67641b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de453c4c10 con 0x55de4546add0 2023-10-14T08:52:35.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac67641b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de453c2530 con 0x55de4546b730 2023-10-14T08:52:35.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4546ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4546ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60622/0 (socket says 172.21.15.6:60622) 2023-10-14T08:52:35.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 -- 172.21.15.6:0/3099209905 learned_addr learned my addr 172.21.15.6:0/3099209905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac591f3700 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4546b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac589f2700 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4546bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 -- 172.21.15.6:0/3099209905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 msgr2=0x55de4546bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4546bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 -- 172.21.15.6:0/3099209905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 msgr2=0x55de4546b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4546b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 -- 172.21.15.6:0/3099209905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de4537b3a0 con 0x55de4546c5d0 2023-10-14T08:52:35.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac591f3700 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4546b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:35.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac599f4700 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4546ca50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac4c096220 tx=0x7fac4c096190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c063437e683e5240 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac3f7fe700 1 -- 172.21.15.6:0/3099209905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c099d20 con 0x55de4546c5d0 2023-10-14T08:52:35.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac3f7fe700 1 -- 172.21.15.6:0/3099209905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac4c09de70 con 0x55de4546c5d0 2023-10-14T08:52:35.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.589+0000 7fac3f7fe700 1 -- 172.21.15.6:0/3099209905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c099210 con 0x55de4546c5d0 2023-10-14T08:52:35.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 -- 172.21.15.6:0/3099209905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 msgr2=0x55de4546ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4546ca50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac4c096220 tx=0x7fac4c096190 comp rx=0 tx=0).stop 2023-10-14T08:52:35.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 -- 172.21.15.6:0/3099209905 shutdown_connections 2023-10-14T08:52:35.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4546ca50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4546b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 --2- 172.21.15.6:0/3099209905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4546bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 -- 172.21.15.6:0/3099209905 >> 172.21.15.6:0/3099209905 conn(0x55de45398d80 msgr2=0x55de45465f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 -- 172.21.15.6:0/3099209905 shutdown_connections 2023-10-14T08:52:35.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 -- 172.21.15.6:0/3099209905 wait complete. 2023-10-14T08:52:35.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 -- start start 2023-10-14T08:52:35.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.590+0000 7fac67641b80 1 Processor -- start 2023-10-14T08:52:35.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546add0 0x55de45474d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546b730 0x55de45475250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de453bde20 con 0x55de4546c5d0 2023-10-14T08:52:35.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4535a6c0 con 0x55de4546b730 2023-10-14T08:52:35.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4535a360 con 0x55de4546add0 2023-10-14T08:52:35.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac67641b80 10 client.0 _ll_register_callbacks cb 0x55de451b77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:35.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60630/0 (socket says 172.21.15.6:60630) 2023-10-14T08:52:35.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 -- 172.21.15.6:0/3233905894 learned_addr learned my addr 172.21.15.6:0/3233905894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac591f3700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546add0 0x55de45474d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 -- 172.21.15.6:0/3233905894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546add0 msgr2=0x55de45474d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546add0 0x55de45474d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac589f2700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546b730 0x55de45475250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 -- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546b730 msgr2=0x55de45475250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546b730 0x55de45475250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 -- 172.21.15.6:0/3233905894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5419f1d0 con 0x55de4546c5d0 2023-10-14T08:52:35.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac599f4700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547c290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0a1af0 tx=0x7fac4c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283c50987eae0227 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.591+0000 7fac3cff9700 1 -- 172.21.15.6:0/3233905894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c099d20 con 0x55de4546c5d0 2023-10-14T08:52:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac3cff9700 1 -- 172.21.15.6:0/3233905894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fac4c0b9040 con 0x55de4546c5d0 2023-10-14T08:52:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de453c2ea0 con 0x55de4546c5d0 2023-10-14T08:52:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac3cff9700 1 -- 172.21.15.6:0/3233905894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac4c0a1b90 con 0x55de4546c5d0 2023-10-14T08:52:35.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 10 client.15231 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:35.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55de451e8d90 con 0x55de4546c5d0 2023-10-14T08:52:35.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac3cff9700 1 -- 172.21.15.6:0/3233905894 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55de453c2ea0 con 0x55de4546c5d0 2023-10-14T08:52:35.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac3cff9700 1 -- 172.21.15.6:0/3233905894 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fac4c0652b0 con 0x55de4546c5d0 2023-10-14T08:52:35.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:35.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 10 client.15231 resolve_mds: resolved name 'k' to daemon mds.k 2023-10-14T08:52:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 20 client.15231 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de45480460 0x55de4547f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 4 client.15231 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de4543abc0 con 0x55de45480460 2023-10-14T08:52:35.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.592+0000 7fac591f3700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de45480460 0x55de4547f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.593+0000 7fac3cff9700 10 client.15231 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.593+0000 7fac591f3700 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de45480460 0x55de4547f1c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a599fafea9f5801f server_cookie=5df98801dabbbd92 in_seq=0 out_seq=0 2023-10-14T08:52:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.593+0000 7fac3cff9700 1 -- 172.21.15.6:0/3233905894 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55de4543abc0 con 0x55de45480460 2023-10-14T08:52:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.593+0000 7fac3cff9700 10 client.15231 handle_command_reply: tid=0 2023-10-14T08:52:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 client.15231 shutdown 2023-10-14T08:52:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 msgr2=0x55de4547c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547c290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0a1af0 tx=0x7fac4c0093e0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 shutdown_connections 2023-10-14T08:52:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547c290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546add0 0x55de45474d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de45480460 0x55de4547f1c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 --2- 172.21.15.6:0/3233905894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546b730 0x55de45475250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac3cff9700 0 client.15231 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 >> 172.21.15.6:0/3233905894 conn(0x55de45398d80 msgr2=0x55de45465ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 shutdown_connections 2023-10-14T08:52:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 1 -- 172.21.15.6:0/3233905894 wait complete. 2023-10-14T08:52:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.594+0000 7fac67641b80 20 client.15231 trim_cache size 0 max 16384 2023-10-14T08:52:35.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.611+0000 7fac67641b80 1 Processor -- start 2023-10-14T08:52:35.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.611+0000 7fac67641b80 1 -- start start 2023-10-14T08:52:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac67641b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4547ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac67641b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4547c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac67641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac67641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4523e8d0 con 0x55de4546c5d0 2023-10-14T08:52:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac67641b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4543abf0 con 0x55de4546add0 2023-10-14T08:52:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac67641b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de454811f0 con 0x55de4546b730 2023-10-14T08:52:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60638/0 (socket says 172.21.15.6:60638) 2023-10-14T08:52:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 -- 172.21.15.6:0/3543792849 learned_addr learned my addr 172.21.15.6:0/3543792849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 -- 172.21.15.6:0/3543792849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 msgr2=0x55de4547c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4547c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 -- 172.21.15.6:0/3543792849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 msgr2=0x55de4547ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4547ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 -- 172.21.15.6:0/3543792849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de451d1c10 con 0x55de4546c5d0 2023-10-14T08:52:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac599f4700 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547f1c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fac4c096220 tx=0x7fac4c099990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422a0824a2525284 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac3ffff700 1 -- 172.21.15.6:0/3543792849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0981a0 con 0x55de4546c5d0 2023-10-14T08:52:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac3ffff700 1 -- 172.21.15.6:0/3543792849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac4c099d20 con 0x55de4546c5d0 2023-10-14T08:52:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.612+0000 7fac3ffff700 1 -- 172.21.15.6:0/3543792849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c09ee10 con 0x55de4546c5d0 2023-10-14T08:52:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 -- 172.21.15.6:0/3543792849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 msgr2=0x55de4547f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547f1c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fac4c096220 tx=0x7fac4c099990 comp rx=0 tx=0).stop 2023-10-14T08:52:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 -- 172.21.15.6:0/3543792849 shutdown_connections 2023-10-14T08:52:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546c5d0 0x55de4547f1c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546add0 0x55de4547ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 --2- 172.21.15.6:0/3543792849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de4547c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 -- 172.21.15.6:0/3543792849 >> 172.21.15.6:0/3543792849 conn(0x55de45398d80 msgr2=0x55de454651f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 -- 172.21.15.6:0/3543792849 shutdown_connections 2023-10-14T08:52:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 -- 172.21.15.6:0/3543792849 wait complete. 2023-10-14T08:52:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 -- start start 2023-10-14T08:52:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.613+0000 7fac67641b80 1 Processor -- start 2023-10-14T08:52:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 0x55de4547bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de454788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546c5d0 0x55de45478df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de454794d0 con 0x55de4546add0 2023-10-14T08:52:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4547c440 con 0x55de4546c5d0 2023-10-14T08:52:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4547c5d0 con 0x55de4546b730 2023-10-14T08:52:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 10 client.0 _ll_register_callbacks cb 0x7fac4c099b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 0x55de4547bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 0x55de4547bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60640/0 (socket says 172.21.15.6:60640) 2023-10-14T08:52:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 -- 172.21.15.6:0/4136326510 learned_addr learned my addr 172.21.15.6:0/4136326510 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac599f4700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546c5d0 0x55de45478df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac589f2700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de454788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 -- 172.21.15.6:0/4136326510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 msgr2=0x55de454788b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de454788b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 -- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546c5d0 msgr2=0x55de45478df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546c5d0 0x55de45478df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 -- 172.21.15.6:0/4136326510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de451e8d90 con 0x55de4546add0 2023-10-14T08:52:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac599f4700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546c5d0 0x55de45478df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac589f2700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de454788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac591f3700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 0x55de4547bdc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac440099c0 tx=0x7fac44009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89426a05a975ce6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac3cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac3cff9700 1 -- 172.21.15.6:0/4136326510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4401d040 con 0x55de4546add0 2023-10-14T08:52:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac3cff9700 1 -- 172.21.15.6:0/4136326510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fac44031280 con 0x55de4546add0 2023-10-14T08:52:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac4c09de70 con 0x55de4546add0 2023-10-14T08:52:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.614+0000 7fac3cff9700 1 -- 172.21.15.6:0/4136326510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac44031440 con 0x55de4546add0 2023-10-14T08:52:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 10 client.15237 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55de4520f200 con 0x55de4546add0 2023-10-14T08:52:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac3cff9700 1 -- 172.21.15.6:0/4136326510 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac4c09de70 con 0x55de4546add0 2023-10-14T08:52:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac3cff9700 1 -- 172.21.15.6:0/4136326510 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fac44023650 con 0x55de4546add0 2023-10-14T08:52:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 10 client.15237 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 10 client.15237 resolve_mds: resolved name 'k' to daemon mds.k 2023-10-14T08:52:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 20 client.15237 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:35.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de454d8fc0 0x55de454d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 4 client.15237 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:35.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55de453b6e00 con 0x55de454d8fc0 2023-10-14T08:52:35.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.615+0000 7fac589f2700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de454d8fc0 0x55de454d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac3cff9700 10 client.15237 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:35.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac589f2700 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de454d8fc0 0x55de454d5440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=164bf04bcdeab27e server_cookie=11c4fb0def690fed in_seq=0 out_seq=0 2023-10-14T08:52:35.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac3cff9700 1 -- 172.21.15.6:0/4136326510 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55de453b6e00 con 0x55de454d8fc0 2023-10-14T08:52:35.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac3cff9700 10 client.15237 handle_command_reply: tid=0 2023-10-14T08:52:35.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 client.15237 shutdown 2023-10-14T08:52:35.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 msgr2=0x55de4547bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 0x55de4547bdc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac440099c0 tx=0x7fac44009310 comp rx=0 tx=0).stop 2023-10-14T08:52:35.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 shutdown_connections 2023-10-14T08:52:35.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55de454d8fc0 0x55de454d5440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de4546c5d0 0x55de45478df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac3cff9700 0 client.15237 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:52:35.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de4546add0 0x55de4547bdc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 --2- 172.21.15.6:0/4136326510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de4546b730 0x55de454788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 >> 172.21.15.6:0/4136326510 conn(0x55de45398d80 msgr2=0x55de4547ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 shutdown_connections 2023-10-14T08:52:35.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 1 -- 172.21.15.6:0/4136326510 wait complete. 2023-10-14T08:52:35.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.616+0000 7fac67641b80 20 client.15237 trim_cache size 0 max 16384 2023-10-14T08:52:35.640 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:35.640 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:35.641 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2023-10-14T08:52:35.641 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24434, 2023-10-14T08:52:35.641 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:35.641 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:35.641 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:35.641 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 72.474383560000007, 2023-10-14T08:52:35.642 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:35.642 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:35.642 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:35.642 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 106.44690215 2023-10-14T08:52:35.642 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:35.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac400a1480 msgr2=0x7fac400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac400a1480 0x7fac400a3940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac44009990 tx=0x7fac4401a040 comp rx=0 tx=0).stop 2023-10-14T08:52:35.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 msgr2=0x7fac5419e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 0x7fac5419e1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00ef30 tx=0x7fac4c00c450 comp rx=0 tx=0).stop 2023-10-14T08:52:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 shutdown_connections 2023-10-14T08:52:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac54102b40 0x7fac5419e1a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac54100fb0 0x7fac54196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fac400a1480 0x7fac400a3940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 --2- 172.21.15.6:0/3404091128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac541021a0 0x7fac54197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 >> 172.21.15.6:0/3404091128 conn(0x7fac540fc520 msgr2=0x7fac54105630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 shutdown_connections 2023-10-14T08:52:35.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.617+0000 7fac5b457700 1 -- 172.21.15.6:0/3404091128 wait complete. 2023-10-14T08:52:35.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-10-14T08:52:35.647 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:35 smithi178 ceph-mon[103612]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-14T08:52:35.647 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:35 smithi178 ceph-mon[103612]: mgrmap e18: x(active, since 7m), standbys: y, z 2023-10-14T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:35 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1294860397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:35 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3762559312' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:35.648 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:35 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2009079026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:35.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3097154218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 msgr2=0x7fbd78107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3097154218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd78107a60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000b0d0 tx=0x7fbd7000b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3097154218 shutdown_connections 2023-10-14T08:52:35.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3097154218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd78107a60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3097154218 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 0x7fbd780ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3097154218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd78100810 0x7fbd78100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3097154218 >> 172.21.15.6:0/3097154218 conn(0x7fbd780fab90 msgr2=0x7fbd780fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3097154218 shutdown_connections 2023-10-14T08:52:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.773+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3097154218 wait complete. 2023-10-14T08:52:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 Processor -- start 2023-10-14T08:52:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 -- start start 2023-10-14T08:52:35.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 0x7fbd78198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd78100810 0x7fbd78199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd781a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd781a0ac0 con 0x7fbd781011b0 2023-10-14T08:52:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd781a0c00 con 0x7fbd780ff620 2023-10-14T08:52:35.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7cc55700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd781a0d90 con 0x7fbd78100810 2023-10-14T08:52:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd781a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd781a04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60658/0 (socket says 172.21.15.6:60658) 2023-10-14T08:52:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 -- 172.21.15.6:0/3773504354 learned_addr learned my addr 172.21.15.6:0/3773504354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd78100810 0x7fbd78199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7659c700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 0x7fbd78198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 -- 172.21.15.6:0/3773504354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd78100810 msgr2=0x7fbd78199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd78100810 0x7fbd78199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 -- 172.21.15.6:0/3773504354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 msgr2=0x7fbd78198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 0x7fbd78198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 -- 172.21.15.6:0/3773504354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009d00 con 0x7fbd781011b0 2023-10-14T08:52:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd7659c700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 0x7fbd78198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:35.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd781a04f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbd70008f10 tx=0x7fbd70008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.774+0000 7fbd677fe700 1 -- 172.21.15.6:0/3773504354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7000e040 con 0x7fbd781011b0 2023-10-14T08:52:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.775+0000 7fbd677fe700 1 -- 172.21.15.6:0/3773504354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7000be60 con 0x7fbd781011b0 2023-10-14T08:52:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.775+0000 7fbd677fe700 1 -- 172.21.15.6:0/3773504354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7001b6a0 con 0x7fbd781011b0 2023-10-14T08:52:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.775+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd781a1010 con 0x7fbd781011b0 2023-10-14T08:52:35.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.775+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd781a13e0 con 0x7fbd781011b0 2023-10-14T08:52:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.777+0000 7fbd677fe700 1 -- 172.21.15.6:0/3773504354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbd70024410 con 0x7fbd781011b0 2023-10-14T08:52:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.777+0000 7fbd677fe700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd600a1500 0x7fbd600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.777+0000 7fbd7659c700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd600a1500 0x7fbd600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.777+0000 7fbd677fe700 1 -- 172.21.15.6:0/3773504354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd700cdea0 con 0x7fbd781011b0 2023-10-14T08:52:35.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd7659c700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd600a1500 0x7fbd600a39c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd68005950 tx=0x7fbd680058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 Processor -- start 2023-10-14T08:52:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 -- start start 2023-10-14T08:52:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f05444a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 0x55f05444aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05444ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0543bec20 con 0x55f05444a730 2023-10-14T08:52:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0543a3c10 con 0x55f054449dd0 2023-10-14T08:52:35.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.778+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0543a1530 con 0x55f05444b5d0 2023-10-14T08:52:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 0x55f05444aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 0x55f05444aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60664/0 (socket says 172.21.15.6:60664) 2023-10-14T08:52:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 -- 172.21.15.6:0/131520116 learned_addr learned my addr 172.21.15.6:0/131520116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd7659c700 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f05444a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 -- 172.21.15.6:0/131520116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 msgr2=0x55f05444ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05444ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05444ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 -- 172.21.15.6:0/131520116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 msgr2=0x55f05444a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f05444a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 -- 172.21.15.6:0/131520116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f05435a3a0 con 0x55f05444a730 2023-10-14T08:52:35.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05444ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 0x55f05444aff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009d80 tx=0x7fbd6c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52558d5f943f6dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd64ff9700 1 -- 172.21.15.6:0/131520116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c004230 con 0x55f05444a730 2023-10-14T08:52:35.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd64ff9700 1 -- 172.21.15.6:0/131520116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd6c004390 con 0x55f05444a730 2023-10-14T08:52:35.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.779+0000 7fbd64ff9700 1 -- 172.21.15.6:0/131520116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c019860 con 0x55f05444a730 2023-10-14T08:52:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/131520116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 msgr2=0x55f05444aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 0x55f05444aff0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009d80 tx=0x7fbd6c011720 comp rx=0 tx=0).stop 2023-10-14T08:52:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/131520116 shutdown_connections 2023-10-14T08:52:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05444ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f05444a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/131520116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444a730 0x55f05444aff0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/131520116 >> 172.21.15.6:0/131520116 conn(0x55f054377d80 msgr2=0x55f054444f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/131520116 shutdown_connections 2023-10-14T08:52:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/131520116 wait complete. 2023-10-14T08:52:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 -- start start 2023-10-14T08:52:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.780+0000 7fbd88e3fb80 1 Processor -- start 2023-10-14T08:52:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054453bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f054454130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05445b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05439ce20 con 0x55f05444b5d0 2023-10-14T08:52:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0543396c0 con 0x55f054449dd0 2023-10-14T08:52:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054339360 con 0x55f05444a730 2023-10-14T08:52:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 10 client.0 _ll_register_callbacks cb 0x55f0541967b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05445b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05445b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60672/0 (socket says 172.21.15.6:60672) 2023-10-14T08:52:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1771373888 learned_addr learned my addr 172.21.15.6:0/1771373888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd7659c700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054453bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1771373888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 msgr2=0x55f054454130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f054454130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f054454130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 msgr2=0x55f054453bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054453bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1771373888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c0099e0 con 0x55f05444b5d0 2023-10-14T08:52:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd7659c700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054453bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f054454130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05445b170 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbd70097cc0 tx=0x7fbd70005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2832d7f5a70f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd5dffb700 1 -- 172.21.15.6:0/1771373888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7009b250 con 0x55f05444b5d0 2023-10-14T08:52:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd5dffb700 1 -- 172.21.15.6:0/1771373888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd7009f3a0 con 0x55f05444b5d0 2023-10-14T08:52:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0543a1ea0 con 0x55f05444b5d0 2023-10-14T08:52:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.781+0000 7fbd5dffb700 1 -- 172.21.15.6:0/1771373888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd700a3550 con 0x55f05444b5d0 2023-10-14T08:52:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 10 client.15249 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f0541c7d90 con 0x55f05444b5d0 2023-10-14T08:52:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd5dffb700 1 -- 172.21.15.6:0/1771373888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f0543a1ea0 con 0x55f05444b5d0 2023-10-14T08:52:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd5dffb700 1 -- 172.21.15.6:0/1771373888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd700a30c0 con 0x55f05444b5d0 2023-10-14T08:52:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 10 client.15249 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-14T08:52:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 20 client.15249 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f05445f490 0x55f05445e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 4 client.15249 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f054419bc0 con 0x55f05445f490 2023-10-14T08:52:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.782+0000 7fbd7659c700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f05445f490 0x55f05445e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.783+0000 7fbd5dffb700 10 client.15249 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.783+0000 7fbd7659c700 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f05445f490 0x55f05445e010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e97d8b813cb117ed server_cookie=52cd0753da0575d0 in_seq=0 out_seq=0 2023-10-14T08:52:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.783+0000 7fbd5dffb700 1 -- 172.21.15.6:0/1771373888 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f054419bc0 con 0x55f05445f490 2023-10-14T08:52:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.783+0000 7fbd5dffb700 10 client.15249 handle_command_reply: tid=0 2023-10-14T08:52:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.783+0000 7fbd88e3fb80 1 client.15249 shutdown 2023-10-14T08:52:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 msgr2=0x55f05445b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05445b170 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbd70097cc0 tx=0x7fbd70005690 comp rx=0 tx=0).stop 2023-10-14T08:52:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 shutdown_connections 2023-10-14T08:52:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f05445f490 0x55f05445e010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05445b170 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054453bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd5dffb700 0 client.15249 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1771373888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f054454130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 >> 172.21.15.6:0/1771373888 conn(0x55f054377d80 msgr2=0x55f054444ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 shutdown_connections 2023-10-14T08:52:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1771373888 wait complete. 2023-10-14T08:52:35.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.784+0000 7fbd88e3fb80 20 client.15249 trim_cache size 0 max 16384 2023-10-14T08:52:35.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.801+0000 7fbd88e3fb80 1 Processor -- start 2023-10-14T08:52:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.801+0000 7fbd88e3fb80 1 -- start start 2023-10-14T08:52:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054451960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f05445b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05444e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0544537c0 con 0x55f05444b5d0 2023-10-14T08:52:35.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05421d8d0 con 0x55f054449dd0 2023-10-14T08:52:35.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f054419bc0 con 0x55f05444a730 2023-10-14T08:52:35.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05444e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05444e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60680/0 (socket says 172.21.15.6:60680) 2023-10-14T08:52:35.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1319635965 learned_addr learned my addr 172.21.15.6:0/1319635965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd7659c700 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054451960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f05445b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1319635965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 msgr2=0x55f05445b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f05445b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1319635965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 msgr2=0x55f054451960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054451960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 -- 172.21.15.6:0/1319635965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0541b0c10 con 0x55f05444b5d0 2023-10-14T08:52:35.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f05445b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:35.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05444e4a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009fd0 tx=0x7fbd70099800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfdf70c40d53ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd657fa700 1 -- 172.21.15.6:0/1319635965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd700246c0 con 0x55f05444b5d0 2023-10-14T08:52:35.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd657fa700 1 -- 172.21.15.6:0/1319635965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd700a1150 con 0x55f05444b5d0 2023-10-14T08:52:35.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.802+0000 7fbd657fa700 1 -- 172.21.15.6:0/1319635965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7009f040 con 0x55f05444b5d0 2023-10-14T08:52:35.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1319635965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 msgr2=0x55f05444e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05444e4a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009fd0 tx=0x7fbd70099800 comp rx=0 tx=0).stop 2023-10-14T08:52:35.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1319635965 shutdown_connections 2023-10-14T08:52:35.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f05444b5d0 0x55f05444e4a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f054449dd0 0x55f054451960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/1319635965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444a730 0x55f05445b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1319635965 >> 172.21.15.6:0/1319635965 conn(0x55f054377d80 msgr2=0x55f054443750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1319635965 shutdown_connections 2023-10-14T08:52:35.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/1319635965 wait complete. 2023-10-14T08:52:35.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 -- start start 2023-10-14T08:52:35.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.803+0000 7fbd88e3fb80 1 Processor -- start 2023-10-14T08:52:35.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 0x55f054458160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05444a730 0x55f05445a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05445ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05445b3c0 con 0x55f054449dd0 2023-10-14T08:52:35.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f05445b530 con 0x55f05444a730 2023-10-14T08:52:35.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0544b2f00 con 0x55f05444b5d0 2023-10-14T08:52:35.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 10 client.0 _ll_register_callbacks cb 0x7fbd7009ad90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:35.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 0x55f054458160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 0x55f054458160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60682/0 (socket says 172.21.15.6:60682) 2023-10-14T08:52:35.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 -- 172.21.15.6:0/4252762071 learned_addr learned my addr 172.21.15.6:0/4252762071 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05444a730 0x55f05445a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd76d9d700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05445ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 -- 172.21.15.6:0/4252762071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 msgr2=0x55f05445ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05445ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 -- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05444a730 msgr2=0x55f05445a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05444a730 0x55f05445a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 -- 172.21.15.6:0/4252762071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0541c7d90 con 0x55f054449dd0 2023-10-14T08:52:35.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05444a730 0x55f05445a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:35.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd7659c700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 0x55f054458160 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55f0544601c0 tx=0x7fbd680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fcfb2e51ac7dcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:35.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd5dffb700 1 -- 172.21.15.6:0/4252762071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68025040 con 0x55f054449dd0 2023-10-14T08:52:35.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd5dffb700 1 -- 172.21.15.6:0/4252762071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd68004220 con 0x55f054449dd0 2023-10-14T08:52:35.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.804+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd6c004390 con 0x55f054449dd0 2023-10-14T08:52:35.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd5dffb700 1 -- 172.21.15.6:0/4252762071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd68028e70 con 0x55f054449dd0 2023-10-14T08:52:35.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 10 client.15255 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:35.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f0541ee200 con 0x55f054449dd0 2023-10-14T08:52:35.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd5dffb700 1 -- 172.21.15.6:0/4252762071 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd6c004390 con 0x55f054449dd0 2023-10-14T08:52:35.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd5dffb700 1 -- 172.21.15.6:0/4252762071 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd68020440 con 0x55f054449dd0 2023-10-14T08:52:35.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 10 client.15255 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:35.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 10 client.15255 resolve_mds: resolved name 'e' to daemon mds.e 2023-10-14T08:52:35.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 20 client.15255 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:35.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f0544b81e0 0x55f0544b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 4 client.15255 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:35.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f054395e00 con 0x55f0544b81e0 2023-10-14T08:52:35.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.805+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f0544b81e0 0x55f0544b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd5dffb700 10 client.15255 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:35.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd75d9b700 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f0544b81e0 0x55f0544b4660 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=39b727e6685d3aa1 server_cookie=7ef48c3bd675ccd in_seq=0 out_seq=0 2023-10-14T08:52:35.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd5dffb700 1 -- 172.21.15.6:0/4252762071 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f054395e00 con 0x55f0544b81e0 2023-10-14T08:52:35.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd5dffb700 10 client.15255 handle_command_reply: tid=0 2023-10-14T08:52:35.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 client.15255 shutdown 2023-10-14T08:52:35.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 msgr2=0x55f054458160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 0x55f054458160 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55f0544601c0 tx=0x7fbd680047c0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 shutdown_connections 2023-10-14T08:52:35.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55f0544b81e0 0x55f0544b4660 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f05444b5d0 0x55f05445ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd5dffb700 0 client.15255 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:52:35.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f054449dd0 0x55f054458160 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 --2- 172.21.15.6:0/4252762071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f05444a730 0x55f05445a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 >> 172.21.15.6:0/4252762071 conn(0x55f054377d80 msgr2=0x55f054451960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 shutdown_connections 2023-10-14T08:52:35.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 1 -- 172.21.15.6:0/4252762071 wait complete. 2023-10-14T08:52:35.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.806+0000 7fbd88e3fb80 20 client.15255 trim_cache size 0 max 16384 2023-10-14T08:52:35.836 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:35.836 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:35.836 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2023-10-14T08:52:35.836 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24455, 2023-10-14T08:52:35.836 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:35.837 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:35.837 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:35.837 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 73.672505321000003, 2023-10-14T08:52:35.837 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:35.838 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:35.838 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:35.838 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 99.912275602999998 2023-10-14T08:52:35.838 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:35.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd600a1500 msgr2=0x7fbd600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd600a1500 0x7fbd600a39c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd68005950 tx=0x7fbd680058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 msgr2=0x7fbd781a04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd781a04f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbd70008f10 tx=0x7fbd70008f40 comp rx=0 tx=0).stop 2023-10-14T08:52:35.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 shutdown_connections 2023-10-14T08:52:35.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd781011b0 0x7fbd781a04f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd600a1500 0x7fbd600a39c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd780ff620 0x7fbd78198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 --2- 172.21.15.6:0/3773504354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd78100810 0x7fbd78199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 >> 172.21.15.6:0/3773504354 conn(0x7fbd780fab90 msgr2=0x7fbd781083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 shutdown_connections 2023-10-14T08:52:35.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.807+0000 7fbd7cc55700 1 -- 172.21.15.6:0/3773504354 wait complete. 2023-10-14T08:52:35.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-14T08:52:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3846912786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44106d20 msgr2=0x7f5d44109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3846912786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44106d20 0x7f5d44109110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00b0a0 tx=0x7f5d3c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3846912786 shutdown_connections 2023-10-14T08:52:35.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3846912786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44106d20 0x7f5d44109110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3846912786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d44101ac0 0x7f5d44103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3846912786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d441043f0 0x7f5d441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3846912786 >> 172.21.15.6:0/3846912786 conn(0x7f5d440fb410 msgr2=0x7f5d440fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3846912786 shutdown_connections 2023-10-14T08:52:35.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3846912786 wait complete. 2023-10-14T08:52:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 Processor -- start 2023-10-14T08:52:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.969+0000 7f5d4b06f700 1 -- start start 2023-10-14T08:52:35.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 0x7f5d44196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d441043f0 0x7f5d441972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d44106d20 0x7f5d4419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4419e8f0 con 0x7f5d44101ac0 2023-10-14T08:52:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4419ea30 con 0x7f5d441043f0 2023-10-14T08:52:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4419ebc0 con 0x7f5d44106d20 2023-10-14T08:52:35.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 0x7f5d44196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 0x7f5d44196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60696/0 (socket says 172.21.15.6:60696) 2023-10-14T08:52:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 -- 172.21.15.6:0/3887083627 learned_addr learned my addr 172.21.15.6:0/3887083627 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d43fff700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d441043f0 0x7f5d441972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4960c700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d44106d20 0x7f5d4419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 -- 172.21.15.6:0/3887083627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d44106d20 msgr2=0x7f5d4419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d44106d20 0x7f5d4419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 -- 172.21.15.6:0/3887083627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d441043f0 msgr2=0x7f5d441972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d441043f0 0x7f5d441972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 -- 172.21.15.6:0/3887083627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009d00 con 0x7f5d44101ac0 2023-10-14T08:52:35.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 0x7f5d44196d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800d950 tx=0x7f5d3800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d41ffb700 1 -- 172.21.15.6:0/3887083627 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38009940 con 0x7f5d44101ac0 2023-10-14T08:52:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d41ffb700 1 -- 172.21.15.6:0/3887083627 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d38010460 con 0x7f5d44101ac0 2023-10-14T08:52:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4419eea0 con 0x7f5d44101ac0 2023-10-14T08:52:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.970+0000 7f5d41ffb700 1 -- 172.21.15.6:0/3887083627 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800f620 con 0x7f5d44101ac0 2023-10-14T08:52:35.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.971+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4419f2d0 con 0x7f5d44101ac0 2023-10-14T08:52:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.973+0000 7f5d41ffb700 1 -- 172.21.15.6:0/3887083627 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5d380108d0 con 0x7f5d44101ac0 2023-10-14T08:52:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.973+0000 7f5d41ffb700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5d340a1500 0x7f5d340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.973+0000 7f5d41ffb700 1 -- 172.21.15.6:0/3887083627 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5d380ccad0 con 0x7f5d44101ac0 2023-10-14T08:52:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.973+0000 7f5d43fff700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5d340a1500 0x7f5d340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.974+0000 7f5d43fff700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5d340a1500 0x7f5d340a39c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009c60 tx=0x7f5d30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.974+0000 7f5d57259b80 1 Processor -- start 2023-10-14T08:52:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.974+0000 7f5d57259b80 1 -- start start 2023-10-14T08:52:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 0x558ff85c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c65d0 0x558ff85c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d57259b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff8539c20 con 0x558ff85c5730 2023-10-14T08:52:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d57259b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff851ec10 con 0x558ff85c65d0 2023-10-14T08:52:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d57259b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff851c530 con 0x558ff85c4dd0 2023-10-14T08:52:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 0x558ff85c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 0x558ff85c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60706/0 (socket says 172.21.15.6:60706) 2023-10-14T08:52:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 -- 172.21.15.6:0/325647911 learned_addr learned my addr 172.21.15.6:0/325647911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 -- 172.21.15.6:0/325647911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 msgr2=0x558ff85c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 -- 172.21.15.6:0/325647911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c65d0 msgr2=0x558ff85c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c65d0 0x558ff85c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 -- 172.21.15.6:0/325647911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff84d53a0 con 0x558ff85c5730 2023-10-14T08:52:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d43fff700 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 0x558ff85c5ff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d30004140 tx=0x7f5d30014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b1e5a661f6524 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d2effd700 1 -- 172.21.15.6:0/325647911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30003b10 con 0x558ff85c5730 2023-10-14T08:52:35.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d2effd700 1 -- 172.21.15.6:0/325647911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d30004cf0 con 0x558ff85c5730 2023-10-14T08:52:35.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.975+0000 7f5d2effd700 1 -- 172.21.15.6:0/325647911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30005700 con 0x558ff85c5730 2023-10-14T08:52:35.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 -- 172.21.15.6:0/325647911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 msgr2=0x558ff85c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:35.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 0x558ff85c5ff0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d30004140 tx=0x7f5d30014000 comp rx=0 tx=0).stop 2023-10-14T08:52:35.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 -- 172.21.15.6:0/325647911 shutdown_connections 2023-10-14T08:52:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c65d0 0x558ff85c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 --2- 172.21.15.6:0/325647911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c5730 0x558ff85c5ff0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 -- 172.21.15.6:0/325647911 >> 172.21.15.6:0/325647911 conn(0x558ff84f2d80 msgr2=0x558ff85bff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 -- 172.21.15.6:0/325647911 shutdown_connections 2023-10-14T08:52:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 -- 172.21.15.6:0/325647911 wait complete. 2023-10-14T08:52:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 -- start start 2023-10-14T08:52:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.976+0000 7f5d57259b80 1 Processor -- start 2023-10-14T08:52:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff85d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff8517e20 con 0x558ff85c65d0 2023-10-14T08:52:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff84b46c0 con 0x558ff85c5730 2023-10-14T08:52:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff84b4360 con 0x558ff85c4dd0 2023-10-14T08:52:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d57259b80 10 client.0 _ll_register_callbacks cb 0x558ff83117b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:35.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff85d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff85d6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60714/0 (socket says 172.21.15.6:60714) 2023-10-14T08:52:35.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 -- 172.21.15.6:0/974469301 learned_addr learned my addr 172.21.15.6:0/974469301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:35.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d43fff700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:35.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 -- 172.21.15.6:0/974469301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 msgr2=0x558ff85cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 -- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 msgr2=0x558ff85cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:35.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:35.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 -- 172.21.15.6:0/974469301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d30017070 con 0x558ff85c65d0 2023-10-14T08:52:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d4960c700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff85d6200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0060b0 tx=0x7f5d3c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfccd66742f317d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.977+0000 7f5d23fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d23fff700 1 -- 172.21.15.6:0/974469301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00e040 con 0x558ff85c65d0 2023-10-14T08:52:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d23fff700 1 -- 172.21.15.6:0/974469301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5d3c004a50 con 0x558ff85c65d0 2023-10-14T08:52:35.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ff851cea0 con 0x558ff85c65d0 2023-10-14T08:52:36.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d23fff700 1 -- 172.21.15.6:0/974469301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d3c004c10 con 0x558ff85c65d0 2023-10-14T08:52:36.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 10 client.15267 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:36.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558ff8342d90 con 0x558ff85c65d0 2023-10-14T08:52:36.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d23fff700 1 -- 172.21.15.6:0/974469301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558ff851cea0 con 0x558ff85c65d0 2023-10-14T08:52:36.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d23fff700 1 -- 172.21.15.6:0/974469301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5d3c019040 con 0x558ff85c65d0 2023-10-14T08:52:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 10 client.15267 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-14T08:52:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 20 client.15267 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff85d9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 4 client.15267 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ff8594bc0 con 0x558ff85da8a0 2023-10-14T08:52:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.978+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff85d9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.979+0000 7f5d23fff700 10 client.15267 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:36.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.979+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff85d9300 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c586999cf98a2d5 server_cookie=83106235c50015f2 in_seq=0 out_seq=0 2023-10-14T08:52:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d23fff700 1 -- 172.21.15.6:0/974469301 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558ff8594bc0 con 0x558ff85da8a0 2023-10-14T08:52:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d23fff700 10 client.15267 handle_command_reply: tid=0 2023-10-14T08:52:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 client.15267 shutdown 2023-10-14T08:52:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 msgr2=0x558ff85d6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff85d6200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0060b0 tx=0x7f5d3c007780 comp rx=0 tx=0).stop 2023-10-14T08:52:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 shutdown_connections 2023-10-14T08:52:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff85d9300 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff85d6200 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d23fff700 0 client.15267 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:36.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 --2- 172.21.15.6:0/974469301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 >> 172.21.15.6:0/974469301 conn(0x558ff84f2d80 msgr2=0x558ff85bfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 shutdown_connections 2023-10-14T08:52:36.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 1 -- 172.21.15.6:0/974469301 wait complete. 2023-10-14T08:52:36.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.980+0000 7f5d57259b80 20 client.15267 trim_cache size 0 max 16384 2023-10-14T08:52:36.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 Processor -- start 2023-10-14T08:52:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 -- start start 2023-10-14T08:52:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 0x558ff85cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c65d0 0x558ff85c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff83988d0 con 0x558ff85c4dd0 2023-10-14T08:52:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff85190b0 con 0x558ff85c5730 2023-10-14T08:52:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d57259b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff8513f10 con 0x558ff85c65d0 2023-10-14T08:52:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 0x558ff85cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 0x558ff85cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60718/0 (socket says 172.21.15.6:60718) 2023-10-14T08:52:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 -- 172.21.15.6:0/849691626 learned_addr learned my addr 172.21.15.6:0/849691626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d4960c700 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c65d0 0x558ff85c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 -- 172.21.15.6:0/849691626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c65d0 msgr2=0x558ff85c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c65d0 0x558ff85c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d43fff700 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 -- 172.21.15.6:0/849691626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 msgr2=0x558ff85d6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 -- 172.21.15.6:0/849691626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff832bc10 con 0x558ff85c4dd0 2023-10-14T08:52:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.998+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 0x558ff85cc9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5d38096860 tx=0x7f5d38005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820533de3f0de915 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d2f7fe700 1 -- 172.21.15.6:0/849691626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38098190 con 0x558ff85c4dd0 2023-10-14T08:52:36.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d2f7fe700 1 -- 172.21.15.6:0/849691626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d3809a050 con 0x558ff85c4dd0 2023-10-14T08:52:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d2f7fe700 1 -- 172.21.15.6:0/849691626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380995b0 con 0x558ff85c4dd0 2023-10-14T08:52:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 -- 172.21.15.6:0/849691626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 msgr2=0x558ff85cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 0x558ff85cc9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5d38096860 tx=0x7f5d38005910 comp rx=0 tx=0).stop 2023-10-14T08:52:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 -- 172.21.15.6:0/849691626 shutdown_connections 2023-10-14T08:52:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c65d0 0x558ff85c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c4dd0 0x558ff85cc9d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 --2- 172.21.15.6:0/849691626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 -- 172.21.15.6:0/849691626 >> 172.21.15.6:0/849691626 conn(0x558ff84f2d80 msgr2=0x558ff85bf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 -- 172.21.15.6:0/849691626 shutdown_connections 2023-10-14T08:52:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 -- 172.21.15.6:0/849691626 wait complete. 2023-10-14T08:52:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:35.999+0000 7f5d57259b80 1 -- start start 2023-10-14T08:52:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 Processor -- start 2023-10-14T08:52:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff862e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff85d61e0 con 0x558ff85c65d0 2023-10-14T08:52:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff85d6350 con 0x558ff85c5730 2023-10-14T08:52:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff85d6510 con 0x558ff85c4dd0 2023-10-14T08:52:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d57259b80 10 client.0 _ll_register_callbacks cb 0x7f5d30005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff862e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff862e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60726/0 (socket says 172.21.15.6:60726) 2023-10-14T08:52:36.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 -- 172.21.15.6:0/2211272026 learned_addr learned my addr 172.21.15.6:0/2211272026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d43fff700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 -- 172.21.15.6:0/2211272026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 msgr2=0x558ff85d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 -- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 msgr2=0x558ff85d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d4960c700 1 -- 172.21.15.6:0/2211272026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4419f2d0 con 0x558ff85c65d0 2023-10-14T08:52:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.000+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d4960c700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff862e290 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c007520 tx=0x7f5d3c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef4fb0e8f4d16ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d23fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d23fff700 1 -- 172.21.15.6:0/2211272026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c00e040 con 0x558ff85c65d0 2023-10-14T08:52:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d23fff700 1 -- 172.21.15.6:0/2211272026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5d3c0060e0 con 0x558ff85c65d0 2023-10-14T08:52:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d30004cf0 con 0x558ff85c65d0 2023-10-14T08:52:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d23fff700 1 -- 172.21.15.6:0/2211272026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d3c005a10 con 0x558ff85c65d0 2023-10-14T08:52:36.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 10 client.15273 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:36.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558ff8369200 con 0x558ff85c65d0 2023-10-14T08:52:36.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d23fff700 1 -- 172.21.15.6:0/2211272026 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d30004cf0 con 0x558ff85c65d0 2023-10-14T08:52:36.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d23fff700 1 -- 172.21.15.6:0/2211272026 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5d3c00b420 con 0x558ff85c65d0 2023-10-14T08:52:36.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 10 client.15273 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:36.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 10 client.15273 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-14T08:52:36.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 20 client.15273 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:36.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff862f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 4 client.15273 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:36.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ff8510e00 con 0x558ff85da8a0 2023-10-14T08:52:36.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.001+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff862f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d23fff700 10 client.15273 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d48e0b700 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff862f940 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdb5760d31dfd830 server_cookie=54a8ea6268c58569 in_seq=0 out_seq=0 2023-10-14T08:52:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d23fff700 1 -- 172.21.15.6:0/2211272026 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x558ff8510e00 con 0x558ff85da8a0 2023-10-14T08:52:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d23fff700 10 client.15273 handle_command_reply: tid=0 2023-10-14T08:52:36.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 client.15273 shutdown 2023-10-14T08:52:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 msgr2=0x558ff862e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff862e290 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c007520 tx=0x7f5d3c005770 comp rx=0 tx=0).stop 2023-10-14T08:52:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 shutdown_connections 2023-10-14T08:52:36.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x558ff85da8a0 0x558ff862f940 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ff85c65d0 0x558ff862e290 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558ff85c4dd0 0x558ff85d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 --2- 172.21.15.6:0/2211272026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558ff85c5730 0x558ff85d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d23fff700 0 client.15273 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:52:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 >> 172.21.15.6:0/2211272026 conn(0x558ff84f2d80 msgr2=0x558ff85c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 shutdown_connections 2023-10-14T08:52:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.002+0000 7f5d57259b80 1 -- 172.21.15.6:0/2211272026 wait complete. 2023-10-14T08:52:36.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d57259b80 20 client.15273 trim_cache size 0 max 16384 2023-10-14T08:52:36.029 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:36.029 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:36.029 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2023-10-14T08:52:36.029 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24473, 2023-10-14T08:52:36.029 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:36.030 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:36.030 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:36.030 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 74.897395617000001, 2023-10-14T08:52:36.030 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:36.030 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:36.031 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:36.031 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 93.252553672999994 2023-10-14T08:52:36.031 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:36.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5d340a1500 msgr2=0x7f5d340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5d340a1500 0x7f5d340a39c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009c60 tx=0x7f5d30009260 comp rx=0 tx=0).stop 2023-10-14T08:52:36.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 msgr2=0x7f5d44196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 0x7f5d44196d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800d950 tx=0x7f5d3800dc60 comp rx=0 tx=0).stop 2023-10-14T08:52:36.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 shutdown_connections 2023-10-14T08:52:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d44106d20 0x7f5d4419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d44101ac0 0x7f5d44196d70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5d340a1500 0x7f5d340a39c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 --2- 172.21.15.6:0/3887083627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d441043f0 0x7f5d441972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 >> 172.21.15.6:0/3887083627 conn(0x7f5d440fb410 msgr2=0x7f5d44102730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 shutdown_connections 2023-10-14T08:52:36.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.003+0000 7f5d4b06f700 1 -- 172.21.15.6:0/3887083627 wait complete. 2023-10-14T08:52:36.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-14T08:52:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 -- 172.21.15.6:0/2271126566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 msgr2=0x7fcab01002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2271126566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab01002b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009990 tx=0x7fcaac009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 -- 172.21.15.6:0/2271126566 shutdown_connections 2023-10-14T08:52:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2271126566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab01019a0 0x7fcab01082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2271126566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab01002b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2271126566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 0x7fcab0101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.161+0000 7fcab7f10700 1 -- 172.21.15.6:0/2271126566 >> 172.21.15.6:0/2271126566 conn(0x7fcab00fb420 msgr2=0x7fcab00fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 -- 172.21.15.6:0/2271126566 shutdown_connections 2023-10-14T08:52:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 -- 172.21.15.6:0/2271126566 wait complete. 2023-10-14T08:52:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 Processor -- start 2023-10-14T08:52:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 -- start start 2023-10-14T08:52:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab0195ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 0x7fcab01960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab01019a0 0x7fcab019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab019d720 con 0x7fcab00ffe90 2023-10-14T08:52:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab019d860 con 0x7fcab01019a0 2023-10-14T08:52:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab7f10700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab019d9f0 con 0x7fcab0100fe0 2023-10-14T08:52:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab0195ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab0195ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60738/0 (socket says 172.21.15.6:60738) 2023-10-14T08:52:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.162+0000 7fcab5cac700 1 -- 172.21.15.6:0/2297066383 learned_addr learned my addr 172.21.15.6:0/2297066383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab54ab700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 0x7fcab01960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab64ad700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab01019a0 0x7fcab019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab5cac700 1 -- 172.21.15.6:0/2297066383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 msgr2=0x7fcab01960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab5cac700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 0x7fcab01960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab5cac700 1 -- 172.21.15.6:0/2297066383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab01019a0 msgr2=0x7fcab019d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab5cac700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab01019a0 0x7fcab019d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab5cac700 1 -- 172.21.15.6:0/2297066383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0095f0 con 0x7fcab00ffe90 2023-10-14T08:52:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab54ab700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 0x7fcab01960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab5cac700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab0195ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcaac005910 tx=0x7fcaac005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcaa6ffd700 1 -- 172.21.15.6:0/2297066383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac01d070 con 0x7fcab00ffe90 2023-10-14T08:52:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcaa6ffd700 1 -- 172.21.15.6:0/2297066383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaac004060 con 0x7fcab00ffe90 2023-10-14T08:52:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab019dc70 con 0x7fcab00ffe90 2023-10-14T08:52:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcaa6ffd700 1 -- 172.21.15.6:0/2297066383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac022e10 con 0x7fcab00ffe90 2023-10-14T08:52:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.163+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab019e0f0 con 0x7fcab00ffe90 2023-10-14T08:52:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.165+0000 7fcaa6ffd700 1 -- 172.21.15.6:0/2297066383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcaac022470 con 0x7fcab00ffe90 2023-10-14T08:52:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.166+0000 7fcaa6ffd700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fca9c0a1500 0x7fca9c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.166+0000 7fcab54ab700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fca9c0a1500 0x7fca9c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.167+0000 7fcaa6ffd700 1 -- 172.21.15.6:0/2297066383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcaac0ce0f0 con 0x7fcab00ffe90 2023-10-14T08:52:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.167+0000 7fcab54ab700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fca9c0a1500 0x7fca9c0a39c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0005950 tx=0x7fcaa00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.167+0000 7fcac40fab80 1 Processor -- start 2023-10-14T08:52:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.167+0000 7fcac40fab80 1 -- start start 2023-10-14T08:52:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf31559fe0 0x55cf3155a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 0x55cf3155b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155b7e0 0x55cf3155bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcac40fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf314ccc20 con 0x55cf3155a940 2023-10-14T08:52:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcac40fab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf314b1c10 con 0x55cf3155b7e0 2023-10-14T08:52:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcac40fab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf314af530 con 0x55cf31559fe0 2023-10-14T08:52:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 0x55cf3155b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 0x55cf3155b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60748/0 (socket says 172.21.15.6:60748) 2023-10-14T08:52:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 -- 172.21.15.6:0/4141534203 learned_addr learned my addr 172.21.15.6:0/4141534203 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab64ad700 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155b7e0 0x55cf3155bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab5cac700 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf31559fe0 0x55cf3155a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 -- 172.21.15.6:0/4141534203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf31559fe0 msgr2=0x55cf3155a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf31559fe0 0x55cf3155a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 -- 172.21.15.6:0/4141534203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155b7e0 msgr2=0x55cf3155bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155b7e0 0x55cf3155bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 -- 172.21.15.6:0/4141534203 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf314683a0 con 0x55cf3155a940 2023-10-14T08:52:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fcab54ab700 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 0x55cf3155b200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000ff00 tx=0x7fcaa0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772dab90d2008d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fca9bfff700 1 -- 172.21.15.6:0/4141534203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0017040 con 0x55cf3155a940 2023-10-14T08:52:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fca9bfff700 1 -- 172.21.15.6:0/4141534203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaa0003d40 con 0x55cf3155a940 2023-10-14T08:52:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.168+0000 7fca9bfff700 1 -- 172.21.15.6:0/4141534203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa001fd30 con 0x55cf3155a940 2023-10-14T08:52:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 -- 172.21.15.6:0/4141534203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 msgr2=0x55cf3155b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 0x55cf3155b200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000ff00 tx=0x7fcaa0012000 comp rx=0 tx=0).stop 2023-10-14T08:52:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 -- 172.21.15.6:0/4141534203 shutdown_connections 2023-10-14T08:52:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155b7e0 0x55cf3155bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf31559fe0 0x55cf3155a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4141534203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf3155a940 0x55cf3155b200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 -- 172.21.15.6:0/4141534203 >> 172.21.15.6:0/4141534203 conn(0x55cf31485d80 msgr2=0x55cf31552f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 -- 172.21.15.6:0/4141534203 shutdown_connections 2023-10-14T08:52:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.169+0000 7fcac40fab80 1 -- 172.21.15.6:0/4141534203 wait complete. 2023-10-14T08:52:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 -- start start 2023-10-14T08:52:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 Processor -- start 2023-10-14T08:52:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31563ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf315643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf314aae20 con 0x55cf31559fe0 2023-10-14T08:52:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf314476c0 con 0x55cf3155a940 2023-10-14T08:52:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf31447360 con 0x55cf3155b7e0 2023-10-14T08:52:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcac40fab80 10 client.0 _ll_register_callbacks cb 0x55cf312a47b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31563ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31563ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60752/0 (socket says 172.21.15.6:60752) 2023-10-14T08:52:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 -- 172.21.15.6:0/1085521451 learned_addr learned my addr 172.21.15.6:0/1085521451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab54ab700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf315643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab64ad700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 -- 172.21.15.6:0/1085521451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 msgr2=0x55cf3156b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 -- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 msgr2=0x55cf315643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf315643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab5cac700 1 -- 172.21.15.6:0/1085521451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa000fbe0 con 0x55cf31559fe0 2023-10-14T08:52:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab64ad700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.170+0000 7fcab54ab700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf315643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcab5cac700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31563ea0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0cbc20 tx=0x7fcaac0228b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7340e84587a0730e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fca997fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fca997fa700 1 -- 172.21.15.6:0/1085521451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac0a35a0 con 0x55cf31559fe0 2023-10-14T08:52:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fca997fa700 1 -- 172.21.15.6:0/1085521451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcaac09bc30 con 0x55cf31559fe0 2023-10-14T08:52:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf314afea0 con 0x55cf31559fe0 2023-10-14T08:52:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fca997fa700 1 -- 172.21.15.6:0/1085521451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaac09b530 con 0x55cf31559fe0 2023-10-14T08:52:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 10 client.15285 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cf312d5d90 con 0x55cf31559fe0 2023-10-14T08:52:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fca997fa700 1 -- 172.21.15.6:0/1085521451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cf314afea0 con 0x55cf31559fe0 2023-10-14T08:52:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fca997fa700 1 -- 172.21.15.6:0/1085521451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcaac0a1430 con 0x55cf31559fe0 2023-10-14T08:52:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T08:52:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 20 client.15285 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf3156f6a0 0x55cf3156e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 4 client.15285 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.171+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf31527bc0 con 0x55cf3156f6a0 2023-10-14T08:52:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.172+0000 7fcab54ab700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf3156f6a0 0x55cf3156e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.172+0000 7fca997fa700 10 client.15285 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.172+0000 7fcab54ab700 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf3156f6a0 0x55cf3156e350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af919ee044678fad server_cookie=f2b0200ec754bc69 in_seq=0 out_seq=0 2023-10-14T08:52:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fca997fa700 1 -- 172.21.15.6:0/1085521451 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cf31527bc0 con 0x55cf3156f6a0 2023-10-14T08:52:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fca997fa700 10 client.15285 handle_command_reply: tid=0 2023-10-14T08:52:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 client.15285 shutdown 2023-10-14T08:52:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 msgr2=0x55cf31563ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31563ea0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0cbc20 tx=0x7fcaac0228b0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 shutdown_connections 2023-10-14T08:52:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf3156f6a0 0x55cf3156e350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31563ea0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 --2- 172.21.15.6:0/1085521451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf315643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fca997fa700 0 client.15285 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 >> 172.21.15.6:0/1085521451 conn(0x55cf31485d80 msgr2=0x55cf31552ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 shutdown_connections 2023-10-14T08:52:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 1 -- 172.21.15.6:0/1085521451 wait complete. 2023-10-14T08:52:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.173+0000 7fcac40fab80 20 client.15285 trim_cache size 0 max 16384 2023-10-14T08:52:36.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 Processor -- start 2023-10-14T08:52:36.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 -- start start 2023-10-14T08:52:36.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf3156e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf3156e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf3132b8d0 con 0x55cf31559fe0 2023-10-14T08:52:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf314aae20 con 0x55cf3155a940 2023-10-14T08:52:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcac40fab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf31564c30 con 0x55cf3155b7e0 2023-10-14T08:52:36.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf3156e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf3156e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60760/0 (socket says 172.21.15.6:60760) 2023-10-14T08:52:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcab5cac700 1 -- 172.21.15.6:0/4197145906 learned_addr learned my addr 172.21.15.6:0/4197145906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.191+0000 7fcab54ab700 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf3156e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab64ad700 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab5cac700 1 -- 172.21.15.6:0/4197145906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 msgr2=0x55cf3156b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab5cac700 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab5cac700 1 -- 172.21.15.6:0/4197145906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 msgr2=0x55cf3156e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab5cac700 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf3156e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab5cac700 1 -- 172.21.15.6:0/4197145906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf31551a20 con 0x55cf31559fe0 2023-10-14T08:52:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab64ad700 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:36.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcab5cac700 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf3156e350 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcaac097fa0 tx=0x7fcaac099ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6f27180f235533 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcaa4ff9700 1 -- 172.21.15.6:0/4197145906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac09bc30 con 0x55cf31559fe0 2023-10-14T08:52:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcaa4ff9700 1 -- 172.21.15.6:0/4197145906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaac097040 con 0x55cf31559fe0 2023-10-14T08:52:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.192+0000 7fcaa4ff9700 1 -- 172.21.15.6:0/4197145906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac09f170 con 0x55cf31559fe0 2023-10-14T08:52:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- 172.21.15.6:0/4197145906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 msgr2=0x55cf3156e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf3156e350 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcaac097fa0 tx=0x7fcaac099ae0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- 172.21.15.6:0/4197145906 shutdown_connections 2023-10-14T08:52:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf3156b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf3156e350 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- 172.21.15.6:0/4197145906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf3156e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- 172.21.15.6:0/4197145906 >> 172.21.15.6:0/4197145906 conn(0x55cf31485d80 msgr2=0x55cf3155e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- 172.21.15.6:0/4197145906 shutdown_connections 2023-10-14T08:52:36.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- 172.21.15.6:0/4197145906 wait complete. 2023-10-14T08:52:36.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- start start 2023-10-14T08:52:36.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 Processor -- start 2023-10-14T08:52:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31568500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf31568a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf31569a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf3156d090 con 0x55cf31559fe0 2023-10-14T08:52:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf31564f30 con 0x55cf3155a940 2023-10-14T08:52:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.193+0000 7fcac40fab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf3151dd60 con 0x55cf3155b7e0 2023-10-14T08:52:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcac40fab80 10 client.0 _ll_register_callbacks cb 0x7fcaac09b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31568500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31568500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60766/0 (socket says 172.21.15.6:60766) 2023-10-14T08:52:36.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 -- 172.21.15.6:0/3345461847 learned_addr learned my addr 172.21.15.6:0/3345461847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab54ab700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf31568a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab64ad700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf31569a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 -- 172.21.15.6:0/3345461847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 msgr2=0x55cf31569a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf31569a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 -- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 msgr2=0x55cf31568a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf31568a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 -- 172.21.15.6:0/3345461847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf312d5d90 con 0x55cf31559fe0 2023-10-14T08:52:36.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab54ab700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf31568a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab64ad700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf31569a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:36.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcab5cac700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31568500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcaac09b4c0 tx=0x7fcaac0228b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bb54dd2c95f7b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fca997fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fca997fa700 1 -- 172.21.15.6:0/3345461847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac09f370 con 0x55cf31559fe0 2023-10-14T08:52:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fca997fa700 1 -- 172.21.15.6:0/3345461847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcaac0b9020 con 0x55cf31559fe0 2023-10-14T08:52:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaa0003d40 con 0x55cf31559fe0 2023-10-14T08:52:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fca997fa700 1 -- 172.21.15.6:0/3345461847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaac09bc30 con 0x55cf31559fe0 2023-10-14T08:52:36.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcac40fab80 10 client.15291 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cf312bec10 con 0x55cf31559fe0 2023-10-14T08:52:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.194+0000 7fca997fa700 1 -- 172.21.15.6:0/3345461847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaa0003d40 con 0x55cf31559fe0 2023-10-14T08:52:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fca997fa700 1 -- 172.21.15.6:0/3345461847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcaac09a700 con 0x55cf31559fe0 2023-10-14T08:52:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcac40fab80 10 client.15291 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcac40fab80 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-14T08:52:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcac40fab80 20 client.15291 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcac40fab80 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf315c80b0 0x55cf3156b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcac40fab80 4 client.15291 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cf314a3e00 con 0x55cf315c80b0 2023-10-14T08:52:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.195+0000 7fcab54ab700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf315c80b0 0x55cf3156b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fca997fa700 10 client.15291 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcab54ab700 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf315c80b0 0x55cf3156b060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eda82e2d424225eb server_cookie=62e0cef41ee45c33 in_seq=0 out_seq=0 2023-10-14T08:52:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fca997fa700 1 -- 172.21.15.6:0/3345461847 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cf314a3e00 con 0x55cf315c80b0 2023-10-14T08:52:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fca997fa700 10 client.15291 handle_command_reply: tid=0 2023-10-14T08:52:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 client.15291 shutdown 2023-10-14T08:52:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 msgr2=0x55cf31568500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31568500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcaac09b4c0 tx=0x7fcaac0228b0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 shutdown_connections 2023-10-14T08:52:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55cf315c80b0 0x55cf3156b060 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cf3155b7e0 0x55cf31569a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cf31559fe0 0x55cf31568500 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fca997fa700 0 client.15291 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:52:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 --2- 172.21.15.6:0/3345461847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55cf3155a940 0x55cf31568a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 >> 172.21.15.6:0/3345461847 conn(0x55cf31485d80 msgr2=0x55cf3155e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 shutdown_connections 2023-10-14T08:52:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 1 -- 172.21.15.6:0/3345461847 wait complete. 2023-10-14T08:52:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.196+0000 7fcac40fab80 20 client.15291 trim_cache size 0 max 16384 2023-10-14T08:52:36.228 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:36.228 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:36.228 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2023-10-14T08:52:36.228 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24506, 2023-10-14T08:52:36.229 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:36.229 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:36.229 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:36.229 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 76.076531564999996, 2023-10-14T08:52:36.229 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:36.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:36.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:36.230 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 84.521686416999998 2023-10-14T08:52:36.230 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fca9c0a1500 msgr2=0x7fca9c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fca9c0a1500 0x7fca9c0a39c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0005950 tx=0x7fcaa00058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 msgr2=0x7fcab0195ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab0195ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcaac005910 tx=0x7fcaac005e80 comp rx=0 tx=0).stop 2023-10-14T08:52:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 shutdown_connections 2023-10-14T08:52:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fca9c0a1500 0x7fca9c0a39c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcab01019a0 0x7fcab019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcab00ffe90 0x7fcab0195ba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 --2- 172.21.15.6:0/2297066383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcab0100fe0 0x7fcab01960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 >> 172.21.15.6:0/2297066383 conn(0x7fcab00fb420 msgr2=0x7fcab00fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 shutdown_connections 2023-10-14T08:52:36.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.197+0000 7fcab7f10700 1 -- 172.21.15.6:0/2297066383 wait complete. 2023-10-14T08:52:36.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-14T08:52:36.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 -- 172.21.15.6:0/496376764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0ffea0 msgr2=0x7fd1ac1002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/496376764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0ffea0 0x7fd1ac1002c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009990 tx=0x7fd1a8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 -- 172.21.15.6:0/496376764 shutdown_connections 2023-10-14T08:52:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/496376764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1ac1019b0 0x7fd1ac1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/496376764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac0ffea0 0x7fd1ac1002c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/496376764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 -- 172.21.15.6:0/496376764 >> 172.21.15.6:0/496376764 conn(0x7fd1ac0fb450 msgr2=0x7fd1ac0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 -- 172.21.15.6:0/496376764 shutdown_connections 2023-10-14T08:52:36.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.361+0000 7fd1b44c6700 1 -- 172.21.15.6:0/496376764 wait complete. 2023-10-14T08:52:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 Processor -- start 2023-10-14T08:52:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 -- start start 2023-10-14T08:52:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1ac0ffea0 0x7fd1ac196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac1019b0 0x7fd1ac19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac19e7b0 con 0x7fd1ac100ff0 2023-10-14T08:52:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac19e920 con 0x7fd1ac1019b0 2023-10-14T08:52:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b44c6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac19eae0 con 0x7fd1ac0ffea0 2023-10-14T08:52:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60782/0 (socket says 172.21.15.6:60782) 2023-10-14T08:52:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 -- 172.21.15.6:0/244541405 learned_addr learned my addr 172.21.15.6:0/244541405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac1019b0 0x7fd1ac19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b2262700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1ac0ffea0 0x7fd1ac196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 -- 172.21.15.6:0/244541405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1ac0ffea0 msgr2=0x7fd1ac196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1ac0ffea0 0x7fd1ac196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 -- 172.21.15.6:0/244541405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac1019b0 msgr2=0x7fd1ac19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac1019b0 0x7fd1ac19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 -- 172.21.15.6:0/244541405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80095f0 con 0x7fd1ac100ff0 2023-10-14T08:52:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac1019b0 0x7fd1ac19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.362+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac1971b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000d950 tx=0x7fd1a000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.363+0000 7fd19f7fe700 1 -- 172.21.15.6:0/244541405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0009b40 con 0x7fd1ac100ff0 2023-10-14T08:52:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.363+0000 7fd19f7fe700 1 -- 172.21.15.6:0/244541405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a0009ca0 con 0x7fd1ac100ff0 2023-10-14T08:52:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.363+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac19edc0 con 0x7fd1ac100ff0 2023-10-14T08:52:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.363+0000 7fd19f7fe700 1 -- 172.21.15.6:0/244541405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000f620 con 0x7fd1ac100ff0 2023-10-14T08:52:36.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.363+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac19f240 con 0x7fd1ac100ff0 2023-10-14T08:52:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.365+0000 7fd19f7fe700 1 -- 172.21.15.6:0/244541405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd1a0010460 con 0x7fd1ac100ff0 2023-10-14T08:52:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.366+0000 7fd19f7fe700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd1980a1500 0x7fd1980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.366+0000 7fd1b2262700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd1980a1500 0x7fd1980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.366+0000 7fd19f7fe700 1 -- 172.21.15.6:0/244541405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd1a00cd010 con 0x7fd1ac100ff0 2023-10-14T08:52:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.366+0000 7fd1b2262700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd1980a1500 0x7fd1980a39c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8006010 tx=0x7fd1a800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 Processor -- start 2023-10-14T08:52:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 -- start start 2023-10-14T08:52:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102d4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d4b40 0x5583102d5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d59e0 0x5583102d5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558310244c20 con 0x5583102d41e0 2023-10-14T08:52:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558310229c10 con 0x5583102d4b40 2023-10-14T08:52:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558310227530 con 0x5583102d59e0 2023-10-14T08:52:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102d4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60788/0 (socket says 172.21.15.6:60788) 2023-10-14T08:52:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 -- 172.21.15.6:0/797409996 learned_addr learned my addr 172.21.15.6:0/797409996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d4b40 0x5583102d5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d59e0 0x5583102d5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 -- 172.21.15.6:0/797409996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d59e0 msgr2=0x5583102d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d59e0 0x5583102d5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 -- 172.21.15.6:0/797409996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d4b40 msgr2=0x5583102d5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d4b40 0x5583102d5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2262700 1 -- 172.21.15.6:0/797409996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583101e03a0 con 0x5583102d41e0 2023-10-14T08:52:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.367+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d59e0 0x5583102d5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1b2262700 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102d4600 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80047e0 tx=0x7fd1a801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847e23cad8c94b7b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd19cd82700 1 -- 172.21.15.6:0/797409996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a802b070 con 0x5583102d41e0 2023-10-14T08:52:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd19cd82700 1 -- 172.21.15.6:0/797409996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a801e040 con 0x5583102d41e0 2023-10-14T08:52:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd19cd82700 1 -- 172.21.15.6:0/797409996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800f6c0 con 0x5583102d41e0 2023-10-14T08:52:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/797409996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 msgr2=0x5583102d4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102d4600 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80047e0 tx=0x7fd1a801f000 comp rx=0 tx=0).stop 2023-10-14T08:52:36.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/797409996 shutdown_connections 2023-10-14T08:52:36.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d59e0 0x5583102d5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102d4600 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/797409996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d4b40 0x5583102d5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.368+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/797409996 >> 172.21.15.6:0/797409996 conn(0x5583101fdd80 msgr2=0x5583102caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/797409996 shutdown_connections 2023-10-14T08:52:36.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/797409996 wait complete. 2023-10-14T08:52:36.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 -- start start 2023-10-14T08:52:36.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 Processor -- start 2023-10-14T08:52:36.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d41e0 0x5583102ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 0x5583102de510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558310222e20 con 0x5583102d4b40 2023-10-14T08:52:36.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583101bf6c0 con 0x5583102d59e0 2023-10-14T08:52:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583101bf360 con 0x5583102d41e0 2023-10-14T08:52:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1c06b0b80 10 client.0 _ll_register_callbacks cb 0x55831001c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1b1a61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 0x5583102de510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1b1a61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 0x5583102de510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60796/0 (socket says 172.21.15.6:60796) 2023-10-14T08:52:36.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1b1a61700 1 -- 172.21.15.6:0/3039737821 learned_addr learned my addr 172.21.15.6:0/3039737821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.369+0000 7fd1b2262700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d41e0 0x5583102ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1b1a61700 1 -- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d41e0 msgr2=0x5583102ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d41e0 0x5583102ddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1b1a61700 1 -- 172.21.15.6:0/3039737821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 msgr2=0x5583102e5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1b1a61700 1 -- 172.21.15.6:0/3039737821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac108c00 con 0x5583102d4b40 2023-10-14T08:52:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 0x5583102de510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd1a009a030 tx=0x7fd1a0099d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3904faba07be658d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd195ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:36.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd195ffb700 1 -- 172.21.15.6:0/3039737821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a009e220 con 0x5583102d4b40 2023-10-14T08:52:36.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd195ffb700 1 -- 172.21.15.6:0/3039737821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd1a009a330 con 0x5583102d4b40 2023-10-14T08:52:36.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558310227ea0 con 0x5583102d4b40 2023-10-14T08:52:36.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd195ffb700 1 -- 172.21.15.6:0/3039737821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1a009e480 con 0x5583102d4b40 2023-10-14T08:52:36.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1c06b0b80 10 client.15303 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:36.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55831004dd90 con 0x5583102d4b40 2023-10-14T08:52:36.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd195ffb700 1 -- 172.21.15.6:0/3039737821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a00b6070 con 0x5583102d4b40 2023-10-14T08:52:36.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.370+0000 7fd195ffb700 1 -- 172.21.15.6:0/3039737821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1a0099820 con 0x5583102d4b40 2023-10-14T08:52:36.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1c06b0b80 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:36.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1c06b0b80 10 client.15303 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-14T08:52:36.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1c06b0b80 20 client.15303 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5583102e9b00 0x5583102e8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1c06b0b80 4 client.15303 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55831029fbc0 con 0x5583102e9b00 2023-10-14T08:52:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1b2262700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5583102e9b00 0x5583102e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd195ffb700 10 client.15303 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.371+0000 7fd1b2262700 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5583102e9b00 0x5583102e8610 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e015237b97f3fd server_cookie=8ada088fb56a41f3 in_seq=0 out_seq=0 2023-10-14T08:52:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd195ffb700 1 -- 172.21.15.6:0/3039737821 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55831029fbc0 con 0x5583102e9b00 2023-10-14T08:52:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd195ffb700 10 client.15303 handle_command_reply: tid=0 2023-10-14T08:52:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 client.15303 shutdown 2023-10-14T08:52:36.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 msgr2=0x5583102de510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 0x5583102de510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd1a009a030 tx=0x7fd1a0099d80 comp rx=0 tx=0).stop 2023-10-14T08:52:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 shutdown_connections 2023-10-14T08:52:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5583102e9b00 0x5583102e8610 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd195ffb700 0 client.15303 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:36.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d41e0 0x5583102ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/3039737821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d4b40 0x5583102de510 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 >> 172.21.15.6:0/3039737821 conn(0x5583101fdd80 msgr2=0x5583102cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.372+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 shutdown_connections 2023-10-14T08:52:36.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.373+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/3039737821 wait complete. 2023-10-14T08:52:36.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.373+0000 7fd1c06b0b80 20 client.15303 trim_cache size 0 max 16384 2023-10-14T08:52:36.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 Processor -- start 2023-10-14T08:52:36.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 -- start start 2023-10-14T08:52:36.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583100a38d0 con 0x5583102d41e0 2023-10-14T08:52:36.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583102240b0 con 0x5583102d59e0 2023-10-14T08:52:36.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55831021ef10 con 0x5583102d4b40 2023-10-14T08:52:36.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1b2262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1b2262700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60802/0 (socket says 172.21.15.6:60802) 2023-10-14T08:52:36.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.390+0000 7fd1b2262700 1 -- 172.21.15.6:0/1246164716 learned_addr learned my addr 172.21.15.6:0/1246164716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2262700 1 -- 172.21.15.6:0/1246164716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 msgr2=0x5583102caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2262700 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2262700 1 -- 172.21.15.6:0/1246164716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 msgr2=0x5583102e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2262700 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2262700 1 -- 172.21.15.6:0/1246164716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558310036c10 con 0x5583102d41e0 2023-10-14T08:52:36.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:36.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd1b2262700 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102caab0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80047e0 tx=0x7fd1a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777974feaffc1182 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd19d583700 1 -- 172.21.15.6:0/1246164716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a802b040 con 0x5583102d41e0 2023-10-14T08:52:36.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd19d583700 1 -- 172.21.15.6:0/1246164716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a802c040 con 0x5583102d41e0 2023-10-14T08:52:36.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.391+0000 7fd19d583700 1 -- 172.21.15.6:0/1246164716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8039d70 con 0x5583102d41e0 2023-10-14T08:52:36.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/1246164716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 msgr2=0x5583102caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102caab0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80047e0 tx=0x7fd1a8009310 comp rx=0 tx=0).stop 2023-10-14T08:52:36.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/1246164716 shutdown_connections 2023-10-14T08:52:36.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d59e0 0x5583102e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d41e0 0x5583102caab0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/1246164716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/1246164716 >> 172.21.15.6:0/1246164716 conn(0x5583101fdd80 msgr2=0x5583102ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/1246164716 shutdown_connections 2023-10-14T08:52:36.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/1246164716 wait complete. 2023-10-14T08:52:36.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- start start 2023-10-14T08:52:36.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 Processor -- start 2023-10-14T08:52:36.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d41e0 0x5583102e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102e2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 0x55831033d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583102e5630 con 0x5583102d59e0 2023-10-14T08:52:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583102e57a0 con 0x5583102d41e0 2023-10-14T08:52:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583102e5960 con 0x5583102d4b40 2023-10-14T08:52:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1c06b0b80 10 client.0 _ll_register_callbacks cb 0x55831001c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1b2a63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 0x55831033d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1b2a63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 0x55831033d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60812/0 (socket says 172.21.15.6:60812) 2023-10-14T08:52:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1b2a63700 1 -- 172.21.15.6:0/397733004 learned_addr learned my addr 172.21.15.6:0/397733004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.392+0000 7fd1b2262700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d41e0 0x5583102e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b1a61700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102e2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b2a63700 1 -- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 msgr2=0x5583102e2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102e2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b2a63700 1 -- 172.21.15.6:0/397733004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d41e0 msgr2=0x5583102e20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d41e0 0x5583102e20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b2a63700 1 -- 172.21.15.6:0/397733004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583101e03a0 con 0x5583102d59e0 2023-10-14T08:52:36.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1b2a63700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 0x55831033d4f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4007af0 tx=0x7fd1a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc068571b035e53 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:36.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd195ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:36.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd195ffb700 1 -- 172.21.15.6:0/397733004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400e070 con 0x5583102d59e0 2023-10-14T08:52:36.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1a801e040 con 0x5583102d59e0 2023-10-14T08:52:36.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd195ffb700 1 -- 172.21.15.6:0/397733004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd1a4015a30 con 0x5583102d59e0 2023-10-14T08:52:36.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd195ffb700 1 -- 172.21.15.6:0/397733004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1a4015bf0 con 0x5583102d59e0 2023-10-14T08:52:36.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1c06b0b80 10 client.15309 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:36.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558310074200 con 0x5583102d59e0 2023-10-14T08:52:36.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.393+0000 7fd195ffb700 1 -- 172.21.15.6:0/397733004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a801e040 con 0x5583102d59e0 2023-10-14T08:52:36.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd195ffb700 1 -- 172.21.15.6:0/397733004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1a4021410 con 0x5583102d59e0 2023-10-14T08:52:36.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 10 client.15309 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:36.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-14T08:52:36.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 20 client.15309 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:36.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558310342cb0 0x55831033f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:36.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 4 client.15309 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T08:52:36.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55831021be00 con 0x558310342cb0 2023-10-14T08:52:36.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1b2262700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558310342cb0 0x55831033f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:36.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd195ffb700 10 client.15309 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:36.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1b2262700 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558310342cb0 0x55831033f150 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c120839376bd982 server_cookie=1a93ce41d145c1fe in_seq=0 out_seq=0 2023-10-14T08:52:36.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd195ffb700 1 -- 172.21.15.6:0/397733004 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55831021be00 con 0x558310342cb0 2023-10-14T08:52:36.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd195ffb700 10 client.15309 handle_command_reply: tid=0 2023-10-14T08:52:36.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.394+0000 7fd1c06b0b80 1 client.15309 shutdown 2023-10-14T08:52:36.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 msgr2=0x55831033d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 0x55831033d4f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4007af0 tx=0x7fd1a4007e00 comp rx=0 tx=0).stop 2023-10-14T08:52:36.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 shutdown_connections 2023-10-14T08:52:36.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558310342cb0 0x55831033f150 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5583102d59e0 0x55831033d4f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd195ffb700 0 client.15309 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:36.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5583102d41e0 0x5583102e20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 --2- 172.21.15.6:0/397733004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583102d4b40 0x5583102e2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 >> 172.21.15.6:0/397733004 conn(0x5583101fdd80 msgr2=0x5583102d8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 shutdown_connections 2023-10-14T08:52:36.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 1 -- 172.21.15.6:0/397733004 wait complete. 2023-10-14T08:52:36.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1c06b0b80 20 client.15309 trim_cache size 0 max 16384 2023-10-14T08:52:36.419 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "af5a2e5a-6a6d-11ee-8db6-212e2dc638e7", 2023-10-14T08:52:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-10-14T08:52:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24508, 2023-10-14T08:52:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-10-14T08:52:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-10-14T08:52:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-10-14T08:52:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 79.298546583000004, 2023-10-14T08:52:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 27, 2023-10-14T08:52:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-10-14T08:52:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 82, 2023-10-14T08:52:36.422 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 91.333127829999995 2023-10-14T08:52:36.422 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd1980a1500 msgr2=0x7fd1980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd1980a1500 0x7fd1980a39c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8006010 tx=0x7fd1a800b540 comp rx=0 tx=0).stop 2023-10-14T08:52:36.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 msgr2=0x7fd1ac1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac1971b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000d950 tx=0x7fd1a000dd10 comp rx=0 tx=0).stop 2023-10-14T08:52:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 shutdown_connections 2023-10-14T08:52:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd1980a1500 0x7fd1980a39c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1ac1019b0 0x7fd1ac19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1ac0ffea0 0x7fd1ac196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 --2- 172.21.15.6:0/244541405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1ac100ff0 0x7fd1ac1971b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 >> 172.21.15.6:0/244541405 conn(0x7fd1ac0fb450 msgr2=0x7fd1ac0fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 shutdown_connections 2023-10-14T08:52:36.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:36.395+0000 7fd1b44c6700 1 -- 172.21.15.6:0/244541405 wait complete. 2023-10-14T08:52:36.426 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:36 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3179024702' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:36.427 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T08:52:36.451 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T08:52:36.452 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-14T08:52:36.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:36.453 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-14T08:52:36.454 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:36 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3179024702' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:36.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:36.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-14T08:52:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-10-14T08:52:36.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T08:52:36.543 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2023-10-14T08:52:36.543 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T08:52:36.544 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-10-14T08:52:36.544 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-10-14T08:52:36.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph fs ls 2023-10-14T08:52:36.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:36 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3179024702' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:37.146 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T08:52:37.420 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:37 smithi006 ceph-mon[99452]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-14T08:52:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:37 smithi057 ceph-mon[103313]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-14T08:52:37.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:37 smithi178 ceph-mon[103612]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2023-10-14T08:52:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 -- 172.21.15.6:0/3118630706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa80ff3c0 msgr2=0x7f1fa80ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/3118630706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa80ff3c0 0x7f1fa80ff840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009990 tx=0x7f1f9c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 -- 172.21.15.6:0/3118630706 shutdown_connections 2023-10-14T08:52:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/3118630706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ffd80 0x7f1fa810dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/3118630706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa8105d90 0x7f1fa8106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/3118630706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa80ff3c0 0x7f1fa80ff840 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 -- 172.21.15.6:0/3118630706 >> 172.21.15.6:0/3118630706 conn(0x7f1fa80fb510 msgr2=0x7f1fa80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 -- 172.21.15.6:0/3118630706 shutdown_connections 2023-10-14T08:52:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.360+0000 7f1fae7a2700 1 -- 172.21.15.6:0/3118630706 wait complete. 2023-10-14T08:52:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.361+0000 7f1fae7a2700 1 Processor -- start 2023-10-14T08:52:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.361+0000 7f1fae7a2700 1 -- start start 2023-10-14T08:52:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fae7a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80ff3c0 0x7f1fa8196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fae7a2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ffd80 0x7f1fa8197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fae7a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 0x7f1fa819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fae7a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa819bea0 con 0x7f1fa8105d90 2023-10-14T08:52:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fae7a2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa819c010 con 0x7f1fa80ff3c0 2023-10-14T08:52:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fae7a2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa819c1d0 con 0x7f1fa80ffd80 2023-10-14T08:52:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 0x7f1fa819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 0x7f1fa819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60826/0 (socket says 172.21.15.6:60826) 2023-10-14T08:52:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 -- 172.21.15.6:0/2416384443 learned_addr learned my addr 172.21.15.6:0/2416384443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fad7a0700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80ff3c0 0x7f1fa8196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:38.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1facf9f700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ffd80 0x7f1fa8197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 -- 172.21.15.6:0/2416384443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ffd80 msgr2=0x7f1fa8197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ffd80 0x7f1fa8197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 -- 172.21.15.6:0/2416384443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80ff3c0 msgr2=0x7f1fa8196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80ff3c0 0x7f1fa8196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 -- 172.21.15.6:0/2416384443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c0095f0 con 0x7f1fa8105d90 2023-10-14T08:52:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.362+0000 7f1fadfa1700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 0x7f1fa819b890 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00094f0 tx=0x7f1fa000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.363+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0004db0 con 0x7f1fa8105d90 2023-10-14T08:52:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.363+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fa000f040 con 0x7f1fa8105d90 2023-10-14T08:52:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.363+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa819c4b0 con 0x7f1fa8105d90 2023-10-14T08:52:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.363+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005980 con 0x7f1fa8105d90 2023-10-14T08:52:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.363+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa81a3d10 con 0x7f1fa8105d90 2023-10-14T08:52:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.364+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa804f400 con 0x7f1fa8105d90 2023-10-14T08:52:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.365+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1fa0005000 con 0x7f1fa8105d90 2023-10-14T08:52:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.366+0000 7f1f9a7fc700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1f940a1480 0x7f1f940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.366+0000 7f1fad7a0700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1f940a1480 0x7f1f940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:38.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.366+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1fa00cce50 con 0x7f1fa8105d90 2023-10-14T08:52:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.366+0000 7f1fad7a0700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1f940a1480 0x7f1f940a3940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009a10 tx=0x7f1fa4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.369+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1fa00964b0 con 0x7f1fa8105d90 2023-10-14T08:52:38.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.616+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fa8110eb0 con 0x7f1fa8105d90 2023-10-14T08:52:38.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.616+0000 7f1f9a7fc700 1 -- 172.21.15.6:0/2416384443 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1fa0023020 con 0x7f1fa8105d90 2023-10-14T08:52:38.618 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T08:52:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1f940a1480 msgr2=0x7f1f940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1f940a1480 0x7f1f940a3940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009a10 tx=0x7f1fa4009190 comp rx=0 tx=0).stop 2023-10-14T08:52:38.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 msgr2=0x7f1fa819b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 0x7f1fa819b890 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00094f0 tx=0x7f1fa000d3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 shutdown_connections 2023-10-14T08:52:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fa8105d90 0x7f1fa819b890 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1f940a1480 0x7f1f940a3940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80ff3c0 0x7f1fa8196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 --2- 172.21.15.6:0/2416384443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ffd80 0x7f1fa8197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 >> 172.21.15.6:0/2416384443 conn(0x7f1fa80fb510 msgr2=0x7f1fa81039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 shutdown_connections 2023-10-14T08:52:38.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:38.618+0000 7f1fae7a2700 1 -- 172.21.15.6:0/2416384443 wait complete. 2023-10-14T08:52:39.006 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T08:52:39.007 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T08:52:39.007 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-10-14T08:52:39.007 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T08:52:39.007 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-10-14T08:52:39.008 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T08:52:39.008 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T08:52:39.008 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T08:52:39.008 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-10-14T08:52:39.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.009 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-10-14T08:52:39.028 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T08:52:39.028 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T08:52:39.028 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T08:52:39.028 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-14T08:52:39.029 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-10-14T08:52:39.029 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-14T08:52:39.029 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T08:52:39.029 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-10-14T08:52:39.030 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T08:52:39.030 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-10-14T08:52:39.030 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T08:52:39.030 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-10-14T08:52:39.030 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-14T08:52:39.031 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41827sec preferred_lft 41827sec 2023-10-14T08:52:39.031 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-10-14T08:52:39.031 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-10-14T08:52:39.031 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T08:52:39.031 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-10-14T08:52:39.032 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T08:52:39.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.032 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-14T08:52:39.033 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-14T08:52:39.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-10-14T08:52:39.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-10-14T08:52:39.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-10-14T08:52:39.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T08:52:39.034 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-14T08:52:39.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.205 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T08:52:39.235 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-10-14T08:52:39.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.236 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-10-14T08:52:39.306 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-10-14T08:52:39.307 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T08:52:39.307 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-14T08:52:39.307 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-14T08:52:39.307 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T08:52:39.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.308 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-14T08:52:39.308 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-14T08:52:39.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-14T08:52:39.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-14T08:52:39.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-14T08:52:39.309 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-14T08:52:39.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:39 smithi006 ceph-mon[99452]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-14T08:52:39.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:39 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2416384443' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-14T08:52:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:39 smithi057 ceph-mon[103313]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-14T08:52:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:39 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2416384443' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-14T08:52:39.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.583 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-14T08:52:39.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:39 smithi178 ceph-mon[103612]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 12 op/s 2023-10-14T08:52:39.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:39 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2416384443' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-14T08:52:39.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.641 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-10-14T08:52:39.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.698 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-14T08:52:39.699 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-14T08:52:39.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--tmp-cephfs 2023-10-14T08:52:39.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-10-14T08:52:39.700 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-14T08:52:39.795 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-10-14T08:52:39.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:39.796 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-14T08:52:39.796 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-14T08:52:39.796 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-10-14T08:52:39.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T08:52:39.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-10-14T08:52:39.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-10-14T08:52:39.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-10-14T08:52:39.798 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-14T08:52:40.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.004 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-10-14T08:52:40.004 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-10-14T08:52:40.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-10-14T08:52:40.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T08:52:40.005 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-10-14T08:52:40.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T08:52:40.105 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /tmp/cephfs 2023-10-14T08:52:40.123 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/tmp/cephfs' 2023-10-14T08:52:40.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T08:52:40.123 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /tmp/cephfs 2023-10-14T08:52:40.180 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-14T08:52:40.181 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-14T08:52:40.181 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e 2023-10-14T08:52:40.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0 2023-10-14T08:52:40.281 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2023-10-14T08:52:40.281 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-10-14T08:52:40.281 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-10-14T08:52:40.406 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2023-10-14T08:52:40.406 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2023-10-14T08:52:40.406 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-10-14T08:52:40.407 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.57:3300,172.21.15.178:3300" 2023-10-14T08:52:40.407 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:3300,172.21.15.57:3300,172.21.15.178:3300:/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e 2023-10-14T08:52:40.407 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=af5a2e5a-6a6d-11ee-8db6-212e2dc638e7" will pass to kernel 2023-10-14T08:52:40.409 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T08:52:40.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /tmp/cephfs 2023-10-14T08:52:40.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.440 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T08:52:40.513 INFO:teuthology.orchestra.run.smithi006.stdout:client25051 2023-10-14T08:52:40.513 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T08:52:40.513 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T08:52:40.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.572 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T08:52:40.646 INFO:teuthology.orchestra.run.smithi006.stdout:client25051 2023-10-14T08:52:40.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.647 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T08:52:40.719 INFO:teuthology.orchestra.run.smithi006.stdout:client25051 2023-10-14T08:52:40.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T08:52:40.720 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7.client25051/status') 2023-10-14T08:52:40.801 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.25051 (3)172.21.15.6:0/2850715203 2023-10-14T08:52:40.801 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-10-14T08:52:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-10-14T08:52:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-10-14T08:52:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:70 bytes copied, 2.3375e-05 s, 3.0 MB/s 2023-10-14T08:52:40.803 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-14T08:52:40.816 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-14T08:52:40.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 -- 172.21.15.6:0/2508466071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560101970 msgr2=0x7f9560108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 --2- 172.21.15.6:0/2508466071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560101970 0x7f9560108220 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f955800b0d0 tx=0x7f955800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 -- 172.21.15.6:0/2508466071 shutdown_connections 2023-10-14T08:52:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 --2- 172.21.15.6:0/2508466071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560101970 0x7f9560108220 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 --2- 172.21.15.6:0/2508466071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ffde0 0x7f9560100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 --2- 172.21.15.6:0/2508466071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9560100fd0 0x7f9560101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.967+0000 7f9566988700 1 -- 172.21.15.6:0/2508466071 >> 172.21.15.6:0/2508466071 conn(0x7f95600fb310 msgr2=0x7f95600fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.968+0000 7f9566988700 1 -- 172.21.15.6:0/2508466071 shutdown_connections 2023-10-14T08:52:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.968+0000 7f9566988700 1 -- 172.21.15.6:0/2508466071 wait complete. 2023-10-14T08:52:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.968+0000 7f9566988700 1 Processor -- start 2023-10-14T08:52:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.968+0000 7f9566988700 1 -- start start 2023-10-14T08:52:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9566988700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ffde0 0x7f9560195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9566988700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 0x7f9560196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9566988700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9560101970 0x7f956019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9566988700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019d650 con 0x7f9560100fd0 2023-10-14T08:52:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9566988700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019d790 con 0x7f95600ffde0 2023-10-14T08:52:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9566988700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956019d920 con 0x7f9560101970 2023-10-14T08:52:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 0x7f9560196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 0x7f9560196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60840/0 (socket says 172.21.15.6:60840) 2023-10-14T08:52:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 -- 172.21.15.6:0/461257126 learned_addr learned my addr 172.21.15.6:0/461257126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:40.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955ffff700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ffde0 0x7f9560195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f9564f25700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9560101970 0x7f956019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 -- 172.21.15.6:0/461257126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9560101970 msgr2=0x7f956019d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9560101970 0x7f956019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 -- 172.21.15.6:0/461257126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ffde0 msgr2=0x7f9560195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ffde0 0x7f9560195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 -- 172.21.15.6:0/461257126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558009d00 con 0x7f9560100fd0 2023-10-14T08:52:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.969+0000 7f955f7fe700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 0x7f9560196010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9554007b50 tx=0x7f9554007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.970+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554011070 con 0x7f9560100fd0 2023-10-14T08:52:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.970+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f955400c2e0 con 0x7f9560100fd0 2023-10-14T08:52:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.970+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9560068210 con 0x7f9560100fd0 2023-10-14T08:52:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.970+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400a900 con 0x7f9560100fd0 2023-10-14T08:52:40.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.970+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9560068720 con 0x7f9560100fd0 2023-10-14T08:52:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.970+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560067d60 con 0x7f9560100fd0 2023-10-14T08:52:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.972+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f955400aa80 con 0x7f9560100fd0 2023-10-14T08:52:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.972+0000 7f955d7fa700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95480a1480 0x7f95480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.972+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f95540ce1e0 con 0x7f9560100fd0 2023-10-14T08:52:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.972+0000 7f955ffff700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95480a1480 0x7f95480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.973+0000 7f955ffff700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95480a1480 0x7f95480a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9560100e30 tx=0x7f955000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:40.976+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f95540978d0 con 0x7f9560100fd0 2023-10-14T08:52:41.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.179+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f956010b600 con 0x7f9560100fd0 2023-10-14T08:52:41.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.181+0000 7f955d7fa700 1 -- 172.21.15.6:0/461257126 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f955409aef0 con 0x7f9560100fd0 2023-10-14T08:52:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:41.183 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95480a1480 msgr2=0x7f95480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95480a1480 0x7f95480a3940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9560100e30 tx=0x7f955000b410 comp rx=0 tx=0).stop 2023-10-14T08:52:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 msgr2=0x7f9560196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 0x7f9560196010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9554007b50 tx=0x7f9554007e60 comp rx=0 tx=0).stop 2023-10-14T08:52:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 shutdown_connections 2023-10-14T08:52:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9560101970 0x7f956019d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f95480a1480 0x7f95480a3940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ffde0 0x7f9560195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 --2- 172.21.15.6:0/461257126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9560100fd0 0x7f9560196010 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 >> 172.21.15.6:0/461257126 conn(0x7f95600fb310 msgr2=0x7f95600fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:41.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 shutdown_connections 2023-10-14T08:52:41.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.183+0000 7f9566988700 1 -- 172.21.15.6:0/461257126 wait complete. 2023-10-14T08:52:41.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:41.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2490188088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 msgr2=0x7ff6d01082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2490188088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d01082d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800b0a0 tx=0x7ff6c800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2490188088 shutdown_connections 2023-10-14T08:52:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2490188088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d01082d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2490188088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6d00ffea0 0x7ff6d01002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2490188088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6d0100ff0 0x7ff6d0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2490188088 >> 172.21.15.6:0/2490188088 conn(0x7ff6d00fb430 msgr2=0x7ff6d00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2490188088 shutdown_connections 2023-10-14T08:52:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2490188088 wait complete. 2023-10-14T08:52:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.327+0000 7ff6d57c0700 1 Processor -- start 2023-10-14T08:52:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 -- start start 2023-10-14T08:52:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6d00ffea0 0x7ff6d0196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6d0100ff0 0x7ff6d0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d019e8f0 con 0x7ff6d01019b0 2023-10-14T08:52:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d019ea30 con 0x7ff6d00ffea0 2023-10-14T08:52:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6d57c0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d019ebc0 con 0x7ff6d0100ff0 2023-10-14T08:52:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d019e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60856/0 (socket says 172.21.15.6:60856) 2023-10-14T08:52:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 -- 172.21.15.6:0/2727812118 learned_addr learned my addr 172.21.15.6:0/2727812118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6ce7fc700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6d0100ff0 0x7ff6d0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 -- 172.21.15.6:0/2727812118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6d0100ff0 msgr2=0x7ff6d0197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6d0100ff0 0x7ff6d0197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 -- 172.21.15.6:0/2727812118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6d00ffea0 msgr2=0x7ff6d0196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6ceffd700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6d00ffea0 0x7ff6d0196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6d00ffea0 0x7ff6d0196dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 -- 172.21.15.6:0/2727812118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8009d00 con 0x7ff6d01019b0 2023-10-14T08:52:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.328+0000 7ff6cf7fe700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d019e320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800b830 tx=0x7ff6c8004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.329+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800e040 con 0x7ff6d01019b0 2023-10-14T08:52:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.329+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6c80094c0 con 0x7ff6d01019b0 2023-10-14T08:52:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.329+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d019ee40 con 0x7ff6d01019b0 2023-10-14T08:52:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.329+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c801bc70 con 0x7ff6d01019b0 2023-10-14T08:52:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.329+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d019f260 con 0x7ff6d01019b0 2023-10-14T08:52:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.330+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d010b6a0 con 0x7ff6d01019b0 2023-10-14T08:52:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.331+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff6c801d890 con 0x7ff6d01019b0 2023-10-14T08:52:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.331+0000 7ff6c7fff700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6bc0a1480 0x7ff6bc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.332+0000 7ff6ceffd700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6bc0a1480 0x7ff6bc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.332+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff6c80cecb0 con 0x7ff6d01019b0 2023-10-14T08:52:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.332+0000 7ff6ceffd700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6bc0a1480 0x7ff6bc0a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0005950 tx=0x7ff6c00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.336+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff6c8098360 con 0x7ff6d01019b0 2023-10-14T08:52:41.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:41 smithi057 ceph-mon[103313]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-14T08:52:41.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:41 smithi006 ceph-mon[99452]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-14T08:52:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.535+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6d019f450 con 0x7ff6d01019b0 2023-10-14T08:52:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.536+0000 7ff6c7fff700 1 -- 172.21.15.6:0/2727812118 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6c809b980 con 0x7ff6d01019b0 2023-10-14T08:52:41.538 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6bc0a1480 msgr2=0x7ff6bc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6bc0a1480 0x7ff6bc0a3940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0005950 tx=0x7ff6c00058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 msgr2=0x7ff6d019e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d019e320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800b830 tx=0x7ff6c8004d30 comp rx=0 tx=0).stop 2023-10-14T08:52:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 shutdown_connections 2023-10-14T08:52:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6d01019b0 0x7ff6d019e320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6bc0a1480 0x7ff6bc0a3940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6d00ffea0 0x7ff6d0196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 --2- 172.21.15.6:0/2727812118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6d0100ff0 0x7ff6d0197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 >> 172.21.15.6:0/2727812118 conn(0x7ff6d00fb430 msgr2=0x7ff6d00681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 shutdown_connections 2023-10-14T08:52:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.538+0000 7ff6d57c0700 1 -- 172.21.15.6:0/2727812118 wait complete. 2023-10-14T08:52:41.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:41.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:41 smithi178 ceph-mon[103612]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2023-10-14T08:52:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 -- 172.21.15.6:0/824282634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01140ffe70 msgr2=0x7f0114100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 --2- 172.21.15.6:0/824282634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01140ffe70 0x7f0114100290 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0110009990 tx=0x7f0110009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 -- 172.21.15.6:0/824282634 shutdown_connections 2023-10-14T08:52:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 --2- 172.21.15.6:0/824282634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 0x7f0114108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 --2- 172.21.15.6:0/824282634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01140ffe70 0x7f0114100290 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 --2- 172.21.15.6:0/824282634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0114101050 0x7f01141014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 -- 172.21.15.6:0/824282634 >> 172.21.15.6:0/824282634 conn(0x7f01140fb410 msgr2=0x7f01140fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 -- 172.21.15.6:0/824282634 shutdown_connections 2023-10-14T08:52:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.679+0000 7f011b755700 1 -- 172.21.15.6:0/824282634 wait complete. 2023-10-14T08:52:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 Processor -- start 2023-10-14T08:52:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 -- start start 2023-10-14T08:52:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01140ffe70 0x7f0114196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 0x7f0114197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 0x7f011419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011419e860 con 0x7f0114101050 2023-10-14T08:52:41.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011419e9d0 con 0x7f0114101a10 2023-10-14T08:52:41.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f011b755700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011419eb90 con 0x7f01140ffe70 2023-10-14T08:52:41.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 0x7f0114197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 0x7f0114197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60868/0 (socket says 172.21.15.6:60868) 2023-10-14T08:52:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 -- 172.21.15.6:0/1427789173 learned_addr learned my addr 172.21.15.6:0/1427789173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0119cf2700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 0x7f011419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f01194f1700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01140ffe70 0x7f0114196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 -- 172.21.15.6:0/1427789173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01140ffe70 msgr2=0x7f0114196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01140ffe70 0x7f0114196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 -- 172.21.15.6:0/1427789173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 msgr2=0x7f011419e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 0x7f011419e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0118cf0700 1 -- 172.21.15.6:0/1427789173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01100095f0 con 0x7f0114101050 2023-10-14T08:52:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f0119cf2700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 0x7f011419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.680+0000 7f01194f1700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01140ffe70 0x7f0114196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.681+0000 7f0118cf0700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 0x7f0114197260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f010400c8f0 tx=0x7f010400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.681+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104007b00 con 0x7f0114101050 2023-10-14T08:52:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.681+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0104007c60 con 0x7f0114101050 2023-10-14T08:52:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.681+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011419ee70 con 0x7f0114101050 2023-10-14T08:52:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.681+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104018660 con 0x7f0114101050 2023-10-14T08:52:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.681+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011419f240 con 0x7f0114101050 2023-10-14T08:52:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.682+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011410c860 con 0x7f0114101050 2023-10-14T08:52:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.683+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f010400f450 con 0x7f0114101050 2023-10-14T08:52:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.683+0000 7f010a7fc700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f01000a1480 0x7f01000a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.684+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f01040ccc60 con 0x7f0114101050 2023-10-14T08:52:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.684+0000 7f01194f1700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f01000a1480 0x7f01000a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:41.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.684+0000 7f01194f1700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f01000a1480 0x7f01000a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0110000c00 tx=0x7f0110005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:41.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.688+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f01040962c0 con 0x7f0114101050 2023-10-14T08:52:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.887+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0114106e80 con 0x7f0114101050 2023-10-14T08:52:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.888+0000 7f010a7fc700 1 -- 172.21.15.6:0/1427789173 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01040998e0 con 0x7f0114101050 2023-10-14T08:52:41.890 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:41.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f01000a1480 msgr2=0x7f01000a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f01000a1480 0x7f01000a3940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0110000c00 tx=0x7f0110005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 msgr2=0x7f0114197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:41.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 0x7f0114197260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f010400c8f0 tx=0x7f010400ccb0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 shutdown_connections 2023-10-14T08:52:41.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f01000a1480 0x7f01000a3940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0114101a10 0x7f011419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01140ffe70 0x7f0114196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 --2- 172.21.15.6:0/1427789173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0114101050 0x7f0114197260 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:41.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 >> 172.21.15.6:0/1427789173 conn(0x7f01140fb410 msgr2=0x7f01140fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 shutdown_connections 2023-10-14T08:52:41.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:41.890+0000 7f011b755700 1 -- 172.21.15.6:0/1427789173 wait complete. 2023-10-14T08:52:41.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 -- 172.21.15.6:0/2641762200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf8102b40 msgr2=0x7fcaf81093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2641762200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf8102b40 0x7fcaf81093f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000b0d0 tx=0x7fcaf000b3e0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 -- 172.21.15.6:0/2641762200 shutdown_connections 2023-10-14T08:52:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2641762200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf8102b40 0x7fcaf81093f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2641762200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf8100fb0 0x7fcaf81013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2641762200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf81021a0 0x7fcaf8102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 -- 172.21.15.6:0/2641762200 >> 172.21.15.6:0/2641762200 conn(0x7fcaf80fc520 msgr2=0x7fcaf80fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 -- 172.21.15.6:0/2641762200 shutdown_connections 2023-10-14T08:52:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 -- 172.21.15.6:0/2641762200 wait complete. 2023-10-14T08:52:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 Processor -- start 2023-10-14T08:52:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.032+0000 7fcaffde1700 1 -- start start 2023-10-14T08:52:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf8100fb0 0x7fcaf8196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 0x7fcaf8197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf8102b40 0x7fcaf819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf819e880 con 0x7fcaf81021a0 2023-10-14T08:52:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf819e9f0 con 0x7fcaf8100fb0 2023-10-14T08:52:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf819ebb0 con 0x7fcaf8102b40 2023-10-14T08:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 0x7fcaf8197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 0x7fcaf8197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60882/0 (socket says 172.21.15.6:60882) 2023-10-14T08:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 -- 172.21.15.6:0/2156981020 learned_addr learned my addr 172.21.15.6:0/2156981020 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafdb7d700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf8100fb0 0x7fcaf8196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafe37e700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf8102b40 0x7fcaf819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 -- 172.21.15.6:0/2156981020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf8102b40 msgr2=0x7fcaf819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf8102b40 0x7fcaf819e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 -- 172.21.15.6:0/2156981020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf8100fb0 msgr2=0x7fcaf8196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf8100fb0 0x7fcaf8196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 -- 172.21.15.6:0/2156981020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0009d00 con 0x7fcaf81021a0 2023-10-14T08:52:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafe37e700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf8102b40 0x7fcaf819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcafd37c700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 0x7fcaf8197280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400e9f0 tx=0x7fcaf400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400eee0 con 0x7fcaf81021a0 2023-10-14T08:52:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaf4004cf0 con 0x7fcaf81021a0 2023-10-14T08:52:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf819ee90 con 0x7fcaf81021a0 2023-10-14T08:52:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.033+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4005540 con 0x7fcaf81021a0 2023-10-14T08:52:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.034+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf819f2b0 con 0x7fcaf81021a0 2023-10-14T08:52:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.034+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf81084a0 con 0x7fcaf81021a0 2023-10-14T08:52:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.036+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcaf400cbd0 con 0x7fcaf81021a0 2023-10-14T08:52:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.036+0000 7fcaeeffd700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcae40a1480 0x7fcae40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.036+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcaf4014070 con 0x7fcaf81021a0 2023-10-14T08:52:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.036+0000 7fcafdb7d700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcae40a1480 0x7fcae40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.037+0000 7fcafdb7d700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcae40a1480 0x7fcae40a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8198210 tx=0x7fcae8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.040+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcaf40967c0 con 0x7fcaf81021a0 2023-10-14T08:52:42.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.241+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcaf810ca40 con 0x7fcaf81021a0 2023-10-14T08:52:42.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.241+0000 7fcaeeffd700 1 -- 172.21.15.6:0/2156981020 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcaf4099de0 con 0x7fcaf81021a0 2023-10-14T08:52:42.243 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:42.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcae40a1480 msgr2=0x7fcae40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcae40a1480 0x7fcae40a3940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8198210 tx=0x7fcae8009260 comp rx=0 tx=0).stop 2023-10-14T08:52:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 msgr2=0x7fcaf8197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 0x7fcaf8197280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400e9f0 tx=0x7fcaf400ed00 comp rx=0 tx=0).stop 2023-10-14T08:52:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 shutdown_connections 2023-10-14T08:52:42.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf8102b40 0x7fcaf819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcae40a1480 0x7fcae40a3940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcaf8100fb0 0x7fcaf8196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 --2- 172.21.15.6:0/2156981020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaf81021a0 0x7fcaf8197280 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 >> 172.21.15.6:0/2156981020 conn(0x7fcaf80fc520 msgr2=0x7fcaf81055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 shutdown_connections 2023-10-14T08:52:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.244+0000 7fcaffde1700 1 -- 172.21.15.6:0/2156981020 wait complete. 2023-10-14T08:52:42.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 -- 172.21.15.6:0/2781957318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740ffe20 msgr2=0x7efd74100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 --2- 172.21.15.6:0/2781957318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740ffe20 0x7efd74100240 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efd64009990 tx=0x7efd64009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 -- 172.21.15.6:0/2781957318 shutdown_connections 2023-10-14T08:52:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 --2- 172.21.15.6:0/2781957318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd74101930 0x7efd74108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 --2- 172.21.15.6:0/2781957318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd740ffe20 0x7efd74100240 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 --2- 172.21.15.6:0/2781957318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd74100f70 0x7efd741013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 -- 172.21.15.6:0/2781957318 >> 172.21.15.6:0/2781957318 conn(0x7efd740fb370 msgr2=0x7efd740fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 -- 172.21.15.6:0/2781957318 shutdown_connections 2023-10-14T08:52:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 -- 172.21.15.6:0/2781957318 wait complete. 2023-10-14T08:52:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.383+0000 7efd7a086700 1 Processor -- start 2023-10-14T08:52:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 -- start start 2023-10-14T08:52:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd740ffe20 0x7efd74196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 0x7efd741972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd74101930 0x7efd7419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7419e8f0 con 0x7efd74100f70 2023-10-14T08:52:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7419ea30 con 0x7efd740ffe20 2023-10-14T08:52:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd7a086700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7419ebc0 con 0x7efd74101930 2023-10-14T08:52:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 0x7efd741972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 0x7efd741972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60896/0 (socket says 172.21.15.6:60896) 2023-10-14T08:52:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 -- 172.21.15.6:0/2242332182 learned_addr learned my addr 172.21.15.6:0/2242332182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd737fe700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd740ffe20 0x7efd74196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd73fff700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd74101930 0x7efd7419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 -- 172.21.15.6:0/2242332182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd74101930 msgr2=0x7efd7419e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd74101930 0x7efd7419e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 -- 172.21.15.6:0/2242332182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd740ffe20 msgr2=0x7efd74196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd740ffe20 0x7efd74196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 -- 172.21.15.6:0/2242332182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd640095f0 con 0x7efd74100f70 2023-10-14T08:52:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.384+0000 7efd72ffd700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 0x7efd741972b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b530 tx=0x7efd5c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.385+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c011830 con 0x7efd74100f70 2023-10-14T08:52:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.385+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd5c011e50 con 0x7efd74100f70 2023-10-14T08:52:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.385+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7419eea0 con 0x7efd74100f70 2023-10-14T08:52:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.385+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00f2e0 con 0x7efd74100f70 2023-10-14T08:52:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.385+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7419f3f0 con 0x7efd74100f70 2023-10-14T08:52:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.386+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7410b770 con 0x7efd74100f70 2023-10-14T08:52:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.387+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7efd5c010580 con 0x7efd74100f70 2023-10-14T08:52:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.387+0000 7efd70ff9700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd600a1500 0x7efd600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.387+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7efd5c0cccc0 con 0x7efd74100f70 2023-10-14T08:52:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.387+0000 7efd737fe700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd600a1500 0x7efd600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.388+0000 7efd737fe700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd600a1500 0x7efd600a39c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd6400b5c0 tx=0x7efd64005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.391+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efd5c096320 con 0x7efd74100f70 2023-10-14T08:52:42.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:42 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/461257126' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:42.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:42 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2727812118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:42.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:42 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1427789173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:42.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:42 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/461257126' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:42.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:42 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2727812118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:42.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:42 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1427789173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:42.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.596+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd7419f640 con 0x7efd74100f70 2023-10-14T08:52:42.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.597+0000 7efd70ff9700 1 -- 172.21.15.6:0/2242332182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7efd5c015090 con 0x7efd74100f70 2023-10-14T08:52:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:42.599 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd600a1500 msgr2=0x7efd600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd600a1500 0x7efd600a39c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd6400b5c0 tx=0x7efd64005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 msgr2=0x7efd741972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 0x7efd741972b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00b530 tx=0x7efd5c00b8f0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 shutdown_connections 2023-10-14T08:52:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd74101930 0x7efd7419e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd600a1500 0x7efd600a39c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd740ffe20 0x7efd74196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 --2- 172.21.15.6:0/2242332182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd74100f70 0x7efd741972b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 >> 172.21.15.6:0/2242332182 conn(0x7efd740fb370 msgr2=0x7efd74068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 shutdown_connections 2023-10-14T08:52:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.599+0000 7efd7a086700 1 -- 172.21.15.6:0/2242332182 wait complete. 2023-10-14T08:52:42.613 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:42.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:42.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/461257126' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:42.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2727812118' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:42.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:42 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1427789173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:42.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 -- 172.21.15.6:0/670417219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8074e90 msgr2=0x7f02a80732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 --2- 172.21.15.6:0/670417219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8074e90 0x7f02a80732e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0290009990 tx=0x7f0290009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 -- 172.21.15.6:0/670417219 shutdown_connections 2023-10-14T08:52:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 --2- 172.21.15.6:0/670417219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02a8108ea0 0x7f02a810b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 --2- 172.21.15.6:0/670417219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8074e90 0x7f02a80732e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 --2- 172.21.15.6:0/670417219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a80738b0 0x7f02a8073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 -- 172.21.15.6:0/670417219 >> 172.21.15.6:0/670417219 conn(0x7f02a80fc520 msgr2=0x7f02a80fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 -- 172.21.15.6:0/670417219 shutdown_connections 2023-10-14T08:52:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.753+0000 7f02aca21700 1 -- 172.21.15.6:0/670417219 wait complete. 2023-10-14T08:52:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 Processor -- start 2023-10-14T08:52:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 -- start start 2023-10-14T08:52:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a80738b0 0x7f02a8198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02a8074e90 0x7f02a8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 0x7f02a81a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81a09a0 con 0x7f02a8108ea0 2023-10-14T08:52:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81a0ae0 con 0x7f02a80738b0 2023-10-14T08:52:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02aca21700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81a0c70 con 0x7f02a8074e90 2023-10-14T08:52:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 0x7f02a81a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 0x7f02a81a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60912/0 (socket says 172.21.15.6:60912) 2023-10-14T08:52:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 -- 172.21.15.6:0/2125077974 learned_addr learned my addr 172.21.15.6:0/2125077974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a659c700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a80738b0 0x7f02a8198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a5d9b700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02a8074e90 0x7f02a8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 -- 172.21.15.6:0/2125077974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02a8074e90 msgr2=0x7f02a8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02a8074e90 0x7f02a8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 -- 172.21.15.6:0/2125077974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a80738b0 msgr2=0x7f02a8198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a80738b0 0x7f02a8198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.754+0000 7f02a6d9d700 1 -- 172.21.15.6:0/2125077974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900095f0 con 0x7f02a8108ea0 2023-10-14T08:52:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.755+0000 7f02a6d9d700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 0x7f02a81a03d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f02a000ada0 tx=0x7f02a000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.755+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a000f070 con 0x7f02a8108ea0 2023-10-14T08:52:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.755+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02a0007b30 con 0x7f02a8108ea0 2023-10-14T08:52:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.755+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a81a0f50 con 0x7f02a8108ea0 2023-10-14T08:52:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.755+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a0005280 con 0x7f02a8108ea0 2023-10-14T08:52:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.755+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a81a1380 con 0x7f02a8108ea0 2023-10-14T08:52:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.756+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a81075a0 con 0x7f02a8108ea0 2023-10-14T08:52:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.757+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f02a000a090 con 0x7f02a8108ea0 2023-10-14T08:52:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.758+0000 7f029f7fe700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02940a1480 0x7f02940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.758+0000 7f02a659c700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02940a1480 0x7f02940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.758+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f02a00cc7c0 con 0x7f02a8108ea0 2023-10-14T08:52:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.758+0000 7f02a659c700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02940a1480 0x7f02940a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f029000b5c0 tx=0x7f0290005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.761+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f02a0099940 con 0x7f02a8108ea0 2023-10-14T08:52:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.960+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02a810ec00 con 0x7f02a8108ea0 2023-10-14T08:52:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.961+0000 7f029f7fe700 1 -- 172.21.15.6:0/2125077974 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02a00994d0 con 0x7f02a8108ea0 2023-10-14T08:52:42.963 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02940a1480 msgr2=0x7f02940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02940a1480 0x7f02940a3940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f029000b5c0 tx=0x7f0290005fd0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 msgr2=0x7f02a81a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 0x7f02a81a03d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f02a000ada0 tx=0x7f02a000c330 comp rx=0 tx=0).stop 2023-10-14T08:52:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 shutdown_connections 2023-10-14T08:52:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02a8108ea0 0x7f02a81a03d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f02940a1480 0x7f02940a3940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a80738b0 0x7f02a8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 --2- 172.21.15.6:0/2125077974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02a8074e90 0x7f02a8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 >> 172.21.15.6:0/2125077974 conn(0x7f02a80fc520 msgr2=0x7f02a80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 shutdown_connections 2023-10-14T08:52:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:42.963+0000 7f02aca21700 1 -- 172.21.15.6:0/2125077974 wait complete. 2023-10-14T08:52:42.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/2897177967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 msgr2=0x7f9eec1002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/2897177967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec1002c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009990 tx=0x7f9ee0009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/2897177967 shutdown_connections 2023-10-14T08:52:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/2897177967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9eec1019b0 0x7f9eec1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/2897177967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec1002c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/2897177967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec100ff0 0x7f9eec101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/2897177967 >> 172.21.15.6:0/2897177967 conn(0x7f9eec0fb430 msgr2=0x7f9eec0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/2897177967 shutdown_connections 2023-10-14T08:52:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/2897177967 wait complete. 2023-10-14T08:52:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.105+0000 7f9ef1d4f700 1 Processor -- start 2023-10-14T08:52:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 -- start start 2023-10-14T08:52:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9eec100ff0 0x7f9eec1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec1019b0 0x7f9eec19e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec19e800 con 0x7f9eec0ffea0 2023-10-14T08:52:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec19e970 con 0x7f9eec1019b0 2023-10-14T08:52:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9ef1d4f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec19eb30 con 0x7f9eec100ff0 2023-10-14T08:52:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60922/0 (socket says 172.21.15.6:60922) 2023-10-14T08:52:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 -- 172.21.15.6:0/309500675 learned_addr learned my addr 172.21.15.6:0/309500675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeaffd700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9eec100ff0 0x7f9eec1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eebfff700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec1019b0 0x7f9eec19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 -- 172.21.15.6:0/309500675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9eec100ff0 msgr2=0x7f9eec1971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9eec100ff0 0x7f9eec1971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 -- 172.21.15.6:0/309500675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec1019b0 msgr2=0x7f9eec19e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec1019b0 0x7f9eec19e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 -- 172.21.15.6:0/309500675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00095f0 con 0x7f9eec0ffea0 2023-10-14T08:52:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eebfff700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec1019b0 0x7f9eec19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.106+0000 7f9eeb7fe700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec196c90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0005910 tx=0x7f9ee0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.107+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee001d070 con 0x7f9eec0ffea0 2023-10-14T08:52:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.107+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec19edb0 con 0x7f9eec0ffea0 2023-10-14T08:52:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.107+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ee0004060 con 0x7f9eec0ffea0 2023-10-14T08:52:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.107+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0022e10 con 0x7f9eec0ffea0 2023-10-14T08:52:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.107+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec19f180 con 0x7f9eec0ffea0 2023-10-14T08:52:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.108+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec10b710 con 0x7f9eec0ffea0 2023-10-14T08:52:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.109+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9ee0022470 con 0x7f9eec0ffea0 2023-10-14T08:52:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.110+0000 7f9ee8ff9700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ed40a1480 0x7f9ed40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.110+0000 7f9eeaffd700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ed40a1480 0x7f9ed40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.110+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9ee00ce560 con 0x7f9eec0ffea0 2023-10-14T08:52:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.111+0000 7f9eeaffd700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ed40a1480 0x7f9ed40a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9edc005950 tx=0x7f9edc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.113+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ee0097ce0 con 0x7f9eec0ffea0 2023-10-14T08:52:43.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:43 smithi006 ceph-mon[99452]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-14T08:52:43.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:43 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2156981020' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:43.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:43 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2242332182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:43.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:43 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2125077974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.319+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9eec19f370 con 0x7f9eec0ffea0 2023-10-14T08:52:43.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.319+0000 7f9ee8ff9700 1 -- 172.21.15.6:0/309500675 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ee009b300 con 0x7f9eec0ffea0 2023-10-14T08:52:43.321 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:43.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ed40a1480 msgr2=0x7f9ed40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ed40a1480 0x7f9ed40a3940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9edc005950 tx=0x7f9edc0058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 msgr2=0x7f9eec196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec196c90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0005910 tx=0x7f9ee0005e80 comp rx=0 tx=0).stop 2023-10-14T08:52:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 shutdown_connections 2023-10-14T08:52:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9ed40a1480 0x7f9ed40a3940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9eec1019b0 0x7f9eec19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9eec0ffea0 0x7f9eec196c90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 --2- 172.21.15.6:0/309500675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9eec100ff0 0x7f9eec1971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 >> 172.21.15.6:0/309500675 conn(0x7f9eec0fb430 msgr2=0x7f9eec0681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 shutdown_connections 2023-10-14T08:52:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.321+0000 7f9ef1d4f700 1 -- 172.21.15.6:0/309500675 wait complete. 2023-10-14T08:52:43.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:43 smithi057 ceph-mon[103313]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-14T08:52:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:43 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2156981020' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:43 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2242332182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:43 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2125077974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 -- 172.21.15.6:0/34367864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 msgr2=0x7f35c01083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 --2- 172.21.15.6:0/34367864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01083b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b0a0 tx=0x7f35b800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 -- 172.21.15.6:0/34367864 shutdown_connections 2023-10-14T08:52:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 --2- 172.21.15.6:0/34367864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01083b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 --2- 172.21.15.6:0/34367864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 0x7f35c01018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 --2- 172.21.15.6:0/34367864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c0100150 0x7f35c01005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 -- 172.21.15.6:0/34367864 >> 172.21.15.6:0/34367864 conn(0x7f35c00fab80 msgr2=0x7f35c00fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 -- 172.21.15.6:0/34367864 shutdown_connections 2023-10-14T08:52:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 -- 172.21.15.6:0/34367864 wait complete. 2023-10-14T08:52:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.463+0000 7f35c5c58700 1 Processor -- start 2023-10-14T08:52:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 -- start start 2023-10-14T08:52:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c0100150 0x7f35c0196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 0x7f35c019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c019e8e0 con 0x7f35c0100b10 2023-10-14T08:52:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c019ea50 con 0x7f35c01014b0 2023-10-14T08:52:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35c5c58700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c019ec10 con 0x7f35c0100150 2023-10-14T08:52:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60938/0 (socket says 172.21.15.6:60938) 2023-10-14T08:52:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 -- 172.21.15.6:0/2470523575 learned_addr learned my addr 172.21.15.6:0/2470523575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35bf7fe700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c0100150 0x7f35c0196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35bffff700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 0x7f35c019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 -- 172.21.15.6:0/2470523575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c0100150 msgr2=0x7f35c0196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c0100150 0x7f35c0196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 -- 172.21.15.6:0/2470523575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 msgr2=0x7f35c019e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 0x7f35c019e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 -- 172.21.15.6:0/2470523575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8009d00 con 0x7f35c0100b10 2023-10-14T08:52:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35bffff700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 0x7f35c019e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.464+0000 7f35beffd700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01972e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f35b000d980 tx=0x7f35b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.465+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0009930 con 0x7f35c0100b10 2023-10-14T08:52:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.465+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35b0010460 con 0x7f35c0100b10 2023-10-14T08:52:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.465+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c019eef0 con 0x7f35c0100b10 2023-10-14T08:52:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.465+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000f620 con 0x7f35c0100b10 2023-10-14T08:52:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.465+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c019f310 con 0x7f35c0100b10 2023-10-14T08:52:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.466+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c010b6f0 con 0x7f35c0100b10 2023-10-14T08:52:43.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.467+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f35b0010860 con 0x7f35c0100b10 2023-10-14T08:52:43.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.467+0000 7f35bcff9700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35a80a1500 0x7f35a80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.468+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f35b00cc780 con 0x7f35c0100b10 2023-10-14T08:52:43.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.468+0000 7f35bf7fe700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35a80a1500 0x7f35a80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.468+0000 7f35bf7fe700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35a80a1500 0x7f35a80a39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35c0198270 tx=0x7f35b4007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:43.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.471+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35b0095e20 con 0x7f35c0100b10 2023-10-14T08:52:43.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:43 smithi178 ceph-mon[103612]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-14T08:52:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:43 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2156981020' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:43 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2242332182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:43 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2125077974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.670+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35c019f530 con 0x7f35c0100b10 2023-10-14T08:52:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.670+0000 7f35bcff9700 1 -- 172.21.15.6:0/2470523575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35b0020020 con 0x7f35c0100b10 2023-10-14T08:52:43.672 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:43.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35a80a1500 msgr2=0x7f35a80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35a80a1500 0x7f35a80a39c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f35c0198270 tx=0x7f35b4007400 comp rx=0 tx=0).stop 2023-10-14T08:52:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 msgr2=0x7f35c01972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01972e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f35b000d980 tx=0x7f35b000dc90 comp rx=0 tx=0).stop 2023-10-14T08:52:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 shutdown_connections 2023-10-14T08:52:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35a80a1500 0x7f35a80a39c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35c01014b0 0x7f35c019e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c0100150 0x7f35c0196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 --2- 172.21.15.6:0/2470523575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35c0100b10 0x7f35c01972e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 >> 172.21.15.6:0/2470523575 conn(0x7f35c00fab80 msgr2=0x7f35c00ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 shutdown_connections 2023-10-14T08:52:43.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.673+0000 7f35c5c58700 1 -- 172.21.15.6:0/2470523575 wait complete. 2023-10-14T08:52:43.687 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-14T08:52:43.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 -- 172.21.15.6:0/3209403765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804102060 msgr2=0x7fb8041024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3209403765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804102060 0x7fb8041024e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009990 tx=0x7fb7f8009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 -- 172.21.15.6:0/3209403765 shutdown_connections 2023-10-14T08:52:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3209403765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102a20 0x7fb804109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3209403765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb804100f10 0x7fb804101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3209403765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804102060 0x7fb8041024e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 -- 172.21.15.6:0/3209403765 >> 172.21.15.6:0/3209403765 conn(0x7fb8040fc460 msgr2=0x7fb8040fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 -- 172.21.15.6:0/3209403765 shutdown_connections 2023-10-14T08:52:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.812+0000 7fb80b85b700 1 -- 172.21.15.6:0/3209403765 wait complete. 2023-10-14T08:52:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 Processor -- start 2023-10-14T08:52:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 -- start start 2023-10-14T08:52:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 0x7fb804198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102060 0x7fb804199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb804102a20 0x7fb8041a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041a08c0 con 0x7fb804100f10 2023-10-14T08:52:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041a0a00 con 0x7fb804102a20 2023-10-14T08:52:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb80b85b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041a0b90 con 0x7fb804102060 2023-10-14T08:52:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb8095f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 0x7fb804198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb8095f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 0x7fb804198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60950/0 (socket says 172.21.15.6:60950) 2023-10-14T08:52:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb8095f7700 1 -- 172.21.15.6:0/3425492320 learned_addr learned my addr 172.21.15.6:0/3425492320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb809df8700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb804102a20 0x7fb8041a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.813+0000 7fb808df6700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102060 0x7fb804199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb8095f7700 1 -- 172.21.15.6:0/3425492320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102060 msgr2=0x7fb804199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb8095f7700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102060 0x7fb804199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb8095f7700 1 -- 172.21.15.6:0/3425492320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb804102a20 msgr2=0x7fb8041a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb8095f7700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb804102a20 0x7fb8041a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb8095f7700 1 -- 172.21.15.6:0/3425492320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80095f0 con 0x7fb804100f10 2023-10-14T08:52:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb808df6700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102060 0x7fb804199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb8095f7700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 0x7fb804198d40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb80000d950 tx=0x7fb80000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800009940 con 0x7fb804100f10 2023-10-14T08:52:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb800010460 con 0x7fb804100f10 2023-10-14T08:52:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8041a0e70 con 0x7fb804100f10 2023-10-14T08:52:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000f620 con 0x7fb804100f10 2023-10-14T08:52:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.814+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041a12a0 con 0x7fb804100f10 2023-10-14T08:52:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.815+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80410c760 con 0x7fb804100f10 2023-10-14T08:52:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.816+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb8000108d0 con 0x7fb804100f10 2023-10-14T08:52:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.817+0000 7fb7f67fc700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb7f00a1500 0x7fb7f00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.817+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb8000ccb20 con 0x7fb804100f10 2023-10-14T08:52:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.817+0000 7fb808df6700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb7f00a1500 0x7fb7f00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.817+0000 7fb808df6700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb7f00a1500 0x7fb7f00a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800b5c0 tx=0x7fb7f8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:43.820+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb800096140 con 0x7fb804100f10 2023-10-14T08:52:44.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.069+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8041a1490 con 0x7fb804100f10 2023-10-14T08:52:44.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.070+0000 7fb7f67fc700 1 -- 172.21.15.6:0/3425492320 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7fb800020090 con 0x7fb804100f10 2023-10-14T08:52:44.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:44.072 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:44.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb7f00a1500 msgr2=0x7fb7f00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb7f00a1500 0x7fb7f00a39c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800b5c0 tx=0x7fb7f8005fd0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 msgr2=0x7fb804198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 0x7fb804198d40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb80000d950 tx=0x7fb80000dc60 comp rx=0 tx=0).stop 2023-10-14T08:52:44.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 shutdown_connections 2023-10-14T08:52:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb7f00a1500 0x7fb7f00a39c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb804102a20 0x7fb8041a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb804100f10 0x7fb804198d40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 --2- 172.21.15.6:0/3425492320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb804102060 0x7fb804199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 >> 172.21.15.6:0/3425492320 conn(0x7fb8040fc460 msgr2=0x7fb804109130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 shutdown_connections 2023-10-14T08:52:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.072+0000 7fb80b85b700 1 -- 172.21.15.6:0/3425492320 wait complete. 2023-10-14T08:52:44.076 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:44.086 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-14T08:52:44.086 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-14T08:52:44.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T08:52:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 -- 172.21.15.6:0/2808843008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c100fd0 msgr2=0x7f865c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 --2- 172.21.15.6:0/2808843008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c100fd0 0x7f865c101430 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86500099c0 tx=0x7f8650009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 -- 172.21.15.6:0/2808843008 shutdown_connections 2023-10-14T08:52:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 --2- 172.21.15.6:0/2808843008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c101970 0x7f865c108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 --2- 172.21.15.6:0/2808843008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865c0ffde0 0x7f865c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 --2- 172.21.15.6:0/2808843008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c100fd0 0x7f865c101430 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 -- 172.21.15.6:0/2808843008 >> 172.21.15.6:0/2808843008 conn(0x7f865c0fb310 msgr2=0x7f865c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:44.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 -- 172.21.15.6:0/2808843008 shutdown_connections 2023-10-14T08:52:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 -- 172.21.15.6:0/2808843008 wait complete. 2023-10-14T08:52:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.213+0000 7f866104a700 1 Processor -- start 2023-10-14T08:52:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 -- start start 2023-10-14T08:52:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 0x7f865c196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c100fd0 0x7f865c197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865c101970 0x7f865c19e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c19e650 con 0x7f865c0ffde0 2023-10-14T08:52:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c19e790 con 0x7f865c101970 2023-10-14T08:52:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f866104a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c19e920 con 0x7f865c100fd0 2023-10-14T08:52:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 0x7f865c196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 0x7f865c196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60982/0 (socket says 172.21.15.6:60982) 2023-10-14T08:52:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 -- 172.21.15.6:0/1548392534 learned_addr learned my addr 172.21.15.6:0/1548392534 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865a59c700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c100fd0 0x7f865c197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865b59e700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865c101970 0x7f865c19e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 -- 172.21.15.6:0/1548392534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c100fd0 msgr2=0x7f865c197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c100fd0 0x7f865c197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 -- 172.21.15.6:0/1548392534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865c101970 msgr2=0x7f865c19e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865c101970 0x7f865c19e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.214+0000 7f865ad9d700 1 -- 172.21.15.6:0/1548392534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500095f0 con 0x7f865c0ffde0 2023-10-14T08:52:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.215+0000 7f865ad9d700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 0x7f865c196ad0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f864c00c990 tx=0x7f864c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.215+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c007b00 con 0x7f865c0ffde0 2023-10-14T08:52:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.215+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f864c007c60 con 0x7f865c0ffde0 2023-10-14T08:52:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.215+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c19ec00 con 0x7f865c0ffde0 2023-10-14T08:52:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.215+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c018660 con 0x7f865c0ffde0 2023-10-14T08:52:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.215+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c19f110 con 0x7f865c0ffde0 2023-10-14T08:52:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.216+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c107df0 con 0x7f865c0ffde0 2023-10-14T08:52:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.217+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f864c00f450 con 0x7f865c0ffde0 2023-10-14T08:52:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.218+0000 7f8643fff700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86440a1480 0x7f86440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.218+0000 7f865a59c700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86440a1480 0x7f86440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.218+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f864c0ccc30 con 0x7f865c0ffde0 2023-10-14T08:52:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.218+0000 7f865a59c700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86440a1480 0x7f86440a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8650006010 tx=0x7f8650005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.222+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f864c096290 con 0x7f865c0ffde0 2023-10-14T08:52:44.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.423+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f865c02d2e0 con 0x7f86440a1480 2023-10-14T08:52:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.436+0000 7f8643fff700 1 -- 172.21.15.6:0/1548392534 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344570 (secure 0 0 0) 0x7f865c02d2e0 con 0x7f86440a1480 2023-10-14T08:52:44.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:44.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:44 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/309500675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:44.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:44 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2470523575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:44.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:44 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3425492320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:44.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86440a1480 msgr2=0x7f86440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86440a1480 0x7f86440a3940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8650006010 tx=0x7f8650005c40 comp rx=0 tx=0).stop 2023-10-14T08:52:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 msgr2=0x7f865c196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 0x7f865c196ad0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f864c00c990 tx=0x7f864c00cca0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 shutdown_connections 2023-10-14T08:52:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86440a1480 0x7f86440a3940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865c101970 0x7f865c19e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f865c0ffde0 0x7f865c196ad0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 --2- 172.21.15.6:0/1548392534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c100fd0 0x7f865c197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 >> 172.21.15.6:0/1548392534 conn(0x7f865c0fb310 msgr2=0x7f865c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:44.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 shutdown_connections 2023-10-14T08:52:44.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.439+0000 7f866104a700 1 -- 172.21.15.6:0/1548392534 wait complete. 2023-10-14T08:52:44.448 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:52:44.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:44 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/309500675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:44.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:44 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2470523575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:44.452 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:44 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3425492320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:44.453 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-10-14T08:52:43.456375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656709,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":917,"num_read_kb":577,"num_write":420,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1240717,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":847,"ondisk_log_size":847,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337196,"kb_used_data":13004,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604628,"statfs":{"total":1151940427776,"available":1151595139072,"internally_reserved":0,"allocated":13316096,"data_stored":7261741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":68,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004855"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477711+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:52:33.477711+0000","last_peered":"2023-10-14T08:52:33.477711+0000","last_clean":"2023-10-14T08:52:33.477711+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:52:33.477711+0000","last_undegraded":"2023-10-14T08:52:33.477711+0000","last_fullsized":"2023-10-14T08:52:33.477711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482316+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:52:33.482316+0000","last_peered":"2023-10-14T08:52:33.482316+0000","last_clean":"2023-10-14T08:52:33.482316+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:52:33.482316+0000","last_undegraded":"2023-10-14T08:52:33.482316+0000","last_fullsized":"2023-10-14T08:52:33.482316+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481572+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:52:33.481572+0000","last_peered":"2023-10-14T08:52:33.481572+0000","last_clean":"2023-10-14T08:52:33.481572+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:52:33.481572+0000","last_undegraded":"2023-10-14T08:52:33.481572+0000","last_fullsized":"2023-10-14T08:52:33.481572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485097+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:52:33.485097+0000","last_peered":"2023-10-14T08:52:33.485097+0000","last_clean":"2023-10-14T08:52:33.485097+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:52:33.485097+0000","last_undegraded":"2023-10-14T08:52:33.485097+0000","last_fullsized":"2023-10-14T08:52:33.485097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.472716+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:52:33.472716+0000","last_peered":"2023-10-14T08:52:33.472716+0000","last_clean":"2023-10-14T08:52:33.472716+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:52:33.472716+0000","last_undegraded":"2023-10-14T08:52:33.472716+0000","last_fullsized":"2023-10-14T08:52:33.472716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485094+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:52:33.485094+0000","last_peered":"2023-10-14T08:52:33.485094+0000","last_clean":"2023-10-14T08:52:33.485094+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:52:33.485094+0000","last_undegraded":"2023-10-14T08:52:33.485094+0000","last_fullsized":"2023-10-14T08:52:33.485094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482319+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:52:33.482319+0000","last_peered":"2023-10-14T08:52:33.482319+0000","last_clean":"2023-10-14T08:52:33.482319+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:52:33.482319+0000","last_undegraded":"2023-10-14T08:52:33.482319+0000","last_fullsized":"2023-10-14T08:52:33.482319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479580+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:52:33.479580+0000","last_peered":"2023-10-14T08:52:33.479580+0000","last_clean":"2023-10-14T08:52:33.479580+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:52:33.479580+0000","last_undegraded":"2023-10-14T08:52:33.479580+0000","last_fullsized":"2023-10-14T08:52:33.479580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486211+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:52:33.486211+0000","last_peered":"2023-10-14T08:52:33.486211+0000","last_clean":"2023-10-14T08:52:33.486211+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:52:33.486211+0000","last_undegraded":"2023-10-14T08:52:33.486211+0000","last_fullsized":"2023-10-14T08:52:33.486211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486016+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:52:33.486016+0000","last_peered":"2023-10-14T08:52:33.486016+0000","last_clean":"2023-10-14T08:52:33.486016+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:52:33.486016+0000","last_undegraded":"2023-10-14T08:52:33.486016+0000","last_fullsized":"2023-10-14T08:52:33.486016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482700+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:52:33.482700+0000","last_peered":"2023-10-14T08:52:33.482700+0000","last_clean":"2023-10-14T08:52:33.482700+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:52:33.482700+0000","last_undegraded":"2023-10-14T08:52:33.482700+0000","last_fullsized":"2023-10-14T08:52:33.482700+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479581+0000","last_change":"2023-10-14T08:52:04.456618+0000","last_active":"2023-10-14T08:52:33.479581+0000","last_peered":"2023-10-14T08:52:33.479581+0000","last_clean":"2023-10-14T08:52:33.479581+0000","last_became_active":"2023-10-14T08:52:04.456226+0000","last_became_peered":"2023-10-14T08:52:04.456226+0000","last_unstale":"2023-10-14T08:52:33.479581+0000","last_undegraded":"2023-10-14T08:52:33.479581+0000","last_fullsized":"2023-10-14T08:52:33.479581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:03:55.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478571+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:52:33.478571+0000","last_peered":"2023-10-14T08:52:33.478571+0000","last_clean":"2023-10-14T08:52:33.478571+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:52:33.478571+0000","last_undegraded":"2023-10-14T08:52:33.478571+0000","last_fullsized":"2023-10-14T08:52:33.478571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481329+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:52:33.481329+0000","last_peered":"2023-10-14T08:52:33.481329+0000","last_clean":"2023-10-14T08:52:33.481329+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:52:33.481329+0000","last_undegraded":"2023-10-14T08:52:33.481329+0000","last_fullsized":"2023-10-14T08:52:33.481329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478692+0000","last_change":"2023-10-14T08:52:04.456089+0000","last_active":"2023-10-14T08:52:33.478692+0000","last_peered":"2023-10-14T08:52:33.478692+0000","last_clean":"2023-10-14T08:52:33.478692+0000","last_became_active":"2023-10-14T08:52:04.455671+0000","last_became_peered":"2023-10-14T08:52:04.455671+0000","last_unstale":"2023-10-14T08:52:33.478692+0000","last_undegraded":"2023-10-14T08:52:33.478692+0000","last_fullsized":"2023-10-14T08:52:33.478692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:59.639694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479608+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:52:33.479608+0000","last_peered":"2023-10-14T08:52:33.479608+0000","last_clean":"2023-10-14T08:52:33.479608+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:52:33.479608+0000","last_undegraded":"2023-10-14T08:52:33.479608+0000","last_fullsized":"2023-10-14T08:52:33.479608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477938+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:52:33.477938+0000","last_peered":"2023-10-14T08:52:33.477938+0000","last_clean":"2023-10-14T08:52:33.477938+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:52:33.477938+0000","last_undegraded":"2023-10-14T08:52:33.477938+0000","last_fullsized":"2023-10-14T08:52:33.477938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480796+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:52:33.480796+0000","last_peered":"2023-10-14T08:52:33.480796+0000","last_clean":"2023-10-14T08:52:33.480796+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:52:33.480796+0000","last_undegraded":"2023-10-14T08:52:33.480796+0000","last_fullsized":"2023-10-14T08:52:33.480796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486271+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:52:33.486271+0000","last_peered":"2023-10-14T08:52:33.486271+0000","last_clean":"2023-10-14T08:52:33.486271+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:52:33.486271+0000","last_undegraded":"2023-10-14T08:52:33.486271+0000","last_fullsized":"2023-10-14T08:52:33.486271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.504016+0000","last_change":"2023-10-14T08:52:04.465622+0000","last_active":"2023-10-14T08:52:39.504016+0000","last_peered":"2023-10-14T08:52:39.504016+0000","last_clean":"2023-10-14T08:52:39.504016+0000","last_became_active":"2023-10-14T08:52:04.455831+0000","last_became_peered":"2023-10-14T08:52:04.455831+0000","last_unstale":"2023-10-14T08:52:39.504016+0000","last_undegraded":"2023-10-14T08:52:39.504016+0000","last_fullsized":"2023-10-14T08:52:39.504016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:49.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480271+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:52:33.480271+0000","last_peered":"2023-10-14T08:52:33.480271+0000","last_clean":"2023-10-14T08:52:33.480271+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:52:33.480271+0000","last_undegraded":"2023-10-14T08:52:33.480271+0000","last_fullsized":"2023-10-14T08:52:33.480271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.549043+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:52:03.549043+0000","last_peered":"2023-10-14T08:52:03.549043+0000","last_clean":"2023-10-14T08:52:03.549043+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:52:03.549043+0000","last_undegraded":"2023-10-14T08:52:03.549043+0000","last_fullsized":"2023-10-14T08:52:03.549043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482984+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:52:33.482984+0000","last_peered":"2023-10-14T08:52:33.482984+0000","last_clean":"2023-10-14T08:52:33.482984+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:52:33.482984+0000","last_undegraded":"2023-10-14T08:52:33.482984+0000","last_fullsized":"2023-10-14T08:52:33.482984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450130+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:52:03.450130+0000","last_peered":"2023-10-14T08:52:03.450130+0000","last_clean":"2023-10-14T08:52:03.450130+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:52:03.450130+0000","last_undegraded":"2023-10-14T08:52:03.450130+0000","last_fullsized":"2023-10-14T08:52:03.450130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480890+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:52:33.480890+0000","last_peered":"2023-10-14T08:52:33.480890+0000","last_clean":"2023-10-14T08:52:33.480890+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:52:33.480890+0000","last_undegraded":"2023-10-14T08:52:33.480890+0000","last_fullsized":"2023-10-14T08:52:33.480890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450012+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:52:03.450012+0000","last_peered":"2023-10-14T08:52:03.450012+0000","last_clean":"2023-10-14T08:52:03.450012+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:52:03.450012+0000","last_undegraded":"2023-10-14T08:52:03.450012+0000","last_fullsized":"2023-10-14T08:52:03.450012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488681+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:52:33.488681+0000","last_peered":"2023-10-14T08:52:33.488681+0000","last_clean":"2023-10-14T08:52:33.488681+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:52:33.488681+0000","last_undegraded":"2023-10-14T08:52:33.488681+0000","last_fullsized":"2023-10-14T08:52:33.488681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":117,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:40.517956+0000","last_change":"2023-10-14T08:52:04.467782+0000","last_active":"2023-10-14T08:52:40.517956+0000","last_peered":"2023-10-14T08:52:40.517956+0000","last_clean":"2023-10-14T08:52:40.517956+0000","last_became_active":"2023-10-14T08:52:04.459237+0000","last_became_peered":"2023-10-14T08:52:04.459237+0000","last_unstale":"2023-10-14T08:52:40.517956+0000","last_undegraded":"2023-10-14T08:52:40.517956+0000","last_fullsized":"2023-10-14T08:52:40.517956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:15:54.861129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481415+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:52:33.481415+0000","last_peered":"2023-10-14T08:52:33.481415+0000","last_clean":"2023-10-14T08:52:33.481415+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:52:33.481415+0000","last_undegraded":"2023-10-14T08:52:33.481415+0000","last_fullsized":"2023-10-14T08:52:33.481415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.839027+0000","last_change":"2023-10-14T08:52:04.839027+0000","last_active":"2023-10-14T08:52:04.839027+0000","last_peered":"2023-10-14T08:52:04.839027+0000","last_clean":"2023-10-14T08:52:04.839027+0000","last_became_active":"2023-10-14T08:52:04.832065+0000","last_became_peered":"2023-10-14T08:52:04.832065+0000","last_unstale":"2023-10-14T08:52:04.839027+0000","last_undegraded":"2023-10-14T08:52:04.839027+0000","last_fullsized":"2023-10-14T08:52:04.839027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:33.970140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480517+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:52:33.480517+0000","last_peered":"2023-10-14T08:52:33.480517+0000","last_clean":"2023-10-14T08:52:33.480517+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:52:33.480517+0000","last_undegraded":"2023-10-14T08:52:33.480517+0000","last_fullsized":"2023-10-14T08:52:33.480517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454545+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:52:03.454545+0000","last_peered":"2023-10-14T08:52:03.454545+0000","last_clean":"2023-10-14T08:52:03.454545+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:52:03.454545+0000","last_undegraded":"2023-10-14T08:52:03.454545+0000","last_fullsized":"2023-10-14T08:52:03.454545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480274+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:52:33.480274+0000","last_peered":"2023-10-14T08:52:33.480274+0000","last_clean":"2023-10-14T08:52:33.480274+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:52:33.480274+0000","last_undegraded":"2023-10-14T08:52:33.480274+0000","last_fullsized":"2023-10-14T08:52:33.480274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453663+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:52:03.453663+0000","last_peered":"2023-10-14T08:52:03.453663+0000","last_clean":"2023-10-14T08:52:03.453663+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:52:03.453663+0000","last_undegraded":"2023-10-14T08:52:03.453663+0000","last_fullsized":"2023-10-14T08:52:03.453663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482449+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:52:33.482449+0000","last_peered":"2023-10-14T08:52:33.482449+0000","last_clean":"2023-10-14T08:52:33.482449+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:52:33.482449+0000","last_undegraded":"2023-10-14T08:52:33.482449+0000","last_fullsized":"2023-10-14T08:52:33.482449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":178,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:41.286292+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:52:41.286292+0000","last_peered":"2023-10-14T08:52:41.286292+0000","last_clean":"2023-10-14T08:52:41.286292+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:52:41.286292+0000","last_undegraded":"2023-10-14T08:52:41.286292+0000","last_fullsized":"2023-10-14T08:52:41.286292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486638+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:52:33.486638+0000","last_peered":"2023-10-14T08:52:33.486638+0000","last_clean":"2023-10-14T08:52:33.486638+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:52:33.486638+0000","last_undegraded":"2023-10-14T08:52:33.486638+0000","last_fullsized":"2023-10-14T08:52:33.486638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453618+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:52:03.453618+0000","last_peered":"2023-10-14T08:52:03.453618+0000","last_clean":"2023-10-14T08:52:03.453618+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:52:03.453618+0000","last_undegraded":"2023-10-14T08:52:03.453618+0000","last_fullsized":"2023-10-14T08:52:03.453618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482782+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:52:33.482782+0000","last_peered":"2023-10-14T08:52:33.482782+0000","last_clean":"2023-10-14T08:52:33.482782+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:52:33.482782+0000","last_undegraded":"2023-10-14T08:52:33.482782+0000","last_fullsized":"2023-10-14T08:52:33.482782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454838+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:52:03.454838+0000","last_peered":"2023-10-14T08:52:03.454838+0000","last_clean":"2023-10-14T08:52:03.454838+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:52:03.454838+0000","last_undegraded":"2023-10-14T08:52:03.454838+0000","last_fullsized":"2023-10-14T08:52:03.454838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487341+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:52:33.487341+0000","last_peered":"2023-10-14T08:52:33.487341+0000","last_clean":"2023-10-14T08:52:33.487341+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:52:33.487341+0000","last_undegraded":"2023-10-14T08:52:33.487341+0000","last_fullsized":"2023-10-14T08:52:33.487341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":240,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:40.895685+0000","last_change":"2023-10-14T08:52:04.847819+0000","last_active":"2023-10-14T08:52:40.895685+0000","last_peered":"2023-10-14T08:52:40.895685+0000","last_clean":"2023-10-14T08:52:40.895685+0000","last_became_active":"2023-10-14T08:52:04.833768+0000","last_became_peered":"2023-10-14T08:52:04.833768+0000","last_unstale":"2023-10-14T08:52:40.895685+0000","last_undegraded":"2023-10-14T08:52:40.895685+0000","last_fullsized":"2023-10-14T08:52:40.895685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:34.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59142,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":134,"num_write":35,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58575,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478496+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:52:33.478496+0000","last_peered":"2023-10-14T08:52:33.478496+0000","last_clean":"2023-10-14T08:52:33.478496+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:52:33.478496+0000","last_undegraded":"2023-10-14T08:52:33.478496+0000","last_fullsized":"2023-10-14T08:52:33.478496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452996+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:52:03.452996+0000","last_peered":"2023-10-14T08:52:03.452996+0000","last_clean":"2023-10-14T08:52:03.452996+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:52:03.452996+0000","last_undegraded":"2023-10-14T08:52:03.452996+0000","last_fullsized":"2023-10-14T08:52:03.452996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.472884+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:52:33.472884+0000","last_peered":"2023-10-14T08:52:33.472884+0000","last_clean":"2023-10-14T08:52:33.472884+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:52:33.472884+0000","last_undegraded":"2023-10-14T08:52:33.472884+0000","last_fullsized":"2023-10-14T08:52:33.472884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454880+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:52:03.454880+0000","last_peered":"2023-10-14T08:52:03.454880+0000","last_clean":"2023-10-14T08:52:03.454880+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:52:03.454880+0000","last_undegraded":"2023-10-14T08:52:03.454880+0000","last_fullsized":"2023-10-14T08:52:03.454880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487252+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:52:33.487252+0000","last_peered":"2023-10-14T08:52:33.487252+0000","last_clean":"2023-10-14T08:52:33.487252+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:52:33.487252+0000","last_undegraded":"2023-10-14T08:52:33.487252+0000","last_fullsized":"2023-10-14T08:52:33.487252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.284024+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:52:39.284024+0000","last_peered":"2023-10-14T08:52:39.284024+0000","last_clean":"2023-10-14T08:52:39.284024+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:52:39.284024+0000","last_undegraded":"2023-10-14T08:52:39.284024+0000","last_fullsized":"2023-10-14T08:52:39.284024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479470+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:52:33.479470+0000","last_peered":"2023-10-14T08:52:33.479470+0000","last_clean":"2023-10-14T08:52:33.479470+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:52:33.479470+0000","last_undegraded":"2023-10-14T08:52:33.479470+0000","last_fullsized":"2023-10-14T08:52:33.479470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.469743+0000","last_change":"2023-10-14T08:52:04.469342+0000","last_active":"2023-10-14T08:52:04.469743+0000","last_peered":"2023-10-14T08:52:04.469743+0000","last_clean":"2023-10-14T08:52:04.469743+0000","last_became_active":"2023-10-14T08:52:04.454202+0000","last_became_peered":"2023-10-14T08:52:04.454202+0000","last_unstale":"2023-10-14T08:52:04.469743+0000","last_undegraded":"2023-10-14T08:52:04.469743+0000","last_fullsized":"2023-10-14T08:52:04.469743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.377924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488047+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:52:33.488047+0000","last_peered":"2023-10-14T08:52:33.488047+0000","last_clean":"2023-10-14T08:52:33.488047+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:52:33.488047+0000","last_undegraded":"2023-10-14T08:52:33.488047+0000","last_fullsized":"2023-10-14T08:52:33.488047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.449764+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:52:03.449764+0000","last_peered":"2023-10-14T08:52:03.449764+0000","last_clean":"2023-10-14T08:52:03.449764+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:52:03.449764+0000","last_undegraded":"2023-10-14T08:52:03.449764+0000","last_fullsized":"2023-10-14T08:52:03.449764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.483217+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:52:33.483217+0000","last_peered":"2023-10-14T08:52:33.483217+0000","last_clean":"2023-10-14T08:52:33.483217+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:52:33.483217+0000","last_undegraded":"2023-10-14T08:52:33.483217+0000","last_fullsized":"2023-10-14T08:52:33.483217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.446910+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:52:03.446910+0000","last_peered":"2023-10-14T08:52:03.446910+0000","last_clean":"2023-10-14T08:52:03.446910+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:52:03.446910+0000","last_undegraded":"2023-10-14T08:52:03.446910+0000","last_fullsized":"2023-10-14T08:52:03.446910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476615+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:52:33.476615+0000","last_peered":"2023-10-14T08:52:33.476615+0000","last_clean":"2023-10-14T08:52:33.476615+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:52:33.476615+0000","last_undegraded":"2023-10-14T08:52:33.476615+0000","last_fullsized":"2023-10-14T08:52:33.476615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.504637+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:52:39.504637+0000","last_peered":"2023-10-14T08:52:39.504637+0000","last_clean":"2023-10-14T08:52:39.504637+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:52:39.504637+0000","last_undegraded":"2023-10-14T08:52:39.504637+0000","last_fullsized":"2023-10-14T08:52:39.504637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484299+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:52:33.484299+0000","last_peered":"2023-10-14T08:52:33.484299+0000","last_clean":"2023-10-14T08:52:33.484299+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:52:33.484299+0000","last_undegraded":"2023-10-14T08:52:33.484299+0000","last_fullsized":"2023-10-14T08:52:33.484299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477044+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:52:33.477044+0000","last_peered":"2023-10-14T08:52:33.477044+0000","last_clean":"2023-10-14T08:52:33.477044+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:52:33.477044+0000","last_undegraded":"2023-10-14T08:52:33.477044+0000","last_fullsized":"2023-10-14T08:52:33.477044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:38.282034+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:52:38.282034+0000","last_peered":"2023-10-14T08:52:38.282034+0000","last_clean":"2023-10-14T08:52:38.282034+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:52:38.282034+0000","last_undegraded":"2023-10-14T08:52:38.282034+0000","last_fullsized":"2023-10-14T08:52:38.282034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478084+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:52:33.478084+0000","last_peered":"2023-10-14T08:52:33.478084+0000","last_clean":"2023-10-14T08:52:33.478084+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:52:33.478084+0000","last_undegraded":"2023-10-14T08:52:33.478084+0000","last_fullsized":"2023-10-14T08:52:33.478084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453005+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:52:03.453005+0000","last_peered":"2023-10-14T08:52:03.453005+0000","last_clean":"2023-10-14T08:52:03.453005+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:52:03.453005+0000","last_undegraded":"2023-10-14T08:52:03.453005+0000","last_fullsized":"2023-10-14T08:52:03.453005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.451187+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:52:03.451187+0000","last_peered":"2023-10-14T08:52:03.451187+0000","last_clean":"2023-10-14T08:52:03.451187+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:52:03.451187+0000","last_undegraded":"2023-10-14T08:52:03.451187+0000","last_fullsized":"2023-10-14T08:52:03.451187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484082+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:52:33.484082+0000","last_peered":"2023-10-14T08:52:33.484082+0000","last_clean":"2023-10-14T08:52:33.484082+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:52:33.484082+0000","last_undegraded":"2023-10-14T08:52:33.484082+0000","last_fullsized":"2023-10-14T08:52:33.484082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452204+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:52:03.452204+0000","last_peered":"2023-10-14T08:52:03.452204+0000","last_clean":"2023-10-14T08:52:03.452204+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:52:03.452204+0000","last_undegraded":"2023-10-14T08:52:03.452204+0000","last_fullsized":"2023-10-14T08:52:03.452204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450005+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:52:03.450005+0000","last_peered":"2023-10-14T08:52:03.450005+0000","last_clean":"2023-10-14T08:52:03.450005+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:52:03.450005+0000","last_undegraded":"2023-10-14T08:52:03.450005+0000","last_fullsized":"2023-10-14T08:52:03.450005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480148+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:52:33.480148+0000","last_peered":"2023-10-14T08:52:33.480148+0000","last_clean":"2023-10-14T08:52:33.480148+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:52:33.480148+0000","last_undegraded":"2023-10-14T08:52:33.480148+0000","last_fullsized":"2023-10-14T08:52:33.480148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'10","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.451638+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:52:04.451638+0000","last_peered":"2023-10-14T08:52:04.451638+0000","last_clean":"2023-10-14T08:52:04.451638+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:52:04.451638+0000","last_undegraded":"2023-10-14T08:52:04.451638+0000","last_fullsized":"2023-10-14T08:52:04.451638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480765+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:52:33.480765+0000","last_peered":"2023-10-14T08:52:33.480765+0000","last_clean":"2023-10-14T08:52:33.480765+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:52:33.480765+0000","last_undegraded":"2023-10-14T08:52:33.480765+0000","last_fullsized":"2023-10-14T08:52:33.480765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454667+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:52:03.454667+0000","last_peered":"2023-10-14T08:52:03.454667+0000","last_clean":"2023-10-14T08:52:03.454667+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:52:03.454667+0000","last_undegraded":"2023-10-14T08:52:03.454667+0000","last_fullsized":"2023-10-14T08:52:03.454667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485895+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:52:33.485895+0000","last_peered":"2023-10-14T08:52:33.485895+0000","last_clean":"2023-10-14T08:52:33.485895+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:52:33.485895+0000","last_undegraded":"2023-10-14T08:52:33.485895+0000","last_fullsized":"2023-10-14T08:52:33.485895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456628+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:52:03.456628+0000","last_peered":"2023-10-14T08:52:03.456628+0000","last_clean":"2023-10-14T08:52:03.456628+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:52:03.456628+0000","last_undegraded":"2023-10-14T08:52:03.456628+0000","last_fullsized":"2023-10-14T08:52:03.456628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.460787+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:52:33.460787+0000","last_peered":"2023-10-14T08:52:33.460787+0000","last_clean":"2023-10-14T08:52:33.460787+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:52:33.460787+0000","last_undegraded":"2023-10-14T08:52:33.460787+0000","last_fullsized":"2023-10-14T08:52:33.460787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.548779+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:52:03.548779+0000","last_peered":"2023-10-14T08:52:03.548779+0000","last_clean":"2023-10-14T08:52:03.548779+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:52:03.548779+0000","last_undegraded":"2023-10-14T08:52:03.548779+0000","last_fullsized":"2023-10-14T08:52:03.548779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478911+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:52:33.478911+0000","last_peered":"2023-10-14T08:52:33.478911+0000","last_clean":"2023-10-14T08:52:33.478911+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:52:33.478911+0000","last_undegraded":"2023-10-14T08:52:33.478911+0000","last_fullsized":"2023-10-14T08:52:33.478911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453327+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:52:03.453327+0000","last_peered":"2023-10-14T08:52:03.453327+0000","last_clean":"2023-10-14T08:52:03.453327+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:52:03.453327+0000","last_undegraded":"2023-10-14T08:52:03.453327+0000","last_fullsized":"2023-10-14T08:52:03.453327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476989+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:52:33.476989+0000","last_peered":"2023-10-14T08:52:33.476989+0000","last_clean":"2023-10-14T08:52:33.476989+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:52:33.476989+0000","last_undegraded":"2023-10-14T08:52:33.476989+0000","last_fullsized":"2023-10-14T08:52:33.476989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.449416+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:52:03.449416+0000","last_peered":"2023-10-14T08:52:03.449416+0000","last_clean":"2023-10-14T08:52:03.449416+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:52:03.449416+0000","last_undegraded":"2023-10-14T08:52:03.449416+0000","last_fullsized":"2023-10-14T08:52:03.449416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486206+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:52:33.486206+0000","last_peered":"2023-10-14T08:52:33.486206+0000","last_clean":"2023-10-14T08:52:33.486206+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:52:33.486206+0000","last_undegraded":"2023-10-14T08:52:33.486206+0000","last_fullsized":"2023-10-14T08:52:33.486206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:38.282644+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:52:38.282644+0000","last_peered":"2023-10-14T08:52:38.282644+0000","last_clean":"2023-10-14T08:52:38.282644+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:52:38.282644+0000","last_undegraded":"2023-10-14T08:52:38.282644+0000","last_fullsized":"2023-10-14T08:52:38.282644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482564+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:52:33.482564+0000","last_peered":"2023-10-14T08:52:33.482564+0000","last_clean":"2023-10-14T08:52:33.482564+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:52:33.482564+0000","last_undegraded":"2023-10-14T08:52:33.482564+0000","last_fullsized":"2023-10-14T08:52:33.482564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454674+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:52:03.454674+0000","last_peered":"2023-10-14T08:52:03.454674+0000","last_clean":"2023-10-14T08:52:03.454674+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:52:03.454674+0000","last_undegraded":"2023-10-14T08:52:03.454674+0000","last_fullsized":"2023-10-14T08:52:03.454674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477586+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:52:33.477586+0000","last_peered":"2023-10-14T08:52:33.477586+0000","last_clean":"2023-10-14T08:52:33.477586+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:52:33.477586+0000","last_undegraded":"2023-10-14T08:52:33.477586+0000","last_fullsized":"2023-10-14T08:52:33.477586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454918+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:52:03.454918+0000","last_peered":"2023-10-14T08:52:03.454918+0000","last_clean":"2023-10-14T08:52:03.454918+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:52:03.454918+0000","last_undegraded":"2023-10-14T08:52:03.454918+0000","last_fullsized":"2023-10-14T08:52:03.454918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481522+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:52:33.481522+0000","last_peered":"2023-10-14T08:52:33.481522+0000","last_clean":"2023-10-14T08:52:33.481522+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:52:33.481522+0000","last_undegraded":"2023-10-14T08:52:33.481522+0000","last_fullsized":"2023-10-14T08:52:33.481522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479680+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:52:33.479680+0000","last_peered":"2023-10-14T08:52:33.479680+0000","last_clean":"2023-10-14T08:52:33.479680+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:52:33.479680+0000","last_undegraded":"2023-10-14T08:52:33.479680+0000","last_fullsized":"2023-10-14T08:52:33.479680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487937+0000","last_change":"2023-10-14T08:52:04.831658+0000","last_active":"2023-10-14T08:52:33.487937+0000","last_peered":"2023-10-14T08:52:33.487937+0000","last_clean":"2023-10-14T08:52:33.487937+0000","last_became_active":"2023-10-14T08:52:04.831331+0000","last_became_peered":"2023-10-14T08:52:04.831331+0000","last_unstale":"2023-10-14T08:52:33.487937+0000","last_undegraded":"2023-10-14T08:52:33.487937+0000","last_fullsized":"2023-10-14T08:52:33.487937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:48:52.884720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485796+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:52:33.485796+0000","last_peered":"2023-10-14T08:52:33.485796+0000","last_clean":"2023-10-14T08:52:33.485796+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:52:33.485796+0000","last_undegraded":"2023-10-14T08:52:33.485796+0000","last_fullsized":"2023-10-14T08:52:33.485796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481732+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:52:33.481732+0000","last_peered":"2023-10-14T08:52:33.481732+0000","last_clean":"2023-10-14T08:52:33.481732+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:52:33.481732+0000","last_undegraded":"2023-10-14T08:52:33.481732+0000","last_fullsized":"2023-10-14T08:52:33.481732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484062+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:52:33.484062+0000","last_peered":"2023-10-14T08:52:33.484062+0000","last_clean":"2023-10-14T08:52:33.484062+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:52:33.484062+0000","last_undegraded":"2023-10-14T08:52:33.484062+0000","last_fullsized":"2023-10-14T08:52:33.484062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476685+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:52:33.476685+0000","last_peered":"2023-10-14T08:52:33.476685+0000","last_clean":"2023-10-14T08:52:33.476685+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:52:33.476685+0000","last_undegraded":"2023-10-14T08:52:33.476685+0000","last_fullsized":"2023-10-14T08:52:33.476685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488984+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:52:33.488984+0000","last_peered":"2023-10-14T08:52:33.488984+0000","last_clean":"2023-10-14T08:52:33.488984+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:52:33.488984+0000","last_undegraded":"2023-10-14T08:52:33.488984+0000","last_fullsized":"2023-10-14T08:52:33.488984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484932+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:52:33.484932+0000","last_peered":"2023-10-14T08:52:33.484932+0000","last_clean":"2023-10-14T08:52:33.484932+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:52:33.484932+0000","last_undegraded":"2023-10-14T08:52:33.484932+0000","last_fullsized":"2023-10-14T08:52:33.484932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485817+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:52:33.485817+0000","last_peered":"2023-10-14T08:52:33.485817+0000","last_clean":"2023-10-14T08:52:33.485817+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:52:33.485817+0000","last_undegraded":"2023-10-14T08:52:33.485817+0000","last_fullsized":"2023-10-14T08:52:33.485817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485317+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:52:33.485317+0000","last_peered":"2023-10-14T08:52:33.485317+0000","last_clean":"2023-10-14T08:52:33.485317+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:52:33.485317+0000","last_undegraded":"2023-10-14T08:52:33.485317+0000","last_fullsized":"2023-10-14T08:52:33.485317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479941+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:52:33.479941+0000","last_peered":"2023-10-14T08:52:33.479941+0000","last_clean":"2023-10-14T08:52:33.479941+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:52:33.479941+0000","last_undegraded":"2023-10-14T08:52:33.479941+0000","last_fullsized":"2023-10-14T08:52:33.479941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476620+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:52:33.476620+0000","last_peered":"2023-10-14T08:52:33.476620+0000","last_clean":"2023-10-14T08:52:33.476620+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:52:33.476620+0000","last_undegraded":"2023-10-14T08:52:33.476620+0000","last_fullsized":"2023-10-14T08:52:33.476620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.475420+0000","last_change":"2023-10-14T08:52:04.456448+0000","last_active":"2023-10-14T08:52:33.475420+0000","last_peered":"2023-10-14T08:52:33.475420+0000","last_clean":"2023-10-14T08:52:33.475420+0000","last_became_active":"2023-10-14T08:52:04.456002+0000","last_became_peered":"2023-10-14T08:52:04.456002+0000","last_unstale":"2023-10-14T08:52:33.475420+0000","last_undegraded":"2023-10-14T08:52:33.475420+0000","last_fullsized":"2023-10-14T08:52:33.475420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:00.467295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66095,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":791,"num_read_kb":468,"num_write":237,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":59981,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481821,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":443104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.75},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78600000000000003,"5min":1.129,"15min":1.129},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46800000000000003,"15min":0.46000000000000002},"min":{"1min":0.33100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81100000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84799999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":1.044,"15min":1.044},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84199999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.872,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.70599999999999996},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90200000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83399999999999996}]},{"osd":8,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84899999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94699999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.94899999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89700000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.93100000000000005,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.875},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98299999999999998,"5min":1.333,"15min":1.333},"last":0.86299999999999999}]}]},{"osd":10,"up_from":69,"seq":296352743457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28600,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716552,"statfs":{"total":95995035648,"available":95965749248,"internally_reserved":0,"allocated":1622016,"data_stored":1092697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.84199999999999997}]},{"osd":1,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.62},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.54100000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.58599999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.99099999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.032,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84199999999999997,"15min":0.82799999999999996},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.57899999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.84699999999999998,"15min":0.83899999999999997},"min":{"1min":0.69599999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.079},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.1060000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.90500000000000003,"15min":0.873},"min":{"1min":0.68000000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.872,"15min":0.85599999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.0589999999999999}]},{"osd":11,"last update":"Sat Oct 14 08:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84599999999999997,"15min":0.84299999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.276,"15min":1.276},"last":1.04},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1639999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.1259999999999999}]}]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68999999999999995,"15min":0.67400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.443}]},{"osd":3,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83499999999999996,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.595,"15min":1.595},"last":0.70899999999999996}]},{"osd":5,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0900000000000001,"5min":1.532,"15min":1.532},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.85999999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.01,"5min":1.466,"15min":1.466},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.85399999999999998,"15min":0.84499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83899999999999997,"15min":0.85799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0629999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.47499999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.624},{"interface":"front","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":442516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78600000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.76100000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.628},"min":{"1min":0.60199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.58499999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":1.915,"15min":1.915},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.48999999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60899999999999999,"15min":0.59199999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.97099999999999997,"5min":1.038,"15min":1.038},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.753,"15min":0.752},"min":{"1min":0.624,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.76700000000000002,"15min":0.747},"min":{"1min":0.69199999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.0680000000000001,"5min":1.119,"15min":1.119},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.748,"15min":0.71899999999999997},"min":{"1min":0.67800000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.93100000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.95099999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.78000000000000003,"15min":0.76500000000000001},"min":{"1min":0.65400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78700000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.745}]}]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1034620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.377,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88500000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.71199999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.47299999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.111,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96899999999999997,"5min":1.05,"15min":1.05},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":1.153,"15min":1.153},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71999999999999997,"15min":0.72099999999999997},"min":{"1min":0.51800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.59999999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":1.238,"15min":1.238},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.66600000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75600000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.034,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.411,"15min":1.411},"last":0.876}]},{"osd":10,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77000000000000002,"15min":0.75600000000000001},"min":{"1min":0.58899999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.81200000000000006,"15min":0.79300000000000004},"min":{"1min":0.56699999999999995,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.77700000000000002}]},{"osd":11,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.89700000000000002}]}]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42099999999999999,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.505},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64800000000000002,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.696,"15min":1.696},"last":0.751},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81200000000000006,"5min":3.73,"15min":3.73},"last":0.72299999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.745},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89600000000000002,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96199999999999997,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.73299999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.8700000000000001,"5min":3.8700000000000001,"15min":3.8700000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84399999999999997,"15min":0.86299999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.875,"5min":1.671,"15min":1.671},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.97699999999999998,"15min":1.0149999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":0.83099999999999996,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":502053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.58299999999999996,"15min":0.52300000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.59899999999999998,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.5019999999999998,"5min":7.5019999999999998,"15min":7.5019999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64000000000000001,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88100000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.51700000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93100000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60799999999999998,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.196,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63300000000000001,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.397,"15min":1.397},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69899999999999995,"15min":0.61699999999999999},"min":{"1min":0.58999999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1950000000000001,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.621,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.099,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.746},{"interface":"front","average":{"1min":0.872,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.47399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.94299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.80700000000000005,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.76700000000000002,"15min":0.72899999999999998},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0589999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83699999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1739999999999999,"5min":1.194,"15min":1.194},"last":0.877},{"interface":"front","average":{"1min":0.877,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89200000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.68899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.753,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.97999999999999998}]},{"osd":11,"last update":"Sat Oct 14 08:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.96799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.499,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68700000000000006,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Oct 14 08:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.53600000000000003},"min":{"1min":0.45700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77800000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.54700000000000004},"min":{"1min":0.437,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:52:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.30399999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79900000000000004,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":1.079,"15min":1.079},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.34599999999999997}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":0.78300000000000003},"min":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42899999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61899999999999999}]},{"osd":11,"last update":"Sat Oct 14 08:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.83699999999999997,"5min":1.159,"15min":1.159},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.879,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.65400000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.47399999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.373}]},{"osd":1,"last update":"Sat Oct 14 08:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.58799999999999997,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92900000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58599999999999997,"15min":0.54800000000000004},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79400000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.47099999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.47599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68300000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.61799999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.57999999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95499999999999996,"5min":1.008,"15min":1.008},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94399999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.77100000000000002}]},{"osd":11,"last update":"Sat Oct 14 08:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64800000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":441804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.39200000000000002,"15min":0.35499999999999998},"min":{"1min":0.28799999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.379},{"interface":"front","average":{"1min":0.873,"5min":0.47699999999999998,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.502},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.63900000000000001,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.70199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.746,"5min":11.746,"15min":11.746},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59599999999999997,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.57499999999999996}]},{"osd":4,"last update":"Sat Oct 14 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.69299999999999995,"15min":0.58399999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":11.82,"5min":11.82,"15min":11.82},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.71099999999999997,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.167,"5min":0.72899999999999998,"15min":0.65500000000000003},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.706,"5min":11.706,"15min":11.706},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.69599999999999995,"15min":0.61599999999999999},"min":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":12.414,"5min":12.414,"15min":12.414},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.73699999999999999,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.4969999999999999,"5min":7.4969999999999999,"15min":7.4969999999999999},"last":0.627},{"interface":"front","average":{"1min":1.1499999999999999,"5min":0.75700000000000001,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":11.784000000000001,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.872,"15min":0.81200000000000006},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.164,"5min":12.164,"15min":12.164},"last":0.67300000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.871,"15min":0.84799999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.6020000000000003,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.66200000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.68300000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":501501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41099999999999998,"15min":0.373},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":0.754,"15min":0.754},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.32400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61699999999999999,"15min":0.56000000000000005},"min":{"1min":0.501,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.57799999999999996},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.434,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85699999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66200000000000003,"15min":0.59199999999999997},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.238,"15min":1.238},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.59299999999999997},"min":{"1min":0.51800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 08:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.67300000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.68000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.82999999999999996,"15min":0.81000000000000005},"min":{"1min":0.60399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":1.724,"15min":1.724},"last":0.85399999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.91100000000000003}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91500000000000004,"15min":0.91200000000000003},"min":{"1min":0.68999999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.76600000000000001},"min":{"1min":0.61299999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":11,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.78900000000000003}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1034108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.54700000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":1.23,"15min":1.23},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.36599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.33600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.627,"15min":0.59699999999999998},"min":{"1min":0.58599999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.623,"15min":0.59999999999999998},"min":{"1min":0.48199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96999999999999997,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.53600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.93100000000000005,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.64400000000000002},"min":{"1min":0.53900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.72499999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.54300000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66600000000000004}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77400000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.04,"15min":1.0820000000000001},"min":{"1min":0.63900000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0129999999999999,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.97699999999999998,"15min":1.0049999999999999},"min":{"1min":0.56899999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.024,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:52:44.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T08:52:44.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 -- 172.21.15.6:0/175580790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9850100740 msgr2=0x7f9850100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 --2- 172.21.15.6:0/175580790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9850100740 0x7f9850100ba0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f98400099c0 tx=0x7f9840009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 -- 172.21.15.6:0/175580790 shutdown_connections 2023-10-14T08:52:44.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 --2- 172.21.15.6:0/175580790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98501010e0 0x7f9850107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 --2- 172.21.15.6:0/175580790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98500ff550 0x7f98500ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 --2- 172.21.15.6:0/175580790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9850100740 0x7f9850100ba0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 -- 172.21.15.6:0/175580790 >> 172.21.15.6:0/175580790 conn(0x7f98500faa80 msgr2=0x7f98500fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:44.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 -- 172.21.15.6:0/175580790 shutdown_connections 2023-10-14T08:52:44.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 -- 172.21.15.6:0/175580790 wait complete. 2023-10-14T08:52:44.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.619+0000 7f9855fe9700 1 Processor -- start 2023-10-14T08:52:44.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 -- start start 2023-10-14T08:52:44.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 0x7f9850196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9850100740 0x7f98501970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98501010e0 0x7f985019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985019e730 con 0x7f98500ff550 2023-10-14T08:52:44.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985019e870 con 0x7f9850100740 2023-10-14T08:52:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f9855fe9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985019ea00 con 0x7f98501010e0 2023-10-14T08:52:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 0x7f9850196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 0x7f9850196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60996/0 (socket says 172.21.15.6:60996) 2023-10-14T08:52:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 -- 172.21.15.6:0/1333977887 learned_addr learned my addr 172.21.15.6:0/1333977887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:44.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984ffff700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98501010e0 0x7f985019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 -- 172.21.15.6:0/1333977887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98501010e0 msgr2=0x7f985019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984effd700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9850100740 0x7f98501970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98501010e0 0x7f985019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 -- 172.21.15.6:0/1333977887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9850100740 msgr2=0x7f98501970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9850100740 0x7f98501970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 -- 172.21.15.6:0/1333977887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400095f0 con 0x7f98500ff550 2023-10-14T08:52:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984ffff700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98501010e0 0x7f985019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.620+0000 7f984f7fe700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 0x7f9850196bb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f983800d980 tx=0x7f983800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:44.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.621+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800de60 con 0x7f98500ff550 2023-10-14T08:52:44.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.621+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985019ece0 con 0x7f98500ff550 2023-10-14T08:52:44.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.621+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98380044e0 con 0x7f98500ff550 2023-10-14T08:52:44.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.621+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838003be0 con 0x7f98500ff550 2023-10-14T08:52:44.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.621+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985019f1a0 con 0x7f98500ff550 2023-10-14T08:52:44.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.622+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985010adc0 con 0x7f98500ff550 2023-10-14T08:52:44.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.623+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9838009bb0 con 0x7f98500ff550 2023-10-14T08:52:44.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.623+0000 7f984cff9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f983c0a1480 0x7f983c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:44.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.623+0000 7f984effd700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f983c0a1480 0x7f983c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:44.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.623+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f98380ccdb0 con 0x7f98500ff550 2023-10-14T08:52:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.624+0000 7f984effd700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f983c0a1480 0x7f983c0a3940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f98400058e0 tx=0x7f9840019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:44.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:44 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/309500675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:44.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:44 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2470523575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:44.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:44 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3425492320' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.627+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9838096410 con 0x7f98500ff550 2023-10-14T08:52:44.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.828+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9850106b90 con 0x7f983c0a1480 2023-10-14T08:52:44.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.840+0000 7f984cff9700 1 -- 172.21.15.6:0/1333977887 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344570 (secure 0 0 0) 0x7f9850106b90 con 0x7f983c0a1480 2023-10-14T08:52:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:44.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f983c0a1480 msgr2=0x7f983c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f983c0a1480 0x7f983c0a3940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f98400058e0 tx=0x7f9840019040 comp rx=0 tx=0).stop 2023-10-14T08:52:44.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 msgr2=0x7f9850196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:44.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 0x7f9850196bb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f983800d980 tx=0x7f983800dd40 comp rx=0 tx=0).stop 2023-10-14T08:52:44.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 shutdown_connections 2023-10-14T08:52:44.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98501010e0 0x7f985019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98500ff550 0x7f9850196bb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f983c0a1480 0x7f983c0a3940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 --2- 172.21.15.6:0/1333977887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9850100740 0x7f98501970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:44.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.844+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 >> 172.21.15.6:0/1333977887 conn(0x7f98500faa80 msgr2=0x7f98500fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:44.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.845+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 shutdown_connections 2023-10-14T08:52:44.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:44.845+0000 7f9855fe9700 1 -- 172.21.15.6:0/1333977887 wait complete. 2023-10-14T08:52:44.851 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:52:44.858 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-10-14T08:52:43.456375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656709,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":917,"num_read_kb":577,"num_write":420,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1240717,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":847,"ondisk_log_size":847,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337196,"kb_used_data":13004,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604628,"statfs":{"total":1151940427776,"available":1151595139072,"internally_reserved":0,"allocated":13316096,"data_stored":7261741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":68,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004855"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477711+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:52:33.477711+0000","last_peered":"2023-10-14T08:52:33.477711+0000","last_clean":"2023-10-14T08:52:33.477711+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:52:33.477711+0000","last_undegraded":"2023-10-14T08:52:33.477711+0000","last_fullsized":"2023-10-14T08:52:33.477711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482316+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:52:33.482316+0000","last_peered":"2023-10-14T08:52:33.482316+0000","last_clean":"2023-10-14T08:52:33.482316+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:52:33.482316+0000","last_undegraded":"2023-10-14T08:52:33.482316+0000","last_fullsized":"2023-10-14T08:52:33.482316+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481572+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:52:33.481572+0000","last_peered":"2023-10-14T08:52:33.481572+0000","last_clean":"2023-10-14T08:52:33.481572+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:52:33.481572+0000","last_undegraded":"2023-10-14T08:52:33.481572+0000","last_fullsized":"2023-10-14T08:52:33.481572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485097+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:52:33.485097+0000","last_peered":"2023-10-14T08:52:33.485097+0000","last_clean":"2023-10-14T08:52:33.485097+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:52:33.485097+0000","last_undegraded":"2023-10-14T08:52:33.485097+0000","last_fullsized":"2023-10-14T08:52:33.485097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.472716+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:52:33.472716+0000","last_peered":"2023-10-14T08:52:33.472716+0000","last_clean":"2023-10-14T08:52:33.472716+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:52:33.472716+0000","last_undegraded":"2023-10-14T08:52:33.472716+0000","last_fullsized":"2023-10-14T08:52:33.472716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485094+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:52:33.485094+0000","last_peered":"2023-10-14T08:52:33.485094+0000","last_clean":"2023-10-14T08:52:33.485094+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:52:33.485094+0000","last_undegraded":"2023-10-14T08:52:33.485094+0000","last_fullsized":"2023-10-14T08:52:33.485094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482319+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:52:33.482319+0000","last_peered":"2023-10-14T08:52:33.482319+0000","last_clean":"2023-10-14T08:52:33.482319+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:52:33.482319+0000","last_undegraded":"2023-10-14T08:52:33.482319+0000","last_fullsized":"2023-10-14T08:52:33.482319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479580+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:52:33.479580+0000","last_peered":"2023-10-14T08:52:33.479580+0000","last_clean":"2023-10-14T08:52:33.479580+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:52:33.479580+0000","last_undegraded":"2023-10-14T08:52:33.479580+0000","last_fullsized":"2023-10-14T08:52:33.479580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486211+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:52:33.486211+0000","last_peered":"2023-10-14T08:52:33.486211+0000","last_clean":"2023-10-14T08:52:33.486211+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:52:33.486211+0000","last_undegraded":"2023-10-14T08:52:33.486211+0000","last_fullsized":"2023-10-14T08:52:33.486211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486016+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:52:33.486016+0000","last_peered":"2023-10-14T08:52:33.486016+0000","last_clean":"2023-10-14T08:52:33.486016+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:52:33.486016+0000","last_undegraded":"2023-10-14T08:52:33.486016+0000","last_fullsized":"2023-10-14T08:52:33.486016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482700+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:52:33.482700+0000","last_peered":"2023-10-14T08:52:33.482700+0000","last_clean":"2023-10-14T08:52:33.482700+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:52:33.482700+0000","last_undegraded":"2023-10-14T08:52:33.482700+0000","last_fullsized":"2023-10-14T08:52:33.482700+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479581+0000","last_change":"2023-10-14T08:52:04.456618+0000","last_active":"2023-10-14T08:52:33.479581+0000","last_peered":"2023-10-14T08:52:33.479581+0000","last_clean":"2023-10-14T08:52:33.479581+0000","last_became_active":"2023-10-14T08:52:04.456226+0000","last_became_peered":"2023-10-14T08:52:04.456226+0000","last_unstale":"2023-10-14T08:52:33.479581+0000","last_undegraded":"2023-10-14T08:52:33.479581+0000","last_fullsized":"2023-10-14T08:52:33.479581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:03:55.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478571+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:52:33.478571+0000","last_peered":"2023-10-14T08:52:33.478571+0000","last_clean":"2023-10-14T08:52:33.478571+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:52:33.478571+0000","last_undegraded":"2023-10-14T08:52:33.478571+0000","last_fullsized":"2023-10-14T08:52:33.478571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481329+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:52:33.481329+0000","last_peered":"2023-10-14T08:52:33.481329+0000","last_clean":"2023-10-14T08:52:33.481329+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:52:33.481329+0000","last_undegraded":"2023-10-14T08:52:33.481329+0000","last_fullsized":"2023-10-14T08:52:33.481329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478692+0000","last_change":"2023-10-14T08:52:04.456089+0000","last_active":"2023-10-14T08:52:33.478692+0000","last_peered":"2023-10-14T08:52:33.478692+0000","last_clean":"2023-10-14T08:52:33.478692+0000","last_became_active":"2023-10-14T08:52:04.455671+0000","last_became_peered":"2023-10-14T08:52:04.455671+0000","last_unstale":"2023-10-14T08:52:33.478692+0000","last_undegraded":"2023-10-14T08:52:33.478692+0000","last_fullsized":"2023-10-14T08:52:33.478692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:59.639694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479608+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:52:33.479608+0000","last_peered":"2023-10-14T08:52:33.479608+0000","last_clean":"2023-10-14T08:52:33.479608+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:52:33.479608+0000","last_undegraded":"2023-10-14T08:52:33.479608+0000","last_fullsized":"2023-10-14T08:52:33.479608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477938+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:52:33.477938+0000","last_peered":"2023-10-14T08:52:33.477938+0000","last_clean":"2023-10-14T08:52:33.477938+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:52:33.477938+0000","last_undegraded":"2023-10-14T08:52:33.477938+0000","last_fullsized":"2023-10-14T08:52:33.477938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480796+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:52:33.480796+0000","last_peered":"2023-10-14T08:52:33.480796+0000","last_clean":"2023-10-14T08:52:33.480796+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:52:33.480796+0000","last_undegraded":"2023-10-14T08:52:33.480796+0000","last_fullsized":"2023-10-14T08:52:33.480796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486271+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:52:33.486271+0000","last_peered":"2023-10-14T08:52:33.486271+0000","last_clean":"2023-10-14T08:52:33.486271+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:52:33.486271+0000","last_undegraded":"2023-10-14T08:52:33.486271+0000","last_fullsized":"2023-10-14T08:52:33.486271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.504016+0000","last_change":"2023-10-14T08:52:04.465622+0000","last_active":"2023-10-14T08:52:39.504016+0000","last_peered":"2023-10-14T08:52:39.504016+0000","last_clean":"2023-10-14T08:52:39.504016+0000","last_became_active":"2023-10-14T08:52:04.455831+0000","last_became_peered":"2023-10-14T08:52:04.455831+0000","last_unstale":"2023-10-14T08:52:39.504016+0000","last_undegraded":"2023-10-14T08:52:39.504016+0000","last_fullsized":"2023-10-14T08:52:39.504016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:49.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480271+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:52:33.480271+0000","last_peered":"2023-10-14T08:52:33.480271+0000","last_clean":"2023-10-14T08:52:33.480271+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:52:33.480271+0000","last_undegraded":"2023-10-14T08:52:33.480271+0000","last_fullsized":"2023-10-14T08:52:33.480271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.549043+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:52:03.549043+0000","last_peered":"2023-10-14T08:52:03.549043+0000","last_clean":"2023-10-14T08:52:03.549043+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:52:03.549043+0000","last_undegraded":"2023-10-14T08:52:03.549043+0000","last_fullsized":"2023-10-14T08:52:03.549043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482984+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:52:33.482984+0000","last_peered":"2023-10-14T08:52:33.482984+0000","last_clean":"2023-10-14T08:52:33.482984+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:52:33.482984+0000","last_undegraded":"2023-10-14T08:52:33.482984+0000","last_fullsized":"2023-10-14T08:52:33.482984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450130+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:52:03.450130+0000","last_peered":"2023-10-14T08:52:03.450130+0000","last_clean":"2023-10-14T08:52:03.450130+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:52:03.450130+0000","last_undegraded":"2023-10-14T08:52:03.450130+0000","last_fullsized":"2023-10-14T08:52:03.450130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480890+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:52:33.480890+0000","last_peered":"2023-10-14T08:52:33.480890+0000","last_clean":"2023-10-14T08:52:33.480890+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:52:33.480890+0000","last_undegraded":"2023-10-14T08:52:33.480890+0000","last_fullsized":"2023-10-14T08:52:33.480890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450012+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:52:03.450012+0000","last_peered":"2023-10-14T08:52:03.450012+0000","last_clean":"2023-10-14T08:52:03.450012+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:52:03.450012+0000","last_undegraded":"2023-10-14T08:52:03.450012+0000","last_fullsized":"2023-10-14T08:52:03.450012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488681+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:52:33.488681+0000","last_peered":"2023-10-14T08:52:33.488681+0000","last_clean":"2023-10-14T08:52:33.488681+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:52:33.488681+0000","last_undegraded":"2023-10-14T08:52:33.488681+0000","last_fullsized":"2023-10-14T08:52:33.488681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":117,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:40.517956+0000","last_change":"2023-10-14T08:52:04.467782+0000","last_active":"2023-10-14T08:52:40.517956+0000","last_peered":"2023-10-14T08:52:40.517956+0000","last_clean":"2023-10-14T08:52:40.517956+0000","last_became_active":"2023-10-14T08:52:04.459237+0000","last_became_peered":"2023-10-14T08:52:04.459237+0000","last_unstale":"2023-10-14T08:52:40.517956+0000","last_undegraded":"2023-10-14T08:52:40.517956+0000","last_fullsized":"2023-10-14T08:52:40.517956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:15:54.861129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481415+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:52:33.481415+0000","last_peered":"2023-10-14T08:52:33.481415+0000","last_clean":"2023-10-14T08:52:33.481415+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:52:33.481415+0000","last_undegraded":"2023-10-14T08:52:33.481415+0000","last_fullsized":"2023-10-14T08:52:33.481415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.839027+0000","last_change":"2023-10-14T08:52:04.839027+0000","last_active":"2023-10-14T08:52:04.839027+0000","last_peered":"2023-10-14T08:52:04.839027+0000","last_clean":"2023-10-14T08:52:04.839027+0000","last_became_active":"2023-10-14T08:52:04.832065+0000","last_became_peered":"2023-10-14T08:52:04.832065+0000","last_unstale":"2023-10-14T08:52:04.839027+0000","last_undegraded":"2023-10-14T08:52:04.839027+0000","last_fullsized":"2023-10-14T08:52:04.839027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:33.970140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480517+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:52:33.480517+0000","last_peered":"2023-10-14T08:52:33.480517+0000","last_clean":"2023-10-14T08:52:33.480517+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:52:33.480517+0000","last_undegraded":"2023-10-14T08:52:33.480517+0000","last_fullsized":"2023-10-14T08:52:33.480517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454545+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:52:03.454545+0000","last_peered":"2023-10-14T08:52:03.454545+0000","last_clean":"2023-10-14T08:52:03.454545+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:52:03.454545+0000","last_undegraded":"2023-10-14T08:52:03.454545+0000","last_fullsized":"2023-10-14T08:52:03.454545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480274+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:52:33.480274+0000","last_peered":"2023-10-14T08:52:33.480274+0000","last_clean":"2023-10-14T08:52:33.480274+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:52:33.480274+0000","last_undegraded":"2023-10-14T08:52:33.480274+0000","last_fullsized":"2023-10-14T08:52:33.480274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453663+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:52:03.453663+0000","last_peered":"2023-10-14T08:52:03.453663+0000","last_clean":"2023-10-14T08:52:03.453663+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:52:03.453663+0000","last_undegraded":"2023-10-14T08:52:03.453663+0000","last_fullsized":"2023-10-14T08:52:03.453663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482449+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:52:33.482449+0000","last_peered":"2023-10-14T08:52:33.482449+0000","last_clean":"2023-10-14T08:52:33.482449+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:52:33.482449+0000","last_undegraded":"2023-10-14T08:52:33.482449+0000","last_fullsized":"2023-10-14T08:52:33.482449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":178,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:41.286292+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:52:41.286292+0000","last_peered":"2023-10-14T08:52:41.286292+0000","last_clean":"2023-10-14T08:52:41.286292+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:52:41.286292+0000","last_undegraded":"2023-10-14T08:52:41.286292+0000","last_fullsized":"2023-10-14T08:52:41.286292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486638+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:52:33.486638+0000","last_peered":"2023-10-14T08:52:33.486638+0000","last_clean":"2023-10-14T08:52:33.486638+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:52:33.486638+0000","last_undegraded":"2023-10-14T08:52:33.486638+0000","last_fullsized":"2023-10-14T08:52:33.486638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453618+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:52:03.453618+0000","last_peered":"2023-10-14T08:52:03.453618+0000","last_clean":"2023-10-14T08:52:03.453618+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:52:03.453618+0000","last_undegraded":"2023-10-14T08:52:03.453618+0000","last_fullsized":"2023-10-14T08:52:03.453618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482782+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:52:33.482782+0000","last_peered":"2023-10-14T08:52:33.482782+0000","last_clean":"2023-10-14T08:52:33.482782+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:52:33.482782+0000","last_undegraded":"2023-10-14T08:52:33.482782+0000","last_fullsized":"2023-10-14T08:52:33.482782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454838+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:52:03.454838+0000","last_peered":"2023-10-14T08:52:03.454838+0000","last_clean":"2023-10-14T08:52:03.454838+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:52:03.454838+0000","last_undegraded":"2023-10-14T08:52:03.454838+0000","last_fullsized":"2023-10-14T08:52:03.454838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487341+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:52:33.487341+0000","last_peered":"2023-10-14T08:52:33.487341+0000","last_clean":"2023-10-14T08:52:33.487341+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:52:33.487341+0000","last_undegraded":"2023-10-14T08:52:33.487341+0000","last_fullsized":"2023-10-14T08:52:33.487341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":240,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:40.895685+0000","last_change":"2023-10-14T08:52:04.847819+0000","last_active":"2023-10-14T08:52:40.895685+0000","last_peered":"2023-10-14T08:52:40.895685+0000","last_clean":"2023-10-14T08:52:40.895685+0000","last_became_active":"2023-10-14T08:52:04.833768+0000","last_became_peered":"2023-10-14T08:52:04.833768+0000","last_unstale":"2023-10-14T08:52:40.895685+0000","last_undegraded":"2023-10-14T08:52:40.895685+0000","last_fullsized":"2023-10-14T08:52:40.895685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:34.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59142,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":134,"num_write":35,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58575,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478496+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:52:33.478496+0000","last_peered":"2023-10-14T08:52:33.478496+0000","last_clean":"2023-10-14T08:52:33.478496+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:52:33.478496+0000","last_undegraded":"2023-10-14T08:52:33.478496+0000","last_fullsized":"2023-10-14T08:52:33.478496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452996+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:52:03.452996+0000","last_peered":"2023-10-14T08:52:03.452996+0000","last_clean":"2023-10-14T08:52:03.452996+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:52:03.452996+0000","last_undegraded":"2023-10-14T08:52:03.452996+0000","last_fullsized":"2023-10-14T08:52:03.452996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.472884+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:52:33.472884+0000","last_peered":"2023-10-14T08:52:33.472884+0000","last_clean":"2023-10-14T08:52:33.472884+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:52:33.472884+0000","last_undegraded":"2023-10-14T08:52:33.472884+0000","last_fullsized":"2023-10-14T08:52:33.472884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454880+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:52:03.454880+0000","last_peered":"2023-10-14T08:52:03.454880+0000","last_clean":"2023-10-14T08:52:03.454880+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:52:03.454880+0000","last_undegraded":"2023-10-14T08:52:03.454880+0000","last_fullsized":"2023-10-14T08:52:03.454880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487252+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:52:33.487252+0000","last_peered":"2023-10-14T08:52:33.487252+0000","last_clean":"2023-10-14T08:52:33.487252+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:52:33.487252+0000","last_undegraded":"2023-10-14T08:52:33.487252+0000","last_fullsized":"2023-10-14T08:52:33.487252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.284024+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:52:39.284024+0000","last_peered":"2023-10-14T08:52:39.284024+0000","last_clean":"2023-10-14T08:52:39.284024+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:52:39.284024+0000","last_undegraded":"2023-10-14T08:52:39.284024+0000","last_fullsized":"2023-10-14T08:52:39.284024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479470+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:52:33.479470+0000","last_peered":"2023-10-14T08:52:33.479470+0000","last_clean":"2023-10-14T08:52:33.479470+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:52:33.479470+0000","last_undegraded":"2023-10-14T08:52:33.479470+0000","last_fullsized":"2023-10-14T08:52:33.479470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.469743+0000","last_change":"2023-10-14T08:52:04.469342+0000","last_active":"2023-10-14T08:52:04.469743+0000","last_peered":"2023-10-14T08:52:04.469743+0000","last_clean":"2023-10-14T08:52:04.469743+0000","last_became_active":"2023-10-14T08:52:04.454202+0000","last_became_peered":"2023-10-14T08:52:04.454202+0000","last_unstale":"2023-10-14T08:52:04.469743+0000","last_undegraded":"2023-10-14T08:52:04.469743+0000","last_fullsized":"2023-10-14T08:52:04.469743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.377924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488047+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:52:33.488047+0000","last_peered":"2023-10-14T08:52:33.488047+0000","last_clean":"2023-10-14T08:52:33.488047+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:52:33.488047+0000","last_undegraded":"2023-10-14T08:52:33.488047+0000","last_fullsized":"2023-10-14T08:52:33.488047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.449764+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:52:03.449764+0000","last_peered":"2023-10-14T08:52:03.449764+0000","last_clean":"2023-10-14T08:52:03.449764+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:52:03.449764+0000","last_undegraded":"2023-10-14T08:52:03.449764+0000","last_fullsized":"2023-10-14T08:52:03.449764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.483217+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:52:33.483217+0000","last_peered":"2023-10-14T08:52:33.483217+0000","last_clean":"2023-10-14T08:52:33.483217+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:52:33.483217+0000","last_undegraded":"2023-10-14T08:52:33.483217+0000","last_fullsized":"2023-10-14T08:52:33.483217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.446910+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:52:03.446910+0000","last_peered":"2023-10-14T08:52:03.446910+0000","last_clean":"2023-10-14T08:52:03.446910+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:52:03.446910+0000","last_undegraded":"2023-10-14T08:52:03.446910+0000","last_fullsized":"2023-10-14T08:52:03.446910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476615+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:52:33.476615+0000","last_peered":"2023-10-14T08:52:33.476615+0000","last_clean":"2023-10-14T08:52:33.476615+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:52:33.476615+0000","last_undegraded":"2023-10-14T08:52:33.476615+0000","last_fullsized":"2023-10-14T08:52:33.476615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.504637+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:52:39.504637+0000","last_peered":"2023-10-14T08:52:39.504637+0000","last_clean":"2023-10-14T08:52:39.504637+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:52:39.504637+0000","last_undegraded":"2023-10-14T08:52:39.504637+0000","last_fullsized":"2023-10-14T08:52:39.504637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484299+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:52:33.484299+0000","last_peered":"2023-10-14T08:52:33.484299+0000","last_clean":"2023-10-14T08:52:33.484299+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:52:33.484299+0000","last_undegraded":"2023-10-14T08:52:33.484299+0000","last_fullsized":"2023-10-14T08:52:33.484299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477044+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:52:33.477044+0000","last_peered":"2023-10-14T08:52:33.477044+0000","last_clean":"2023-10-14T08:52:33.477044+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:52:33.477044+0000","last_undegraded":"2023-10-14T08:52:33.477044+0000","last_fullsized":"2023-10-14T08:52:33.477044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:38.282034+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:52:38.282034+0000","last_peered":"2023-10-14T08:52:38.282034+0000","last_clean":"2023-10-14T08:52:38.282034+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:52:38.282034+0000","last_undegraded":"2023-10-14T08:52:38.282034+0000","last_fullsized":"2023-10-14T08:52:38.282034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478084+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:52:33.478084+0000","last_peered":"2023-10-14T08:52:33.478084+0000","last_clean":"2023-10-14T08:52:33.478084+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:52:33.478084+0000","last_undegraded":"2023-10-14T08:52:33.478084+0000","last_fullsized":"2023-10-14T08:52:33.478084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453005+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:52:03.453005+0000","last_peered":"2023-10-14T08:52:03.453005+0000","last_clean":"2023-10-14T08:52:03.453005+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:52:03.453005+0000","last_undegraded":"2023-10-14T08:52:03.453005+0000","last_fullsized":"2023-10-14T08:52:03.453005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.451187+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:52:03.451187+0000","last_peered":"2023-10-14T08:52:03.451187+0000","last_clean":"2023-10-14T08:52:03.451187+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:52:03.451187+0000","last_undegraded":"2023-10-14T08:52:03.451187+0000","last_fullsized":"2023-10-14T08:52:03.451187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484082+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:52:33.484082+0000","last_peered":"2023-10-14T08:52:33.484082+0000","last_clean":"2023-10-14T08:52:33.484082+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:52:33.484082+0000","last_undegraded":"2023-10-14T08:52:33.484082+0000","last_fullsized":"2023-10-14T08:52:33.484082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452204+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:52:03.452204+0000","last_peered":"2023-10-14T08:52:03.452204+0000","last_clean":"2023-10-14T08:52:03.452204+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:52:03.452204+0000","last_undegraded":"2023-10-14T08:52:03.452204+0000","last_fullsized":"2023-10-14T08:52:03.452204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450005+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:52:03.450005+0000","last_peered":"2023-10-14T08:52:03.450005+0000","last_clean":"2023-10-14T08:52:03.450005+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:52:03.450005+0000","last_undegraded":"2023-10-14T08:52:03.450005+0000","last_fullsized":"2023-10-14T08:52:03.450005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480148+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:52:33.480148+0000","last_peered":"2023-10-14T08:52:33.480148+0000","last_clean":"2023-10-14T08:52:33.480148+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:52:33.480148+0000","last_undegraded":"2023-10-14T08:52:33.480148+0000","last_fullsized":"2023-10-14T08:52:33.480148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'10","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.451638+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:52:04.451638+0000","last_peered":"2023-10-14T08:52:04.451638+0000","last_clean":"2023-10-14T08:52:04.451638+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:52:04.451638+0000","last_undegraded":"2023-10-14T08:52:04.451638+0000","last_fullsized":"2023-10-14T08:52:04.451638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480765+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:52:33.480765+0000","last_peered":"2023-10-14T08:52:33.480765+0000","last_clean":"2023-10-14T08:52:33.480765+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:52:33.480765+0000","last_undegraded":"2023-10-14T08:52:33.480765+0000","last_fullsized":"2023-10-14T08:52:33.480765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454667+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:52:03.454667+0000","last_peered":"2023-10-14T08:52:03.454667+0000","last_clean":"2023-10-14T08:52:03.454667+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:52:03.454667+0000","last_undegraded":"2023-10-14T08:52:03.454667+0000","last_fullsized":"2023-10-14T08:52:03.454667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485895+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:52:33.485895+0000","last_peered":"2023-10-14T08:52:33.485895+0000","last_clean":"2023-10-14T08:52:33.485895+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:52:33.485895+0000","last_undegraded":"2023-10-14T08:52:33.485895+0000","last_fullsized":"2023-10-14T08:52:33.485895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456628+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:52:03.456628+0000","last_peered":"2023-10-14T08:52:03.456628+0000","last_clean":"2023-10-14T08:52:03.456628+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:52:03.456628+0000","last_undegraded":"2023-10-14T08:52:03.456628+0000","last_fullsized":"2023-10-14T08:52:03.456628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.460787+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:52:33.460787+0000","last_peered":"2023-10-14T08:52:33.460787+0000","last_clean":"2023-10-14T08:52:33.460787+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:52:33.460787+0000","last_undegraded":"2023-10-14T08:52:33.460787+0000","last_fullsized":"2023-10-14T08:52:33.460787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.548779+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:52:03.548779+0000","last_peered":"2023-10-14T08:52:03.548779+0000","last_clean":"2023-10-14T08:52:03.548779+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:52:03.548779+0000","last_undegraded":"2023-10-14T08:52:03.548779+0000","last_fullsized":"2023-10-14T08:52:03.548779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478911+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:52:33.478911+0000","last_peered":"2023-10-14T08:52:33.478911+0000","last_clean":"2023-10-14T08:52:33.478911+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:52:33.478911+0000","last_undegraded":"2023-10-14T08:52:33.478911+0000","last_fullsized":"2023-10-14T08:52:33.478911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453327+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:52:03.453327+0000","last_peered":"2023-10-14T08:52:03.453327+0000","last_clean":"2023-10-14T08:52:03.453327+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:52:03.453327+0000","last_undegraded":"2023-10-14T08:52:03.453327+0000","last_fullsized":"2023-10-14T08:52:03.453327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476989+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:52:33.476989+0000","last_peered":"2023-10-14T08:52:33.476989+0000","last_clean":"2023-10-14T08:52:33.476989+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:52:33.476989+0000","last_undegraded":"2023-10-14T08:52:33.476989+0000","last_fullsized":"2023-10-14T08:52:33.476989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.449416+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:52:03.449416+0000","last_peered":"2023-10-14T08:52:03.449416+0000","last_clean":"2023-10-14T08:52:03.449416+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:52:03.449416+0000","last_undegraded":"2023-10-14T08:52:03.449416+0000","last_fullsized":"2023-10-14T08:52:03.449416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486206+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:52:33.486206+0000","last_peered":"2023-10-14T08:52:33.486206+0000","last_clean":"2023-10-14T08:52:33.486206+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:52:33.486206+0000","last_undegraded":"2023-10-14T08:52:33.486206+0000","last_fullsized":"2023-10-14T08:52:33.486206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:38.282644+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:52:38.282644+0000","last_peered":"2023-10-14T08:52:38.282644+0000","last_clean":"2023-10-14T08:52:38.282644+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:52:38.282644+0000","last_undegraded":"2023-10-14T08:52:38.282644+0000","last_fullsized":"2023-10-14T08:52:38.282644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482564+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:52:33.482564+0000","last_peered":"2023-10-14T08:52:33.482564+0000","last_clean":"2023-10-14T08:52:33.482564+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:52:33.482564+0000","last_undegraded":"2023-10-14T08:52:33.482564+0000","last_fullsized":"2023-10-14T08:52:33.482564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454674+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:52:03.454674+0000","last_peered":"2023-10-14T08:52:03.454674+0000","last_clean":"2023-10-14T08:52:03.454674+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:52:03.454674+0000","last_undegraded":"2023-10-14T08:52:03.454674+0000","last_fullsized":"2023-10-14T08:52:03.454674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477586+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:52:33.477586+0000","last_peered":"2023-10-14T08:52:33.477586+0000","last_clean":"2023-10-14T08:52:33.477586+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:52:33.477586+0000","last_undegraded":"2023-10-14T08:52:33.477586+0000","last_fullsized":"2023-10-14T08:52:33.477586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454918+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:52:03.454918+0000","last_peered":"2023-10-14T08:52:03.454918+0000","last_clean":"2023-10-14T08:52:03.454918+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:52:03.454918+0000","last_undegraded":"2023-10-14T08:52:03.454918+0000","last_fullsized":"2023-10-14T08:52:03.454918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481522+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:52:33.481522+0000","last_peered":"2023-10-14T08:52:33.481522+0000","last_clean":"2023-10-14T08:52:33.481522+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:52:33.481522+0000","last_undegraded":"2023-10-14T08:52:33.481522+0000","last_fullsized":"2023-10-14T08:52:33.481522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479680+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:52:33.479680+0000","last_peered":"2023-10-14T08:52:33.479680+0000","last_clean":"2023-10-14T08:52:33.479680+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:52:33.479680+0000","last_undegraded":"2023-10-14T08:52:33.479680+0000","last_fullsized":"2023-10-14T08:52:33.479680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487937+0000","last_change":"2023-10-14T08:52:04.831658+0000","last_active":"2023-10-14T08:52:33.487937+0000","last_peered":"2023-10-14T08:52:33.487937+0000","last_clean":"2023-10-14T08:52:33.487937+0000","last_became_active":"2023-10-14T08:52:04.831331+0000","last_became_peered":"2023-10-14T08:52:04.831331+0000","last_unstale":"2023-10-14T08:52:33.487937+0000","last_undegraded":"2023-10-14T08:52:33.487937+0000","last_fullsized":"2023-10-14T08:52:33.487937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:48:52.884720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485796+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:52:33.485796+0000","last_peered":"2023-10-14T08:52:33.485796+0000","last_clean":"2023-10-14T08:52:33.485796+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:52:33.485796+0000","last_undegraded":"2023-10-14T08:52:33.485796+0000","last_fullsized":"2023-10-14T08:52:33.485796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481732+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:52:33.481732+0000","last_peered":"2023-10-14T08:52:33.481732+0000","last_clean":"2023-10-14T08:52:33.481732+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:52:33.481732+0000","last_undegraded":"2023-10-14T08:52:33.481732+0000","last_fullsized":"2023-10-14T08:52:33.481732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484062+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:52:33.484062+0000","last_peered":"2023-10-14T08:52:33.484062+0000","last_clean":"2023-10-14T08:52:33.484062+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:52:33.484062+0000","last_undegraded":"2023-10-14T08:52:33.484062+0000","last_fullsized":"2023-10-14T08:52:33.484062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476685+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:52:33.476685+0000","last_peered":"2023-10-14T08:52:33.476685+0000","last_clean":"2023-10-14T08:52:33.476685+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:52:33.476685+0000","last_undegraded":"2023-10-14T08:52:33.476685+0000","last_fullsized":"2023-10-14T08:52:33.476685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488984+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:52:33.488984+0000","last_peered":"2023-10-14T08:52:33.488984+0000","last_clean":"2023-10-14T08:52:33.488984+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:52:33.488984+0000","last_undegraded":"2023-10-14T08:52:33.488984+0000","last_fullsized":"2023-10-14T08:52:33.488984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484932+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:52:33.484932+0000","last_peered":"2023-10-14T08:52:33.484932+0000","last_clean":"2023-10-14T08:52:33.484932+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:52:33.484932+0000","last_undegraded":"2023-10-14T08:52:33.484932+0000","last_fullsized":"2023-10-14T08:52:33.484932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485817+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:52:33.485817+0000","last_peered":"2023-10-14T08:52:33.485817+0000","last_clean":"2023-10-14T08:52:33.485817+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:52:33.485817+0000","last_undegraded":"2023-10-14T08:52:33.485817+0000","last_fullsized":"2023-10-14T08:52:33.485817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485317+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:52:33.485317+0000","last_peered":"2023-10-14T08:52:33.485317+0000","last_clean":"2023-10-14T08:52:33.485317+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:52:33.485317+0000","last_undegraded":"2023-10-14T08:52:33.485317+0000","last_fullsized":"2023-10-14T08:52:33.485317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479941+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:52:33.479941+0000","last_peered":"2023-10-14T08:52:33.479941+0000","last_clean":"2023-10-14T08:52:33.479941+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:52:33.479941+0000","last_undegraded":"2023-10-14T08:52:33.479941+0000","last_fullsized":"2023-10-14T08:52:33.479941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476620+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:52:33.476620+0000","last_peered":"2023-10-14T08:52:33.476620+0000","last_clean":"2023-10-14T08:52:33.476620+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:52:33.476620+0000","last_undegraded":"2023-10-14T08:52:33.476620+0000","last_fullsized":"2023-10-14T08:52:33.476620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.475420+0000","last_change":"2023-10-14T08:52:04.456448+0000","last_active":"2023-10-14T08:52:33.475420+0000","last_peered":"2023-10-14T08:52:33.475420+0000","last_clean":"2023-10-14T08:52:33.475420+0000","last_became_active":"2023-10-14T08:52:04.456002+0000","last_became_peered":"2023-10-14T08:52:04.456002+0000","last_unstale":"2023-10-14T08:52:33.475420+0000","last_undegraded":"2023-10-14T08:52:33.475420+0000","last_fullsized":"2023-10-14T08:52:33.475420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:00.467295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66095,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":791,"num_read_kb":468,"num_write":237,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":59981,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481821,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":443104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.75},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78600000000000003,"5min":1.129,"15min":1.129},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46800000000000003,"15min":0.46000000000000002},"min":{"1min":0.33100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81100000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84799999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":1.044,"15min":1.044},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84199999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.872,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.70599999999999996},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90200000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83399999999999996}]},{"osd":8,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84899999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94699999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.94899999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89700000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.93100000000000005,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.875},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98299999999999998,"5min":1.333,"15min":1.333},"last":0.86299999999999999}]}]},{"osd":10,"up_from":69,"seq":296352743457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28600,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716552,"statfs":{"total":95995035648,"available":95965749248,"internally_reserved":0,"allocated":1622016,"data_stored":1092697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.84199999999999997}]},{"osd":1,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.62},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.54100000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.58599999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.99099999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.032,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84199999999999997,"15min":0.82799999999999996},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.57899999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.84699999999999998,"15min":0.83899999999999997},"min":{"1min":0.69599999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.079},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.1060000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.90500000000000003,"15min":0.873},"min":{"1min":0.68000000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.872,"15min":0.85599999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.0589999999999999}]},{"osd":11,"last update":"Sat Oct 14 08:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84599999999999997,"15min":0.84299999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.276,"15min":1.276},"last":1.04},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1639999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.1259999999999999}]}]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68999999999999995,"15min":0.67400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.443}]},{"osd":3,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83499999999999996,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.595,"15min":1.595},"last":0.70899999999999996}]},{"osd":5,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0900000000000001,"5min":1.532,"15min":1.532},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.85999999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.01,"5min":1.466,"15min":1.466},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.85399999999999998,"15min":0.84499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83899999999999997,"15min":0.85799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0629999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.47499999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.624},{"interface":"front","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":442516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78600000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.76100000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.628},"min":{"1min":0.60199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.58499999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":1.915,"15min":1.915},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.48999999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60899999999999999,"15min":0.59199999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.97099999999999997,"5min":1.038,"15min":1.038},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.753,"15min":0.752},"min":{"1min":0.624,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.76700000000000002,"15min":0.747},"min":{"1min":0.69199999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.0680000000000001,"5min":1.119,"15min":1.119},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.748,"15min":0.71899999999999997},"min":{"1min":0.67800000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.93100000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.95099999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.78000000000000003,"15min":0.76500000000000001},"min":{"1min":0.65400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78700000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.745}]}]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1034620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.377,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88500000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.71199999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.47299999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.111,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96899999999999997,"5min":1.05,"15min":1.05},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":1.153,"15min":1.153},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71999999999999997,"15min":0.72099999999999997},"min":{"1min":0.51800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.59999999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":1.238,"15min":1.238},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.66600000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75600000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.034,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.411,"15min":1.411},"last":0.876}]},{"osd":10,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77000000000000002,"15min":0.75600000000000001},"min":{"1min":0.58899999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.81200000000000006,"15min":0.79300000000000004},"min":{"1min":0.56699999999999995,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.77700000000000002}]},{"osd":11,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.89700000000000002}]}]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42099999999999999,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.505},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64800000000000002,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.696,"15min":1.696},"last":0.751},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81200000000000006,"5min":3.73,"15min":3.73},"last":0.72299999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.745},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89600000000000002,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96199999999999997,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.73299999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.8700000000000001,"5min":3.8700000000000001,"15min":3.8700000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84399999999999997,"15min":0.86299999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.875,"5min":1.671,"15min":1.671},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.97699999999999998,"15min":1.0149999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":0.83099999999999996,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":502053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.58299999999999996,"15min":0.52300000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.59899999999999998,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.5019999999999998,"5min":7.5019999999999998,"15min":7.5019999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64000000000000001,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88100000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.51700000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93100000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60799999999999998,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.196,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63300000000000001,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.397,"15min":1.397},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69899999999999995,"15min":0.61699999999999999},"min":{"1min":0.58999999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1950000000000001,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.621,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.099,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.746},{"interface":"front","average":{"1min":0.872,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.47399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.94299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.80700000000000005,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.76700000000000002,"15min":0.72899999999999998},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0589999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83699999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1739999999999999,"5min":1.194,"15min":1.194},"last":0.877},{"interface":"front","average":{"1min":0.877,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89200000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.68899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.753,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.97999999999999998}]},{"osd":11,"last update":"Sat Oct 14 08:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.96799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.499,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68700000000000006,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Oct 14 08:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.53600000000000003},"min":{"1min":0.45700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77800000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.54700000000000004},"min":{"1min":0.437,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:52:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.30399999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79900000000000004,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":1.079,"15min":1.079},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.34599999999999997}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":0.78300000000000003},"min":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42899999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61899999999999999}]},{"osd":11,"last update":"Sat Oct 14 08:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.83699999999999997,"5min":1.159,"15min":1.159},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.879,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.65400000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.47399999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.373}]},{"osd":1,"last update":"Sat Oct 14 08:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.58799999999999997,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92900000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58599999999999997,"15min":0.54800000000000004},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79400000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.47099999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.47599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68300000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.61799999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.57999999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95499999999999996,"5min":1.008,"15min":1.008},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94399999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.77100000000000002}]},{"osd":11,"last update":"Sat Oct 14 08:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64800000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":441804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.39200000000000002,"15min":0.35499999999999998},"min":{"1min":0.28799999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.379},{"interface":"front","average":{"1min":0.873,"5min":0.47699999999999998,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.502},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.63900000000000001,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.70199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.746,"5min":11.746,"15min":11.746},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59599999999999997,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.57499999999999996}]},{"osd":4,"last update":"Sat Oct 14 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.69299999999999995,"15min":0.58399999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":11.82,"5min":11.82,"15min":11.82},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.71099999999999997,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.167,"5min":0.72899999999999998,"15min":0.65500000000000003},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.706,"5min":11.706,"15min":11.706},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.69599999999999995,"15min":0.61599999999999999},"min":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":12.414,"5min":12.414,"15min":12.414},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.73699999999999999,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.4969999999999999,"5min":7.4969999999999999,"15min":7.4969999999999999},"last":0.627},{"interface":"front","average":{"1min":1.1499999999999999,"5min":0.75700000000000001,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":11.784000000000001,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.872,"15min":0.81200000000000006},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.164,"5min":12.164,"15min":12.164},"last":0.67300000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.871,"15min":0.84799999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.6020000000000003,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.66200000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.68300000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":501501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41099999999999998,"15min":0.373},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":0.754,"15min":0.754},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.32400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61699999999999999,"15min":0.56000000000000005},"min":{"1min":0.501,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.57799999999999996},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.434,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85699999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66200000000000003,"15min":0.59199999999999997},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.238,"15min":1.238},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.59299999999999997},"min":{"1min":0.51800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 08:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.67300000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.68000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.82999999999999996,"15min":0.81000000000000005},"min":{"1min":0.60399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":1.724,"15min":1.724},"last":0.85399999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.91100000000000003}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91500000000000004,"15min":0.91200000000000003},"min":{"1min":0.68999999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.76600000000000001},"min":{"1min":0.61299999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":11,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.78900000000000003}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1034108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.54700000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":1.23,"15min":1.23},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.36599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.33600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.627,"15min":0.59699999999999998},"min":{"1min":0.58599999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.623,"15min":0.59999999999999998},"min":{"1min":0.48199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96999999999999997,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.53600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.93100000000000005,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.64400000000000002},"min":{"1min":0.53900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.72499999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.54300000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66600000000000004}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77400000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.04,"15min":1.0820000000000001},"min":{"1min":0.63900000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0129999999999999,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.97699999999999998,"15min":1.0049999999999999},"min":{"1min":0.56899999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.024,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:52:44.865 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-14T08:52:44.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T08:52:45.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 -- 172.21.15.6:0/3159435185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c0ffde0 msgr2=0x7fab4c100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 --2- 172.21.15.6:0/3159435185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c0ffde0 0x7fab4c100200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0099c0 tx=0x7fab3c009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 -- 172.21.15.6:0/3159435185 shutdown_connections 2023-10-14T08:52:45.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 --2- 172.21.15.6:0/3159435185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab4c101970 0x7fab4c108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 --2- 172.21.15.6:0/3159435185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c0ffde0 0x7fab4c100200 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 --2- 172.21.15.6:0/3159435185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab4c100fd0 0x7fab4c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 -- 172.21.15.6:0/3159435185 >> 172.21.15.6:0/3159435185 conn(0x7fab4c0fb310 msgr2=0x7fab4c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:45.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 -- 172.21.15.6:0/3159435185 shutdown_connections 2023-10-14T08:52:45.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.023+0000 7fab50ba0700 1 -- 172.21.15.6:0/3159435185 wait complete. 2023-10-14T08:52:45.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 Processor -- start 2023-10-14T08:52:45.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 -- start start 2023-10-14T08:52:45.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab4c0ffde0 0x7fab4c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab4c100fd0 0x7fab4c1960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 0x7fab4c19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c19d6f0 con 0x7fab4c101970 2023-10-14T08:52:45.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c19d830 con 0x7fab4c100fd0 2023-10-14T08:52:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab50ba0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c19d9c0 con 0x7fab4c0ffde0 2023-10-14T08:52:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 0x7fab4c19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 0x7fab4c19d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32796/0 (socket says 172.21.15.6:32796) 2023-10-14T08:52:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 -- 172.21.15.6:0/4018815578 learned_addr learned my addr 172.21.15.6:0/4018815578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4a59c700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab4c0ffde0 0x7fab4c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab49d9b700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab4c100fd0 0x7fab4c1960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 -- 172.21.15.6:0/4018815578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab4c0ffde0 msgr2=0x7fab4c195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab4c0ffde0 0x7fab4c195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 -- 172.21.15.6:0/4018815578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab4c100fd0 msgr2=0x7fab4c1960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab4c100fd0 0x7fab4c1960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.024+0000 7fab4ad9d700 1 -- 172.21.15.6:0/4018815578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c0095f0 con 0x7fab4c101970 2023-10-14T08:52:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.025+0000 7fab4ad9d700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 0x7fab4c19d120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fab44007ee0 tx=0x7fab4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.025+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44017070 con 0x7fab4c101970 2023-10-14T08:52:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.025+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab4400f040 con 0x7fab4c101970 2023-10-14T08:52:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.025+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c19dca0 con 0x7fab4c101970 2023-10-14T08:52:45.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.025+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44005740 con 0x7fab4c101970 2023-10-14T08:52:45.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.025+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c19e160 con 0x7fab4c101970 2023-10-14T08:52:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.026+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c107370 con 0x7fab4c101970 2023-10-14T08:52:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.027+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fab4400dc60 con 0x7fab4c101970 2023-10-14T08:52:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.028+0000 7fab3b7fe700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fab340a1480 0x7fab340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.028+0000 7fab4a59c700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fab340a1480 0x7fab340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.028+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fab440ccb70 con 0x7fab4c101970 2023-10-14T08:52:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.028+0000 7fab4a59c700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fab340a1480 0x7fab340a3940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00b580 tx=0x7fab3c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.032+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fab440961d0 con 0x7fab4c101970 2023-10-14T08:52:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.237+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 --> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab4c02d2e0 con 0x7fab340a1480 2023-10-14T08:52:45.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.249+0000 7fab3b7fe700 1 -- 172.21.15.6:0/4018815578 <== mgr.14152 v2:172.21.15.6:6800/827561147 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344570 (secure 0 0 0) 0x7fab4c02d2e0 con 0x7fab340a1480 2023-10-14T08:52:45.255 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fab340a1480 msgr2=0x7fab340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fab340a1480 0x7fab340a3940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00b580 tx=0x7fab3c009f10 comp rx=0 tx=0).stop 2023-10-14T08:52:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 msgr2=0x7fab4c19d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 0x7fab4c19d120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fab44007ee0 tx=0x7fab4400d3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 shutdown_connections 2023-10-14T08:52:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab4c101970 0x7fab4c19d120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab4c0ffde0 0x7fab4c195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fab340a1480 0x7fab340a3940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 --2- 172.21.15.6:0/4018815578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab4c100fd0 0x7fab4c1960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 >> 172.21.15.6:0/4018815578 conn(0x7fab4c0fb310 msgr2=0x7fab4c1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 shutdown_connections 2023-10-14T08:52:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.253+0000 7fab50ba0700 1 -- 172.21.15.6:0/4018815578 wait complete. 2023-10-14T08:52:45.260 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-10-14T08:52:45.267 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-10-14T08:52:43.456375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656709,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":917,"num_read_kb":577,"num_write":420,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1240717,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":847,"ondisk_log_size":847,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337196,"kb_used_data":13004,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604628,"statfs":{"total":1151940427776,"available":1151595139072,"internally_reserved":0,"allocated":13316096,"data_stored":7261741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":68,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004855"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477711+0000","last_change":"2023-10-14T08:51:16.812784+0000","last_active":"2023-10-14T08:52:33.477711+0000","last_peered":"2023-10-14T08:52:33.477711+0000","last_clean":"2023-10-14T08:52:33.477711+0000","last_became_active":"2023-10-14T08:51:16.812476+0000","last_became_peered":"2023-10-14T08:51:16.812476+0000","last_unstale":"2023-10-14T08:52:33.477711+0000","last_undegraded":"2023-10-14T08:52:33.477711+0000","last_fullsized":"2023-10-14T08:52:33.477711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:17:00.327448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482316+0000","last_change":"2023-10-14T08:51:16.814846+0000","last_active":"2023-10-14T08:52:33.482316+0000","last_peered":"2023-10-14T08:52:33.482316+0000","last_clean":"2023-10-14T08:52:33.482316+0000","last_became_active":"2023-10-14T08:51:16.814528+0000","last_became_peered":"2023-10-14T08:51:16.814528+0000","last_unstale":"2023-10-14T08:52:33.482316+0000","last_undegraded":"2023-10-14T08:52:33.482316+0000","last_fullsized":"2023-10-14T08:52:33.482316+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:38:53.154561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481572+0000","last_change":"2023-10-14T08:51:16.818149+0000","last_active":"2023-10-14T08:52:33.481572+0000","last_peered":"2023-10-14T08:52:33.481572+0000","last_clean":"2023-10-14T08:52:33.481572+0000","last_became_active":"2023-10-14T08:51:16.817764+0000","last_became_peered":"2023-10-14T08:51:16.817764+0000","last_unstale":"2023-10-14T08:52:33.481572+0000","last_undegraded":"2023-10-14T08:52:33.481572+0000","last_fullsized":"2023-10-14T08:52:33.481572+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:31.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485097+0000","last_change":"2023-10-14T08:51:16.820285+0000","last_active":"2023-10-14T08:52:33.485097+0000","last_peered":"2023-10-14T08:52:33.485097+0000","last_clean":"2023-10-14T08:52:33.485097+0000","last_became_active":"2023-10-14T08:51:16.819699+0000","last_became_peered":"2023-10-14T08:51:16.819699+0000","last_unstale":"2023-10-14T08:52:33.485097+0000","last_undegraded":"2023-10-14T08:52:33.485097+0000","last_fullsized":"2023-10-14T08:52:33.485097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:34:34.950991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.472716+0000","last_change":"2023-10-14T08:51:16.806992+0000","last_active":"2023-10-14T08:52:33.472716+0000","last_peered":"2023-10-14T08:52:33.472716+0000","last_clean":"2023-10-14T08:52:33.472716+0000","last_became_active":"2023-10-14T08:51:16.806719+0000","last_became_peered":"2023-10-14T08:51:16.806719+0000","last_unstale":"2023-10-14T08:52:33.472716+0000","last_undegraded":"2023-10-14T08:52:33.472716+0000","last_fullsized":"2023-10-14T08:52:33.472716+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:16.805197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485094+0000","last_change":"2023-10-14T08:51:16.819908+0000","last_active":"2023-10-14T08:52:33.485094+0000","last_peered":"2023-10-14T08:52:33.485094+0000","last_clean":"2023-10-14T08:52:33.485094+0000","last_became_active":"2023-10-14T08:51:16.819578+0000","last_became_peered":"2023-10-14T08:51:16.819578+0000","last_unstale":"2023-10-14T08:52:33.485094+0000","last_undegraded":"2023-10-14T08:52:33.485094+0000","last_fullsized":"2023-10-14T08:52:33.485094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:53.491710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482319+0000","last_change":"2023-10-14T08:51:16.816056+0000","last_active":"2023-10-14T08:52:33.482319+0000","last_peered":"2023-10-14T08:52:33.482319+0000","last_clean":"2023-10-14T08:52:33.482319+0000","last_became_active":"2023-10-14T08:51:16.815735+0000","last_became_peered":"2023-10-14T08:51:16.815735+0000","last_unstale":"2023-10-14T08:52:33.482319+0000","last_undegraded":"2023-10-14T08:52:33.482319+0000","last_fullsized":"2023-10-14T08:52:33.482319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:22.068075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479580+0000","last_change":"2023-10-14T08:51:16.811920+0000","last_active":"2023-10-14T08:52:33.479580+0000","last_peered":"2023-10-14T08:52:33.479580+0000","last_clean":"2023-10-14T08:52:33.479580+0000","last_became_active":"2023-10-14T08:51:16.811578+0000","last_became_peered":"2023-10-14T08:51:16.811578+0000","last_unstale":"2023-10-14T08:52:33.479580+0000","last_undegraded":"2023-10-14T08:52:33.479580+0000","last_fullsized":"2023-10-14T08:52:33.479580+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:05:04.461840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486211+0000","last_change":"2023-10-14T08:51:16.811104+0000","last_active":"2023-10-14T08:52:33.486211+0000","last_peered":"2023-10-14T08:52:33.486211+0000","last_clean":"2023-10-14T08:52:33.486211+0000","last_became_active":"2023-10-14T08:51:16.810793+0000","last_became_peered":"2023-10-14T08:51:16.810793+0000","last_unstale":"2023-10-14T08:52:33.486211+0000","last_undegraded":"2023-10-14T08:52:33.486211+0000","last_fullsized":"2023-10-14T08:52:33.486211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:13.699658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486016+0000","last_change":"2023-10-14T08:51:16.820622+0000","last_active":"2023-10-14T08:52:33.486016+0000","last_peered":"2023-10-14T08:52:33.486016+0000","last_clean":"2023-10-14T08:52:33.486016+0000","last_became_active":"2023-10-14T08:51:16.820257+0000","last_became_peered":"2023-10-14T08:51:16.820257+0000","last_unstale":"2023-10-14T08:52:33.486016+0000","last_undegraded":"2023-10-14T08:52:33.486016+0000","last_fullsized":"2023-10-14T08:52:33.486016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:46.020453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482700+0000","last_change":"2023-10-14T08:51:16.819491+0000","last_active":"2023-10-14T08:52:33.482700+0000","last_peered":"2023-10-14T08:52:33.482700+0000","last_clean":"2023-10-14T08:52:33.482700+0000","last_became_active":"2023-10-14T08:51:16.818950+0000","last_became_peered":"2023-10-14T08:51:16.818950+0000","last_unstale":"2023-10-14T08:52:33.482700+0000","last_undegraded":"2023-10-14T08:52:33.482700+0000","last_fullsized":"2023-10-14T08:52:33.482700+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:43:17.530028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479581+0000","last_change":"2023-10-14T08:52:04.456618+0000","last_active":"2023-10-14T08:52:33.479581+0000","last_peered":"2023-10-14T08:52:33.479581+0000","last_clean":"2023-10-14T08:52:33.479581+0000","last_became_active":"2023-10-14T08:52:04.456226+0000","last_became_peered":"2023-10-14T08:52:04.456226+0000","last_unstale":"2023-10-14T08:52:33.479581+0000","last_undegraded":"2023-10-14T08:52:33.479581+0000","last_fullsized":"2023-10-14T08:52:33.479581+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:03:55.187892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478571+0000","last_change":"2023-10-14T08:51:16.814812+0000","last_active":"2023-10-14T08:52:33.478571+0000","last_peered":"2023-10-14T08:52:33.478571+0000","last_clean":"2023-10-14T08:52:33.478571+0000","last_became_active":"2023-10-14T08:51:16.814499+0000","last_became_peered":"2023-10-14T08:51:16.814499+0000","last_unstale":"2023-10-14T08:52:33.478571+0000","last_undegraded":"2023-10-14T08:52:33.478571+0000","last_fullsized":"2023-10-14T08:52:33.478571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:24:22.662673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481329+0000","last_change":"2023-10-14T08:51:16.814877+0000","last_active":"2023-10-14T08:52:33.481329+0000","last_peered":"2023-10-14T08:52:33.481329+0000","last_clean":"2023-10-14T08:52:33.481329+0000","last_became_active":"2023-10-14T08:51:16.814572+0000","last_became_peered":"2023-10-14T08:51:16.814572+0000","last_unstale":"2023-10-14T08:52:33.481329+0000","last_undegraded":"2023-10-14T08:52:33.481329+0000","last_fullsized":"2023-10-14T08:52:33.481329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:55.758385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478692+0000","last_change":"2023-10-14T08:52:04.456089+0000","last_active":"2023-10-14T08:52:33.478692+0000","last_peered":"2023-10-14T08:52:33.478692+0000","last_clean":"2023-10-14T08:52:33.478692+0000","last_became_active":"2023-10-14T08:52:04.455671+0000","last_became_peered":"2023-10-14T08:52:04.455671+0000","last_unstale":"2023-10-14T08:52:33.478692+0000","last_undegraded":"2023-10-14T08:52:33.478692+0000","last_fullsized":"2023-10-14T08:52:33.478692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:59.639694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479608+0000","last_change":"2023-10-14T08:51:16.810873+0000","last_active":"2023-10-14T08:52:33.479608+0000","last_peered":"2023-10-14T08:52:33.479608+0000","last_clean":"2023-10-14T08:52:33.479608+0000","last_became_active":"2023-10-14T08:51:16.810528+0000","last_became_peered":"2023-10-14T08:51:16.810528+0000","last_unstale":"2023-10-14T08:52:33.479608+0000","last_undegraded":"2023-10-14T08:52:33.479608+0000","last_fullsized":"2023-10-14T08:52:33.479608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:22:54.916930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477938+0000","last_change":"2023-10-14T08:51:16.812535+0000","last_active":"2023-10-14T08:52:33.477938+0000","last_peered":"2023-10-14T08:52:33.477938+0000","last_clean":"2023-10-14T08:52:33.477938+0000","last_became_active":"2023-10-14T08:51:16.811935+0000","last_became_peered":"2023-10-14T08:51:16.811935+0000","last_unstale":"2023-10-14T08:52:33.477938+0000","last_undegraded":"2023-10-14T08:52:33.477938+0000","last_fullsized":"2023-10-14T08:52:33.477938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.149378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480796+0000","last_change":"2023-10-14T08:51:16.815097+0000","last_active":"2023-10-14T08:52:33.480796+0000","last_peered":"2023-10-14T08:52:33.480796+0000","last_clean":"2023-10-14T08:52:33.480796+0000","last_became_active":"2023-10-14T08:51:16.814795+0000","last_became_peered":"2023-10-14T08:51:16.814795+0000","last_unstale":"2023-10-14T08:52:33.480796+0000","last_undegraded":"2023-10-14T08:52:33.480796+0000","last_fullsized":"2023-10-14T08:52:33.480796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:54.258757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486271+0000","last_change":"2023-10-14T08:51:16.810041+0000","last_active":"2023-10-14T08:52:33.486271+0000","last_peered":"2023-10-14T08:52:33.486271+0000","last_clean":"2023-10-14T08:52:33.486271+0000","last_became_active":"2023-10-14T08:51:16.809680+0000","last_became_peered":"2023-10-14T08:51:16.809680+0000","last_unstale":"2023-10-14T08:52:33.486271+0000","last_undegraded":"2023-10-14T08:52:33.486271+0000","last_fullsized":"2023-10-14T08:52:33.486271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:01:39.990870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.504016+0000","last_change":"2023-10-14T08:52:04.465622+0000","last_active":"2023-10-14T08:52:39.504016+0000","last_peered":"2023-10-14T08:52:39.504016+0000","last_clean":"2023-10-14T08:52:39.504016+0000","last_became_active":"2023-10-14T08:52:04.455831+0000","last_became_peered":"2023-10-14T08:52:04.455831+0000","last_unstale":"2023-10-14T08:52:39.504016+0000","last_undegraded":"2023-10-14T08:52:39.504016+0000","last_fullsized":"2023-10-14T08:52:39.504016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:49:49.123968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480271+0000","last_change":"2023-10-14T08:51:16.807413+0000","last_active":"2023-10-14T08:52:33.480271+0000","last_peered":"2023-10-14T08:52:33.480271+0000","last_clean":"2023-10-14T08:52:33.480271+0000","last_became_active":"2023-10-14T08:51:16.807104+0000","last_became_peered":"2023-10-14T08:51:16.807104+0000","last_unstale":"2023-10-14T08:52:33.480271+0000","last_undegraded":"2023-10-14T08:52:33.480271+0000","last_fullsized":"2023-10-14T08:52:33.480271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:25:06.917050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.549043+0000","last_change":"2023-10-14T08:51:15.863057+0000","last_active":"2023-10-14T08:52:03.549043+0000","last_peered":"2023-10-14T08:52:03.549043+0000","last_clean":"2023-10-14T08:52:03.549043+0000","last_became_active":"2023-10-14T08:51:15.862742+0000","last_became_peered":"2023-10-14T08:51:15.862742+0000","last_unstale":"2023-10-14T08:52:03.549043+0000","last_undegraded":"2023-10-14T08:52:03.549043+0000","last_fullsized":"2023-10-14T08:52:03.549043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:36:19.700657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482984+0000","last_change":"2023-10-14T08:51:16.813019+0000","last_active":"2023-10-14T08:52:33.482984+0000","last_peered":"2023-10-14T08:52:33.482984+0000","last_clean":"2023-10-14T08:52:33.482984+0000","last_became_active":"2023-10-14T08:51:16.812558+0000","last_became_peered":"2023-10-14T08:51:16.812558+0000","last_unstale":"2023-10-14T08:52:33.482984+0000","last_undegraded":"2023-10-14T08:52:33.482984+0000","last_fullsized":"2023-10-14T08:52:33.482984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:10:10.833725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450130+0000","last_change":"2023-10-14T08:51:15.861299+0000","last_active":"2023-10-14T08:52:03.450130+0000","last_peered":"2023-10-14T08:52:03.450130+0000","last_clean":"2023-10-14T08:52:03.450130+0000","last_became_active":"2023-10-14T08:51:15.860783+0000","last_became_peered":"2023-10-14T08:51:15.860783+0000","last_unstale":"2023-10-14T08:52:03.450130+0000","last_undegraded":"2023-10-14T08:52:03.450130+0000","last_fullsized":"2023-10-14T08:52:03.450130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:46.747538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480890+0000","last_change":"2023-10-14T08:51:16.816168+0000","last_active":"2023-10-14T08:52:33.480890+0000","last_peered":"2023-10-14T08:52:33.480890+0000","last_clean":"2023-10-14T08:52:33.480890+0000","last_became_active":"2023-10-14T08:51:16.815835+0000","last_became_peered":"2023-10-14T08:51:16.815835+0000","last_unstale":"2023-10-14T08:52:33.480890+0000","last_undegraded":"2023-10-14T08:52:33.480890+0000","last_fullsized":"2023-10-14T08:52:33.480890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:16:29.643994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450012+0000","last_change":"2023-10-14T08:51:15.857090+0000","last_active":"2023-10-14T08:52:03.450012+0000","last_peered":"2023-10-14T08:52:03.450012+0000","last_clean":"2023-10-14T08:52:03.450012+0000","last_became_active":"2023-10-14T08:51:15.856772+0000","last_became_peered":"2023-10-14T08:51:15.856772+0000","last_unstale":"2023-10-14T08:52:03.450012+0000","last_undegraded":"2023-10-14T08:52:03.450012+0000","last_fullsized":"2023-10-14T08:52:03.450012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:53:35.255805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488681+0000","last_change":"2023-10-14T08:51:16.820946+0000","last_active":"2023-10-14T08:52:33.488681+0000","last_peered":"2023-10-14T08:52:33.488681+0000","last_clean":"2023-10-14T08:52:33.488681+0000","last_became_active":"2023-10-14T08:51:16.820648+0000","last_became_peered":"2023-10-14T08:51:16.820648+0000","last_unstale":"2023-10-14T08:52:33.488681+0000","last_undegraded":"2023-10-14T08:52:33.488681+0000","last_fullsized":"2023-10-14T08:52:33.488681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:18.660452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":117,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:40.517956+0000","last_change":"2023-10-14T08:52:04.467782+0000","last_active":"2023-10-14T08:52:40.517956+0000","last_peered":"2023-10-14T08:52:40.517956+0000","last_clean":"2023-10-14T08:52:40.517956+0000","last_became_active":"2023-10-14T08:52:04.459237+0000","last_became_peered":"2023-10-14T08:52:04.459237+0000","last_unstale":"2023-10-14T08:52:40.517956+0000","last_undegraded":"2023-10-14T08:52:40.517956+0000","last_fullsized":"2023-10-14T08:52:40.517956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:15:54.861129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481415+0000","last_change":"2023-10-14T08:51:16.801642+0000","last_active":"2023-10-14T08:52:33.481415+0000","last_peered":"2023-10-14T08:52:33.481415+0000","last_clean":"2023-10-14T08:52:33.481415+0000","last_became_active":"2023-10-14T08:51:16.801333+0000","last_became_peered":"2023-10-14T08:51:16.801333+0000","last_unstale":"2023-10-14T08:52:33.481415+0000","last_undegraded":"2023-10-14T08:52:33.481415+0000","last_fullsized":"2023-10-14T08:52:33.481415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:00:57.936074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.839027+0000","last_change":"2023-10-14T08:52:04.839027+0000","last_active":"2023-10-14T08:52:04.839027+0000","last_peered":"2023-10-14T08:52:04.839027+0000","last_clean":"2023-10-14T08:52:04.839027+0000","last_became_active":"2023-10-14T08:52:04.832065+0000","last_became_peered":"2023-10-14T08:52:04.832065+0000","last_unstale":"2023-10-14T08:52:04.839027+0000","last_undegraded":"2023-10-14T08:52:04.839027+0000","last_fullsized":"2023-10-14T08:52:04.839027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:43:33.970140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480517+0000","last_change":"2023-10-14T08:51:16.807098+0000","last_active":"2023-10-14T08:52:33.480517+0000","last_peered":"2023-10-14T08:52:33.480517+0000","last_clean":"2023-10-14T08:52:33.480517+0000","last_became_active":"2023-10-14T08:51:16.806767+0000","last_became_peered":"2023-10-14T08:51:16.806767+0000","last_unstale":"2023-10-14T08:52:33.480517+0000","last_undegraded":"2023-10-14T08:52:33.480517+0000","last_fullsized":"2023-10-14T08:52:33.480517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:10:23.822483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454545+0000","last_change":"2023-10-14T08:51:15.862387+0000","last_active":"2023-10-14T08:52:03.454545+0000","last_peered":"2023-10-14T08:52:03.454545+0000","last_clean":"2023-10-14T08:52:03.454545+0000","last_became_active":"2023-10-14T08:51:15.862093+0000","last_became_peered":"2023-10-14T08:51:15.862093+0000","last_unstale":"2023-10-14T08:52:03.454545+0000","last_undegraded":"2023-10-14T08:52:03.454545+0000","last_fullsized":"2023-10-14T08:52:03.454545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:23:44.003319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480274+0000","last_change":"2023-10-14T08:51:16.806686+0000","last_active":"2023-10-14T08:52:33.480274+0000","last_peered":"2023-10-14T08:52:33.480274+0000","last_clean":"2023-10-14T08:52:33.480274+0000","last_became_active":"2023-10-14T08:51:16.806371+0000","last_became_peered":"2023-10-14T08:51:16.806371+0000","last_unstale":"2023-10-14T08:52:33.480274+0000","last_undegraded":"2023-10-14T08:52:33.480274+0000","last_fullsized":"2023-10-14T08:52:33.480274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:10.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453663+0000","last_change":"2023-10-14T08:51:15.861863+0000","last_active":"2023-10-14T08:52:03.453663+0000","last_peered":"2023-10-14T08:52:03.453663+0000","last_clean":"2023-10-14T08:52:03.453663+0000","last_became_active":"2023-10-14T08:51:15.861541+0000","last_became_peered":"2023-10-14T08:51:15.861541+0000","last_unstale":"2023-10-14T08:52:03.453663+0000","last_undegraded":"2023-10-14T08:52:03.453663+0000","last_fullsized":"2023-10-14T08:52:03.453663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:14.812219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482449+0000","last_change":"2023-10-14T08:51:16.814440+0000","last_active":"2023-10-14T08:52:33.482449+0000","last_peered":"2023-10-14T08:52:33.482449+0000","last_clean":"2023-10-14T08:52:33.482449+0000","last_became_active":"2023-10-14T08:51:16.814142+0000","last_became_peered":"2023-10-14T08:51:16.814142+0000","last_unstale":"2023-10-14T08:52:33.482449+0000","last_undegraded":"2023-10-14T08:52:33.482449+0000","last_fullsized":"2023-10-14T08:52:33.482449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:03.860927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":178,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:41.286292+0000","last_change":"2023-10-14T08:51:15.862736+0000","last_active":"2023-10-14T08:52:41.286292+0000","last_peered":"2023-10-14T08:52:41.286292+0000","last_clean":"2023-10-14T08:52:41.286292+0000","last_became_active":"2023-10-14T08:51:15.862341+0000","last_became_peered":"2023-10-14T08:51:15.862341+0000","last_unstale":"2023-10-14T08:52:41.286292+0000","last_undegraded":"2023-10-14T08:52:41.286292+0000","last_fullsized":"2023-10-14T08:52:41.286292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:02.206085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":159,"num_read_kb":159,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486638+0000","last_change":"2023-10-14T08:51:16.814908+0000","last_active":"2023-10-14T08:52:33.486638+0000","last_peered":"2023-10-14T08:52:33.486638+0000","last_clean":"2023-10-14T08:52:33.486638+0000","last_became_active":"2023-10-14T08:51:16.814629+0000","last_became_peered":"2023-10-14T08:51:16.814629+0000","last_unstale":"2023-10-14T08:52:33.486638+0000","last_undegraded":"2023-10-14T08:52:33.486638+0000","last_fullsized":"2023-10-14T08:52:33.486638+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:03.669450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453618+0000","last_change":"2023-10-14T08:51:15.863718+0000","last_active":"2023-10-14T08:52:03.453618+0000","last_peered":"2023-10-14T08:52:03.453618+0000","last_clean":"2023-10-14T08:52:03.453618+0000","last_became_active":"2023-10-14T08:51:15.863115+0000","last_became_peered":"2023-10-14T08:51:15.863115+0000","last_unstale":"2023-10-14T08:52:03.453618+0000","last_undegraded":"2023-10-14T08:52:03.453618+0000","last_fullsized":"2023-10-14T08:52:03.453618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:59.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482782+0000","last_change":"2023-10-14T08:51:16.820126+0000","last_active":"2023-10-14T08:52:33.482782+0000","last_peered":"2023-10-14T08:52:33.482782+0000","last_clean":"2023-10-14T08:52:33.482782+0000","last_became_active":"2023-10-14T08:51:16.819759+0000","last_became_peered":"2023-10-14T08:51:16.819759+0000","last_unstale":"2023-10-14T08:52:33.482782+0000","last_undegraded":"2023-10-14T08:52:33.482782+0000","last_fullsized":"2023-10-14T08:52:33.482782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:33.381146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454838+0000","last_change":"2023-10-14T08:51:15.859864+0000","last_active":"2023-10-14T08:52:03.454838+0000","last_peered":"2023-10-14T08:52:03.454838+0000","last_clean":"2023-10-14T08:52:03.454838+0000","last_became_active":"2023-10-14T08:51:15.859250+0000","last_became_peered":"2023-10-14T08:51:15.859250+0000","last_unstale":"2023-10-14T08:52:03.454838+0000","last_undegraded":"2023-10-14T08:52:03.454838+0000","last_fullsized":"2023-10-14T08:52:03.454838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:37:58.994147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487341+0000","last_change":"2023-10-14T08:51:16.821276+0000","last_active":"2023-10-14T08:52:33.487341+0000","last_peered":"2023-10-14T08:52:33.487341+0000","last_clean":"2023-10-14T08:52:33.487341+0000","last_became_active":"2023-10-14T08:51:16.820965+0000","last_became_peered":"2023-10-14T08:51:16.820965+0000","last_unstale":"2023-10-14T08:52:33.487341+0000","last_undegraded":"2023-10-14T08:52:33.487341+0000","last_fullsized":"2023-10-14T08:52:33.487341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:31:29.914054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":240,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:40.895685+0000","last_change":"2023-10-14T08:52:04.847819+0000","last_active":"2023-10-14T08:52:40.895685+0000","last_peered":"2023-10-14T08:52:40.895685+0000","last_clean":"2023-10-14T08:52:40.895685+0000","last_became_active":"2023-10-14T08:52:04.833768+0000","last_became_peered":"2023-10-14T08:52:04.833768+0000","last_unstale":"2023-10-14T08:52:40.895685+0000","last_undegraded":"2023-10-14T08:52:40.895685+0000","last_fullsized":"2023-10-14T08:52:40.895685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:34:34.282425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59142,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":154,"num_read_kb":134,"num_write":35,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58575,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478496+0000","last_change":"2023-10-14T08:51:16.823483+0000","last_active":"2023-10-14T08:52:33.478496+0000","last_peered":"2023-10-14T08:52:33.478496+0000","last_clean":"2023-10-14T08:52:33.478496+0000","last_became_active":"2023-10-14T08:51:16.823159+0000","last_became_peered":"2023-10-14T08:51:16.823159+0000","last_unstale":"2023-10-14T08:52:33.478496+0000","last_undegraded":"2023-10-14T08:52:33.478496+0000","last_fullsized":"2023-10-14T08:52:33.478496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:39.314776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452996+0000","last_change":"2023-10-14T08:51:15.859887+0000","last_active":"2023-10-14T08:52:03.452996+0000","last_peered":"2023-10-14T08:52:03.452996+0000","last_clean":"2023-10-14T08:52:03.452996+0000","last_became_active":"2023-10-14T08:51:15.859424+0000","last_became_peered":"2023-10-14T08:51:15.859424+0000","last_unstale":"2023-10-14T08:52:03.452996+0000","last_undegraded":"2023-10-14T08:52:03.452996+0000","last_fullsized":"2023-10-14T08:52:03.452996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:08.629889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.472884+0000","last_change":"2023-10-14T08:51:16.818961+0000","last_active":"2023-10-14T08:52:33.472884+0000","last_peered":"2023-10-14T08:52:33.472884+0000","last_clean":"2023-10-14T08:52:33.472884+0000","last_became_active":"2023-10-14T08:51:16.818667+0000","last_became_peered":"2023-10-14T08:51:16.818667+0000","last_unstale":"2023-10-14T08:52:33.472884+0000","last_undegraded":"2023-10-14T08:52:33.472884+0000","last_fullsized":"2023-10-14T08:52:33.472884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:34.391609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454880+0000","last_change":"2023-10-14T08:51:15.860734+0000","last_active":"2023-10-14T08:52:03.454880+0000","last_peered":"2023-10-14T08:52:03.454880+0000","last_clean":"2023-10-14T08:52:03.454880+0000","last_became_active":"2023-10-14T08:51:15.860415+0000","last_became_peered":"2023-10-14T08:51:15.860415+0000","last_unstale":"2023-10-14T08:52:03.454880+0000","last_undegraded":"2023-10-14T08:52:03.454880+0000","last_fullsized":"2023-10-14T08:52:03.454880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:12:53.729522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487252+0000","last_change":"2023-10-14T08:51:16.823428+0000","last_active":"2023-10-14T08:52:33.487252+0000","last_peered":"2023-10-14T08:52:33.487252+0000","last_clean":"2023-10-14T08:52:33.487252+0000","last_became_active":"2023-10-14T08:51:16.823078+0000","last_became_peered":"2023-10-14T08:51:16.823078+0000","last_unstale":"2023-10-14T08:52:33.487252+0000","last_undegraded":"2023-10-14T08:52:33.487252+0000","last_fullsized":"2023-10-14T08:52:33.487252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:06.825554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'7","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.284024+0000","last_change":"2023-10-14T08:51:15.857592+0000","last_active":"2023-10-14T08:52:39.284024+0000","last_peered":"2023-10-14T08:52:39.284024+0000","last_clean":"2023-10-14T08:52:39.284024+0000","last_became_active":"2023-10-14T08:51:15.857227+0000","last_became_peered":"2023-10-14T08:51:15.857227+0000","last_unstale":"2023-10-14T08:52:39.284024+0000","last_undegraded":"2023-10-14T08:52:39.284024+0000","last_fullsized":"2023-10-14T08:52:39.284024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:44.852262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479470+0000","last_change":"2023-10-14T08:51:16.816734+0000","last_active":"2023-10-14T08:52:33.479470+0000","last_peered":"2023-10-14T08:52:33.479470+0000","last_clean":"2023-10-14T08:52:33.479470+0000","last_became_active":"2023-10-14T08:51:16.816405+0000","last_became_peered":"2023-10-14T08:51:16.816405+0000","last_unstale":"2023-10-14T08:52:33.479470+0000","last_undegraded":"2023-10-14T08:52:33.479470+0000","last_fullsized":"2023-10-14T08:52:33.479470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:25:54.286265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.469743+0000","last_change":"2023-10-14T08:52:04.469342+0000","last_active":"2023-10-14T08:52:04.469743+0000","last_peered":"2023-10-14T08:52:04.469743+0000","last_clean":"2023-10-14T08:52:04.469743+0000","last_became_active":"2023-10-14T08:52:04.454202+0000","last_became_peered":"2023-10-14T08:52:04.454202+0000","last_unstale":"2023-10-14T08:52:04.469743+0000","last_undegraded":"2023-10-14T08:52:04.469743+0000","last_fullsized":"2023-10-14T08:52:04.469743+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.377924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488047+0000","last_change":"2023-10-14T08:51:16.812261+0000","last_active":"2023-10-14T08:52:33.488047+0000","last_peered":"2023-10-14T08:52:33.488047+0000","last_clean":"2023-10-14T08:52:33.488047+0000","last_became_active":"2023-10-14T08:51:16.811906+0000","last_became_peered":"2023-10-14T08:51:16.811906+0000","last_unstale":"2023-10-14T08:52:33.488047+0000","last_undegraded":"2023-10-14T08:52:33.488047+0000","last_fullsized":"2023-10-14T08:52:33.488047+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:56.770799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.449764+0000","last_change":"2023-10-14T08:51:15.858446+0000","last_active":"2023-10-14T08:52:03.449764+0000","last_peered":"2023-10-14T08:52:03.449764+0000","last_clean":"2023-10-14T08:52:03.449764+0000","last_became_active":"2023-10-14T08:51:15.858095+0000","last_became_peered":"2023-10-14T08:51:15.858095+0000","last_unstale":"2023-10-14T08:52:03.449764+0000","last_undegraded":"2023-10-14T08:52:03.449764+0000","last_fullsized":"2023-10-14T08:52:03.449764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:55.507900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.483217+0000","last_change":"2023-10-14T08:51:16.805734+0000","last_active":"2023-10-14T08:52:33.483217+0000","last_peered":"2023-10-14T08:52:33.483217+0000","last_clean":"2023-10-14T08:52:33.483217+0000","last_became_active":"2023-10-14T08:51:16.805436+0000","last_became_peered":"2023-10-14T08:51:16.805436+0000","last_unstale":"2023-10-14T08:52:33.483217+0000","last_undegraded":"2023-10-14T08:52:33.483217+0000","last_fullsized":"2023-10-14T08:52:33.483217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:31:24.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.446910+0000","last_change":"2023-10-14T08:51:15.861635+0000","last_active":"2023-10-14T08:52:03.446910+0000","last_peered":"2023-10-14T08:52:03.446910+0000","last_clean":"2023-10-14T08:52:03.446910+0000","last_became_active":"2023-10-14T08:51:15.861302+0000","last_became_peered":"2023-10-14T08:51:15.861302+0000","last_unstale":"2023-10-14T08:52:03.446910+0000","last_undegraded":"2023-10-14T08:52:03.446910+0000","last_fullsized":"2023-10-14T08:52:03.446910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:11:15.682934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476615+0000","last_change":"2023-10-14T08:51:16.817448+0000","last_active":"2023-10-14T08:52:33.476615+0000","last_peered":"2023-10-14T08:52:33.476615+0000","last_clean":"2023-10-14T08:52:33.476615+0000","last_became_active":"2023-10-14T08:51:16.817159+0000","last_became_peered":"2023-10-14T08:51:16.817159+0000","last_unstale":"2023-10-14T08:52:33.476615+0000","last_undegraded":"2023-10-14T08:52:33.476615+0000","last_fullsized":"2023-10-14T08:52:33.476615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:44:35.889802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:39.504637+0000","last_change":"2023-10-14T08:51:15.863704+0000","last_active":"2023-10-14T08:52:39.504637+0000","last_peered":"2023-10-14T08:52:39.504637+0000","last_clean":"2023-10-14T08:52:39.504637+0000","last_became_active":"2023-10-14T08:51:15.863315+0000","last_became_peered":"2023-10-14T08:51:15.863315+0000","last_unstale":"2023-10-14T08:52:39.504637+0000","last_undegraded":"2023-10-14T08:52:39.504637+0000","last_fullsized":"2023-10-14T08:52:39.504637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:16:48.409415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484299+0000","last_change":"2023-10-14T08:51:16.819773+0000","last_active":"2023-10-14T08:52:33.484299+0000","last_peered":"2023-10-14T08:52:33.484299+0000","last_clean":"2023-10-14T08:52:33.484299+0000","last_became_active":"2023-10-14T08:51:16.819435+0000","last_became_peered":"2023-10-14T08:51:16.819435+0000","last_unstale":"2023-10-14T08:52:33.484299+0000","last_undegraded":"2023-10-14T08:52:33.484299+0000","last_fullsized":"2023-10-14T08:52:33.484299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:46:46.468553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477044+0000","last_change":"2023-10-14T08:51:16.818613+0000","last_active":"2023-10-14T08:52:33.477044+0000","last_peered":"2023-10-14T08:52:33.477044+0000","last_clean":"2023-10-14T08:52:33.477044+0000","last_became_active":"2023-10-14T08:51:16.818085+0000","last_became_peered":"2023-10-14T08:51:16.818085+0000","last_unstale":"2023-10-14T08:52:33.477044+0000","last_undegraded":"2023-10-14T08:52:33.477044+0000","last_fullsized":"2023-10-14T08:52:33.477044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:24:20.304403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'6","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:38.282034+0000","last_change":"2023-10-14T08:51:15.863087+0000","last_active":"2023-10-14T08:52:38.282034+0000","last_peered":"2023-10-14T08:52:38.282034+0000","last_clean":"2023-10-14T08:52:38.282034+0000","last_became_active":"2023-10-14T08:51:15.861220+0000","last_became_peered":"2023-10-14T08:51:15.861220+0000","last_unstale":"2023-10-14T08:52:38.282034+0000","last_undegraded":"2023-10-14T08:52:38.282034+0000","last_fullsized":"2023-10-14T08:52:38.282034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:26.302269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478084+0000","last_change":"2023-10-14T08:51:16.812614+0000","last_active":"2023-10-14T08:52:33.478084+0000","last_peered":"2023-10-14T08:52:33.478084+0000","last_clean":"2023-10-14T08:52:33.478084+0000","last_became_active":"2023-10-14T08:51:16.812320+0000","last_became_peered":"2023-10-14T08:51:16.812320+0000","last_unstale":"2023-10-14T08:52:33.478084+0000","last_undegraded":"2023-10-14T08:52:33.478084+0000","last_fullsized":"2023-10-14T08:52:33.478084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:44:25.355941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453005+0000","last_change":"2023-10-14T08:51:15.862030+0000","last_active":"2023-10-14T08:52:03.453005+0000","last_peered":"2023-10-14T08:52:03.453005+0000","last_clean":"2023-10-14T08:52:03.453005+0000","last_became_active":"2023-10-14T08:51:15.861535+0000","last_became_peered":"2023-10-14T08:51:15.861535+0000","last_unstale":"2023-10-14T08:52:03.453005+0000","last_undegraded":"2023-10-14T08:52:03.453005+0000","last_fullsized":"2023-10-14T08:52:03.453005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:14:32.122489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.451187+0000","last_change":"2023-10-14T08:50:15.133596+0000","last_active":"2023-10-14T08:52:03.451187+0000","last_peered":"2023-10-14T08:52:03.451187+0000","last_clean":"2023-10-14T08:52:03.451187+0000","last_became_active":"2023-10-14T08:50:15.133081+0000","last_became_peered":"2023-10-14T08:50:15.133081+0000","last_unstale":"2023-10-14T08:52:03.451187+0000","last_undegraded":"2023-10-14T08:52:03.451187+0000","last_fullsized":"2023-10-14T08:52:03.451187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:47:16.221383+0000","last_clean_scrub_stamp":"2023-10-14T08:47:16.221383+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:35:44.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484082+0000","last_change":"2023-10-14T08:51:16.820649+0000","last_active":"2023-10-14T08:52:33.484082+0000","last_peered":"2023-10-14T08:52:33.484082+0000","last_clean":"2023-10-14T08:52:33.484082+0000","last_became_active":"2023-10-14T08:51:16.820336+0000","last_became_peered":"2023-10-14T08:51:16.820336+0000","last_unstale":"2023-10-14T08:52:33.484082+0000","last_undegraded":"2023-10-14T08:52:33.484082+0000","last_fullsized":"2023-10-14T08:52:33.484082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:15.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.452204+0000","last_change":"2023-10-14T08:51:15.856109+0000","last_active":"2023-10-14T08:52:03.452204+0000","last_peered":"2023-10-14T08:52:03.452204+0000","last_clean":"2023-10-14T08:52:03.452204+0000","last_became_active":"2023-10-14T08:51:15.855729+0000","last_became_peered":"2023-10-14T08:51:15.855729+0000","last_unstale":"2023-10-14T08:52:03.452204+0000","last_undegraded":"2023-10-14T08:52:03.452204+0000","last_fullsized":"2023-10-14T08:52:03.452204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:01:22.580672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.450005+0000","last_change":"2023-10-14T08:51:15.858817+0000","last_active":"2023-10-14T08:52:03.450005+0000","last_peered":"2023-10-14T08:52:03.450005+0000","last_clean":"2023-10-14T08:52:03.450005+0000","last_became_active":"2023-10-14T08:51:15.858507+0000","last_became_peered":"2023-10-14T08:51:15.858507+0000","last_unstale":"2023-10-14T08:52:03.450005+0000","last_undegraded":"2023-10-14T08:52:03.450005+0000","last_fullsized":"2023-10-14T08:52:03.450005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:16:38.001180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480148+0000","last_change":"2023-10-14T08:51:16.804408+0000","last_active":"2023-10-14T08:52:33.480148+0000","last_peered":"2023-10-14T08:52:33.480148+0000","last_clean":"2023-10-14T08:52:33.480148+0000","last_became_active":"2023-10-14T08:51:16.804125+0000","last_became_peered":"2023-10-14T08:51:16.804125+0000","last_unstale":"2023-10-14T08:52:33.480148+0000","last_undegraded":"2023-10-14T08:52:33.480148+0000","last_fullsized":"2023-10-14T08:52:33.480148+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:18:59.443413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'10","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:04.451638+0000","last_change":"2023-10-14T08:51:15.856438+0000","last_active":"2023-10-14T08:52:04.451638+0000","last_peered":"2023-10-14T08:52:04.451638+0000","last_clean":"2023-10-14T08:52:04.451638+0000","last_became_active":"2023-10-14T08:51:15.856125+0000","last_became_peered":"2023-10-14T08:51:15.856125+0000","last_unstale":"2023-10-14T08:52:04.451638+0000","last_undegraded":"2023-10-14T08:52:04.451638+0000","last_fullsized":"2023-10-14T08:52:04.451638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:36.067639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.480765+0000","last_change":"2023-10-14T08:51:16.815335+0000","last_active":"2023-10-14T08:52:33.480765+0000","last_peered":"2023-10-14T08:52:33.480765+0000","last_clean":"2023-10-14T08:52:33.480765+0000","last_became_active":"2023-10-14T08:51:16.815009+0000","last_became_peered":"2023-10-14T08:51:16.815009+0000","last_unstale":"2023-10-14T08:52:33.480765+0000","last_undegraded":"2023-10-14T08:52:33.480765+0000","last_fullsized":"2023-10-14T08:52:33.480765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:04.370327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454667+0000","last_change":"2023-10-14T08:51:15.856281+0000","last_active":"2023-10-14T08:52:03.454667+0000","last_peered":"2023-10-14T08:52:03.454667+0000","last_clean":"2023-10-14T08:52:03.454667+0000","last_became_active":"2023-10-14T08:51:15.855847+0000","last_became_peered":"2023-10-14T08:51:15.855847+0000","last_unstale":"2023-10-14T08:52:03.454667+0000","last_undegraded":"2023-10-14T08:52:03.454667+0000","last_fullsized":"2023-10-14T08:52:03.454667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:21:47.909295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485895+0000","last_change":"2023-10-14T08:51:16.819136+0000","last_active":"2023-10-14T08:52:33.485895+0000","last_peered":"2023-10-14T08:52:33.485895+0000","last_clean":"2023-10-14T08:52:33.485895+0000","last_became_active":"2023-10-14T08:51:16.818793+0000","last_became_peered":"2023-10-14T08:51:16.818793+0000","last_unstale":"2023-10-14T08:52:33.485895+0000","last_undegraded":"2023-10-14T08:52:33.485895+0000","last_fullsized":"2023-10-14T08:52:33.485895+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:17.754028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.456628+0000","last_change":"2023-10-14T08:51:15.859843+0000","last_active":"2023-10-14T08:52:03.456628+0000","last_peered":"2023-10-14T08:52:03.456628+0000","last_clean":"2023-10-14T08:52:03.456628+0000","last_became_active":"2023-10-14T08:51:15.859474+0000","last_became_peered":"2023-10-14T08:51:15.859474+0000","last_unstale":"2023-10-14T08:52:03.456628+0000","last_undegraded":"2023-10-14T08:52:03.456628+0000","last_fullsized":"2023-10-14T08:52:03.456628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:56:16.145861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.460787+0000","last_change":"2023-10-14T08:51:16.815353+0000","last_active":"2023-10-14T08:52:33.460787+0000","last_peered":"2023-10-14T08:52:33.460787+0000","last_clean":"2023-10-14T08:52:33.460787+0000","last_became_active":"2023-10-14T08:51:16.815018+0000","last_became_peered":"2023-10-14T08:51:16.815018+0000","last_unstale":"2023-10-14T08:52:33.460787+0000","last_undegraded":"2023-10-14T08:52:33.460787+0000","last_fullsized":"2023-10-14T08:52:33.460787+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:46:37.983268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.548779+0000","last_change":"2023-10-14T08:51:15.857967+0000","last_active":"2023-10-14T08:52:03.548779+0000","last_peered":"2023-10-14T08:52:03.548779+0000","last_clean":"2023-10-14T08:52:03.548779+0000","last_became_active":"2023-10-14T08:51:15.857465+0000","last_became_peered":"2023-10-14T08:51:15.857465+0000","last_unstale":"2023-10-14T08:52:03.548779+0000","last_undegraded":"2023-10-14T08:52:03.548779+0000","last_fullsized":"2023-10-14T08:52:03.548779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:48:17.467697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.478911+0000","last_change":"2023-10-14T08:51:16.805061+0000","last_active":"2023-10-14T08:52:33.478911+0000","last_peered":"2023-10-14T08:52:33.478911+0000","last_clean":"2023-10-14T08:52:33.478911+0000","last_became_active":"2023-10-14T08:51:16.804721+0000","last_became_peered":"2023-10-14T08:51:16.804721+0000","last_unstale":"2023-10-14T08:52:33.478911+0000","last_undegraded":"2023-10-14T08:52:33.478911+0000","last_fullsized":"2023-10-14T08:52:33.478911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:09:17.079528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.453327+0000","last_change":"2023-10-14T08:51:15.859371+0000","last_active":"2023-10-14T08:52:03.453327+0000","last_peered":"2023-10-14T08:52:03.453327+0000","last_clean":"2023-10-14T08:52:03.453327+0000","last_became_active":"2023-10-14T08:51:15.859014+0000","last_became_peered":"2023-10-14T08:51:15.859014+0000","last_unstale":"2023-10-14T08:52:03.453327+0000","last_undegraded":"2023-10-14T08:52:03.453327+0000","last_fullsized":"2023-10-14T08:52:03.453327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:20.437755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476989+0000","last_change":"2023-10-14T08:51:16.811759+0000","last_active":"2023-10-14T08:52:33.476989+0000","last_peered":"2023-10-14T08:52:33.476989+0000","last_clean":"2023-10-14T08:52:33.476989+0000","last_became_active":"2023-10-14T08:51:16.811464+0000","last_became_peered":"2023-10-14T08:51:16.811464+0000","last_unstale":"2023-10-14T08:52:33.476989+0000","last_undegraded":"2023-10-14T08:52:33.476989+0000","last_fullsized":"2023-10-14T08:52:33.476989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:08:33.045410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.449416+0000","last_change":"2023-10-14T08:51:15.861871+0000","last_active":"2023-10-14T08:52:03.449416+0000","last_peered":"2023-10-14T08:52:03.449416+0000","last_clean":"2023-10-14T08:52:03.449416+0000","last_became_active":"2023-10-14T08:51:15.861528+0000","last_became_peered":"2023-10-14T08:51:15.861528+0000","last_unstale":"2023-10-14T08:52:03.449416+0000","last_undegraded":"2023-10-14T08:52:03.449416+0000","last_fullsized":"2023-10-14T08:52:03.449416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:29:15.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.486206+0000","last_change":"2023-10-14T08:51:16.814065+0000","last_active":"2023-10-14T08:52:33.486206+0000","last_peered":"2023-10-14T08:52:33.486206+0000","last_clean":"2023-10-14T08:52:33.486206+0000","last_became_active":"2023-10-14T08:51:16.813640+0000","last_became_peered":"2023-10-14T08:51:16.813640+0000","last_unstale":"2023-10-14T08:52:33.486206+0000","last_undegraded":"2023-10-14T08:52:33.486206+0000","last_fullsized":"2023-10-14T08:52:33.486206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:00:01.513410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":98,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:38.282644+0000","last_change":"2023-10-14T08:51:15.860381+0000","last_active":"2023-10-14T08:52:38.282644+0000","last_peered":"2023-10-14T08:52:38.282644+0000","last_clean":"2023-10-14T08:52:38.282644+0000","last_became_active":"2023-10-14T08:51:15.860049+0000","last_became_peered":"2023-10-14T08:51:15.860049+0000","last_unstale":"2023-10-14T08:52:38.282644+0000","last_undegraded":"2023-10-14T08:52:38.282644+0000","last_fullsized":"2023-10-14T08:52:38.282644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:10:50.089678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.482564+0000","last_change":"2023-10-14T08:51:16.819282+0000","last_active":"2023-10-14T08:52:33.482564+0000","last_peered":"2023-10-14T08:52:33.482564+0000","last_clean":"2023-10-14T08:52:33.482564+0000","last_became_active":"2023-10-14T08:51:16.818488+0000","last_became_peered":"2023-10-14T08:51:16.818488+0000","last_unstale":"2023-10-14T08:52:33.482564+0000","last_undegraded":"2023-10-14T08:52:33.482564+0000","last_fullsized":"2023-10-14T08:52:33.482564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:51:07.958669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454674+0000","last_change":"2023-10-14T08:51:15.860027+0000","last_active":"2023-10-14T08:52:03.454674+0000","last_peered":"2023-10-14T08:52:03.454674+0000","last_clean":"2023-10-14T08:52:03.454674+0000","last_became_active":"2023-10-14T08:51:15.859727+0000","last_became_peered":"2023-10-14T08:51:15.859727+0000","last_unstale":"2023-10-14T08:52:03.454674+0000","last_undegraded":"2023-10-14T08:52:03.454674+0000","last_fullsized":"2023-10-14T08:52:03.454674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:55.083336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.477586+0000","last_change":"2023-10-14T08:51:16.814027+0000","last_active":"2023-10-14T08:52:33.477586+0000","last_peered":"2023-10-14T08:52:33.477586+0000","last_clean":"2023-10-14T08:52:33.477586+0000","last_became_active":"2023-10-14T08:51:16.813661+0000","last_became_peered":"2023-10-14T08:51:16.813661+0000","last_unstale":"2023-10-14T08:52:33.477586+0000","last_undegraded":"2023-10-14T08:52:33.477586+0000","last_fullsized":"2023-10-14T08:52:33.477586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:45:32.856604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-14T08:52:03.454918+0000","last_change":"2023-10-14T08:51:15.858084+0000","last_active":"2023-10-14T08:52:03.454918+0000","last_peered":"2023-10-14T08:52:03.454918+0000","last_clean":"2023-10-14T08:52:03.454918+0000","last_became_active":"2023-10-14T08:51:15.857817+0000","last_became_peered":"2023-10-14T08:51:15.857817+0000","last_unstale":"2023-10-14T08:52:03.454918+0000","last_undegraded":"2023-10-14T08:52:03.454918+0000","last_fullsized":"2023-10-14T08:52:03.454918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:14.834671+0000","last_clean_scrub_stamp":"2023-10-14T08:51:14.834671+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:46:52.379246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481522+0000","last_change":"2023-10-14T08:51:16.813964+0000","last_active":"2023-10-14T08:52:33.481522+0000","last_peered":"2023-10-14T08:52:33.481522+0000","last_clean":"2023-10-14T08:52:33.481522+0000","last_became_active":"2023-10-14T08:51:16.813355+0000","last_became_peered":"2023-10-14T08:51:16.813355+0000","last_unstale":"2023-10-14T08:52:33.481522+0000","last_undegraded":"2023-10-14T08:52:33.481522+0000","last_fullsized":"2023-10-14T08:52:33.481522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:44.237735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479680+0000","last_change":"2023-10-14T08:51:16.805980+0000","last_active":"2023-10-14T08:52:33.479680+0000","last_peered":"2023-10-14T08:52:33.479680+0000","last_clean":"2023-10-14T08:52:33.479680+0000","last_became_active":"2023-10-14T08:51:16.805645+0000","last_became_peered":"2023-10-14T08:51:16.805645+0000","last_unstale":"2023-10-14T08:52:33.479680+0000","last_undegraded":"2023-10-14T08:52:33.479680+0000","last_fullsized":"2023-10-14T08:52:33.479680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:12:00.746302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.487937+0000","last_change":"2023-10-14T08:52:04.831658+0000","last_active":"2023-10-14T08:52:33.487937+0000","last_peered":"2023-10-14T08:52:33.487937+0000","last_clean":"2023-10-14T08:52:33.487937+0000","last_became_active":"2023-10-14T08:52:04.831331+0000","last_became_peered":"2023-10-14T08:52:04.831331+0000","last_unstale":"2023-10-14T08:52:33.487937+0000","last_undegraded":"2023-10-14T08:52:33.487937+0000","last_fullsized":"2023-10-14T08:52:33.487937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:48:52.884720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485796+0000","last_change":"2023-10-14T08:51:16.807669+0000","last_active":"2023-10-14T08:52:33.485796+0000","last_peered":"2023-10-14T08:52:33.485796+0000","last_clean":"2023-10-14T08:52:33.485796+0000","last_became_active":"2023-10-14T08:51:16.807326+0000","last_became_peered":"2023-10-14T08:51:16.807326+0000","last_unstale":"2023-10-14T08:52:33.485796+0000","last_undegraded":"2023-10-14T08:52:33.485796+0000","last_fullsized":"2023-10-14T08:52:33.485796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:33.821902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.481732+0000","last_change":"2023-10-14T08:51:16.808231+0000","last_active":"2023-10-14T08:52:33.481732+0000","last_peered":"2023-10-14T08:52:33.481732+0000","last_clean":"2023-10-14T08:52:33.481732+0000","last_became_active":"2023-10-14T08:51:16.807884+0000","last_became_peered":"2023-10-14T08:51:16.807884+0000","last_unstale":"2023-10-14T08:52:33.481732+0000","last_undegraded":"2023-10-14T08:52:33.481732+0000","last_fullsized":"2023-10-14T08:52:33.481732+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:07:51.913031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484062+0000","last_change":"2023-10-14T08:51:16.821637+0000","last_active":"2023-10-14T08:52:33.484062+0000","last_peered":"2023-10-14T08:52:33.484062+0000","last_clean":"2023-10-14T08:52:33.484062+0000","last_became_active":"2023-10-14T08:51:16.821330+0000","last_became_peered":"2023-10-14T08:51:16.821330+0000","last_unstale":"2023-10-14T08:52:33.484062+0000","last_undegraded":"2023-10-14T08:52:33.484062+0000","last_fullsized":"2023-10-14T08:52:33.484062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:10:24.008557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476685+0000","last_change":"2023-10-14T08:51:16.804129+0000","last_active":"2023-10-14T08:52:33.476685+0000","last_peered":"2023-10-14T08:52:33.476685+0000","last_clean":"2023-10-14T08:52:33.476685+0000","last_became_active":"2023-10-14T08:51:16.803805+0000","last_became_peered":"2023-10-14T08:51:16.803805+0000","last_unstale":"2023-10-14T08:52:33.476685+0000","last_undegraded":"2023-10-14T08:52:33.476685+0000","last_fullsized":"2023-10-14T08:52:33.476685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:35:23.677281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.488984+0000","last_change":"2023-10-14T08:51:16.812210+0000","last_active":"2023-10-14T08:52:33.488984+0000","last_peered":"2023-10-14T08:52:33.488984+0000","last_clean":"2023-10-14T08:52:33.488984+0000","last_became_active":"2023-10-14T08:51:16.811919+0000","last_became_peered":"2023-10-14T08:51:16.811919+0000","last_unstale":"2023-10-14T08:52:33.488984+0000","last_undegraded":"2023-10-14T08:52:33.488984+0000","last_fullsized":"2023-10-14T08:52:33.488984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:29.376220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.484932+0000","last_change":"2023-10-14T08:51:16.819725+0000","last_active":"2023-10-14T08:52:33.484932+0000","last_peered":"2023-10-14T08:52:33.484932+0000","last_clean":"2023-10-14T08:52:33.484932+0000","last_became_active":"2023-10-14T08:51:16.819385+0000","last_became_peered":"2023-10-14T08:51:16.819385+0000","last_unstale":"2023-10-14T08:52:33.484932+0000","last_undegraded":"2023-10-14T08:52:33.484932+0000","last_fullsized":"2023-10-14T08:52:33.484932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:37:30.556362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485817+0000","last_change":"2023-10-14T08:51:16.807552+0000","last_active":"2023-10-14T08:52:33.485817+0000","last_peered":"2023-10-14T08:52:33.485817+0000","last_clean":"2023-10-14T08:52:33.485817+0000","last_became_active":"2023-10-14T08:51:16.807244+0000","last_became_peered":"2023-10-14T08:51:16.807244+0000","last_unstale":"2023-10-14T08:52:33.485817+0000","last_undegraded":"2023-10-14T08:52:33.485817+0000","last_fullsized":"2023-10-14T08:52:33.485817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:16.797365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.485317+0000","last_change":"2023-10-14T08:51:16.810604+0000","last_active":"2023-10-14T08:52:33.485317+0000","last_peered":"2023-10-14T08:52:33.485317+0000","last_clean":"2023-10-14T08:52:33.485317+0000","last_became_active":"2023-10-14T08:51:16.810244+0000","last_became_peered":"2023-10-14T08:51:16.810244+0000","last_unstale":"2023-10-14T08:52:33.485317+0000","last_undegraded":"2023-10-14T08:52:33.485317+0000","last_fullsized":"2023-10-14T08:52:33.485317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:58:53.474184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.479941+0000","last_change":"2023-10-14T08:51:16.818745+0000","last_active":"2023-10-14T08:52:33.479941+0000","last_peered":"2023-10-14T08:52:33.479941+0000","last_clean":"2023-10-14T08:52:33.479941+0000","last_became_active":"2023-10-14T08:51:16.818429+0000","last_became_peered":"2023-10-14T08:51:16.818429+0000","last_unstale":"2023-10-14T08:52:33.479941+0000","last_undegraded":"2023-10-14T08:52:33.479941+0000","last_fullsized":"2023-10-14T08:52:33.479941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:04:00.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.476620+0000","last_change":"2023-10-14T08:51:16.819557+0000","last_active":"2023-10-14T08:52:33.476620+0000","last_peered":"2023-10-14T08:52:33.476620+0000","last_clean":"2023-10-14T08:52:33.476620+0000","last_became_active":"2023-10-14T08:51:16.819304+0000","last_became_peered":"2023-10-14T08:51:16.819304+0000","last_unstale":"2023-10-14T08:52:33.476620+0000","last_undegraded":"2023-10-14T08:52:33.476620+0000","last_fullsized":"2023-10-14T08:52:33.476620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:24.913884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-14T08:52:33.475420+0000","last_change":"2023-10-14T08:52:04.456448+0000","last_active":"2023-10-14T08:52:33.475420+0000","last_peered":"2023-10-14T08:52:33.475420+0000","last_clean":"2023-10-14T08:52:33.475420+0000","last_became_active":"2023-10-14T08:52:04.456002+0000","last_became_peered":"2023-10-14T08:52:04.456002+0000","last_unstale":"2023-10-14T08:52:33.475420+0000","last_undegraded":"2023-10-14T08:52:33.475420+0000","last_fullsized":"2023-10-14T08:52:33.475420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T08:51:15.836602+0000","last_clean_scrub_stamp":"2023-10-14T08:51:15.836602+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:00.467295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66095,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":791,"num_read_kb":468,"num_write":237,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":59981,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481821,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":443104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.443},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58699999999999997,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.75},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78600000000000003,"5min":1.129,"15min":1.129},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45900000000000002,"15min":0.45800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.46800000000000003,"15min":0.46000000000000002},"min":{"1min":0.33100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.81100000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84799999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.35699999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.751,"5min":1.044,"15min":1.044},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84199999999999997,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48599999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.872,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.70599999999999996},"min":{"1min":0.56499999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90200000000000002,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.83399999999999996}]},{"osd":8,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84899999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94699999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.94899999999999995,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89700000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.93100000000000005,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.875},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.79600000000000004,"15min":0.79400000000000004},"min":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.98299999999999998,"5min":1.333,"15min":1.333},"last":0.86299999999999999}]}]},{"osd":10,"up_from":69,"seq":296352743457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28600,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716552,"statfs":{"total":95995035648,"available":95965749248,"internally_reserved":0,"allocated":1622016,"data_stored":1092697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.1230000000000002,"5min":5.1230000000000002,"15min":5.1230000000000002},"last":0.84199999999999997}]},{"osd":1,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51200000000000001,"15min":0.50900000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.62},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38700000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.54100000000000004,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.501,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.71199999999999997,"15min":0.69199999999999995},"min":{"1min":0.58599999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.99099999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.53200000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.032,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.84199999999999997,"15min":0.82799999999999996},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":3.625,"5min":3.625,"15min":3.625},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.81599999999999995,"15min":0.79600000000000004},"min":{"1min":0.57899999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.72699999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.84699999999999998,"15min":0.83899999999999997},"min":{"1min":0.69599999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.079},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82499999999999996,"15min":0.82199999999999995},"min":{"1min":0.61699999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":1.1060000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.90500000000000003,"15min":0.873},"min":{"1min":0.68000000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.872,"15min":0.85599999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":1.0589999999999999}]},{"osd":11,"last update":"Sat Oct 14 08:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84599999999999997,"15min":0.84299999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.276,"15min":1.276},"last":1.04},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.85999999999999999,"15min":0.84999999999999998},"min":{"1min":0.54000000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1639999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.1259999999999999}]}]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":442250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.50600000000000001,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.2069999999999999,"5min":4.2069999999999999,"15min":4.2069999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.52400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.2530000000000001,"5min":2.2530000000000001,"15min":2.2530000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69099999999999995,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68999999999999995,"15min":0.67400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":4.0890000000000004,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.443}]},{"osd":3,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.83499999999999996,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.41099999999999998}]},{"osd":4,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94299999999999995,"5min":1.595,"15min":1.595},"last":0.70899999999999996}]},{"osd":5,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0900000000000001,"5min":1.532,"15min":1.532},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.83899999999999997,"15min":0.85999999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.01,"5min":1.466,"15min":1.466},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.86499999999999999,"15min":0.877},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.63900000000000001}]},{"osd":8,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.85399999999999998,"15min":0.84499999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.1459999999999999,"5min":4.1459999999999999,"15min":4.1459999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83899999999999997,"15min":0.85799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0629999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.47499999999999998}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.624},{"interface":"front","average":{"1min":0.753,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":442516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.501},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56599999999999995,"15min":0.58399999999999996},"min":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78600000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.59299999999999997,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.41799999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.33400000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.76100000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.47499999999999998},"min":{"1min":0.34599999999999997,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.82199999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.64200000000000002,"15min":0.628},"min":{"1min":0.60199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.58499999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":1.915,"15min":1.915},"last":0.66700000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.48999999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60899999999999999,"15min":0.59199999999999997},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.84099999999999997}]},{"osd":6,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.97099999999999997,"5min":1.038,"15min":1.038},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.753,"15min":0.752},"min":{"1min":0.624,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.76700000000000002,"15min":0.747},"min":{"1min":0.69199999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.0680000000000001,"5min":1.119,"15min":1.119},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.748,"15min":0.71899999999999997},"min":{"1min":0.67800000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0089999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.93100000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.95099999999999996}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.78000000000000003,"15min":0.76500000000000001},"min":{"1min":0.65400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.68100000000000005,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78700000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.745}]}]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1034620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.62,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32100000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.46200000000000002},"min":{"1min":0.377,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81799999999999995,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61499999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60399999999999998,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88500000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.71199999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.42899999999999999}]},{"osd":5,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67600000000000005,"15min":0.66400000000000003},"min":{"1min":0.47299999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.111,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96899999999999997,"5min":1.05,"15min":1.05},"last":0.68400000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.93300000000000005,"5min":1.153,"15min":1.153},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71999999999999997,"15min":0.72099999999999997},"min":{"1min":0.51800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.036,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.75800000000000001,"15min":0.75600000000000001},"min":{"1min":0.59999999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93700000000000006,"5min":1.238,"15min":1.238},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.75,"15min":0.73399999999999999},"min":{"1min":0.66600000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90900000000000003,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75600000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.034,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0649999999999999,"5min":1.411,"15min":1.411},"last":0.876}]},{"osd":10,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77000000000000002,"15min":0.75600000000000001},"min":{"1min":0.58899999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.81200000000000006,"15min":0.79300000000000004},"min":{"1min":0.56699999999999995,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.77700000000000002}]},{"osd":11,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.89700000000000002}]}]},{"osd":6,"up_from":44,"seq":188978561075,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.42099999999999999,"15min":0.39700000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.40899999999999997},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.59699999999999998,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.42499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.49099999999999999}]},{"osd":2,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.505},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.6080000000000001,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.48199999999999998,"15min":0.45000000000000001},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.8359999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.51600000000000001,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.61899999999999999,"15min":0.59499999999999997},"min":{"1min":0.443,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":3.6949999999999998,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":0.77000000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64800000000000002,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.442,"15min":0.442},"max":{"1min":0.85199999999999998,"5min":1.696,"15min":1.696},"last":0.751},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71999999999999997,"15min":0.68600000000000005},"min":{"1min":0.54200000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81200000000000006,"5min":3.73,"15min":3.73},"last":0.72299999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.755,"15min":0.745},"min":{"1min":0.499,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89600000000000002,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96199999999999997,"5min":2.5489999999999999,"15min":2.5489999999999999},"last":0.73299999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76600000000000001,"15min":0.77500000000000002},"min":{"1min":0.495,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":3.8700000000000001,"5min":3.8700000000000001,"15min":3.8700000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Sat Oct 14 08:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.84399999999999997,"15min":0.86299999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.875,"5min":1.671,"15min":1.671},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.97699999999999998,"15min":1.0149999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":0.83099999999999996,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":502053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.58299999999999996,"15min":0.52300000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.59899999999999998,"15min":0.53000000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.5019999999999998,"5min":7.5019999999999998,"15min":7.5019999999999998},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64000000000000001,"15min":0.60599999999999998},"min":{"1min":0.42899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88100000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64200000000000002,"15min":0.60599999999999998},"min":{"1min":0.51700000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93100000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92300000000000004}]},{"osd":3,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.60799999999999998,"15min":0.56899999999999995},"min":{"1min":0.36399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.48799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.196,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.63300000000000001,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92200000000000004,"5min":1.397,"15min":1.397},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.69899999999999995,"15min":0.61699999999999999},"min":{"1min":0.58999999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1950000000000001,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:52:08 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.621,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.099,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.746},{"interface":"front","average":{"1min":0.872,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.47399999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.94299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:52:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.80700000000000005,"15min":0.75700000000000001},"min":{"1min":0.60499999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.76700000000000002,"15min":0.72899999999999998},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0589999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83699999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1739999999999999,"5min":1.194,"15min":1.194},"last":0.877},{"interface":"front","average":{"1min":0.877,"5min":0.78500000000000003,"15min":0.77000000000000002},"min":{"1min":0.63400000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89200000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.68899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.753,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.97999999999999998}]},{"osd":11,"last update":"Sat Oct 14 08:52:20 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.96799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 08:52:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.499,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68700000000000006,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sat Oct 14 08:52:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57199999999999995,"15min":0.53600000000000003},"min":{"1min":0.45700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77800000000000002,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59399999999999997,"15min":0.54700000000000004},"min":{"1min":0.437,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75900000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Oct 14 08:52:18 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.30399999999999999}]},{"osd":4,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73599999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.58299999999999996,"15min":0.55800000000000005},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67100000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.79900000000000004,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.75800000000000001,"5min":1.079,"15min":1.079},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79900000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.34599999999999997}]},{"osd":7,"last update":"Sat Oct 14 08:51:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.69499999999999995,"15min":0.68300000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":0.78300000000000003},"min":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.81899999999999995,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63400000000000001}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.70899999999999996,"15min":0.72399999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.86299999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.72699999999999998,"15min":0.74299999999999999},"min":{"1min":0.41199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42899999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:52:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80300000000000005,"15min":0.81599999999999995},"min":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.61899999999999999}]},{"osd":11,"last update":"Sat Oct 14 08:52:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.83699999999999997,"5min":1.159,"15min":1.159},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.879,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.65400000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":441809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.47399999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.373}]},{"osd":1,"last update":"Sat Oct 14 08:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.58799999999999997,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92900000000000005,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.58599999999999997,"15min":0.54800000000000004},"min":{"1min":0.39900000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Sat Oct 14 08:51:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71199999999999997,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Oct 14 08:52:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.79400000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48699999999999999,"15min":0.47099999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.49199999999999999,"15min":0.47599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.38500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.753,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.57399999999999995}]},{"osd":7,"last update":"Sat Oct 14 08:51:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.752}]},{"osd":8,"last update":"Sat Oct 14 08:52:35 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68300000000000005}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73999999999999999,"15min":0.74099999999999999},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.61799999999999999}]},{"osd":10,"last update":"Sat Oct 14 08:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.57999999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95499999999999996,"5min":1.008,"15min":1.008},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94399999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.77100000000000002}]},{"osd":11,"last update":"Sat Oct 14 08:52:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64800000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":441804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.39200000000000002,"15min":0.35499999999999998},"min":{"1min":0.28799999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.379},{"interface":"front","average":{"1min":0.873,"5min":0.47699999999999998,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":7.4390000000000001,"5min":7.4390000000000001,"15min":7.4390000000000001},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.54100000000000004},"min":{"1min":0.40999999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.502},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.63900000000000001,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":7.5359999999999996,"5min":7.5359999999999996,"15min":7.5359999999999996},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Oct 14 08:51:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":0.70199999999999996,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.746,"5min":11.746,"15min":11.746},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59599999999999997,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.57499999999999996}]},{"osd":4,"last update":"Sat Oct 14 08:52:05 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.69299999999999995,"15min":0.58399999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":11.82,"5min":11.82,"15min":11.82},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.626,"15min":0.58299999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.55000000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:29 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.71099999999999997,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.5720000000000001,"5min":7.5720000000000001,"15min":7.5720000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.167,"5min":0.72899999999999998,"15min":0.65500000000000003},"min":{"1min":0.39500000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":11.706,"5min":11.706,"15min":11.706},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 08:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.371,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.69599999999999995,"15min":0.61599999999999999},"min":{"1min":0.34999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":12.414,"5min":12.414,"15min":12.414},"last":0.47199999999999998}]},{"osd":7,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.73699999999999999,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":7.4969999999999999,"5min":7.4969999999999999,"15min":7.4969999999999999},"last":0.627},{"interface":"front","average":{"1min":1.1499999999999999,"5min":0.75700000000000001,"15min":0.68700000000000006},"min":{"1min":0.51000000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":11.784000000000001,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Sat Oct 14 08:50:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.627},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71799999999999997}]},{"osd":9,"last update":"Sat Oct 14 08:51:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69499999999999995,"15min":0.70399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.872,"15min":0.81200000000000006},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.164,"5min":12.164,"15min":12.164},"last":0.67300000000000004}]},{"osd":10,"last update":"Sat Oct 14 08:52:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.871,"15min":0.84799999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":7.6020000000000003,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.66200000000000003}]},{"osd":11,"last update":"Sat Oct 14 08:52:18 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.68300000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":501501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:51:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"min":{"1min":0.41999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.96399999999999997,"5min":1.012,"15min":1.012},"last":0.433},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54700000000000004,"15min":0.54000000000000004},"min":{"1min":0.40200000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41099999999999998,"15min":0.373},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":0.69799999999999995,"5min":0.754,"15min":0.754},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.32400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.55700000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.82199999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61699999999999999,"15min":0.56000000000000005},"min":{"1min":0.501,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84799999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61899999999999999}]},{"osd":3,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60199999999999998,"15min":0.57799999999999996},"min":{"1min":0.40799999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57599999999999996,"15min":0.56299999999999994},"min":{"1min":0.434,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85699999999999998,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54600000000000004}]},{"osd":5,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.66200000000000003,"15min":0.59199999999999997},"min":{"1min":0.54800000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.238,"15min":1.238},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.63800000000000001,"15min":0.59299999999999997},"min":{"1min":0.51800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sat Oct 14 08:51:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68200000000000005,"15min":0.65900000000000003},"min":{"1min":0.51800000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.71299999999999997,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.69699999999999995,"15min":0.67300000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58999999999999997}]},{"osd":8,"last update":"Sat Oct 14 08:52:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.70499999999999996,"15min":0.68000000000000005},"min":{"1min":0.58499999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.82999999999999996,"15min":0.81000000000000005},"min":{"1min":0.60399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":1.724,"15min":1.724},"last":0.85399999999999998}]},{"osd":9,"last update":"Sat Oct 14 08:51:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.91100000000000003}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.91500000000000004,"15min":0.91200000000000003},"min":{"1min":0.68999999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77200000000000002,"15min":0.76600000000000001},"min":{"1min":0.61299999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748}]},{"osd":11,"last update":"Sat Oct 14 08:52:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.78900000000000003}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1034108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50800000000000001,"15min":0.502},"min":{"1min":0.37,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72399999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.54700000000000004},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.49299999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":1.23,"15min":1.23},"last":0.59999999999999998}]},{"osd":2,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.38800000000000001},"min":{"1min":0.36599999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.441,"15min":0.435},"min":{"1min":0.33600000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.56399999999999995},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58399999999999996}]},{"osd":4,"last update":"Sat Oct 14 08:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.627,"15min":0.59699999999999998},"min":{"1min":0.58599999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91400000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.623,"15min":0.59999999999999998},"min":{"1min":0.48199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96999999999999997,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 08:51:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.60399999999999998},"min":{"1min":0.48499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.53600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.93100000000000005,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.64400000000000002},"min":{"1min":0.53900000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.72499999999999998}]},{"osd":8,"last update":"Sat Oct 14 08:52:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.59199999999999997,"15min":0.55600000000000005},"min":{"1min":0.54300000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66600000000000004}]},{"osd":9,"last update":"Sat Oct 14 08:51:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.89900000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77400000000000002}]},{"osd":10,"last update":"Sat Oct 14 08:52:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.04,"15min":1.0820000000000001},"min":{"1min":0.63900000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0129999999999999,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.97699999999999998,"15min":1.0049999999999999},"min":{"1min":0.56899999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.024,"5min":6.3559999999999999,"15min":6.3559999999999999},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T08:52:45.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 -- 172.21.15.6:0/2423312927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8100fe0 msgr2=0x7f93c8101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 --2- 172.21.15.6:0/2423312927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8100fe0 0x7f93c8101440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0099c0 tx=0x7f93bc009cd0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 -- 172.21.15.6:0/2423312927 shutdown_connections 2023-10-14T08:52:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 --2- 172.21.15.6:0/2423312927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93c8101980 0x7f93c8108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 --2- 172.21.15.6:0/2423312927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93c80ffdf0 0x7f93c8100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 --2- 172.21.15.6:0/2423312927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8100fe0 0x7f93c8101440 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 -- 172.21.15.6:0/2423312927 >> 172.21.15.6:0/2423312927 conn(0x7f93c80fb340 msgr2=0x7f93c80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 -- 172.21.15.6:0/2423312927 shutdown_connections 2023-10-14T08:52:45.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 -- 172.21.15.6:0/2423312927 wait complete. 2023-10-14T08:52:45.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 Processor -- start 2023-10-14T08:52:45.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.432+0000 7f93ce405700 1 -- start start 2023-10-14T08:52:45.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93c80ffdf0 0x7f93c8103d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93c8100fe0 0x7f93c81023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 0x7f93c8102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81030a0 con 0x7f93c8101980 2023-10-14T08:52:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8103210 con 0x7f93c80ffdf0 2023-10-14T08:52:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81a0be0 con 0x7f93c8100fe0 2023-10-14T08:52:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 0x7f93c8102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 0x7f93c8102900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32810/0 (socket says 172.21.15.6:32810) 2023-10-14T08:52:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 -- 172.21.15.6:0/1098393090 learned_addr learned my addr 172.21.15.6:0/1098393090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 -- 172.21.15.6:0/1098393090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93c8100fe0 msgr2=0x7f93c81023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93c8100fe0 0x7f93c81023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93c7fff700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93c80ffdf0 0x7f93c8103d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 -- 172.21.15.6:0/1098393090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93c80ffdf0 msgr2=0x7f93c8103d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93c80ffdf0 0x7f93c8103d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 -- 172.21.15.6:0/1098393090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0095f0 con 0x7f93c8101980 2023-10-14T08:52:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93cc9a2700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 0x7f93c8102900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f93c0007ee0 tx=0x7f93c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0017070 con 0x7f93c8101980 2023-10-14T08:52:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93c000f040 con 0x7f93c8101980 2023-10-14T08:52:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c81a0ec0 con 0x7f93c8101980 2023-10-14T08:52:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0005740 con 0x7f93c8101980 2023-10-14T08:52:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.433+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c81a12f0 con 0x7f93c8101980 2023-10-14T08:52:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.435+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c810b600 con 0x7f93c8101980 2023-10-14T08:52:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.436+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f93c00058a0 con 0x7f93c8101980 2023-10-14T08:52:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.436+0000 7f93c57fa700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93b00a1480 0x7f93b00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.436+0000 7f93c7fff700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93b00a1480 0x7f93b00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.437+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f93c00cc5e0 con 0x7f93c8101980 2023-10-14T08:52:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.437+0000 7f93c7fff700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93b00a1480 0x7f93b00a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93b8005950 tx=0x7f93b80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.441+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93c0095c40 con 0x7f93c8101980 2023-10-14T08:52:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:45 smithi057 ceph-mon[103313]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-14T08:52:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:45 smithi006 ceph-mon[99452]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-14T08:52:45.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:45 smithi178 ceph-mon[103612]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2023-10-14T08:52:45.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.645+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93c81a15d0 con 0x7f93c8101980 2023-10-14T08:52:45.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.647+0000 7f93c57fa700 1 -- 172.21.15.6:0/1098393090 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f93c0099260 con 0x7f93c8101980 2023-10-14T08:52:45.649 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:45.649 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93b00a1480 msgr2=0x7f93b00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93b00a1480 0x7f93b00a3940 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f93b8005950 tx=0x7f93b80058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 msgr2=0x7f93c8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 0x7f93c8102900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f93c0007ee0 tx=0x7f93c000d3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 shutdown_connections 2023-10-14T08:52:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c8101980 0x7f93c8102900 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93b00a1480 0x7f93b00a3940 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93c80ffdf0 0x7f93c8103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 --2- 172.21.15.6:0/1098393090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93c8100fe0 0x7f93c81023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.649+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 >> 172.21.15.6:0/1098393090 conn(0x7f93c80fb340 msgr2=0x7f93c8069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.650+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 shutdown_connections 2023-10-14T08:52:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.650+0000 7f93ce405700 1 -- 172.21.15.6:0/1098393090 wait complete. 2023-10-14T08:52:45.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T08:52:45.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T08:52:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.790+0000 7f8719aeb700 1 -- 172.21.15.6:0/3040496084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 msgr2=0x7f87141082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.790+0000 7f8719aeb700 1 --2- 172.21.15.6:0/3040496084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f87141082d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f870c00b0a0 tx=0x7f870c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 -- 172.21.15.6:0/3040496084 shutdown_connections 2023-10-14T08:52:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 --2- 172.21.15.6:0/3040496084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f87141082d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 --2- 172.21.15.6:0/3040496084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87140ffea0 0x7f87141002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 --2- 172.21.15.6:0/3040496084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8714100ff0 0x7f8714101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 -- 172.21.15.6:0/3040496084 >> 172.21.15.6:0/3040496084 conn(0x7f87140fb430 msgr2=0x7f87140fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 -- 172.21.15.6:0/3040496084 shutdown_connections 2023-10-14T08:52:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 -- 172.21.15.6:0/3040496084 wait complete. 2023-10-14T08:52:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 Processor -- start 2023-10-14T08:52:45.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 -- start start 2023-10-14T08:52:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87140ffea0 0x7f8714068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.791+0000 7f8719aeb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8714100ff0 0x7f871419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8719aeb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f871419e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8719aeb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871419e8e0 con 0x7f87141019b0 2023-10-14T08:52:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8719aeb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871419ea50 con 0x7f8714100ff0 2023-10-14T08:52:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8719aeb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871419ec10 con 0x7f87140ffea0 2023-10-14T08:52:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f871419e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f871419e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32824/0 (socket says 172.21.15.6:32824) 2023-10-14T08:52:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 -- 172.21.15.6:0/1347553699 learned_addr learned my addr 172.21.15.6:0/1347553699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f87137fe700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87140ffea0 0x7f8714068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8712ffd700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8714100ff0 0x7f871419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 -- 172.21.15.6:0/1347553699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87140ffea0 msgr2=0x7f8714068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87140ffea0 0x7f8714068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 -- 172.21.15.6:0/1347553699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8714100ff0 msgr2=0x7f871419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8714100ff0 0x7f871419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 -- 172.21.15.6:0/1347553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c009d00 con 0x7f87141019b0 2023-10-14T08:52:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8713fff700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f871419e110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f870c00d010 tx=0x7f870c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c00e040 con 0x7f87141019b0 2023-10-14T08:52:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f870c009440 con 0x7f87141019b0 2023-10-14T08:52:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871419ee90 con 0x7f87141019b0 2023-10-14T08:52:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c004280 con 0x7f87141019b0 2023-10-14T08:52:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.792+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871419f2b0 con 0x7f87141019b0 2023-10-14T08:52:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.793+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8714106d70 con 0x7f87141019b0 2023-10-14T08:52:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.795+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f870c01d720 con 0x7f87141019b0 2023-10-14T08:52:45.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.796+0000 7f8710ff9700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86fc0a1500 0x7f86fc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.796+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f870c01de40 con 0x7f87141019b0 2023-10-14T08:52:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.796+0000 7f87137fe700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86fc0a1500 0x7f86fc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.796+0000 7f87137fe700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86fc0a1500 0x7f86fc0a39c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8704005950 tx=0x7f87040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:45.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.799+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f870c098570 con 0x7f87141019b0 2023-10-14T08:52:46.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:45.999+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f871402cf70 con 0x7f87141019b0 2023-10-14T08:52:46.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.000+0000 7f8710ff9700 1 -- 172.21.15.6:0/1347553699 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f870c021020 con 0x7f87141019b0 2023-10-14T08:52:46.002 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T08:52:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86fc0a1500 msgr2=0x7f86fc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86fc0a1500 0x7f86fc0a39c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8704005950 tx=0x7f87040058e0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 msgr2=0x7f871419e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f871419e110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f870c00d010 tx=0x7f870c004d30 comp rx=0 tx=0).stop 2023-10-14T08:52:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 shutdown_connections 2023-10-14T08:52:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87141019b0 0x7f871419e110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87140ffea0 0x7f8714068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f86fc0a1500 0x7f86fc0a39c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 --2- 172.21.15.6:0/1347553699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8714100ff0 0x7f871419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 >> 172.21.15.6:0/1347553699 conn(0x7f87140fb430 msgr2=0x7f87140fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 shutdown_connections 2023-10-14T08:52:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.002+0000 7f8719aeb700 1 -- 172.21.15.6:0/1347553699 wait complete. 2023-10-14T08:52:46.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T08:52:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/298090480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4100ab0 msgr2=0x7f2cb4108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/298090480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4100ab0 0x7f2cb4108350 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00b0a0 tx=0x7f2cac00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/298090480 shutdown_connections 2023-10-14T08:52:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/298090480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4100ab0 0x7f2cb4108350 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/298090480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb4101530 0x7f2cb4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/298090480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb41000f0 0x7f2cb4100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/298090480 >> 172.21.15.6:0/298090480 conn(0x7f2cb40fab80 msgr2=0x7f2cb40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:46.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.144+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/298090480 shutdown_connections 2023-10-14T08:52:46.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/298090480 wait complete. 2023-10-14T08:52:46.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 Processor -- start 2023-10-14T08:52:46.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 -- start start 2023-10-14T08:52:46.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb41000f0 0x7f2cb40ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4100ab0 0x7f2cb419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 0x7f2cb419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb419e8b0 con 0x7f2cb4101530 2023-10-14T08:52:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb419ea20 con 0x7f2cb41000f0 2023-10-14T08:52:46.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.145+0000 7f2cb8d6f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb419ebe0 con 0x7f2cb4100ab0 2023-10-14T08:52:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 0x7f2cb419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb41000f0 0x7f2cb40ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb41000f0 0x7f2cb40ffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:59824/0 (socket says 172.21.15.6:59824) 2023-10-14T08:52:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 0x7f2cb419e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32838/0 (socket says 172.21.15.6:32838) 2023-10-14T08:52:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb259c700 1 -- 172.21.15.6:0/3591583656 learned_addr learned my addr 172.21.15.6:0/3591583656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb1d9b700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4100ab0 0x7f2cb419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 -- 172.21.15.6:0/3591583656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4100ab0 msgr2=0x7f2cb419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4100ab0 0x7f2cb419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 -- 172.21.15.6:0/3591583656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb41000f0 msgr2=0x7f2cb40ffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb41000f0 0x7f2cb40ffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 -- 172.21.15.6:0/3591583656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009d00 con 0x7f2cb4101530 2023-10-14T08:52:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb1d9b700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4100ab0 0x7f2cb419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 0x7f2cb419e0e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009fd0 tx=0x7f2cac004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00e040 con 0x7f2cb4101530 2023-10-14T08:52:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cac005710 con 0x7f2cb4101530 2023-10-14T08:52:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb419ee60 con 0x7f2cb4101530 2023-10-14T08:52:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac01db10 con 0x7f2cb4101530 2023-10-14T08:52:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.146+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb419f280 con 0x7f2cb4101530 2023-10-14T08:52:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.147+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb4106da0 con 0x7f2cb4101530 2023-10-14T08:52:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.148+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2cac005880 con 0x7f2cb4101530 2023-10-14T08:52:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.149+0000 7f2cab7fe700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2ca00a1500 0x7f2ca00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.149+0000 7f2cb259c700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2ca00a1500 0x7f2ca00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.149+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2cac0ce6a0 con 0x7f2cb4101530 2023-10-14T08:52:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.150+0000 7f2cb259c700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2ca00a1500 0x7f2ca00a39c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4007c90 tx=0x7f2ca4007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.153+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2cac097d90 con 0x7f2cb4101530 2023-10-14T08:52:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.358+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cb402cf70 con 0x7f2cb4101530 2023-10-14T08:52:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.358+0000 7f2cab7fe700 1 -- 172.21.15.6:0/3591583656 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cac09b3b0 con 0x7f2cb4101530 2023-10-14T08:52:46.360 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T08:52:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2ca00a1500 msgr2=0x7f2ca00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2ca00a1500 0x7f2ca00a39c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4007c90 tx=0x7f2ca4007480 comp rx=0 tx=0).stop 2023-10-14T08:52:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 msgr2=0x7f2cb419e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 0x7f2cb419e0e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009fd0 tx=0x7f2cac004c80 comp rx=0 tx=0).stop 2023-10-14T08:52:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 shutdown_connections 2023-10-14T08:52:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb4101530 0x7f2cb419e0e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2ca00a1500 0x7f2ca00a39c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cb41000f0 0x7f2cb40ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 --2- 172.21.15.6:0/3591583656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cb4100ab0 0x7f2cb419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 >> 172.21.15.6:0/3591583656 conn(0x7f2cb40fab80 msgr2=0x7f2cb40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.360+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 shutdown_connections 2023-10-14T08:52:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.361+0000 7f2cb8d6f700 1 -- 172.21.15.6:0/3591583656 wait complete. 2023-10-14T08:52:46.373 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:46 smithi006 ceph-mon[99452]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.373 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:46 smithi006 ceph-mon[99452]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.373 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:46 smithi006 ceph-mon[99452]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.373 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1098393090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:46.374 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1347553699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:46.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T08:52:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:46 smithi057 ceph-mon[103313]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:46 smithi057 ceph-mon[103313]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:46 smithi057 ceph-mon[103313]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1098393090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1347553699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:46.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 -- 172.21.15.6:0/1018453200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 msgr2=0x7f0c68100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/1018453200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68100570 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009990 tx=0x7f0c50009ca0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 -- 172.21.15.6:0/1018453200 shutdown_connections 2023-10-14T08:52:46.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/1018453200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c68100ab0 0x7f0c68108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/1018453200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c68101530 0x7f0c68101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/1018453200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68100570 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 -- 172.21.15.6:0/1018453200 >> 172.21.15.6:0/1018453200 conn(0x7f0c680fab80 msgr2=0x7f0c680fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:46.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 -- 172.21.15.6:0/1018453200 shutdown_connections 2023-10-14T08:52:46.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.503+0000 7f0c6e36e700 1 -- 172.21.15.6:0/1018453200 wait complete. 2023-10-14T08:52:46.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 Processor -- start 2023-10-14T08:52:46.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 -- start start 2023-10-14T08:52:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c68100ab0 0x7f0c68197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c68101530 0x7f0c6819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6819e780 con 0x7f0c681000f0 2023-10-14T08:52:46.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6819e8f0 con 0x7f0c68101530 2023-10-14T08:52:46.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6e36e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6819eab0 con 0x7f0c68100ab0 2023-10-14T08:52:46.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c67fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32848/0 (socket says 172.21.15.6:32848) 2023-10-14T08:52:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c67fff700 1 -- 172.21.15.6:0/3438078461 learned_addr learned my addr 172.21.15.6:0/3438078461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c677fe700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c68100ab0 0x7f0c68197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.504+0000 7f0c6c90b700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c68101530 0x7f0c6819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c67fff700 1 -- 172.21.15.6:0/3438078461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c68100ab0 msgr2=0x7f0c68197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c67fff700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c68100ab0 0x7f0c68197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c67fff700 1 -- 172.21.15.6:0/3438078461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c68101530 msgr2=0x7f0c6819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c67fff700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c68101530 0x7f0c6819e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c67fff700 1 -- 172.21.15.6:0/3438078461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500095f0 con 0x7f0c681000f0 2023-10-14T08:52:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c67fff700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68196c40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800d950 tx=0x7f0c5800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58009940 con 0x7f0c681000f0 2023-10-14T08:52:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c58010460 con 0x7f0c681000f0 2023-10-14T08:52:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6819ed90 con 0x7f0c681000f0 2023-10-14T08:52:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800f620 con 0x7f0c681000f0 2023-10-14T08:52:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.505+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6819f1e0 con 0x7f0c681000f0 2023-10-14T08:52:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.506+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c68107fc0 con 0x7f0c681000f0 2023-10-14T08:52:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.507+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0c580108d0 con 0x7f0c681000f0 2023-10-14T08:52:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.508+0000 7f0c657fa700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c540a1480 0x7f0c540a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.508+0000 7f0c677fe700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c540a1480 0x7f0c540a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.508+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0c580ccb10 con 0x7f0c681000f0 2023-10-14T08:52:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.509+0000 7f0c677fe700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c540a1480 0x7f0c540a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000b2e0 tx=0x7f0c50005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.512+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0c58096170 con 0x7f0c681000f0 2023-10-14T08:52:46.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:46 smithi178 ceph-mon[103612]: from='client.15375 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:46 smithi178 ceph-mon[103612]: from='client.15381 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:46 smithi178 ceph-mon[103612]: from='client.15387 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-14T08:52:46.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1098393090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:46.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1347553699' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T08:52:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.715+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c6810b790 con 0x7f0c681000f0 2023-10-14T08:52:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.716+0000 7f0c657fa700 1 -- 172.21.15.6:0/3438078461 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c58020020 con 0x7f0c681000f0 2023-10-14T08:52:46.718 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T08:52:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c540a1480 msgr2=0x7f0c540a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c540a1480 0x7f0c540a3940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000b2e0 tx=0x7f0c50005fb0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 msgr2=0x7f0c68196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68196c40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800d950 tx=0x7f0c5800dc60 comp rx=0 tx=0).stop 2023-10-14T08:52:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 shutdown_connections 2023-10-14T08:52:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0c540a1480 0x7f0c540a3940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c68101530 0x7f0c6819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c681000f0 0x7f0c68196c40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 --2- 172.21.15.6:0/3438078461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c68100ab0 0x7f0c68197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 >> 172.21.15.6:0/3438078461 conn(0x7f0c680fab80 msgr2=0x7f0c680fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 shutdown_connections 2023-10-14T08:52:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.718+0000 7f0c6e36e700 1 -- 172.21.15.6:0/3438078461 wait complete. 2023-10-14T08:52:46.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:52:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/3803765093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 msgr2=0x7f6eec109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/3803765093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec109030 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400b0a0 tx=0x7f6ee400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/3803765093 shutdown_connections 2023-10-14T08:52:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/3803765093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec109030 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/3803765093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eec101960 0x7f6eec103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/3803765093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eec104290 0x7f6eec106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/3803765093 >> 172.21.15.6:0/3803765093 conn(0x7f6eec0fb310 msgr2=0x7f6eec0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:46.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/3803765093 shutdown_connections 2023-10-14T08:52:46.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.856+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/3803765093 wait complete. 2023-10-14T08:52:46.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 Processor -- start 2023-10-14T08:52:46.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 -- start start 2023-10-14T08:52:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eec101960 0x7f6eec196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eec104290 0x7f6eec197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec19e850 con 0x7f6eec106bc0 2023-10-14T08:52:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec19e9c0 con 0x7f6eec101960 2023-10-14T08:52:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ef0b4d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec19eb80 con 0x7f6eec104290 2023-10-14T08:52:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec19e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32866/0 (socket says 172.21.15.6:32866) 2023-10-14T08:52:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 -- 172.21.15.6:0/1300608345 learned_addr learned my addr 172.21.15.6:0/1300608345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6ee9d9b700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eec104290 0x7f6eec197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eea59c700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eec101960 0x7f6eec196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 -- 172.21.15.6:0/1300608345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eec104290 msgr2=0x7f6eec197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eec104290 0x7f6eec197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 -- 172.21.15.6:0/1300608345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eec101960 msgr2=0x7f6eec196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eec101960 0x7f6eec196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.857+0000 7f6eead9d700 1 -- 172.21.15.6:0/1300608345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee4009d00 con 0x7f6eec106bc0 2023-10-14T08:52:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.858+0000 7f6eead9d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec19e280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009fd0 tx=0x7f6ee400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.858+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400e040 con 0x7f6eec106bc0 2023-10-14T08:52:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.858+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec19ee00 con 0x7f6eec106bc0 2023-10-14T08:52:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.858+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ee4003e10 con 0x7f6eec106bc0 2023-10-14T08:52:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.858+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee401b6a0 con 0x7f6eec106bc0 2023-10-14T08:52:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.858+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec19f1d0 con 0x7f6eec106bc0 2023-10-14T08:52:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.859+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec0fce90 con 0x7f6eec106bc0 2023-10-14T08:52:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.860+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6ee401b800 con 0x7f6eec106bc0 2023-10-14T08:52:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.860+0000 7f6ee37fe700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6ed80a1480 0x7f6ed80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.861+0000 7f6eea59c700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6ed80a1480 0x7f6ed80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.861+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6ee40ce4e0 con 0x7f6eec106bc0 2023-10-14T08:52:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.861+0000 7f6eea59c700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6ed80a1480 0x7f6ed80a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6eec1981e0 tx=0x7f6edc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:46.864+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6ee4097bd0 con 0x7f6eec106bc0 2023-10-14T08:52:47.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.110+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eec0008d0 con 0x7f6eec106bc0 2023-10-14T08:52:47.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.111+0000 7f6ee37fe700 1 -- 172.21.15.6:0/1300608345 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7f6ee409b1f0 con 0x7f6eec106bc0 2023-10-14T08:52:47.113 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:47.114 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:52:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6ed80a1480 msgr2=0x7f6ed80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6ed80a1480 0x7f6ed80a3940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6eec1981e0 tx=0x7f6edc00b410 comp rx=0 tx=0).stop 2023-10-14T08:52:47.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 msgr2=0x7f6eec19e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec19e280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009fd0 tx=0x7f6ee400bce0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 shutdown_connections 2023-10-14T08:52:47.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eec106bc0 0x7f6eec19e280 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6ed80a1480 0x7f6ed80a3940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6eec101960 0x7f6eec196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 --2- 172.21.15.6:0/1300608345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eec104290 0x7f6eec197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 >> 172.21.15.6:0/1300608345 conn(0x7f6eec0fb310 msgr2=0x7f6eec1025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 shutdown_connections 2023-10-14T08:52:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.113+0000 7f6ef0b4d700 1 -- 172.21.15.6:0/1300608345 wait complete. 2023-10-14T08:52:47.119 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:52:47.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T08:52:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.254+0000 7facd30c0700 1 -- 172.21.15.6:0/3265018956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc106c40 msgr2=0x7faccc109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.254+0000 7facd30c0700 1 --2- 172.21.15.6:0/3265018956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc106c40 0x7faccc109030 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7facc400b0a0 tx=0x7facc400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 -- 172.21.15.6:0/3265018956 shutdown_connections 2023-10-14T08:52:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 --2- 172.21.15.6:0/3265018956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc106c40 0x7faccc109030 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 --2- 172.21.15.6:0/3265018956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc1019e0 0x7faccc103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 --2- 172.21.15.6:0/3265018956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 0x7faccc106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 -- 172.21.15.6:0/3265018956 >> 172.21.15.6:0/3265018956 conn(0x7faccc0fb310 msgr2=0x7faccc0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 -- 172.21.15.6:0/3265018956 shutdown_connections 2023-10-14T08:52:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 -- 172.21.15.6:0/3265018956 wait complete. 2023-10-14T08:52:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 Processor -- start 2023-10-14T08:52:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.255+0000 7facd30c0700 1 -- start start 2023-10-14T08:52:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 0x7faccc196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 0x7faccc1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc106c40 0x7faccc19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc19e810 con 0x7faccc1019e0 2023-10-14T08:52:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc19e980 con 0x7faccc106c40 2023-10-14T08:52:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc19eb40 con 0x7faccc104310 2023-10-14T08:52:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 0x7faccc196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 0x7faccc196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32876/0 (socket says 172.21.15.6:32876) 2023-10-14T08:52:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 -- 172.21.15.6:0/2430062137 learned_addr learned my addr 172.21.15.6:0/2430062137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd165d700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc106c40 0x7faccc19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7faccbfff700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 0x7faccc1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 -- 172.21.15.6:0/2430062137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 msgr2=0x7faccc1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 0x7faccc1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 -- 172.21.15.6:0/2430062137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc106c40 msgr2=0x7faccc19e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc106c40 0x7faccc19e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 -- 172.21.15.6:0/2430062137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4009d00 con 0x7faccc1019e0 2023-10-14T08:52:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7faccbfff700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 0x7faccc1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd165d700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc106c40 0x7faccc19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd0e5c700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 0x7faccc196ca0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7facc000d950 tx=0x7facc000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0009b40 con 0x7faccc1019e0 2023-10-14T08:52:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facc0009ca0 con 0x7faccc1019e0 2023-10-14T08:52:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc19ee20 con 0x7faccc1019e0 2023-10-14T08:52:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.256+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc000f620 con 0x7faccc1019e0 2023-10-14T08:52:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.257+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc19f240 con 0x7faccc1019e0 2023-10-14T08:52:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.258+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc0fce90 con 0x7faccc1019e0 2023-10-14T08:52:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.259+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7facc0010460 con 0x7faccc1019e0 2023-10-14T08:52:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.259+0000 7facc9ffb700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7facbc0a1480 0x7facbc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.260+0000 7faccbfff700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7facbc0a1480 0x7facbc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.260+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7facc00cd0d0 con 0x7faccc1019e0 2023-10-14T08:52:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.260+0000 7faccbfff700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7facbc0a1480 0x7facbc0a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faccc1981a0 tx=0x7facb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.264+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7facc00966f0 con 0x7faccc1019e0 2023-10-14T08:52:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.466+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faccc10c6c0 con 0x7faccc1019e0 2023-10-14T08:52:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.467+0000 7facc9ffb700 1 -- 172.21.15.6:0/2430062137 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7facc0099d10 con 0x7faccc1019e0 2023-10-14T08:52:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:47.470 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T08:52:47.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7facbc0a1480 msgr2=0x7facbc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7facbc0a1480 0x7facbc0a3940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faccc1981a0 tx=0x7facb8009260 comp rx=0 tx=0).stop 2023-10-14T08:52:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 msgr2=0x7faccc196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 0x7faccc196ca0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7facc000d950 tx=0x7facc000dd10 comp rx=0 tx=0).stop 2023-10-14T08:52:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 shutdown_connections 2023-10-14T08:52:47.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7facbc0a1480 0x7facbc0a3940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faccc106c40 0x7faccc19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faccc1019e0 0x7faccc196ca0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 --2- 172.21.15.6:0/2430062137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc104310 0x7faccc1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 >> 172.21.15.6:0/2430062137 conn(0x7faccc0fb310 msgr2=0x7faccc102670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 shutdown_connections 2023-10-14T08:52:47.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.470+0000 7facd30c0700 1 -- 172.21.15.6:0/2430062137 wait complete. 2023-10-14T08:52:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:47 smithi006 ceph-mon[99452]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 10 op/s 2023-10-14T08:52:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3591583656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3438078461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:47.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1300608345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:47.484 DEBUG:tasks.fwd_scrub:Yielding 2023-10-14T08:52:47.485 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-14T08:52:47.533 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T08:52:47.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-14T08:52:47.534 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-14T08:52:47.535 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-14T08:52:47.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-14T08:52:47.537 INFO:teuthology.run_tasks:Running task exec... 2023-10-14T08:52:47.547 INFO:teuthology.task.exec:Executing custom commands... 2023-10-14T08:52:47.548 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T08:52:47.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-10-14T08:52:47.591 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:47.630 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem Size Used Avail Use% Mounted on 2023-10-14T08:52:47.630 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:3300,172.21.15.57:3300,172.21.15.178:3300:/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e 340G 0 340G 0% /tmp/cephfs 2023-10-14T08:52:47.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-10-14T08:52:47.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:47 smithi178 ceph-mon[103612]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 10 op/s 2023-10-14T08:52:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3591583656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3438078461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1300608345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:47.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 -- 172.21.15.6:0/1133634517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa298100990 msgr2=0x7fa298101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 --2- 172.21.15.6:0/1133634517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa298100990 0x7fa298101210 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa29000b0a0 tx=0x7fa29000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 -- 172.21.15.6:0/1133634517 shutdown_connections 2023-10-14T08:52:47.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 --2- 172.21.15.6:0/1133634517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa298100990 0x7fa298101210 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 --2- 172.21.15.6:0/1133634517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2980ff270 0x7fa2980ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 --2- 172.21.15.6:0/1133634517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2980fffd0 0x7fa298100450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 -- 172.21.15.6:0/1133634517 >> 172.21.15.6:0/1133634517 conn(0x7fa2980fab80 msgr2=0x7fa2980fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 -- 172.21.15.6:0/1133634517 shutdown_connections 2023-10-14T08:52:47.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.679+0000 7fa29d28e700 1 -- 172.21.15.6:0/1133634517 wait complete. 2023-10-14T08:52:47.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 Processor -- start 2023-10-14T08:52:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 -- start start 2023-10-14T08:52:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2980ff270 0x7fa298198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 0x7fa298199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa298100990 0x7fa2981a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2981a0ac0 con 0x7fa2980fffd0 2023-10-14T08:52:47.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2981a0c00 con 0x7fa298100990 2023-10-14T08:52:47.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa29d28e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2981a0d90 con 0x7fa2980ff270 2023-10-14T08:52:47.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa2967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 0x7fa298199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa2967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 0x7fa298199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32894/0 (socket says 172.21.15.6:32894) 2023-10-14T08:52:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa2967fc700 1 -- 172.21.15.6:0/3631758344 learned_addr learned my addr 172.21.15.6:0/3631758344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa298100990 0x7fa2981a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.680+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2980ff270 0x7fa298198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa2967fc700 1 -- 172.21.15.6:0/3631758344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2980ff270 msgr2=0x7fa298198f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2980ff270 0x7fa298198f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa2967fc700 1 -- 172.21.15.6:0/3631758344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa298100990 msgr2=0x7fa2981a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa298100990 0x7fa2981a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa2967fc700 1 -- 172.21.15.6:0/3631758344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009d00 con 0x7fa2980fffd0 2023-10-14T08:52:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 0x7fa298199480 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d950 tx=0x7fa28c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa27ffff700 1 -- 172.21.15.6:0/3631758344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00f890 con 0x7fa2980fffd0 2023-10-14T08:52:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2981a1070 con 0x7fa2980fffd0 2023-10-14T08:52:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa27ffff700 1 -- 172.21.15.6:0/3631758344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa28c010460 con 0x7fa2980fffd0 2023-10-14T08:52:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa27ffff700 1 -- 172.21.15.6:0/3631758344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00e610 con 0x7fa2980fffd0 2023-10-14T08:52:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.681+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2981a1580 con 0x7fa2980fffd0 2023-10-14T08:52:47.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.683+0000 7fa27ffff700 1 -- 172.21.15.6:0/3631758344 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa28c0108d0 con 0x7fa2980fffd0 2023-10-14T08:52:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.684+0000 7fa27ffff700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa2800a1480 0x7fa2800a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.684+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa2800a1480 0x7fa2800a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.684+0000 7fa27ffff700 1 -- 172.21.15.6:0/3631758344 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa28c0cca90 con 0x7fa2980fffd0 2023-10-14T08:52:47.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.685+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa2800a1480 0x7fa2800a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa288005950 tx=0x7fa28800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.685+0000 7fa2a9478b80 1 Processor -- start 2023-10-14T08:52:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.685+0000 7fa2a9478b80 1 -- start start 2023-10-14T08:52:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.685+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f861cf0 con 0x56149f8ee6a0 2023-10-14T08:52:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f846ce0 con 0x56149f8ecea0 2023-10-14T08:52:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f844600 con 0x56149f8ed800 2023-10-14T08:52:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8eeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32904/0 (socket says 172.21.15.6:32904) 2023-10-14T08:52:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 -- 172.21.15.6:0/3261049513 learned_addr learned my addr 172.21.15.6:0/3261049513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 -- 172.21.15.6:0/3261049513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 msgr2=0x56149f8ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 -- 172.21.15.6:0/3261049513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 msgr2=0x56149f8ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 -- 172.21.15.6:0/3261049513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149f7fd470 con 0x56149f8ee6a0 2023-10-14T08:52:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:47.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8eeb20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa290007610 tx=0x7fa290007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f31ef70d21ab4a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa27d7fa700 1 -- 172.21.15.6:0/3261049513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000e040 con 0x56149f8ee6a0 2023-10-14T08:52:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa27d7fa700 1 -- 172.21.15.6:0/3261049513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa290009b80 con 0x56149f8ee6a0 2023-10-14T08:52:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.686+0000 7fa27d7fa700 1 -- 172.21.15.6:0/3261049513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29001cab0 con 0x56149f8ee6a0 2023-10-14T08:52:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3261049513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 msgr2=0x56149f8eeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8eeb20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa290007610 tx=0x7fa290007640 comp rx=0 tx=0).stop 2023-10-14T08:52:47.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3261049513 shutdown_connections 2023-10-14T08:52:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8eeb20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3261049513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3261049513 >> 172.21.15.6:0/3261049513 conn(0x56149f81ae50 msgr2=0x56149f8e8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3261049513 shutdown_connections 2023-10-14T08:52:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.687+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3261049513 wait complete. 2023-10-14T08:52:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 -- start start 2023-10-14T08:52:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 Processor -- start 2023-10-14T08:52:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ecea0 0x56149f8f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ed800 0x56149f8f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8fe210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f83fef0 con 0x56149f8ee6a0 2023-10-14T08:52:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f7dc790 con 0x56149f8ed800 2023-10-14T08:52:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f7dc430 con 0x56149f8ecea0 2023-10-14T08:52:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2a9478b80 10 client.0 _ll_register_callbacks cb 0x56149f639880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8fe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa296ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ecea0 0x56149f8f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8fe210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32910/0 (socket says 172.21.15.6:32910) 2023-10-14T08:52:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 -- 172.21.15.6:0/3645364725 learned_addr learned my addr 172.21.15.6:0/3645364725 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ed800 0x56149f8f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 -- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ecea0 msgr2=0x56149f8f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ecea0 0x56149f8f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 -- 172.21.15.6:0/3645364725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ed800 msgr2=0x56149f8f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ed800 0x56149f8f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.688+0000 7fa2977fe700 1 -- 172.21.15.6:0/3645364725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa298101c40 con 0x56149f8ee6a0 2023-10-14T08:52:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ed800 0x56149f8f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8fe210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa290009a20 tx=0x7fa290003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b14c467f4825b7e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa27aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa27aff5700 1 -- 172.21.15.6:0/3645364725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000e040 con 0x56149f8ee6a0 2023-10-14T08:52:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa27aff5700 1 -- 172.21.15.6:0/3645364725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa29001cbc0 con 0x56149f8ee6a0 2023-10-14T08:52:47.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56149f8bcc90 con 0x56149f8ee6a0 2023-10-14T08:52:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa27aff5700 1 -- 172.21.15.6:0/3645364725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa290009b80 con 0x56149f8ee6a0 2023-10-14T08:52:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 10 client.15435 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56149f66ae60 con 0x56149f8ee6a0 2023-10-14T08:52:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa27aff5700 1 -- 172.21.15.6:0/3645364725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa290038020 con 0x56149f8ee6a0 2023-10-14T08:52:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa27aff5700 1 -- 172.21.15.6:0/3645364725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa290019070 con 0x56149f8ee6a0 2023-10-14T08:52:47.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:47.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:52:47.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 20 client.15435 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:47.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f902790 0x56149f904bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.689+0000 7fa2a9478b80 4 client.15435 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:47.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.690+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56149f838ed0 con 0x56149f902790 2023-10-14T08:52:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.690+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f902790 0x56149f904bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.690+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f902790 0x56149f904bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b462706684151a9 server_cookie=6049c3ac14753ebb in_seq=0 out_seq=0 2023-10-14T08:52:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.690+0000 7fa27aff5700 10 client.15435 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa27aff5700 1 -- 172.21.15.6:0/3645364725 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56149f838ed0 con 0x56149f902790 2023-10-14T08:52:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa27aff5700 10 client.15435 handle_command_reply: tid=0 2023-10-14T08:52:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 client.15435 shutdown 2023-10-14T08:52:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 msgr2=0x56149f8fe210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8fe210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa290009a20 tx=0x7fa290003c10 comp rx=0 tx=0).stop 2023-10-14T08:52:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 shutdown_connections 2023-10-14T08:52:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f902790 0x56149f904bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8fe210 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ecea0 0x56149f8f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa27aff5700 0 client.15435 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3645364725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ed800 0x56149f8f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 >> 172.21.15.6:0/3645364725 conn(0x56149f81ae50 msgr2=0x56149f8e7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 shutdown_connections 2023-10-14T08:52:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3645364725 wait complete. 2023-10-14T08:52:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.691+0000 7fa2a9478b80 20 client.15435 trim_cache size 0 max 16384 2023-10-14T08:52:47.712 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:47 smithi057 ceph-mon[103313]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 10 op/s 2023-10-14T08:52:47.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3591583656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T08:52:47.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3438078461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T08:52:47.713 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1300608345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:52:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.709+0000 7fa2a9478b80 1 Processor -- start 2023-10-14T08:52:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 -- start start 2023-10-14T08:52:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f8f6860 con 0x56149f8ee6a0 2023-10-14T08:52:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f6c09a0 con 0x56149f8ecea0 2023-10-14T08:52:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f8edca0 con 0x56149f8ed800 2023-10-14T08:52:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8e7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32918/0 (socket says 172.21.15.6:32918) 2023-10-14T08:52:47.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 -- 172.21.15.6:0/2759984073 learned_addr learned my addr 172.21.15.6:0/2759984073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa296ffd700 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2967fc700 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 -- 172.21.15.6:0/2759984073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 msgr2=0x56149f8fe1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fe1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 -- 172.21.15.6:0/2759984073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 msgr2=0x56149f8e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 -- 172.21.15.6:0/2759984073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56149f653ce0 con 0x56149f8ee6a0 2023-10-14T08:52:47.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.710+0000 7fa2977fe700 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8e7800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa290005a30 tx=0x7fa29001c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25db6cdcba22f75e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa27dffb700 1 -- 172.21.15.6:0/2759984073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29000e070 con 0x56149f8ee6a0 2023-10-14T08:52:47.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa27dffb700 1 -- 172.21.15.6:0/2759984073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa290038070 con 0x56149f8ee6a0 2023-10-14T08:52:47.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa27dffb700 1 -- 172.21.15.6:0/2759984073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900057f0 con 0x56149f8ee6a0 2023-10-14T08:52:47.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 -- 172.21.15.6:0/2759984073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 msgr2=0x56149f8e7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8e7800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa290005a30 tx=0x7fa29001c680 comp rx=0 tx=0).stop 2023-10-14T08:52:47.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 -- 172.21.15.6:0/2759984073 shutdown_connections 2023-10-14T08:52:47.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ee6a0 0x56149f8e7800 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ecea0 0x56149f8e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/2759984073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 -- 172.21.15.6:0/2759984073 >> 172.21.15.6:0/2759984073 conn(0x56149f81ae50 msgr2=0x56149f8f6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 -- 172.21.15.6:0/2759984073 shutdown_connections 2023-10-14T08:52:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.711+0000 7fa2a9478b80 1 -- 172.21.15.6:0/2759984073 wait complete. 2023-10-14T08:52:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 -- start start 2023-10-14T08:52:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 Processor -- start 2023-10-14T08:52:47.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 0x56149f8fb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ee6a0 0x56149f8fca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f8fcfa0 con 0x56149f8ecea0 2023-10-14T08:52:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f8fd110 con 0x56149f8ee6a0 2023-10-14T08:52:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56149f8fd2d0 con 0x56149f8ed800 2023-10-14T08:52:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2a9478b80 10 client.0 _ll_register_callbacks cb 0x7fa2900074e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 0x56149f8fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 0x56149f8fb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32920/0 (socket says 172.21.15.6:32920) 2023-10-14T08:52:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 -- 172.21.15.6:0/3002708871 learned_addr learned my addr 172.21.15.6:0/3002708871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ee6a0 0x56149f8fca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 -- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 msgr2=0x56149f8fba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 -- 172.21.15.6:0/3002708871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ee6a0 msgr2=0x56149f8fca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ee6a0 0x56149f8fca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa296ffd700 1 -- 172.21.15.6:0/3002708871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56149f66ae60 con 0x56149f8ecea0 2023-10-14T08:52:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.712+0000 7fa2977fe700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ee6a0 0x56149f8fca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa296ffd700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 0x56149f8fb510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x56149f905450 tx=0x7fa2880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5be50342c11786a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa27aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa27aff5700 1 -- 172.21.15.6:0/3002708871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288021040 con 0x56149f8ecea0 2023-10-14T08:52:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa27aff5700 1 -- 172.21.15.6:0/3002708871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa288004a30 con 0x56149f8ecea0 2023-10-14T08:52:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56149f844f70 con 0x56149f8ecea0 2023-10-14T08:52:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa27aff5700 1 -- 172.21.15.6:0/3002708871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa288025730 con 0x56149f8ecea0 2023-10-14T08:52:47.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 10 client.15441 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56149f6912d0 con 0x56149f8ecea0 2023-10-14T08:52:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa27aff5700 1 -- 172.21.15.6:0/3002708871 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56149f844f70 con 0x56149f8ecea0 2023-10-14T08:52:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa27aff5700 1 -- 172.21.15.6:0/3002708871 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa28801c4d0 con 0x56149f8ecea0 2023-10-14T08:52:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 10 client.15441 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 10 client.15441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:52:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 20 client.15441 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f958bc0 0x56149f95afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 4 client.15441 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-14T08:52:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.713+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56149f838bf0 con 0x56149f958bc0 2023-10-14T08:52:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.714+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f958bc0 0x56149f95afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.714+0000 7fa27aff5700 10 client.15441 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.714+0000 7fa2967fc700 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f958bc0 0x56149f95afe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9f6e515b89f712 server_cookie=887f1b257fa460e5 in_seq=0 out_seq=0 2023-10-14T08:52:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa27aff5700 1 -- 172.21.15.6:0/3002708871 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56149f838bf0 con 0x56149f958bc0 2023-10-14T08:52:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa27aff5700 10 client.15441 handle_command_reply: tid=0 2023-10-14T08:52:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 client.15441 shutdown 2023-10-14T08:52:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 msgr2=0x56149f8fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 0x56149f8fb510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x56149f905450 tx=0x7fa2880047c0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 shutdown_connections 2023-10-14T08:52:47.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56149f958bc0 0x56149f95afe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56149f8ee6a0 0x56149f8fca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56149f8ecea0 0x56149f8fb510 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa27aff5700 0 client.15441 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 --2- 172.21.15.6:0/3002708871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56149f8ed800 0x56149f8fba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 >> 172.21.15.6:0/3002708871 conn(0x56149f81ae50 msgr2=0x56149f8e8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 shutdown_connections 2023-10-14T08:52:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 1 -- 172.21.15.6:0/3002708871 wait complete. 2023-10-14T08:52:47.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.716+0000 7fa2a9478b80 20 client.15441 trim_cache size 0 max 16384 2023-10-14T08:52:47.736 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-10-14T08:52:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "e97ba0ee-f07c-4d9b-a48e-fbdc8ee3f40e", 2023-10-14T08:52:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-10-14T08:52:47.737 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa2800a1480 msgr2=0x7fa2800a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa2800a1480 0x7fa2800a3940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa288005950 tx=0x7fa28800a300 comp rx=0 tx=0).stop 2023-10-14T08:52:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 msgr2=0x7fa298199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 0x7fa298199480 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00d950 tx=0x7fa28c00dc60 comp rx=0 tx=0).stop 2023-10-14T08:52:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 shutdown_connections 2023-10-14T08:52:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa2800a1480 0x7fa2800a3940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa298100990 0x7fa2981a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2980ff270 0x7fa298198f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 --2- 172.21.15.6:0/3631758344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2980fffd0 0x7fa298199480 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 >> 172.21.15.6:0/3631758344 conn(0x7fa2980fab80 msgr2=0x7fa2980fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 shutdown_connections 2023-10-14T08:52:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.717+0000 7fa29d28e700 1 -- 172.21.15.6:0/3631758344 wait complete. 2023-10-14T08:52:47.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-14T08:52:47.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-10-14T08:52:47.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-10-14T08:52:47.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 -- 172.21.15.6:0/775247237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101a30 msgr2=0x7ffb74108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/775247237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101a30 0x7ffb74108350 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00b0a0 tx=0x7ffb6c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 -- 172.21.15.6:0/775247237 shutdown_connections 2023-10-14T08:52:47.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/775247237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101a30 0x7ffb74108350 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/775247237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb740ffe90 0x7ffb741002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/775247237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb74101070 0x7ffb741014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 -- 172.21.15.6:0/775247237 >> 172.21.15.6:0/775247237 conn(0x7ffb740fb450 msgr2=0x7ffb740fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 -- 172.21.15.6:0/775247237 shutdown_connections 2023-10-14T08:52:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.911+0000 7ffb78ec6700 1 -- 172.21.15.6:0/775247237 wait complete. 2023-10-14T08:52:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 Processor -- start 2023-10-14T08:52:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 -- start start 2023-10-14T08:52:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb740ffe90 0x7ffb74103ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 0x7ffb741024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb74101a30 0x7ffb74102a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb741031c0 con 0x7ffb74101070 2023-10-14T08:52:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74103330 con 0x7ffb740ffe90 2023-10-14T08:52:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb78ec6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb741a0e00 con 0x7ffb74101a30 2023-10-14T08:52:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 0x7ffb741024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 0x7ffb741024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32936/0 (socket says 172.21.15.6:32936) 2023-10-14T08:52:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 -- 172.21.15.6:0/4096255504 learned_addr learned my addr 172.21.15.6:0/4096255504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb7259c700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb740ffe90 0x7ffb74103ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb74101a30 0x7ffb74102a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 -- 172.21.15.6:0/4096255504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb74101a30 msgr2=0x7ffb74102a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb74101a30 0x7ffb74102a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 -- 172.21.15.6:0/4096255504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb740ffe90 msgr2=0x7ffb74103ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb740ffe90 0x7ffb74103ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 -- 172.21.15.6:0/4096255504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c009d00 con 0x7ffb74101070 2023-10-14T08:52:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb7259c700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb740ffe90 0x7ffb74103ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:52:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.912+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 0x7ffb741024e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800e970 tx=0x7ffb6800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.913+0000 7ffb637fe700 1 -- 172.21.15.6:0/4096255504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68009790 con 0x7ffb74101070 2023-10-14T08:52:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.913+0000 7ffb637fe700 1 -- 172.21.15.6:0/4096255504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb680044e0 con 0x7ffb74101070 2023-10-14T08:52:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.913+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb741a10e0 con 0x7ffb74101070 2023-10-14T08:52:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.913+0000 7ffb637fe700 1 -- 172.21.15.6:0/4096255504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68003e30 con 0x7ffb74101070 2023-10-14T08:52:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.913+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb741a1640 con 0x7ffb74101070 2023-10-14T08:52:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.916+0000 7ffb637fe700 1 -- 172.21.15.6:0/4096255504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ffb68003f90 con 0x7ffb74101070 2023-10-14T08:52:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 Processor -- start 2023-10-14T08:52:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb637fe700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb5c0a1500 0x7ffb5c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb637fe700 1 -- 172.21.15.6:0/4096255504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ffb68014070 con 0x7ffb74101070 2023-10-14T08:52:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb5c0a1500 0x7ffb5c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 -- start start 2023-10-14T08:52:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48775240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f48776040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 0x561f48776aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f486e9c70 con 0x561f48776620 2023-10-14T08:52:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f486cec60 con 0x561f48774e20 2023-10-14T08:52:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.917+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f486cc580 con 0x561f48775780 2023-10-14T08:52:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 0x561f48776aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb5c0a1500 0x7ffb5c0a39c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00b780 tx=0x7ffb6c009be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48775240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 0x561f48776aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32946/0 (socket says 172.21.15.6:32946) 2023-10-14T08:52:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 -- 172.21.15.6:0/1864120656 learned_addr learned my addr 172.21.15.6:0/1864120656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f48776040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 -- 172.21.15.6:0/1864120656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 msgr2=0x561f48776040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f48776040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 -- 172.21.15.6:0/1864120656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 msgr2=0x561f48775240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48775240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 -- 172.21.15.6:0/1864120656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f486853f0 con 0x561f48776620 2023-10-14T08:52:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 0x561f48776aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c015000 tx=0x7ffb6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e49968cc9520941 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb60ff9700 1 -- 172.21.15.6:0/1864120656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00e040 con 0x561f48776620 2023-10-14T08:52:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb60ff9700 1 -- 172.21.15.6:0/1864120656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb6c00bdb0 con 0x561f48776620 2023-10-14T08:52:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.918+0000 7ffb60ff9700 1 -- 172.21.15.6:0/1864120656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c01dce0 con 0x561f48776620 2023-10-14T08:52:47.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 -- 172.21.15.6:0/1864120656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 msgr2=0x561f48776aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 0x561f48776aa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c015000 tx=0x7ffb6c01a000 comp rx=0 tx=0).stop 2023-10-14T08:52:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 -- 172.21.15.6:0/1864120656 shutdown_connections 2023-10-14T08:52:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48776620 0x561f48776aa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48775240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/1864120656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f48776040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 -- 172.21.15.6:0/1864120656 >> 172.21.15.6:0/1864120656 conn(0x561f486a2dd0 msgr2=0x561f4876ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 -- 172.21.15.6:0/1864120656 shutdown_connections 2023-10-14T08:52:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.919+0000 7ffb850b0b80 1 -- 172.21.15.6:0/1864120656 wait complete. 2023-10-14T08:52:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 -- start start 2023-10-14T08:52:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 Processor -- start 2023-10-14T08:52:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 0x561f4877eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f4877f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48786080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f486c7e70 con 0x561f48774e20 2023-10-14T08:52:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f48664710 con 0x561f48776620 2023-10-14T08:52:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f486643b0 con 0x561f48775780 2023-10-14T08:52:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb850b0b80 10 client.0 _ll_register_callbacks cb 0x561f484c1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:47.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 0x561f4877eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 0x561f4877eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32948/0 (socket says 172.21.15.6:32948) 2023-10-14T08:52:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 -- 172.21.15.6:0/807638659 learned_addr learned my addr 172.21.15.6:0/807638659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f4877f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48786080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 -- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 msgr2=0x561f4877f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f4877f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 -- 172.21.15.6:0/807638659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 msgr2=0x561f48786080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48786080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb7259c700 1 -- 172.21.15.6:0/807638659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb74108c80 con 0x561f48774e20 2023-10-14T08:52:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.920+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48786080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:47.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb7259c700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 0x561f4877eb00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffb64013710 tx=0x7ffb64013ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ea29ba950de945 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:47.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb59ffb700 1 -- 172.21.15.6:0/807638659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011730 con 0x561f48774e20 2023-10-14T08:52:47.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb59ffb700 1 -- 172.21.15.6:0/807638659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ffb64011890 con 0x561f48774e20 2023-10-14T08:52:47.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f486ccef0 con 0x561f48774e20 2023-10-14T08:52:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb59ffb700 1 -- 172.21.15.6:0/807638659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb64011a50 con 0x561f48774e20 2023-10-14T08:52:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 10 client.15453 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561f484f2de0 con 0x561f48774e20 2023-10-14T08:52:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb59ffb700 1 -- 172.21.15.6:0/807638659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561f486ccef0 con 0x561f48774e20 2023-10-14T08:52:47.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb59ffb700 1 -- 172.21.15.6:0/807638659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffb640263e0 con 0x561f48774e20 2023-10-14T08:52:47.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:47.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:52:47.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 20 client.15453 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:47.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f4878a940 0x561f4878cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 4 client.15453 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:52:47.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.921+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f48744c10 con 0x561f4878a940 2023-10-14T08:52:47.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.922+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f4878a940 0x561f4878cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.922+0000 7ffb59ffb700 10 client.15453 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.922+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f4878a940 0x561f4878cd60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8cbccdfb4c3aa17 server_cookie=8b6fc426ffb102d8 in_seq=0 out_seq=0 2023-10-14T08:52:47.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb59ffb700 1 -- 172.21.15.6:0/807638659 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561f48744c10 con 0x561f4878a940 2023-10-14T08:52:47.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb59ffb700 10 client.15453 handle_command_reply: tid=0 2023-10-14T08:52:47.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 client.15453 shutdown 2023-10-14T08:52:47.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 msgr2=0x561f4877eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 0x561f4877eb00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffb64013710 tx=0x7ffb64013ad0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 shutdown_connections 2023-10-14T08:52:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f4878a940 0x561f4878cd60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48786080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb59ffb700 0 client.15453 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48774e20 0x561f4877eb00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/807638659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48775780 0x561f4877f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 >> 172.21.15.6:0/807638659 conn(0x561f486a2dd0 msgr2=0x561f4876fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 shutdown_connections 2023-10-14T08:52:47.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 1 -- 172.21.15.6:0/807638659 wait complete. 2023-10-14T08:52:47.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.923+0000 7ffb850b0b80 20 client.15453 trim_cache size 0 max 16384 2023-10-14T08:52:47.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 Processor -- start 2023-10-14T08:52:47.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 -- start start 2023-10-14T08:52:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48779590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f48786040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48776620 0x561f48779ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f48548920 con 0x561f48775780 2023-10-14T08:52:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f48775e30 con 0x561f48774e20 2023-10-14T08:52:47.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4877c800 con 0x561f48776620 2023-10-14T08:52:47.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f48786040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f48786040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32956/0 (socket says 172.21.15.6:32956) 2023-10-14T08:52:47.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 -- 172.21.15.6:0/3472969911 learned_addr learned my addr 172.21.15.6:0/3472969911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48776620 0x561f48779ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb7259c700 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48779590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 -- 172.21.15.6:0/3472969911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48776620 msgr2=0x561f48779ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48776620 0x561f48779ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 -- 172.21.15.6:0/3472969911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 msgr2=0x561f48779590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48779590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb71d9b700 1 -- 172.21.15.6:0/3472969911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f484dbc60 con 0x561f48775780 2023-10-14T08:52:47.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.941+0000 7ffb7259c700 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48779590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:52:47.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.942+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f48786040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ffb6809a1a0 tx=0x7ffb68095eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9afae45131d266 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.942+0000 7ffb617fa700 1 -- 172.21.15.6:0/3472969911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6809a210 con 0x561f48775780 2023-10-14T08:52:47.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.942+0000 7ffb617fa700 1 -- 172.21.15.6:0/3472969911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb6809e360 con 0x561f48775780 2023-10-14T08:52:47.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.942+0000 7ffb617fa700 1 -- 172.21.15.6:0/3472969911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680985b0 con 0x561f48775780 2023-10-14T08:52:47.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- 172.21.15.6:0/3472969911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 msgr2=0x561f48786040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f48786040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ffb6809a1a0 tx=0x7ffb68095eb0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- 172.21.15.6:0/3472969911 shutdown_connections 2023-10-14T08:52:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48776620 0x561f48779ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48774e20 0x561f48779590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/3472969911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f48786040 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- 172.21.15.6:0/3472969911 >> 172.21.15.6:0/3472969911 conn(0x561f486a2dd0 msgr2=0x561f4877d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- 172.21.15.6:0/3472969911 shutdown_connections 2023-10-14T08:52:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- 172.21.15.6:0/3472969911 wait complete. 2023-10-14T08:52:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- start start 2023-10-14T08:52:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 Processor -- start 2023-10-14T08:52:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48774e20 0x561f48785cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f487842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48784800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f487864d0 con 0x561f48775780 2023-10-14T08:52:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f48784d40 con 0x561f48776620 2023-10-14T08:52:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.943+0000 7ffb850b0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f48784eb0 con 0x561f48774e20 2023-10-14T08:52:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb850b0b80 10 client.0 _ll_register_callbacks cb 0x7ffb64009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:52:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48774e20 0x561f48785cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f487842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb7259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48774e20 0x561f48785cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58596/0 (socket says 172.21.15.6:58596) 2023-10-14T08:52:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb7259c700 1 -- 172.21.15.6:0/661414028 learned_addr learned my addr 172.21.15.6:0/661414028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:52:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb72d9d700 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48784800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 -- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48774e20 msgr2=0x561f48785cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48774e20 0x561f48785cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 -- 172.21.15.6:0/661414028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 msgr2=0x561f48784800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:52:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48784800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 -- 172.21.15.6:0/661414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb741a1640 con 0x561f48775780 2023-10-14T08:52:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb71d9b700 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f487842c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffb6809a1a0 tx=0x7ffb68098520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f2cd4cff71447 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:52:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:52:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb59ffb700 1 -- 172.21.15.6:0/661414028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680cab00 con 0x561f48775780 2023-10-14T08:52:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.944+0000 7ffb59ffb700 1 -- 172.21.15.6:0/661414028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ffb680a25a0 con 0x561f48775780 2023-10-14T08:52:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb6c00bdb0 con 0x561f48775780 2023-10-14T08:52:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb59ffb700 1 -- 172.21.15.6:0/661414028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb6809a210 con 0x561f48775780 2023-10-14T08:52:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 10 client.15459 fetch_fsmap learned FSMap version 27 2023-10-14T08:52:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561f48519250 con 0x561f48775780 2023-10-14T08:52:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb59ffb700 1 -- 172.21.15.6:0/661414028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb6c00bdb0 con 0x561f48775780 2023-10-14T08:52:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb59ffb700 1 -- 172.21.15.6:0/661414028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffb6807d070 con 0x561f48775780 2023-10-14T08:52:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:52:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:52:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 20 client.15459 populate_metadata read hostname 'smithi006' 2023-10-14T08:52:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f487df8d0 0x561f487e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:52:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 4 client.15459 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-14T08:52:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561f486c0e50 con 0x561f487df8d0 2023-10-14T08:52:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.945+0000 7ffb7259c700 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f487df8d0 0x561f487e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:52:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb7259c700 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f487df8d0 0x561f487e1cf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=516142eb4b5d34a6 server_cookie=1d473f3b6bf41962 in_seq=0 out_seq=0 2023-10-14T08:52:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb59ffb700 10 client.15459 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb59ffb700 1 -- 172.21.15.6:0/661414028 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561f486c0e50 con 0x561f487df8d0 2023-10-14T08:52:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb59ffb700 10 client.15459 handle_command_reply: tid=0 2023-10-14T08:52:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 client.15459 shutdown 2023-10-14T08:52:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 msgr2=0x561f487842c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f487842c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffb6809a1a0 tx=0x7ffb68098520 comp rx=0 tx=0).stop 2023-10-14T08:52:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 shutdown_connections 2023-10-14T08:52:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561f487df8d0 0x561f487e1cf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561f48776620 0x561f48784800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f48774e20 0x561f48785cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 --2- 172.21.15.6:0/661414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561f48775780 0x561f487842c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 >> 172.21.15.6:0/661414028 conn(0x561f486a2dd0 msgr2=0x561f48779590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb59ffb700 0 client.15459 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:52:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 shutdown_connections 2023-10-14T08:52:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 1 -- 172.21.15.6:0/661414028 wait complete. 2023-10-14T08:52:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.946+0000 7ffb850b0b80 20 client.15459 trim_cache size 0 max 16384 2023-10-14T08:52:47.975 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:52:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-14T08:52:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-10-14T08:52:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "e97ba0ee-f07c-4d9b-a48e-fbdc8ee3f40e": { 2023-10-14T08:52:47.977 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-10-14T08:52:47.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "e97ba0ee-f07c-4d9b-a48e-fbdc8ee3f40e", 2023-10-14T08:52:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-10-14T08:52:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T08:52:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T08:52:47.979 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:52:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb5c0a1500 msgr2=0x7ffb5c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb5c0a1500 0x7ffb5c0a39c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00b780 tx=0x7ffb6c009be0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 msgr2=0x7ffb741024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:52:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 0x7ffb741024e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800e970 tx=0x7ffb6800ed30 comp rx=0 tx=0).stop 2023-10-14T08:52:47.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 shutdown_connections 2023-10-14T08:52:47.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb74101a30 0x7ffb74102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ffb5c0a1500 0x7ffb5c0a39c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb740ffe90 0x7ffb74103ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 --2- 172.21.15.6:0/4096255504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb74101070 0x7ffb741024e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:52:47.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 >> 172.21.15.6:0/4096255504 conn(0x7ffb740fb450 msgr2=0x7ffb74068e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:52:47.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 shutdown_connections 2023-10-14T08:52:47.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:52:47.947+0000 7ffb78ec6700 1 -- 172.21.15.6:0/4096255504 wait complete. 2023-10-14T08:52:47.983 INFO:tasks.cephfs.filesystem:scrub status for tag:e97ba0ee-f07c-4d9b-a48e-fbdc8ee3f40e - {'path': '/', 'tag': 'e97ba0ee-f07c-4d9b-a48e-fbdc8ee3f40e', 'options': 'recursive,force'} 2023-10-14T08:52:48.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:48 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2430062137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:48.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:48 smithi057 ceph-mon[103313]: scrub queued for path: / 2023-10-14T08:52:48.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:48 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:52:48.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:48 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:52:48.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:48 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:52:48.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:48 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2430062137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:48.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:48 smithi006 ceph-mon[99452]: scrub queued for path: / 2023-10-14T08:52:48.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:48 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:52:48.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:48 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:52:48.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:48 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:52:48.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:48 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2430062137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T08:52:48.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:48 smithi178 ceph-mon[103612]: scrub queued for path: / 2023-10-14T08:52:48.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:48 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:52:48.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:48 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:52:48.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:48 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:52:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:49 smithi006 ceph-mon[99452]: pgmap v306: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-14T08:52:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:49 smithi178 ceph-mon[103612]: pgmap v306: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-14T08:52:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:49 smithi057 ceph-mon[103313]: pgmap v306: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2023-10-14T08:52:50.452 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-10-14T08:52:50.494 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-10-14T08:52:50.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-10-14T08:52:50.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-14T08:52:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/: 2023-10-14T08:52:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:50.659 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 .. 2023-10-14T08:52:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 data 2023-10-14T08:52:50.660 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data: 2023-10-14T08:52:50.660 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:50.661 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 .. 2023-10-14T08:52:50.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-10-14T08:52:50.750 INFO:teuthology.orchestra.run.smithi006.stdout:[Service] 2023-10-14T08:52:50.750 INFO:teuthology.orchestra.run.smithi006.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-10-14T08:52:50.750 INFO:teuthology.orchestra.run.smithi006.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-10-14T08:52:50.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-10-14T08:52:50.854 INFO:teuthology.orchestra.run.smithi006.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-10-14T08:52:51.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:51 smithi006 ceph-mon[99452]: pgmap v307: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-10-14T08:52:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:51 smithi178 ceph-mon[103612]: pgmap v307: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-10-14T08:52:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:51 smithi057 ceph-mon[103313]: pgmap v307: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2023-10-14T08:52:53.335 INFO:teuthology.orchestra.run.smithi006.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-10-14T08:52:53.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-14T08:52:53.384 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/: 2023-10-14T08:52:53.385 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:53.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 .. 2023-10-14T08:52:53.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 data 2023-10-14T08:52:53.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.386 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data: 2023-10-14T08:52:53.386 INFO:teuthology.orchestra.run.smithi006.stdout:total 30 2023-10-14T08:52:53.386 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 . 2023-10-14T08:52:53.386 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 .. 2023-10-14T08:52:53.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 base 2023-10-14T08:52:53.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Oct 14 08:52 global 2023-10-14T08:52:53.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 log 2023-10-14T08:52:53.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_commit_ts 2023-10-14T08:52:53.388 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_dynshmem 2023-10-14T08:52:53.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 14 08:52 pg_hba.conf 2023-10-14T08:52:53.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 14 08:52 pg_ident.conf 2023-10-14T08:52:53.388 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 pg_logical 2023-10-14T08:52:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 pg_multixact 2023-10-14T08:52:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 pg_notify 2023-10-14T08:52:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_replslot 2023-10-14T08:52:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_serial 2023-10-14T08:52:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_snapshots 2023-10-14T08:52:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_stat 2023-10-14T08:52:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_stat_tmp 2023-10-14T08:52:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 pg_subtrans 2023-10-14T08:52:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_tblspc 2023-10-14T08:52:53.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_twophase 2023-10-14T08:52:53.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T08:52:53.391 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 pg_wal 2023-10-14T08:52:53.391 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 pg_xact 2023-10-14T08:52:53.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 14 08:52 postgresql.auto.conf 2023-10-14T08:52:53.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 14 08:52 postgresql.conf 2023-10-14T08:52:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.392 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base: 2023-10-14T08:52:53.392 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.392 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 . 2023-10-14T08:52:53.393 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.393 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 1 2023-10-14T08:52:53.393 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 12346 2023-10-14T08:52:53.393 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 12347 2023-10-14T08:52:53.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.393 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-14T08:52:53.394 INFO:teuthology.orchestra.run.smithi006.stdout:total 7193 2023-10-14T08:52:53.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 . 2023-10-14T08:52:53.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 .. 2023-10-14T08:52:53.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 112 2023-10-14T08:52:53.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 113 2023-10-14T08:52:53.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 14 08:52 12182 2023-10-14T08:52:53.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12182_fsm 2023-10-14T08:52:53.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12182_vm 2023-10-14T08:52:53.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12184 2023-10-14T08:52:53.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12186 2023-10-14T08:52:53.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187 2023-10-14T08:52:53.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12187_fsm 2023-10-14T08:52:53.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187_vm 2023-10-14T08:52:53.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12189 2023-10-14T08:52:53.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12191 2023-10-14T08:52:53.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192 2023-10-14T08:52:53.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12192_fsm 2023-10-14T08:52:53.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192_vm 2023-10-14T08:52:53.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12194 2023-10-14T08:52:53.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12196 2023-10-14T08:52:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197 2023-10-14T08:52:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12197_fsm 2023-10-14T08:52:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197_vm 2023-10-14T08:52:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12199 2023-10-14T08:52:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12201 2023-10-14T08:52:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202 2023-10-14T08:52:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12202_fsm 2023-10-14T08:52:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202_vm 2023-10-14T08:52:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12204 2023-10-14T08:52:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12206 2023-10-14T08:52:53.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207 2023-10-14T08:52:53.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12207_fsm 2023-10-14T08:52:53.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207_vm 2023-10-14T08:52:53.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12209 2023-10-14T08:52:53.400 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12211 2023-10-14T08:52:53.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12212 2023-10-14T08:52:53.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12214 2023-10-14T08:52:53.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12216 2023-10-14T08:52:53.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 14 08:52 1247 2023-10-14T08:52:53.401 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1247_fsm 2023-10-14T08:52:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1247_vm 2023-10-14T08:52:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 14 08:52 1249 2023-10-14T08:52:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1249_fsm 2023-10-14T08:52:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1249_vm 2023-10-14T08:52:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 14 08:52 1255 2023-10-14T08:52:53.402 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1255_fsm 2023-10-14T08:52:53.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1255_vm 2023-10-14T08:52:53.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 08:52 1259 2023-10-14T08:52:53.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1259_fsm 2023-10-14T08:52:53.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1259_vm 2023-10-14T08:52:53.403 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417 2023-10-14T08:52:53.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417_vm 2023-10-14T08:52:53.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418 2023-10-14T08:52:53.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418_vm 2023-10-14T08:52:53.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 174 2023-10-14T08:52:53.404 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 175 2023-10-14T08:52:53.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2187 2023-10-14T08:52:53.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224 2023-10-14T08:52:53.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224_vm 2023-10-14T08:52:53.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328 2023-10-14T08:52:53.405 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328_vm 2023-10-14T08:52:53.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336 2023-10-14T08:52:53.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336_vm 2023-10-14T08:52:53.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2337 2023-10-14T08:52:53.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2600 2023-10-14T08:52:53.406 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2600_fsm 2023-10-14T08:52:53.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2600_vm 2023-10-14T08:52:53.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601 2023-10-14T08:52:53.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2601_fsm 2023-10-14T08:52:53.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601_vm 2023-10-14T08:52:53.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2602 2023-10-14T08:52:53.407 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2602_fsm 2023-10-14T08:52:53.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2602_vm 2023-10-14T08:52:53.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2603 2023-10-14T08:52:53.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2603_fsm 2023-10-14T08:52:53.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2603_vm 2023-10-14T08:52:53.408 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604 2023-10-14T08:52:53.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604_vm 2023-10-14T08:52:53.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2605 2023-10-14T08:52:53.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2605_fsm 2023-10-14T08:52:53.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2605_vm 2023-10-14T08:52:53.409 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606 2023-10-14T08:52:53.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2606_fsm 2023-10-14T08:52:53.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606_vm 2023-10-14T08:52:53.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607 2023-10-14T08:52:53.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607_fsm 2023-10-14T08:52:53.410 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2607_vm 2023-10-14T08:52:53.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 14 08:52 2608 2023-10-14T08:52:53.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2608_fsm 2023-10-14T08:52:53.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2608_vm 2023-10-14T08:52:53.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 14 08:52 2609 2023-10-14T08:52:53.411 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2609_fsm 2023-10-14T08:52:53.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2609_vm 2023-10-14T08:52:53.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610 2023-10-14T08:52:53.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610_fsm 2023-10-14T08:52:53.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2610_vm 2023-10-14T08:52:53.412 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611 2023-10-14T08:52:53.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611_vm 2023-10-14T08:52:53.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612 2023-10-14T08:52:53.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2612_fsm 2023-10-14T08:52:53.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612_vm 2023-10-14T08:52:53.413 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613 2023-10-14T08:52:53.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613_vm 2023-10-14T08:52:53.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615 2023-10-14T08:52:53.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2615_fsm 2023-10-14T08:52:53.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615_vm 2023-10-14T08:52:53.414 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616 2023-10-14T08:52:53.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616_fsm 2023-10-14T08:52:53.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2616_vm 2023-10-14T08:52:53.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 14 08:52 2617 2023-10-14T08:52:53.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2617_fsm 2023-10-14T08:52:53.415 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2617_vm 2023-10-14T08:52:53.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 14 08:52 2618 2023-10-14T08:52:53.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2618_fsm 2023-10-14T08:52:53.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2618_vm 2023-10-14T08:52:53.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 14 08:52 2619 2023-10-14T08:52:53.416 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2619_fsm 2023-10-14T08:52:53.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2619_vm 2023-10-14T08:52:53.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620 2023-10-14T08:52:53.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620_vm 2023-10-14T08:52:53.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2650 2023-10-14T08:52:53.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2651 2023-10-14T08:52:53.417 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2652 2023-10-14T08:52:53.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2653 2023-10-14T08:52:53.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2654 2023-10-14T08:52:53.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2655 2023-10-14T08:52:53.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2656 2023-10-14T08:52:53.418 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2657 2023-10-14T08:52:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 14 08:52 2658 2023-10-14T08:52:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2659 2023-10-14T08:52:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2660 2023-10-14T08:52:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2661 2023-10-14T08:52:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2662 2023-10-14T08:52:53.419 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2663 2023-10-14T08:52:53.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2664 2023-10-14T08:52:53.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2665 2023-10-14T08:52:53.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2666 2023-10-14T08:52:53.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2667 2023-10-14T08:52:53.420 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2668 2023-10-14T08:52:53.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2669 2023-10-14T08:52:53.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2670 2023-10-14T08:52:53.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 14 08:52 2673 2023-10-14T08:52:53.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 14 08:52 2674 2023-10-14T08:52:53.421 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 14 08:52 2675 2023-10-14T08:52:53.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2678 2023-10-14T08:52:53.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2679 2023-10-14T08:52:53.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2680 2023-10-14T08:52:53.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2681 2023-10-14T08:52:53.422 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2682 2023-10-14T08:52:53.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2683 2023-10-14T08:52:53.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2684 2023-10-14T08:52:53.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2685 2023-10-14T08:52:53.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2686 2023-10-14T08:52:53.423 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2687 2023-10-14T08:52:53.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2688 2023-10-14T08:52:53.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2689 2023-10-14T08:52:53.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2690 2023-10-14T08:52:53.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 14 08:52 2691 2023-10-14T08:52:53.424 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2692 2023-10-14T08:52:53.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2693 2023-10-14T08:52:53.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2696 2023-10-14T08:52:53.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2699 2023-10-14T08:52:53.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2701 2023-10-14T08:52:53.425 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2702 2023-10-14T08:52:53.426 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2703 2023-10-14T08:52:53.426 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2704 2023-10-14T08:52:53.426 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2753 2023-10-14T08:52:53.426 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2753_fsm 2023-10-14T08:52:53.426 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2753_vm 2023-10-14T08:52:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2754 2023-10-14T08:52:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2755 2023-10-14T08:52:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2756 2023-10-14T08:52:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2757 2023-10-14T08:52:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830 2023-10-14T08:52:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830_vm 2023-10-14T08:52:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2831 2023-10-14T08:52:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832 2023-10-14T08:52:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832_vm 2023-10-14T08:52:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2833 2023-10-14T08:52:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834 2023-10-14T08:52:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834_vm 2023-10-14T08:52:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2835 2023-10-14T08:52:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836 2023-10-14T08:52:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836_vm 2023-10-14T08:52:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2837 2023-10-14T08:52:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 14 08:52 2838 2023-10-14T08:52:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2838_fsm 2023-10-14T08:52:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2838_vm 2023-10-14T08:52:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2839 2023-10-14T08:52:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840 2023-10-14T08:52:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840_fsm 2023-10-14T08:52:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2840_vm 2023-10-14T08:52:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2841 2023-10-14T08:52:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995 2023-10-14T08:52:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995_vm 2023-10-14T08:52:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2996 2023-10-14T08:52:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079 2023-10-14T08:52:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3079_fsm 2023-10-14T08:52:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079_vm 2023-10-14T08:52:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3080 2023-10-14T08:52:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3081 2023-10-14T08:52:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3085 2023-10-14T08:52:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118 2023-10-14T08:52:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118_vm 2023-10-14T08:52:53.434 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3119 2023-10-14T08:52:53.434 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3164 2023-10-14T08:52:53.434 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256 2023-10-14T08:52:53.434 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256_vm 2023-10-14T08:52:53.434 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3257 2023-10-14T08:52:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3258 2023-10-14T08:52:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350 2023-10-14T08:52:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350_vm 2023-10-14T08:52:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3351 2023-10-14T08:52:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3379 2023-10-14T08:52:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3380 2023-10-14T08:52:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381 2023-10-14T08:52:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381_vm 2023-10-14T08:52:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3394 2023-10-14T08:52:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3394_fsm 2023-10-14T08:52:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3394_vm 2023-10-14T08:52:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3395 2023-10-14T08:52:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439 2023-10-14T08:52:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439_vm 2023-10-14T08:52:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3440 2023-10-14T08:52:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 3455 2023-10-14T08:52:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3456 2023-10-14T08:52:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3456_fsm 2023-10-14T08:52:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3456_vm 2023-10-14T08:52:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466 2023-10-14T08:52:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466_vm 2023-10-14T08:52:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3467 2023-10-14T08:52:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3468 2023-10-14T08:52:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501 2023-10-14T08:52:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501_vm 2023-10-14T08:52:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3502 2023-10-14T08:52:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3503 2023-10-14T08:52:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3534 2023-10-14T08:52:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541 2023-10-14T08:52:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3541_fsm 2023-10-14T08:52:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541_vm 2023-10-14T08:52:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3542 2023-10-14T08:52:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3574 2023-10-14T08:52:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3575 2023-10-14T08:52:53.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576 2023-10-14T08:52:53.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576_vm 2023-10-14T08:52:53.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596 2023-10-14T08:52:53.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596_vm 2023-10-14T08:52:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3597 2023-10-14T08:52:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598 2023-10-14T08:52:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598_vm 2023-10-14T08:52:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3599 2023-10-14T08:52:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600 2023-10-14T08:52:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3600_fsm 2023-10-14T08:52:53.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600_vm 2023-10-14T08:52:53.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601 2023-10-14T08:52:53.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3601_fsm 2023-10-14T08:52:53.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601_vm 2023-10-14T08:52:53.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602 2023-10-14T08:52:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3602_fsm 2023-10-14T08:52:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602_vm 2023-10-14T08:52:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3603 2023-10-14T08:52:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3603_fsm 2023-10-14T08:52:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3603_vm 2023-10-14T08:52:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3604 2023-10-14T08:52:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3605 2023-10-14T08:52:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3606 2023-10-14T08:52:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3607 2023-10-14T08:52:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3608 2023-10-14T08:52:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 3609 2023-10-14T08:52:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3712 2023-10-14T08:52:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764 2023-10-14T08:52:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3764_fsm 2023-10-14T08:52:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764_vm 2023-10-14T08:52:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3766 2023-10-14T08:52:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3767 2023-10-14T08:52:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3997 2023-10-14T08:52:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 5002 2023-10-14T08:52:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 548 2023-10-14T08:52:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 549 2023-10-14T08:52:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102 2023-10-14T08:52:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102_vm 2023-10-14T08:52:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104 2023-10-14T08:52:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104_vm 2023-10-14T08:52:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106 2023-10-14T08:52:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106_vm 2023-10-14T08:52:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6110 2023-10-14T08:52:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6111 2023-10-14T08:52:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6112 2023-10-14T08:52:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6113 2023-10-14T08:52:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6117 2023-10-14T08:52:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826 2023-10-14T08:52:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826_vm 2023-10-14T08:52:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 827 2023-10-14T08:52:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 828 2023-10-14T08:52:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T08:52:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T08:52:53.455 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-14T08:52:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:total 7193 2023-10-14T08:52:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 . 2023-10-14T08:52:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 .. 2023-10-14T08:52:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 112 2023-10-14T08:52:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 113 2023-10-14T08:52:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 14 08:52 12182 2023-10-14T08:52:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12182_fsm 2023-10-14T08:52:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12182_vm 2023-10-14T08:52:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12184 2023-10-14T08:52:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12186 2023-10-14T08:52:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187 2023-10-14T08:52:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12187_fsm 2023-10-14T08:52:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187_vm 2023-10-14T08:52:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12189 2023-10-14T08:52:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12191 2023-10-14T08:52:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192 2023-10-14T08:52:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12192_fsm 2023-10-14T08:52:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192_vm 2023-10-14T08:52:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12194 2023-10-14T08:52:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12196 2023-10-14T08:52:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197 2023-10-14T08:52:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12197_fsm 2023-10-14T08:52:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197_vm 2023-10-14T08:52:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12199 2023-10-14T08:52:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12201 2023-10-14T08:52:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202 2023-10-14T08:52:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12202_fsm 2023-10-14T08:52:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202_vm 2023-10-14T08:52:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12204 2023-10-14T08:52:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12206 2023-10-14T08:52:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207 2023-10-14T08:52:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12207_fsm 2023-10-14T08:52:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207_vm 2023-10-14T08:52:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12209 2023-10-14T08:52:53.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12211 2023-10-14T08:52:53.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12212 2023-10-14T08:52:53.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12214 2023-10-14T08:52:53.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12216 2023-10-14T08:52:53.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 14 08:52 1247 2023-10-14T08:52:53.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1247_fsm 2023-10-14T08:52:53.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1247_vm 2023-10-14T08:52:53.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 14 08:52 1249 2023-10-14T08:52:53.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1249_fsm 2023-10-14T08:52:53.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1249_vm 2023-10-14T08:52:53.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 14 08:52 1255 2023-10-14T08:52:53.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1255_fsm 2023-10-14T08:52:53.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1255_vm 2023-10-14T08:52:53.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 08:52 1259 2023-10-14T08:52:53.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1259_fsm 2023-10-14T08:52:53.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1259_vm 2023-10-14T08:52:53.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417 2023-10-14T08:52:53.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417_vm 2023-10-14T08:52:53.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418 2023-10-14T08:52:53.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418_vm 2023-10-14T08:52:53.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 174 2023-10-14T08:52:53.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 175 2023-10-14T08:52:53.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2187 2023-10-14T08:52:53.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224 2023-10-14T08:52:53.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224_vm 2023-10-14T08:52:53.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328 2023-10-14T08:52:53.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328_vm 2023-10-14T08:52:53.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336 2023-10-14T08:52:53.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336_vm 2023-10-14T08:52:53.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2337 2023-10-14T08:52:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2600 2023-10-14T08:52:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2600_fsm 2023-10-14T08:52:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2600_vm 2023-10-14T08:52:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601 2023-10-14T08:52:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2601_fsm 2023-10-14T08:52:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601_vm 2023-10-14T08:52:53.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2602 2023-10-14T08:52:53.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2602_fsm 2023-10-14T08:52:53.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2602_vm 2023-10-14T08:52:53.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2603 2023-10-14T08:52:53.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2603_fsm 2023-10-14T08:52:53.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2603_vm 2023-10-14T08:52:53.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604 2023-10-14T08:52:53.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604_vm 2023-10-14T08:52:53.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2605 2023-10-14T08:52:53.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2605_fsm 2023-10-14T08:52:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2605_vm 2023-10-14T08:52:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606 2023-10-14T08:52:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2606_fsm 2023-10-14T08:52:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606_vm 2023-10-14T08:52:53.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607 2023-10-14T08:52:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607_fsm 2023-10-14T08:52:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2607_vm 2023-10-14T08:52:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 14 08:52 2608 2023-10-14T08:52:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2608_fsm 2023-10-14T08:52:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2608_vm 2023-10-14T08:52:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 14 08:52 2609 2023-10-14T08:52:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2609_fsm 2023-10-14T08:52:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2609_vm 2023-10-14T08:52:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610 2023-10-14T08:52:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610_fsm 2023-10-14T08:52:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2610_vm 2023-10-14T08:52:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611 2023-10-14T08:52:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611_vm 2023-10-14T08:52:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612 2023-10-14T08:52:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2612_fsm 2023-10-14T08:52:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612_vm 2023-10-14T08:52:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613 2023-10-14T08:52:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613_vm 2023-10-14T08:52:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615 2023-10-14T08:52:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2615_fsm 2023-10-14T08:52:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615_vm 2023-10-14T08:52:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616 2023-10-14T08:52:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616_fsm 2023-10-14T08:52:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2616_vm 2023-10-14T08:52:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 14 08:52 2617 2023-10-14T08:52:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2617_fsm 2023-10-14T08:52:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2617_vm 2023-10-14T08:52:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 14 08:52 2618 2023-10-14T08:52:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2618_fsm 2023-10-14T08:52:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2618_vm 2023-10-14T08:52:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 14 08:52 2619 2023-10-14T08:52:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2619_fsm 2023-10-14T08:52:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2619_vm 2023-10-14T08:52:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620 2023-10-14T08:52:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620_vm 2023-10-14T08:52:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2650 2023-10-14T08:52:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2651 2023-10-14T08:52:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2652 2023-10-14T08:52:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2653 2023-10-14T08:52:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2654 2023-10-14T08:52:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2655 2023-10-14T08:52:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2656 2023-10-14T08:52:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2657 2023-10-14T08:52:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 14 08:52 2658 2023-10-14T08:52:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2659 2023-10-14T08:52:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2660 2023-10-14T08:52:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2661 2023-10-14T08:52:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2662 2023-10-14T08:52:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2663 2023-10-14T08:52:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2664 2023-10-14T08:52:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2665 2023-10-14T08:52:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2666 2023-10-14T08:52:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2667 2023-10-14T08:52:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2668 2023-10-14T08:52:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2669 2023-10-14T08:52:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2670 2023-10-14T08:52:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 14 08:52 2673 2023-10-14T08:52:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 14 08:52 2674 2023-10-14T08:52:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 14 08:52 2675 2023-10-14T08:52:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2678 2023-10-14T08:52:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2679 2023-10-14T08:52:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2680 2023-10-14T08:52:53.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2681 2023-10-14T08:52:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2682 2023-10-14T08:52:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2683 2023-10-14T08:52:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2684 2023-10-14T08:52:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2685 2023-10-14T08:52:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2686 2023-10-14T08:52:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2687 2023-10-14T08:52:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2688 2023-10-14T08:52:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2689 2023-10-14T08:52:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2690 2023-10-14T08:52:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 14 08:52 2691 2023-10-14T08:52:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2692 2023-10-14T08:52:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2693 2023-10-14T08:52:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2696 2023-10-14T08:52:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2699 2023-10-14T08:52:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2701 2023-10-14T08:52:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2702 2023-10-14T08:52:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2703 2023-10-14T08:52:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2704 2023-10-14T08:52:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2753 2023-10-14T08:52:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2753_fsm 2023-10-14T08:52:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2753_vm 2023-10-14T08:52:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2754 2023-10-14T08:52:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2755 2023-10-14T08:52:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2756 2023-10-14T08:52:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2757 2023-10-14T08:52:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830 2023-10-14T08:52:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830_vm 2023-10-14T08:52:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2831 2023-10-14T08:52:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832 2023-10-14T08:52:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832_vm 2023-10-14T08:52:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2833 2023-10-14T08:52:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834 2023-10-14T08:52:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834_vm 2023-10-14T08:52:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2835 2023-10-14T08:52:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836 2023-10-14T08:52:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836_vm 2023-10-14T08:52:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2837 2023-10-14T08:52:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 14 08:52 2838 2023-10-14T08:52:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2838_fsm 2023-10-14T08:52:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2838_vm 2023-10-14T08:52:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2839 2023-10-14T08:52:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840 2023-10-14T08:52:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840_fsm 2023-10-14T08:52:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2840_vm 2023-10-14T08:52:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2841 2023-10-14T08:52:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995 2023-10-14T08:52:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995_vm 2023-10-14T08:52:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2996 2023-10-14T08:52:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079 2023-10-14T08:52:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3079_fsm 2023-10-14T08:52:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079_vm 2023-10-14T08:52:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3080 2023-10-14T08:52:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3081 2023-10-14T08:52:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3085 2023-10-14T08:52:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118 2023-10-14T08:52:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118_vm 2023-10-14T08:52:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3119 2023-10-14T08:52:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3164 2023-10-14T08:52:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256 2023-10-14T08:52:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256_vm 2023-10-14T08:52:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3257 2023-10-14T08:52:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3258 2023-10-14T08:52:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350 2023-10-14T08:52:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350_vm 2023-10-14T08:52:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3351 2023-10-14T08:52:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3379 2023-10-14T08:52:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3380 2023-10-14T08:52:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381 2023-10-14T08:52:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381_vm 2023-10-14T08:52:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3394 2023-10-14T08:52:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3394_fsm 2023-10-14T08:52:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3394_vm 2023-10-14T08:52:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3395 2023-10-14T08:52:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439 2023-10-14T08:52:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439_vm 2023-10-14T08:52:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3440 2023-10-14T08:52:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 3455 2023-10-14T08:52:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3456 2023-10-14T08:52:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3456_fsm 2023-10-14T08:52:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3456_vm 2023-10-14T08:52:53.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466 2023-10-14T08:52:53.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466_vm 2023-10-14T08:52:53.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3467 2023-10-14T08:52:53.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3468 2023-10-14T08:52:53.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501 2023-10-14T08:52:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501_vm 2023-10-14T08:52:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3502 2023-10-14T08:52:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3503 2023-10-14T08:52:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3534 2023-10-14T08:52:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541 2023-10-14T08:52:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3541_fsm 2023-10-14T08:52:53.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541_vm 2023-10-14T08:52:53.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3542 2023-10-14T08:52:53.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3574 2023-10-14T08:52:53.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3575 2023-10-14T08:52:53.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576 2023-10-14T08:52:53.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576_vm 2023-10-14T08:52:53.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596 2023-10-14T08:52:53.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596_vm 2023-10-14T08:52:53.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3597 2023-10-14T08:52:53.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598 2023-10-14T08:52:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598_vm 2023-10-14T08:52:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3599 2023-10-14T08:52:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600 2023-10-14T08:52:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3600_fsm 2023-10-14T08:52:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600_vm 2023-10-14T08:52:53.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601 2023-10-14T08:52:53.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3601_fsm 2023-10-14T08:52:53.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601_vm 2023-10-14T08:52:53.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602 2023-10-14T08:52:53.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3602_fsm 2023-10-14T08:52:53.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602_vm 2023-10-14T08:52:53.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3603 2023-10-14T08:52:53.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3603_fsm 2023-10-14T08:52:53.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3603_vm 2023-10-14T08:52:53.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3604 2023-10-14T08:52:53.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3605 2023-10-14T08:52:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3606 2023-10-14T08:52:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3607 2023-10-14T08:52:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3608 2023-10-14T08:52:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 3609 2023-10-14T08:52:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3712 2023-10-14T08:52:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764 2023-10-14T08:52:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3764_fsm 2023-10-14T08:52:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764_vm 2023-10-14T08:52:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3766 2023-10-14T08:52:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3767 2023-10-14T08:52:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3997 2023-10-14T08:52:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 5002 2023-10-14T08:52:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 548 2023-10-14T08:52:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 549 2023-10-14T08:52:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102 2023-10-14T08:52:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102_vm 2023-10-14T08:52:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104 2023-10-14T08:52:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104_vm 2023-10-14T08:52:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106 2023-10-14T08:52:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106_vm 2023-10-14T08:52:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6110 2023-10-14T08:52:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6111 2023-10-14T08:52:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6112 2023-10-14T08:52:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6113 2023-10-14T08:52:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6117 2023-10-14T08:52:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826 2023-10-14T08:52:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826_vm 2023-10-14T08:52:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 827 2023-10-14T08:52:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 828 2023-10-14T08:52:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T08:52:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T08:52:53.512 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-14T08:52:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:total 7193 2023-10-14T08:52:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 . 2023-10-14T08:52:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 .. 2023-10-14T08:52:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 112 2023-10-14T08:52:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 113 2023-10-14T08:52:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 14 08:52 12182 2023-10-14T08:52:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12182_fsm 2023-10-14T08:52:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12182_vm 2023-10-14T08:52:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12184 2023-10-14T08:52:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12186 2023-10-14T08:52:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187 2023-10-14T08:52:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12187_fsm 2023-10-14T08:52:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187_vm 2023-10-14T08:52:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12189 2023-10-14T08:52:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12191 2023-10-14T08:52:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192 2023-10-14T08:52:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12192_fsm 2023-10-14T08:52:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192_vm 2023-10-14T08:52:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12194 2023-10-14T08:52:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12196 2023-10-14T08:52:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197 2023-10-14T08:52:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12197_fsm 2023-10-14T08:52:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197_vm 2023-10-14T08:52:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12199 2023-10-14T08:52:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12201 2023-10-14T08:52:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202 2023-10-14T08:52:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12202_fsm 2023-10-14T08:52:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202_vm 2023-10-14T08:52:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12204 2023-10-14T08:52:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12206 2023-10-14T08:52:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207 2023-10-14T08:52:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12207_fsm 2023-10-14T08:52:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207_vm 2023-10-14T08:52:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12209 2023-10-14T08:52:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12211 2023-10-14T08:52:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12212 2023-10-14T08:52:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12214 2023-10-14T08:52:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12216 2023-10-14T08:52:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 14 08:52 1247 2023-10-14T08:52:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1247_fsm 2023-10-14T08:52:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1247_vm 2023-10-14T08:52:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 14 08:52 1249 2023-10-14T08:52:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1249_fsm 2023-10-14T08:52:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1249_vm 2023-10-14T08:52:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 14 08:52 1255 2023-10-14T08:52:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1255_fsm 2023-10-14T08:52:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1255_vm 2023-10-14T08:52:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 08:52 1259 2023-10-14T08:52:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1259_fsm 2023-10-14T08:52:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1259_vm 2023-10-14T08:52:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417 2023-10-14T08:52:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417_vm 2023-10-14T08:52:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418 2023-10-14T08:52:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418_vm 2023-10-14T08:52:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 174 2023-10-14T08:52:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 175 2023-10-14T08:52:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2187 2023-10-14T08:52:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224 2023-10-14T08:52:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224_vm 2023-10-14T08:52:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328 2023-10-14T08:52:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328_vm 2023-10-14T08:52:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336 2023-10-14T08:52:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336_vm 2023-10-14T08:52:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2337 2023-10-14T08:52:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2600 2023-10-14T08:52:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2600_fsm 2023-10-14T08:52:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2600_vm 2023-10-14T08:52:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601 2023-10-14T08:52:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2601_fsm 2023-10-14T08:52:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601_vm 2023-10-14T08:52:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2602 2023-10-14T08:52:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2602_fsm 2023-10-14T08:52:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2602_vm 2023-10-14T08:52:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2603 2023-10-14T08:52:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2603_fsm 2023-10-14T08:52:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2603_vm 2023-10-14T08:52:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604 2023-10-14T08:52:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604_vm 2023-10-14T08:52:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2605 2023-10-14T08:52:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2605_fsm 2023-10-14T08:52:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2605_vm 2023-10-14T08:52:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606 2023-10-14T08:52:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2606_fsm 2023-10-14T08:52:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606_vm 2023-10-14T08:52:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607 2023-10-14T08:52:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607_fsm 2023-10-14T08:52:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2607_vm 2023-10-14T08:52:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 14 08:52 2608 2023-10-14T08:52:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2608_fsm 2023-10-14T08:52:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2608_vm 2023-10-14T08:52:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 14 08:52 2609 2023-10-14T08:52:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2609_fsm 2023-10-14T08:52:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2609_vm 2023-10-14T08:52:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610 2023-10-14T08:52:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610_fsm 2023-10-14T08:52:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2610_vm 2023-10-14T08:52:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611 2023-10-14T08:52:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611_vm 2023-10-14T08:52:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612 2023-10-14T08:52:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2612_fsm 2023-10-14T08:52:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612_vm 2023-10-14T08:52:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613 2023-10-14T08:52:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613_vm 2023-10-14T08:52:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615 2023-10-14T08:52:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2615_fsm 2023-10-14T08:52:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615_vm 2023-10-14T08:52:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616 2023-10-14T08:52:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616_fsm 2023-10-14T08:52:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2616_vm 2023-10-14T08:52:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 14 08:52 2617 2023-10-14T08:52:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2617_fsm 2023-10-14T08:52:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2617_vm 2023-10-14T08:52:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 14 08:52 2618 2023-10-14T08:52:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2618_fsm 2023-10-14T08:52:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2618_vm 2023-10-14T08:52:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 14 08:52 2619 2023-10-14T08:52:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2619_fsm 2023-10-14T08:52:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2619_vm 2023-10-14T08:52:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620 2023-10-14T08:52:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620_vm 2023-10-14T08:52:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2650 2023-10-14T08:52:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2651 2023-10-14T08:52:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2652 2023-10-14T08:52:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2653 2023-10-14T08:52:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2654 2023-10-14T08:52:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2655 2023-10-14T08:52:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2656 2023-10-14T08:52:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2657 2023-10-14T08:52:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 14 08:52 2658 2023-10-14T08:52:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2659 2023-10-14T08:52:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2660 2023-10-14T08:52:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2661 2023-10-14T08:52:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2662 2023-10-14T08:52:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2663 2023-10-14T08:52:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2664 2023-10-14T08:52:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2665 2023-10-14T08:52:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2666 2023-10-14T08:52:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2667 2023-10-14T08:52:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2668 2023-10-14T08:52:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2669 2023-10-14T08:52:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2670 2023-10-14T08:52:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 14 08:52 2673 2023-10-14T08:52:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 14 08:52 2674 2023-10-14T08:52:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 14 08:52 2675 2023-10-14T08:52:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2678 2023-10-14T08:52:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2679 2023-10-14T08:52:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2680 2023-10-14T08:52:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2681 2023-10-14T08:52:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2682 2023-10-14T08:52:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2683 2023-10-14T08:52:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2684 2023-10-14T08:52:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2685 2023-10-14T08:52:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2686 2023-10-14T08:52:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2687 2023-10-14T08:52:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2688 2023-10-14T08:52:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2689 2023-10-14T08:52:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2690 2023-10-14T08:52:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 14 08:52 2691 2023-10-14T08:52:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2692 2023-10-14T08:52:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2693 2023-10-14T08:52:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2696 2023-10-14T08:52:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2699 2023-10-14T08:52:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2701 2023-10-14T08:52:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2702 2023-10-14T08:52:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2703 2023-10-14T08:52:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2704 2023-10-14T08:52:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2753 2023-10-14T08:52:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2753_fsm 2023-10-14T08:52:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2753_vm 2023-10-14T08:52:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2754 2023-10-14T08:52:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2755 2023-10-14T08:52:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2756 2023-10-14T08:52:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2757 2023-10-14T08:52:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830 2023-10-14T08:52:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830_vm 2023-10-14T08:52:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2831 2023-10-14T08:52:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832 2023-10-14T08:52:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832_vm 2023-10-14T08:52:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2833 2023-10-14T08:52:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834 2023-10-14T08:52:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834_vm 2023-10-14T08:52:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2835 2023-10-14T08:52:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836 2023-10-14T08:52:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836_vm 2023-10-14T08:52:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2837 2023-10-14T08:52:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 14 08:52 2838 2023-10-14T08:52:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2838_fsm 2023-10-14T08:52:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2838_vm 2023-10-14T08:52:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2839 2023-10-14T08:52:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840 2023-10-14T08:52:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840_fsm 2023-10-14T08:52:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2840_vm 2023-10-14T08:52:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2841 2023-10-14T08:52:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995 2023-10-14T08:52:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995_vm 2023-10-14T08:52:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2996 2023-10-14T08:52:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079 2023-10-14T08:52:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3079_fsm 2023-10-14T08:52:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079_vm 2023-10-14T08:52:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3080 2023-10-14T08:52:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3081 2023-10-14T08:52:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3085 2023-10-14T08:52:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118 2023-10-14T08:52:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118_vm 2023-10-14T08:52:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3119 2023-10-14T08:52:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3164 2023-10-14T08:52:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256 2023-10-14T08:52:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256_vm 2023-10-14T08:52:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3257 2023-10-14T08:52:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3258 2023-10-14T08:52:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350 2023-10-14T08:52:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350_vm 2023-10-14T08:52:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3351 2023-10-14T08:52:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3379 2023-10-14T08:52:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3380 2023-10-14T08:52:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381 2023-10-14T08:52:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381_vm 2023-10-14T08:52:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3394 2023-10-14T08:52:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3394_fsm 2023-10-14T08:52:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3394_vm 2023-10-14T08:52:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3395 2023-10-14T08:52:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439 2023-10-14T08:52:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439_vm 2023-10-14T08:52:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3440 2023-10-14T08:52:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 3455 2023-10-14T08:52:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3456 2023-10-14T08:52:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3456_fsm 2023-10-14T08:52:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3456_vm 2023-10-14T08:52:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466 2023-10-14T08:52:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466_vm 2023-10-14T08:52:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3467 2023-10-14T08:52:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3468 2023-10-14T08:52:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501 2023-10-14T08:52:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501_vm 2023-10-14T08:52:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3502 2023-10-14T08:52:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3503 2023-10-14T08:52:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3534 2023-10-14T08:52:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541 2023-10-14T08:52:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3541_fsm 2023-10-14T08:52:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541_vm 2023-10-14T08:52:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3542 2023-10-14T08:52:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3574 2023-10-14T08:52:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3575 2023-10-14T08:52:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576 2023-10-14T08:52:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576_vm 2023-10-14T08:52:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596 2023-10-14T08:52:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596_vm 2023-10-14T08:52:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3597 2023-10-14T08:52:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598 2023-10-14T08:52:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598_vm 2023-10-14T08:52:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3599 2023-10-14T08:52:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600 2023-10-14T08:52:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3600_fsm 2023-10-14T08:52:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600_vm 2023-10-14T08:52:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601 2023-10-14T08:52:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3601_fsm 2023-10-14T08:52:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601_vm 2023-10-14T08:52:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602 2023-10-14T08:52:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3602_fsm 2023-10-14T08:52:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602_vm 2023-10-14T08:52:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3603 2023-10-14T08:52:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3603_fsm 2023-10-14T08:52:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3603_vm 2023-10-14T08:52:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3604 2023-10-14T08:52:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3605 2023-10-14T08:52:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3606 2023-10-14T08:52:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3607 2023-10-14T08:52:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3608 2023-10-14T08:52:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 3609 2023-10-14T08:52:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3712 2023-10-14T08:52:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764 2023-10-14T08:52:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3764_fsm 2023-10-14T08:52:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764_vm 2023-10-14T08:52:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3766 2023-10-14T08:52:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3767 2023-10-14T08:52:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3997 2023-10-14T08:52:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 5002 2023-10-14T08:52:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 548 2023-10-14T08:52:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 549 2023-10-14T08:52:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102 2023-10-14T08:52:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102_vm 2023-10-14T08:52:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104 2023-10-14T08:52:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104_vm 2023-10-14T08:52:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106 2023-10-14T08:52:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106_vm 2023-10-14T08:52:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6110 2023-10-14T08:52:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6111 2023-10-14T08:52:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6112 2023-10-14T08:52:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6113 2023-10-14T08:52:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6117 2023-10-14T08:52:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826 2023-10-14T08:52:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826_vm 2023-10-14T08:52:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 827 2023-10-14T08:52:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 828 2023-10-14T08:52:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T08:52:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T08:52:53.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/global: 2023-10-14T08:52:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:total 553 2023-10-14T08:52:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Oct 14 08:52 . 2023-10-14T08:52:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1136 2023-10-14T08:52:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1136_fsm 2023-10-14T08:52:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1136_vm 2023-10-14T08:52:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 1137 2023-10-14T08:52:53.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1213 2023-10-14T08:52:53.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1213_fsm 2023-10-14T08:52:53.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1213_vm 2023-10-14T08:52:53.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1214 2023-10-14T08:52:53.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1214_fsm 2023-10-14T08:52:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1214_vm 2023-10-14T08:52:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 1232 2023-10-14T08:52:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 1233 2023-10-14T08:52:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1260 2023-10-14T08:52:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1260_fsm 2023-10-14T08:52:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1260_vm 2023-10-14T08:52:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1261 2023-10-14T08:52:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1261_fsm 2023-10-14T08:52:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1261_vm 2023-10-14T08:52:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1262 2023-10-14T08:52:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1262_fsm 2023-10-14T08:52:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1262_vm 2023-10-14T08:52:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2396 2023-10-14T08:52:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2396_fsm 2023-10-14T08:52:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2396_vm 2023-10-14T08:52:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2397 2023-10-14T08:52:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2671 2023-10-14T08:52:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2672 2023-10-14T08:52:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2676 2023-10-14T08:52:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2677 2023-10-14T08:52:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2694 2023-10-14T08:52:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2695 2023-10-14T08:52:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2697 2023-10-14T08:52:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2698 2023-10-14T08:52:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2846 2023-10-14T08:52:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2846_vm 2023-10-14T08:52:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2847 2023-10-14T08:52:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2964 2023-10-14T08:52:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2964_vm 2023-10-14T08:52:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2965 2023-10-14T08:52:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2966 2023-10-14T08:52:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2966_vm 2023-10-14T08:52:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2967 2023-10-14T08:52:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3592 2023-10-14T08:52:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3592_vm 2023-10-14T08:52:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3593 2023-10-14T08:52:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 4060 2023-10-14T08:52:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 4060_vm 2023-10-14T08:52:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 4061 2023-10-14T08:52:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6000 2023-10-14T08:52:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6000_vm 2023-10-14T08:52:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6001 2023-10-14T08:52:53.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6002 2023-10-14T08:52:53.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6100 2023-10-14T08:52:53.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6100_vm 2023-10-14T08:52:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6114 2023-10-14T08:52:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6115 2023-10-14T08:52:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 pg_control 2023-10-14T08:52:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T08:52:53.582 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.583 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/log: 2023-10-14T08:52:53.583 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.583 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.583 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-14T08:52:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.584 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.585 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-14T08:52:53.585 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.585 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.585 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.585 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.586 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-14T08:52:53.586 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2023-10-14T08:52:53.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 . 2023-10-14T08:52:53.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 mappings 2023-10-14T08:52:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 14 08:52 replorigin_checkpoint 2023-10-14T08:52:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 snapshots 2023-10-14T08:52:53.587 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-14T08:52:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 .. 2023-10-14T08:52:53.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-14T08:52:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 .. 2023-10-14T08:52:53.589 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-14T08:52:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 . 2023-10-14T08:52:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 members 2023-10-14T08:52:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 offsets 2023-10-14T08:52:53.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-14T08:52:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T08:52:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 .. 2023-10-14T08:52:53.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T08:52:53.592 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.592 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-14T08:52:53.592 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T08:52:53.592 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 .. 2023-10-14T08:52:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T08:52:53.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-14T08:52:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T08:52:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T08:52:53.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-14T08:52:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.595 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-14T08:52:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.596 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-14T08:52:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-14T08:52:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-14T08:52:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-14T08:52:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T08:52:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T08:52:53.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-14T08:52:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.602 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-14T08:52:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-14T08:52:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:total 16384 2023-10-14T08:52:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 . 2023-10-14T08:52:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 08:52 000000010000000000000001 2023-10-14T08:52:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 archive_status 2023-10-14T08:52:53.604 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-14T08:52:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T08:52:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T08:52:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 .. 2023-10-14T08:52:53.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:52:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-14T08:52:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T08:52:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T08:52:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Oct 14 08:52 .. 2023-10-14T08:52:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T08:52:53.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-10-14T08:52:53.608 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:53 smithi006 ceph-mon[99452]: pgmap v308: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-14T08:52:53.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:53 smithi178 ceph-mon[103612]: pgmap v308: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-14T08:52:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:53 smithi057 ceph-mon[103313]: pgmap v308: 97 pgs: 97 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-14T08:52:53.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2023-10-14T08:52:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-10-14T08:52:53.807 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-10-14T08:52:53.810 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-10-14T08:52:53.815 INFO:teuthology.orchestra.run.smithi006.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-10-14T08:52:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:creating tables... 2023-10-14T08:52:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.97 s) 2023-10-14T08:52:54.080 INFO:teuthology.orchestra.run.smithi006.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.24 s, remaining 3.67 s) 2023-10-14T08:52:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.35 s, remaining 3.38 s) 2023-10-14T08:52:54.355 INFO:teuthology.orchestra.run.smithi006.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.52 s, remaining 3.64 s) 2023-10-14T08:52:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.71 s, remaining 3.84 s) 2023-10-14T08:52:54.646 INFO:teuthology.orchestra.run.smithi006.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.81 s, remaining 3.52 s) 2023-10-14T08:52:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.01 s, remaining 3.62 s) 2023-10-14T08:52:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.21 s, remaining 3.64 s) 2023-10-14T08:52:55.148 INFO:teuthology.orchestra.run.smithi006.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.31 s, remaining 3.36 s) 2023-10-14T08:52:55.314 INFO:teuthology.orchestra.run.smithi006.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.48 s, remaining 3.25 s) 2023-10-14T08:52:55.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:55 smithi006 ceph-mon[99452]: pgmap v309: 97 pgs: 97 active+clean; 1.4 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 69 KiB/s wr, 13 op/s 2023-10-14T08:52:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.67 s, remaining 3.18 s) 2023-10-14T08:52:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.77 s, remaining 2.95 s) 2023-10-14T08:52:55.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:55 smithi178 ceph-mon[103612]: pgmap v309: 97 pgs: 97 active+clean; 1.4 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 69 KiB/s wr, 13 op/s 2023-10-14T08:52:55.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:55 smithi057 ceph-mon[103313]: pgmap v309: 97 pgs: 97 active+clean; 1.4 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 69 KiB/s wr, 13 op/s 2023-10-14T08:52:55.775 INFO:teuthology.orchestra.run.smithi006.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.94 s, remaining 2.84 s) 2023-10-14T08:52:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:1400000 of 3200000 tuples (43%) done (elapsed 2.13 s, remaining 2.74 s) 2023-10-14T08:52:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:1500000 of 3200000 tuples (46%) done (elapsed 2.24 s, remaining 2.53 s) 2023-10-14T08:52:56.256 INFO:teuthology.orchestra.run.smithi006.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.42 s, remaining 2.42 s) 2023-10-14T08:52:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.61 s, remaining 2.30 s) 2023-10-14T08:52:56.510 INFO:teuthology.orchestra.run.smithi006.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.67 s, remaining 2.08 s) 2023-10-14T08:52:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.91 s, remaining 1.99 s) 2023-10-14T08:52:56.926 INFO:teuthology.orchestra.run.smithi006.stderr:2000000 of 3200000 tuples (62%) done (elapsed 3.09 s, remaining 1.85 s) 2023-10-14T08:52:56.990 INFO:teuthology.orchestra.run.smithi006.stderr:2100000 of 3200000 tuples (65%) done (elapsed 3.16 s, remaining 1.65 s) 2023-10-14T08:52:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2200000 of 3200000 tuples (68%) done (elapsed 3.37 s, remaining 1.53 s) 2023-10-14T08:52:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2300000 of 3200000 tuples (71%) done (elapsed 3.43 s, remaining 1.34 s) 2023-10-14T08:52:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.63 s, remaining 1.21 s) 2023-10-14T08:52:57.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:57 smithi006 ceph-mon[99452]: pgmap v310: 97 pgs: 97 active+clean; 67 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.1 MiB/s wr, 48 op/s 2023-10-14T08:52:57.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:57 smithi178 ceph-mon[103612]: pgmap v310: 97 pgs: 97 active+clean; 67 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.1 MiB/s wr, 48 op/s 2023-10-14T08:52:57.663 INFO:teuthology.orchestra.run.smithi006.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.83 s, remaining 1.07 s) 2023-10-14T08:52:57.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:57 smithi057 ceph-mon[103313]: pgmap v310: 97 pgs: 97 active+clean; 67 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.1 MiB/s wr, 48 op/s 2023-10-14T08:52:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.90 s, remaining 0.90 s) 2023-10-14T08:52:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2700000 of 3200000 tuples (84%) done (elapsed 4.08 s, remaining 0.76 s) 2023-10-14T08:52:58.128 INFO:teuthology.orchestra.run.smithi006.stderr:2800000 of 3200000 tuples (87%) done (elapsed 4.29 s, remaining 0.61 s) 2023-10-14T08:52:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2900000 of 3200000 tuples (90%) done (elapsed 4.36 s, remaining 0.45 s) 2023-10-14T08:52:58.367 INFO:teuthology.orchestra.run.smithi006.stderr:3000000 of 3200000 tuples (93%) done (elapsed 4.53 s, remaining 0.30 s) 2023-10-14T08:52:58.466 INFO:teuthology.orchestra.run.smithi006.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.63 s, remaining 0.15 s) 2023-10-14T08:52:58.619 INFO:teuthology.orchestra.run.smithi006.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.78 s, remaining 0.00 s) 2023-10-14T08:52:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:vacuum... 2023-10-14T08:52:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:set primary keys... 2023-10-14T08:52:59.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:52:59 smithi006 ceph-mon[99452]: pgmap v311: 97 pgs: 97 active+clean; 150 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 21 MiB/s wr, 160 op/s 2023-10-14T08:52:59.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:52:59 smithi178 ceph-mon[103612]: pgmap v311: 97 pgs: 97 active+clean; 150 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 21 MiB/s wr, 160 op/s 2023-10-14T08:52:59.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:52:59 smithi057 ceph-mon[103313]: pgmap v311: 97 pgs: 97 active+clean; 150 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 21 MiB/s wr, 160 op/s 2023-10-14T08:53:00.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:00 smithi006 ceph-mon[99452]: scrub summary: idle 2023-10-14T08:53:00.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:00 smithi178 ceph-mon[103612]: scrub summary: idle 2023-10-14T08:53:00.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:00 smithi057 ceph-mon[103313]: scrub summary: idle 2023-10-14T08:53:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/2402645735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84100eb0 msgr2=0x7f9b841012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/2402645735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84100eb0 0x7f9b841012d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009990 tx=0x7f9b80009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/2402645735 shutdown_connections 2023-10-14T08:53:00.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/2402645735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84102a50 0x7f9b84109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/2402645735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84100eb0 0x7f9b841012d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/2402645735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b84102090 0x7f9b84102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/2402645735 >> 172.21.15.6:0/2402645735 conn(0x7f9b840fc470 msgr2=0x7f9b840fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/2402645735 shutdown_connections 2023-10-14T08:53:00.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.750+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/2402645735 wait complete. 2023-10-14T08:53:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 Processor -- start 2023-10-14T08:53:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 -- start start 2023-10-14T08:53:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84100eb0 0x7f9b84196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 0x7f9b841971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b84102a50 0x7f9b8419e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8419e7c0 con 0x7f9b84102090 2023-10-14T08:53:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8419e930 con 0x7f9b84102a50 2023-10-14T08:53:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8b7ef700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8419eaf0 con 0x7f9b84100eb0 2023-10-14T08:53:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 0x7f9b841971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 0x7f9b841971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33008/0 (socket says 172.21.15.6:33008) 2023-10-14T08:53:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b88d8a700 1 -- 172.21.15.6:0/1487725418 learned_addr learned my addr 172.21.15.6:0/1487725418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b8958b700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84100eb0 0x7f9b84196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.751+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b84102a50 0x7f9b8419e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b88d8a700 1 -- 172.21.15.6:0/1487725418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84100eb0 msgr2=0x7f9b84196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84100eb0 0x7f9b84196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b88d8a700 1 -- 172.21.15.6:0/1487725418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b84102a50 msgr2=0x7f9b8419e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b84102a50 0x7f9b8419e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b88d8a700 1 -- 172.21.15.6:0/1487725418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800095f0 con 0x7f9b84102090 2023-10-14T08:53:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b8958b700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84100eb0 0x7f9b84196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 0x7f9b841971c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400e970 tx=0x7f9b7400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b7a7fc700 1 -- 172.21.15.6:0/1487725418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74009790 con 0x7f9b84102090 2023-10-14T08:53:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b84073140 con 0x7f9b84102090 2023-10-14T08:53:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b7a7fc700 1 -- 172.21.15.6:0/1487725418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b7400c7e0 con 0x7f9b84102090 2023-10-14T08:53:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b7a7fc700 1 -- 172.21.15.6:0/1487725418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74003c70 con 0x7f9b84102090 2023-10-14T08:53:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.752+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840736d0 con 0x7f9b84102090 2023-10-14T08:53:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.754+0000 7f9b7a7fc700 1 -- 172.21.15.6:0/1487725418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9b7400cc50 con 0x7f9b84102090 2023-10-14T08:53:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.755+0000 7f9b7a7fc700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9b700a1480 0x7f9b700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.755+0000 7f9b7a7fc700 1 -- 172.21.15.6:0/1487725418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9b74014070 con 0x7f9b84102090 2023-10-14T08:53:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.755+0000 7f9b8958b700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9b700a1480 0x7f9b700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b8958b700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9b700a1480 0x7f9b700a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000c00 tx=0x7f9b80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 Processor -- start 2023-10-14T08:53:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 -- start start 2023-10-14T08:53:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b82ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8300ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8301520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8274c10 con 0x5587b83001b0 2023-10-14T08:53:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8259c00 con 0x5587b83010a0 2023-10-14T08:53:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8257520 con 0x5587b82ff850 2023-10-14T08:53:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8300ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b89d8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8301520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b8958b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b82ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8300ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33016/0 (socket says 172.21.15.6:33016) 2023-10-14T08:53:00.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.756+0000 7f9b88d8a700 1 -- 172.21.15.6:0/331105644 learned_addr learned my addr 172.21.15.6:0/331105644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b88d8a700 1 -- 172.21.15.6:0/331105644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 msgr2=0x5587b82ffc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b82ffc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b88d8a700 1 -- 172.21.15.6:0/331105644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 msgr2=0x5587b8301520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8301520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b88d8a700 1 -- 172.21.15.6:0/331105644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b8210390 con 0x5587b83001b0 2023-10-14T08:53:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b8958b700 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b82ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8300ac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9b74096c80 tx=0x7f9b74003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4cbfd85e5cf671 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b6f7fe700 1 -- 172.21.15.6:0/331105644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7409e170 con 0x5587b83001b0 2023-10-14T08:53:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b6f7fe700 1 -- 172.21.15.6:0/331105644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b740b2030 con 0x5587b83001b0 2023-10-14T08:53:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.757+0000 7f9b6f7fe700 1 -- 172.21.15.6:0/331105644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7409a470 con 0x5587b83001b0 2023-10-14T08:53:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 -- 172.21.15.6:0/331105644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 msgr2=0x5587b8300ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8300ac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9b74096c80 tx=0x7f9b74003680 comp rx=0 tx=0).stop 2023-10-14T08:53:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 -- 172.21.15.6:0/331105644 shutdown_connections 2023-10-14T08:53:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8301520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b82ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/331105644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8300ac0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 -- 172.21.15.6:0/331105644 >> 172.21.15.6:0/331105644 conn(0x5587b822dd70 msgr2=0x5587b82fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 -- 172.21.15.6:0/331105644 shutdown_connections 2023-10-14T08:53:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 -- 172.21.15.6:0/331105644 wait complete. 2023-10-14T08:53:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 -- start start 2023-10-14T08:53:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.758+0000 7f9b979d9b80 1 Processor -- start 2023-10-14T08:53:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b8309870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8309db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8310df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8252e10 con 0x5587b83001b0 2023-10-14T08:53:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b81ef6b0 con 0x5587b83010a0 2023-10-14T08:53:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b81ef350 con 0x5587b82ff850 2023-10-14T08:53:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b979d9b80 10 client.0 _ll_register_callbacks cb 0x5587b804c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8309db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8310df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8309db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33022/0 (socket says 172.21.15.6:33022) 2023-10-14T08:53:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b88d8a700 1 -- 172.21.15.6:0/556543480 learned_addr learned my addr 172.21.15.6:0/556543480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b8958b700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b8309870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 -- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 msgr2=0x5587b8309870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b8309870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 -- 172.21.15.6:0/556543480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 msgr2=0x5587b8309db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8309db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 -- 172.21.15.6:0/556543480 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b84109ca0 con 0x5587b83010a0 2023-10-14T08:53:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b8958b700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b8309870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8309db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:00.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8310df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5587b8300880 tx=0x7f9b7c015490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d176ae9c495e1d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.759+0000 7f9b6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b6cff9700 1 -- 172.21.15.6:0/556543480 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c014040 con 0x5587b83010a0 2023-10-14T08:53:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587b8257e90 con 0x5587b83010a0 2023-10-14T08:53:00.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b6cff9700 1 -- 172.21.15.6:0/556543480 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9b7c006e40 con 0x5587b83010a0 2023-10-14T08:53:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b6cff9700 1 -- 172.21.15.6:0/556543480 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b7c00ee70 con 0x5587b83010a0 2023-10-14T08:53:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 10 client.25076 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f9b840736d0 con 0x5587b83010a0 2023-10-14T08:53:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b6cff9700 1 -- 172.21.15.6:0/556543480 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5587b8257e90 con 0x5587b83010a0 2023-10-14T08:53:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b6cff9700 1 -- 172.21.15.6:0/556543480 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9b7c022440 con 0x5587b83010a0 2023-10-14T08:53:00.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 10 client.25076 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 10 client.25076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 20 client.25076 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8315770 0x5587b8317b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 4 client.25076 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:00.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.760+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587b82cfbb0 con 0x5587b8315770 2023-10-14T08:53:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.761+0000 7f9b8958b700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8315770 0x5587b8317b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.761+0000 7f9b8958b700 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8315770 0x5587b8317b90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27058b5b1dec91e server_cookie=79e45cab97705159 in_seq=0 out_seq=0 2023-10-14T08:53:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.761+0000 7f9b6cff9700 10 client.25076 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b6cff9700 1 -- 172.21.15.6:0/556543480 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5587b82cfbb0 con 0x5587b8315770 2023-10-14T08:53:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b6cff9700 10 client.25076 handle_command_reply: tid=0 2023-10-14T08:53:00.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 client.25076 shutdown 2023-10-14T08:53:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 msgr2=0x5587b8310df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8310df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5587b8300880 tx=0x7f9b7c015490 comp rx=0 tx=0).stop 2023-10-14T08:53:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 shutdown_connections 2023-10-14T08:53:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8315770 0x5587b8317b90 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b8310df0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b82ff850 0x5587b8309870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/556543480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b8309db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b6cff9700 0 client.25076 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 >> 172.21.15.6:0/556543480 conn(0x5587b822dd70 msgr2=0x5587b82fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:00.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 shutdown_connections 2023-10-14T08:53:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 1 -- 172.21.15.6:0/556543480 wait complete. 2023-10-14T08:53:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.762+0000 7f9b979d9b80 20 client.25076 trim_cache size 0 max 16384 2023-10-14T08:53:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 Processor -- start 2023-10-14T08:53:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 -- start start 2023-10-14T08:53:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 0x5587b83083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83001b0 0x5587b8310db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b83115c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b80d38c0 con 0x5587b82ff850 2023-10-14T08:53:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b82fb770 con 0x5587b83010a0 2023-10-14T08:53:00.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.777+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8312ae0 con 0x5587b83001b0 2023-10-14T08:53:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b8958b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 0x5587b83083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b83115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b8958b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 0x5587b83083d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33028/0 (socket says 172.21.15.6:33028) 2023-10-14T08:53:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b8958b700 1 -- 172.21.15.6:0/2596922970 learned_addr learned my addr 172.21.15.6:0/2596922970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83001b0 0x5587b8310db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 -- 172.21.15.6:0/2596922970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83001b0 msgr2=0x5587b8310db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83001b0 0x5587b8310db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 -- 172.21.15.6:0/2596922970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 msgr2=0x5587b83083d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 0x5587b83083d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 -- 172.21.15.6:0/2596922970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587b807dd80 con 0x5587b83010a0 2023-10-14T08:53:00.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b8958b700 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 0x5587b83083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b89d8c700 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b83115c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000f80 tx=0x7f9b7c015990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4151be8fb625cd94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b6ffff700 1 -- 172.21.15.6:0/2596922970 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c014070 con 0x5587b83010a0 2023-10-14T08:53:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b6ffff700 1 -- 172.21.15.6:0/2596922970 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b7c015040 con 0x5587b83010a0 2023-10-14T08:53:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.778+0000 7f9b6ffff700 1 -- 172.21.15.6:0/2596922970 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c01ab70 con 0x5587b83010a0 2023-10-14T08:53:00.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2596922970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 msgr2=0x5587b83115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b83115c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000f80 tx=0x7f9b7c015990 comp rx=0 tx=0).stop 2023-10-14T08:53:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2596922970 shutdown_connections 2023-10-14T08:53:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b83010a0 0x5587b83115c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b82ff850 0x5587b83083d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2596922970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83001b0 0x5587b8310db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2596922970 >> 172.21.15.6:0/2596922970 conn(0x5587b822dd70 msgr2=0x5587b82f9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2596922970 shutdown_connections 2023-10-14T08:53:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2596922970 wait complete. 2023-10-14T08:53:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 -- start start 2023-10-14T08:53:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.779+0000 7f9b979d9b80 1 Processor -- start 2023-10-14T08:53:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b82ff850 0x5587b830e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b830ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83010a0 0x5587b830fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8310260 con 0x5587b83001b0 2023-10-14T08:53:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b83103d0 con 0x5587b82ff850 2023-10-14T08:53:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587b8310590 con 0x5587b83010a0 2023-10-14T08:53:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b979d9b80 10 client.0 _ll_register_callbacks cb 0x7f9b7c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b830ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b830ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33036/0 (socket says 172.21.15.6:33036) 2023-10-14T08:53:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 -- 172.21.15.6:0/2423333895 learned_addr learned my addr 172.21.15.6:0/2423333895 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b8958b700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b82ff850 0x5587b830e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 -- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83010a0 msgr2=0x5587b830fd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83010a0 0x5587b830fd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 -- 172.21.15.6:0/2423333895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b82ff850 msgr2=0x5587b830e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b82ff850 0x5587b830e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b88d8a700 1 -- 172.21.15.6:0/2423333895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b80036ae0 con 0x5587b83001b0 2023-10-14T08:53:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.780+0000 7f9b8958b700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b82ff850 0x5587b830e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b88d8a700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b830ed10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9b74096c30 tx=0x7f9b7409aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60d12d2706c83fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b6cff9700 1 -- 172.21.15.6:0/2423333895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74065070 con 0x5587b83001b0 2023-10-14T08:53:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b6cff9700 1 -- 172.21.15.6:0/2423333895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9b740a25a0 con 0x5587b83001b0 2023-10-14T08:53:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b740b2030 con 0x5587b83001b0 2023-10-14T08:53:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b6cff9700 1 -- 172.21.15.6:0/2423333895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b7409e360 con 0x5587b83001b0 2023-10-14T08:53:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 10 client.15477 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f9b7c00ee70 con 0x5587b83001b0 2023-10-14T08:53:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b6cff9700 1 -- 172.21.15.6:0/2423333895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b740b2030 con 0x5587b83001b0 2023-10-14T08:53:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b6cff9700 1 -- 172.21.15.6:0/2423333895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9b740a2110 con 0x5587b83001b0 2023-10-14T08:53:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 20 client.15477 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8369e70 0x5587b836c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 4 client.15477 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:53:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.781+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5587b824bdf0 con 0x5587b8369e70 2023-10-14T08:53:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.782+0000 7f9b8958b700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8369e70 0x5587b836c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.782+0000 7f9b8958b700 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8369e70 0x5587b836c290 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e1abf6663af34d9 server_cookie=dd53a610482be5c9 in_seq=0 out_seq=0 2023-10-14T08:53:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.782+0000 7f9b6cff9700 10 client.15477 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:00.803 INFO:teuthology.orchestra.run.smithi006.stderr:done. 2023-10-14T08:53:00.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-10-14T08:53:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:starting vacuum...end. 2023-10-14T08:53:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b6cff9700 1 -- 172.21.15.6:0/2423333895 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5587b824bdf0 con 0x5587b8369e70 2023-10-14T08:53:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b6cff9700 10 client.15477 handle_command_reply: tid=0 2023-10-14T08:53:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 client.15477 shutdown 2023-10-14T08:53:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 msgr2=0x5587b830ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b830ed10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9b74096c30 tx=0x7f9b7409aa80 comp rx=0 tx=0).stop 2023-10-14T08:53:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 shutdown_connections 2023-10-14T08:53:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5587b8369e70 0x5587b836c290 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587b83010a0 0x5587b830fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5587b82ff850 0x5587b830e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 --2- 172.21.15.6:0/2423333895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587b83001b0 0x5587b830ed10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 >> 172.21.15.6:0/2423333895 conn(0x5587b822dd70 msgr2=0x5587b83115c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.978+0000 7f9b6cff9700 0 client.15477 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 shutdown_connections 2023-10-14T08:53:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b979d9b80 1 -- 172.21.15.6:0/2423333895 wait complete. 2023-10-14T08:53:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b979d9b80 20 client.15477 trim_cache size 0 max 16384 2023-10-14T08:53:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:53:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:53:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:53:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:53:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9b700a1480 msgr2=0x7f9b700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9b700a1480 0x7f9b700a3940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000c00 tx=0x7f9b80005fb0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 msgr2=0x7f9b841971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.980+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 0x7f9b841971c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400e970 tx=0x7f9b7400ec80 comp rx=0 tx=0).stop 2023-10-14T08:53:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 shutdown_connections 2023-10-14T08:53:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9b700a1480 0x7f9b700a3940 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000c00 tx=0x7f9b80005fb0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b84102a50 0x7f9b8419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b84100eb0 0x7f9b84196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 --2- 172.21.15.6:0/1487725418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b84102090 0x7f9b841971c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 >> 172.21.15.6:0/1487725418 conn(0x7f9b840fc470 msgr2=0x7f9b841055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 shutdown_connections 2023-10-14T08:53:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:00.981+0000 7f9b8b7ef700 1 -- 172.21.15.6:0/1487725418 wait complete. 2023-10-14T08:53:01.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:01 smithi006 ceph-mon[99452]: pgmap v312: 97 pgs: 97 active+clean; 198 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 29 MiB/s wr, 159 op/s 2023-10-14T08:53:01.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:01 smithi178 ceph-mon[103612]: pgmap v312: 97 pgs: 97 active+clean; 198 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 29 MiB/s wr, 159 op/s 2023-10-14T08:53:01.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:01 smithi057 ceph-mon[103313]: pgmap v312: 97 pgs: 97 active+clean; 198 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 29 MiB/s wr, 159 op/s 2023-10-14T08:53:03.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:03 smithi006 ceph-mon[99452]: pgmap v313: 97 pgs: 97 active+clean; 394 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 MiB/s wr, 219 op/s 2023-10-14T08:53:03.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:03 smithi178 ceph-mon[103612]: pgmap v313: 97 pgs: 97 active+clean; 394 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 MiB/s wr, 219 op/s 2023-10-14T08:53:03.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:03 smithi057 ceph-mon[103313]: pgmap v313: 97 pgs: 97 active+clean; 394 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 61 MiB/s wr, 219 op/s 2023-10-14T08:53:05.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:05 smithi006 ceph-mon[99452]: pgmap v314: 97 pgs: 97 active+clean; 445 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 66 MiB/s wr, 268 op/s 2023-10-14T08:53:05.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:05 smithi178 ceph-mon[103612]: pgmap v314: 97 pgs: 97 active+clean; 445 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 66 MiB/s wr, 268 op/s 2023-10-14T08:53:05.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:05 smithi057 ceph-mon[103313]: pgmap v314: 97 pgs: 97 active+clean; 445 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 66 MiB/s wr, 268 op/s 2023-10-14T08:53:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 5.0 s, 3655.8 tps, lat 26.831 ms stddev 32.033 2023-10-14T08:53:07.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:07 smithi178 ceph-mon[103612]: pgmap v315: 97 pgs: 97 active+clean; 813 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 88 MiB/s wr, 497 op/s 2023-10-14T08:53:07.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:07 smithi057 ceph-mon[103313]: pgmap v315: 97 pgs: 97 active+clean; 813 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 88 MiB/s wr, 497 op/s 2023-10-14T08:53:07.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:07 smithi006 ceph-mon[99452]: pgmap v315: 97 pgs: 97 active+clean; 813 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 88 MiB/s wr, 497 op/s 2023-10-14T08:53:09.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:09 smithi178 ceph-mon[103612]: pgmap v316: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 94 MiB/s wr, 641 op/s 2023-10-14T08:53:09.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:09 smithi057 ceph-mon[103313]: pgmap v316: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 94 MiB/s wr, 641 op/s 2023-10-14T08:53:09.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:09 smithi006 ceph-mon[99452]: pgmap v316: 97 pgs: 97 active+clean; 1.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 94 MiB/s wr, 641 op/s 2023-10-14T08:53:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 10.0 s, 3897.4 tps, lat 25.777 ms stddev 43.240 2023-10-14T08:53:11.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:11 smithi178 ceph-mon[103612]: pgmap v317: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 97 MiB/s wr, 699 op/s 2023-10-14T08:53:11.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:11 smithi057 ceph-mon[103313]: pgmap v317: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 97 MiB/s wr, 699 op/s 2023-10-14T08:53:11.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:11 smithi006 ceph-mon[99452]: pgmap v317: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 97 MiB/s wr, 699 op/s 2023-10-14T08:53:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:13 smithi178 ceph-mon[103612]: pgmap v318: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 121 MiB/s wr, 1.07k op/s 2023-10-14T08:53:13.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:13 smithi057 ceph-mon[103313]: pgmap v318: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 121 MiB/s wr, 1.07k op/s 2023-10-14T08:53:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:13 smithi006 ceph-mon[99452]: pgmap v318: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 121 MiB/s wr, 1.07k op/s 2023-10-14T08:53:14.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 -- 172.21.15.6:0/4294140060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2568101980 msgr2=0x7f2568108230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 --2- 172.21.15.6:0/4294140060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2568101980 0x7f2568108230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2560009fc0 tx=0x7f256000b330 comp rx=0 tx=0).stop 2023-10-14T08:53:14.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 -- 172.21.15.6:0/4294140060 shutdown_connections 2023-10-14T08:53:14.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 --2- 172.21.15.6:0/4294140060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2568101980 0x7f2568108230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 --2- 172.21.15.6:0/4294140060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25680ffdf0 0x7f2568100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 --2- 172.21.15.6:0/4294140060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2568100fe0 0x7f2568101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.160+0000 7f256e9cc700 1 -- 172.21.15.6:0/4294140060 >> 172.21.15.6:0/4294140060 conn(0x7f25680fb340 msgr2=0x7f25680fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.162+0000 7f256e9cc700 1 -- 172.21.15.6:0/4294140060 shutdown_connections 2023-10-14T08:53:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.162+0000 7f256e9cc700 1 -- 172.21.15.6:0/4294140060 wait complete. 2023-10-14T08:53:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 Processor -- start 2023-10-14T08:53:14.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 -- start start 2023-10-14T08:53:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 0x7f25681949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2568100fe0 0x7f2568194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2568101980 0x7f256819bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256819c540 con 0x7f2568101980 2023-10-14T08:53:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256819c680 con 0x7f25680ffdf0 2023-10-14T08:53:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.163+0000 7f256e9cc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256819c810 con 0x7f2568100fe0 2023-10-14T08:53:14.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 0x7f25681949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 0x7f25681949c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60038/0 (socket says 172.21.15.6:60038) 2023-10-14T08:53:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 -- 172.21.15.6:0/833827499 learned_addr learned my addr 172.21.15.6:0/833827499 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f25677fe700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2568100fe0 0x7f2568194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 -- 172.21.15.6:0/833827499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2568100fe0 msgr2=0x7f2568194f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2568100fe0 0x7f2568194f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 -- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2568101980 msgr2=0x7f256819bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2568101980 0x7f256819bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 -- 172.21.15.6:0/833827499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009c40 con 0x7f25680ffdf0 2023-10-14T08:53:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.164+0000 7f2567fff700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 0x7f25681949c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f255800e9f0 tx=0x7f255800edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.165+0000 7f25657fa700 1 -- 172.21.15.6:0/833827499 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255800cbd0 con 0x7f25680ffdf0 2023-10-14T08:53:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.165+0000 7f25657fa700 1 -- 172.21.15.6:0/833827499 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25580044e0 con 0x7f25680ffdf0 2023-10-14T08:53:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.165+0000 7f25657fa700 1 -- 172.21.15.6:0/833827499 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558003d80 con 0x7f25680ffdf0 2023-10-14T08:53:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.165+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25681a5300 con 0x7f25680ffdf0 2023-10-14T08:53:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.165+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681a5840 con 0x7f25680ffdf0 2023-10-14T08:53:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.169+0000 7f25657fa700 1 -- 172.21.15.6:0/833827499 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2558003ee0 con 0x7f25680ffdf0 2023-10-14T08:53:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.169+0000 7f25657fa700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25500a1530 0x7f25500a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f25657fa700 1 -- 172.21.15.6:0/833827499 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2558014070 con 0x7f25680ffdf0 2023-10-14T08:53:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 Processor -- start 2023-10-14T08:53:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f25677fe700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25500a1530 0x7f25500a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 -- start start 2023-10-14T08:53:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19ebc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19ed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e1960c10 con 0x55f3e19ec1b0 2023-10-14T08:53:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e1945c00 con 0x55f3e19ed0a0 2023-10-14T08:53:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.170+0000 7f257abb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e1943520 con 0x55f3e19eb850 2023-10-14T08:53:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60048/0 (socket says 172.21.15.6:60048) 2023-10-14T08:53:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 -- 172.21.15.6:0/4252442917 learned_addr learned my addr 172.21.15.6:0/4252442917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f25677fe700 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 -- 172.21.15.6:0/4252442917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 msgr2=0x55f3e19ebc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19ebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 -- 172.21.15.6:0/4252442917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 msgr2=0x55f3e19ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 -- 172.21.15.6:0/4252442917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3e18fc390 con 0x55f3e19ed0a0 2023-10-14T08:53:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f25677fe700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25500a1530 0x7f25500a39f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f255c006fd0 tx=0x7f255c009d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.171+0000 7f256cf69700 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19ed520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2560009ba0 tx=0x7f2560009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699a9c0f248e7de7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.172+0000 7f254e7fc700 1 -- 172.21.15.6:0/4252442917 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560021070 con 0x55f3e19ed0a0 2023-10-14T08:53:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.172+0000 7f254e7fc700 1 -- 172.21.15.6:0/4252442917 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2560008e50 con 0x55f3e19ed0a0 2023-10-14T08:53:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.172+0000 7f254e7fc700 1 -- 172.21.15.6:0/4252442917 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e040 con 0x55f3e19ed0a0 2023-10-14T08:53:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.172+0000 7f257abb6b80 1 -- 172.21.15.6:0/4252442917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 msgr2=0x55f3e19ed520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19ed520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2560009ba0 tx=0x7f2560009bd0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 -- 172.21.15.6:0/4252442917 shutdown_connections 2023-10-14T08:53:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19ed520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19ebc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 --2- 172.21.15.6:0/4252442917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 -- 172.21.15.6:0/4252442917 >> 172.21.15.6:0/4252442917 conn(0x55f3e1919d70 msgr2=0x55f3e19e6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 -- 172.21.15.6:0/4252442917 shutdown_connections 2023-10-14T08:53:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 -- 172.21.15.6:0/4252442917 wait complete. 2023-10-14T08:53:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 -- start start 2023-10-14T08:53:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.173+0000 7f257abb6b80 1 Processor -- start 2023-10-14T08:53:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19f5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e193ee10 con 0x55f3e19ec1b0 2023-10-14T08:53:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e18db6b0 con 0x55f3e19ed0a0 2023-10-14T08:53:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e18db350 con 0x55f3e19eb850 2023-10-14T08:53:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f257abb6b80 10 client.0 _ll_register_callbacks cb 0x55f3e17387a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f256cf69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f256cf69700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60054/0 (socket says 172.21.15.6:60054) 2023-10-14T08:53:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f256cf69700 1 -- 172.21.15.6:0/3495927178 learned_addr learned my addr 172.21.15.6:0/3495927178 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f25677fe700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.174+0000 7f2567fff700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.175+0000 7f25677fe700 1 -- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 msgr2=0x55f3e19f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:14.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.175+0000 7f25677fe700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.175+0000 7f25677fe700 1 -- 172.21.15.6:0/3495927178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 msgr2=0x55f3e19fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:14.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.175+0000 7f25677fe700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.175+0000 7f25677fe700 1 -- 172.21.15.6:0/3495927178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2568069350 con 0x55f3e19ec1b0 2023-10-14T08:53:14.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.175+0000 7f256cf69700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:14.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.176+0000 7f25677fe700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19f5c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f255c027480 tx=0x7f255c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b580a9b3ce0af166 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:14.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.176+0000 7f25477fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:14.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.176+0000 7f25477fe700 1 -- 172.21.15.6:0/3495927178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c031450 con 0x55f3e19ec1b0 2023-10-14T08:53:14.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.176+0000 7f25477fe700 1 -- 172.21.15.6:0/3495927178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f255c02d040 con 0x55f3e19ec1b0 2023-10-14T08:53:14.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.176+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3e1943e90 con 0x55f3e19ec1b0 2023-10-14T08:53:14.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.177+0000 7f25477fe700 1 -- 172.21.15.6:0/3495927178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f255c0315b0 con 0x55f3e19ec1b0 2023-10-14T08:53:14.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.177+0000 7f257abb6b80 10 client.15486 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:14.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f3e1769d80 con 0x55f3e19ec1b0 2023-10-14T08:53:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f25477fe700 1 -- 172.21.15.6:0/3495927178 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f255c040020 con 0x55f3e19ec1b0 2023-10-14T08:53:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f25477fe700 1 -- 172.21.15.6:0/3495927178 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f255c028820 con 0x55f3e19ec1b0 2023-10-14T08:53:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 10 client.15486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 20 client.15486 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a015d0 0x55f3e1a039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 4 client.15486 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.178+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3e19bbbb0 con 0x55f3e1a015d0 2023-10-14T08:53:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.179+0000 7f2567fff700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a015d0 0x55f3e1a039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.179+0000 7f25477fe700 10 client.15486 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.179+0000 7f2567fff700 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a015d0 0x55f3e1a039f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61fbb0f81e51bc70 server_cookie=80190f3dda0d2f37 in_seq=0 out_seq=0 2023-10-14T08:53:14.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.180+0000 7f25477fe700 1 -- 172.21.15.6:0/3495927178 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f3e19bbbb0 con 0x55f3e1a015d0 2023-10-14T08:53:14.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.180+0000 7f25477fe700 10 client.15486 handle_command_reply: tid=0 2023-10-14T08:53:14.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.180+0000 7f257abb6b80 1 client.15486 shutdown 2023-10-14T08:53:14.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.180+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 msgr2=0x55f3e19f5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.180+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19f5c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f255c027480 tx=0x7f255c004750 comp rx=0 tx=0).stop 2023-10-14T08:53:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 shutdown_connections 2023-10-14T08:53:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a015d0 0x55f3e1a039f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19eb850 0x55f3e19f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3495927178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ec1b0 0x55f3e19f5c90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 >> 172.21.15.6:0/3495927178 conn(0x55f3e1919d70 msgr2=0x55f3e19e6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f25477fe700 0 client.15486 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 shutdown_connections 2023-10-14T08:53:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 1 -- 172.21.15.6:0/3495927178 wait complete. 2023-10-14T08:53:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.181+0000 7f257abb6b80 20 client.15486 trim_cache size 0 max 16384 2023-10-14T08:53:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 Processor -- start 2023-10-14T08:53:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 -- start start 2023-10-14T08:53:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19eb850 0x55f3e19f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19ec1b0 0x55f3e19fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 0x55f3e19f5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e17bf8c0 con 0x55f3e19ed0a0 2023-10-14T08:53:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e19fe9c0 con 0x55f3e19eb850 2023-10-14T08:53:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.208+0000 7f257abb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e19f4c00 con 0x55f3e19ec1b0 2023-10-14T08:53:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.211+0000 7f256cf69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 0x55f3e19f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.211+0000 7f256cf69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 0x55f3e19f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33072/0 (socket says 172.21.15.6:33072) 2023-10-14T08:53:14.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.211+0000 7f256cf69700 1 -- 172.21.15.6:0/3084317616 learned_addr learned my addr 172.21.15.6:0/3084317616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.212+0000 7f256cf69700 1 -- 172.21.15.6:0/3084317616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19ec1b0 msgr2=0x55f3e19fcc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.212+0000 7f256cf69700 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19ec1b0 0x55f3e19fcc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.212+0000 7f256cf69700 1 -- 172.21.15.6:0/3084317616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19eb850 msgr2=0x55f3e19f34d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.212+0000 7f256cf69700 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19eb850 0x55f3e19f34d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.212+0000 7f256cf69700 1 -- 172.21.15.6:0/3084317616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3e1752c00 con 0x55f3e19ed0a0 2023-10-14T08:53:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.212+0000 7f256cf69700 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 0x55f3e19f5750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f25600096f0 tx=0x7f2560009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93394e8ae1c437bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.213+0000 7f254effd700 1 -- 172.21.15.6:0/3084317616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560021070 con 0x55f3e19ed0a0 2023-10-14T08:53:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.213+0000 7f254effd700 1 -- 172.21.15.6:0/3084317616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25600075a0 con 0x55f3e19ed0a0 2023-10-14T08:53:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.213+0000 7f254effd700 1 -- 172.21.15.6:0/3084317616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e040 con 0x55f3e19ed0a0 2023-10-14T08:53:14.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.214+0000 7f257abb6b80 1 -- 172.21.15.6:0/3084317616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 msgr2=0x55f3e19f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.214+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 0x55f3e19f5750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f25600096f0 tx=0x7f2560009720 comp rx=0 tx=0).stop 2023-10-14T08:53:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.215+0000 7f257abb6b80 1 -- 172.21.15.6:0/3084317616 shutdown_connections 2023-10-14T08:53:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.215+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19ed0a0 0x55f3e19f5750 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.215+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19eb850 0x55f3e19f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.215+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3084317616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19ec1b0 0x55f3e19fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.215+0000 7f257abb6b80 1 -- 172.21.15.6:0/3084317616 >> 172.21.15.6:0/3084317616 conn(0x55f3e1919d70 msgr2=0x55f3e1a035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:14.226 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.220+0000 7f257abb6b80 1 -- 172.21.15.6:0/3084317616 shutdown_connections 2023-10-14T08:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.220+0000 7f257abb6b80 1 -- 172.21.15.6:0/3084317616 wait complete. 2023-10-14T08:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.220+0000 7f257abb6b80 1 -- start start 2023-10-14T08:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 Processor -- start 2023-10-14T08:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.227 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19faa00 0x55f3e19fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 0x55f3e19fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e19fc6c0 con 0x55f3e19fae80 2023-10-14T08:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e19fc830 con 0x55f3e19ed0a0 2023-10-14T08:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3e19fc9f0 con 0x55f3e19faa00 2023-10-14T08:53:14.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f257abb6b80 10 client.0 _ll_register_callbacks cb 0x7f255c00da50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.221+0000 7f2567fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.222+0000 7f256cf69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 0x55f3e19fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.222+0000 7f256cf69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 0x55f3e19fbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33078/0 (socket says 172.21.15.6:33078) 2023-10-14T08:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.222+0000 7f256cf69700 1 -- 172.21.15.6:0/3651279507 learned_addr learned my addr 172.21.15.6:0/3651279507 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:14.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f256cf69700 1 -- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19faa00 msgr2=0x55f3e19fba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f256cf69700 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19faa00 0x55f3e19fba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f256cf69700 1 -- 172.21.15.6:0/3651279507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 msgr2=0x55f3e19fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f256cf69700 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f256cf69700 1 -- 172.21.15.6:0/3651279507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3e18fc390 con 0x55f3e19fae80 2023-10-14T08:53:14.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f256cf69700 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 0x55f3e19fbfb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f256000b6c0 tx=0x7f256001d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0964a9473d4ac4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.223+0000 7f25477fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.224+0000 7f25477fe700 1 -- 172.21.15.6:0/3651279507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560021050 con 0x55f3e19fae80 2023-10-14T08:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.224+0000 7f25477fe700 1 -- 172.21.15.6:0/3651279507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2560003e10 con 0x55f3e19fae80 2023-10-14T08:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.224+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2560008e50 con 0x55f3e19fae80 2023-10-14T08:53:14.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.224+0000 7f25477fe700 1 -- 172.21.15.6:0/3651279507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f256000e070 con 0x55f3e19fae80 2023-10-14T08:53:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.224+0000 7f257abb6b80 10 client.15492 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:14.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.224+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55f3e17901f0 con 0x55f3e19fae80 2023-10-14T08:53:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.225+0000 7f25477fe700 1 -- 172.21.15.6:0/3651279507 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2560008e50 con 0x55f3e19fae80 2023-10-14T08:53:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.225+0000 7f25477fe700 1 -- 172.21.15.6:0/3651279507 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2560019040 con 0x55f3e19fae80 2023-10-14T08:53:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.225+0000 7f257abb6b80 10 client.15492 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.225+0000 7f257abb6b80 10 client.15492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.226+0000 7f257abb6b80 20 client.15492 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.226+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a560d0 0x55f3e1a584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.226+0000 7f257abb6b80 4 client.15492 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:53:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.226+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f3e1937df0 con 0x55f3e1a560d0 2023-10-14T08:53:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.226+0000 7f2567fff700 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a560d0 0x55f3e1a584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.229+0000 7f25477fe700 10 client.15492 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.229+0000 7f2567fff700 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a560d0 0x55f3e1a584f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e65c313343d7102b server_cookie=93bf36548e155505 in_seq=0 out_seq=0 2023-10-14T08:53:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.256+0000 7f25477fe700 1 -- 172.21.15.6:0/3651279507 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f3e1937df0 con 0x55f3e1a560d0 2023-10-14T08:53:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.256+0000 7f25477fe700 10 client.15492 handle_command_reply: tid=0 2023-10-14T08:53:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.256+0000 7f257abb6b80 1 client.15492 shutdown 2023-10-14T08:53:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 msgr2=0x55f3e19fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 0x55f3e19fbfb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f256000b6c0 tx=0x7f256001d750 comp rx=0 tx=0).stop 2023-10-14T08:53:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 shutdown_connections 2023-10-14T08:53:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f3e1a560d0 0x55f3e1a584f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3e19fae80 0x55f3e19fbfb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f3e19ed0a0 0x55f3e19fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 --2- 172.21.15.6:0/3651279507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f3e19faa00 0x55f3e19fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f25477fe700 0 client.15492 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 >> 172.21.15.6:0/3651279507 conn(0x55f3e1919d70 msgr2=0x55f3e19f34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 shutdown_connections 2023-10-14T08:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 1 -- 172.21.15.6:0/3651279507 wait complete. 2023-10-14T08:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.257+0000 7f257abb6b80 20 client.15492 trim_cache size 0 max 16384 2023-10-14T08:53:14.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:53:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:53:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:53:14.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:53:14.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.258+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25500a1530 msgr2=0x7f25500a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.258+0000 7f256e9cc700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25500a1530 0x7f25500a39f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f255c006fd0 tx=0x7f255c009d50 comp rx=0 tx=0).stop 2023-10-14T08:53:14.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.258+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 msgr2=0x7f25681949c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:14.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.258+0000 7f256e9cc700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 0x7f25681949c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f255800e9f0 tx=0x7f255800edb0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 shutdown_connections 2023-10-14T08:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2568101980 0x7f256819bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f25500a1530 0x7f25500a39f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25680ffdf0 0x7f25681949c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 --2- 172.21.15.6:0/833827499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2568100fe0 0x7f2568194f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 >> 172.21.15.6:0/833827499 conn(0x7f25680fb340 msgr2=0x7f2568104470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 shutdown_connections 2023-10-14T08:53:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:14.259+0000 7f256e9cc700 1 -- 172.21.15.6:0/833827499 wait complete. 2023-10-14T08:53:15.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:15 smithi178 ceph-mon[103612]: pgmap v319: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 MiB/s wr, 1.10k op/s 2023-10-14T08:53:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:15 smithi057 ceph-mon[103313]: pgmap v319: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 MiB/s wr, 1.10k op/s 2023-10-14T08:53:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:15 smithi006 ceph-mon[99452]: pgmap v319: 97 pgs: 97 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 MiB/s wr, 1.10k op/s 2023-10-14T08:53:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 15.0 s, 4799.4 tps, lat 20.845 ms stddev 25.149 2023-10-14T08:53:17.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:17 smithi178 ceph-mon[103612]: pgmap v320: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 101 MiB/s wr, 1.25k op/s 2023-10-14T08:53:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:17 smithi057 ceph-mon[103313]: pgmap v320: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 101 MiB/s wr, 1.25k op/s 2023-10-14T08:53:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:17 smithi006 ceph-mon[99452]: pgmap v320: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 101 MiB/s wr, 1.25k op/s 2023-10-14T08:53:17.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-14T08:53:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 -- 172.21.15.6:0/715317822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10b980 msgr2=0x7fe75c10bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 --2- 172.21.15.6:0/715317822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10b980 0x7fe75c10bda0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe7500099c0 tx=0x7fe750009cd0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 -- 172.21.15.6:0/715317822 shutdown_connections 2023-10-14T08:53:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 --2- 172.21.15.6:0/715317822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10d510 0x7fe75c113dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 --2- 172.21.15.6:0/715317822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10b980 0x7fe75c10bda0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 --2- 172.21.15.6:0/715317822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 0x7fe75c10cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 -- 172.21.15.6:0/715317822 >> 172.21.15.6:0/715317822 conn(0x7fe75c06b6d0 msgr2=0x7fe75c06bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 -- 172.21.15.6:0/715317822 shutdown_connections 2023-10-14T08:53:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.166+0000 7fe762012700 1 -- 172.21.15.6:0/715317822 wait complete. 2023-10-14T08:53:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.167+0000 7fe762012700 1 Processor -- start 2023-10-14T08:53:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 -- start start 2023-10-14T08:53:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 0x7fe75c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 0x7fe75c1a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10d510 0x7fe75c1a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1a92d0 con 0x7fe75c10d510 2023-10-14T08:53:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1a9410 con 0x7fe75c10b980 2023-10-14T08:53:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe762012700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c1a95a0 con 0x7fe75c10cb70 2023-10-14T08:53:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe75b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 0x7fe75c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe75affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 0x7fe75c1a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe75b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 0x7fe75c1a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60078/0 (socket says 172.21.15.6:60078) 2023-10-14T08:53:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.168+0000 7fe75b7fe700 1 -- 172.21.15.6:0/3406194289 learned_addr learned my addr 172.21.15.6:0/3406194289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75bfff700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10d510 0x7fe75c1a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75b7fe700 1 -- 172.21.15.6:0/3406194289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 msgr2=0x7fe75c1a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 0x7fe75c1a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75b7fe700 1 -- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10d510 msgr2=0x7fe75c1a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10d510 0x7fe75c1a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75b7fe700 1 -- 172.21.15.6:0/3406194289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500095f0 con 0x7fe75c10b980 2023-10-14T08:53:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75affd700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 0x7fe75c1a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 0x7fe75c1a1750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe750006010 tx=0x7fe750005b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.169+0000 7fe75bfff700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10d510 0x7fe75c1a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.170+0000 7fe758ff9700 1 -- 172.21.15.6:0/3406194289 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75001d070 con 0x7fe75c10b980 2023-10-14T08:53:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.170+0000 7fe758ff9700 1 -- 172.21.15.6:0/3406194289 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe750004150 con 0x7fe75c10b980 2023-10-14T08:53:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.170+0000 7fe758ff9700 1 -- 172.21.15.6:0/3406194289 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe750005270 con 0x7fe75c10b980 2023-10-14T08:53:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.171+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c1a9820 con 0x7fe75c10b980 2023-10-14T08:53:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.171+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c1a9b90 con 0x7fe75c10b980 2023-10-14T08:53:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.175+0000 7fe76e1fcb80 1 Processor -- start 2023-10-14T08:53:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.175+0000 7fe76e1fcb80 1 -- start start 2023-10-14T08:53:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd0d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd0e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd0eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcc81c70 con 0x55babcd0d780 2023-10-14T08:53:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcc66c60 con 0x55babcd0ce20 2023-10-14T08:53:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcc64580 con 0x55babcd0e620 2023-10-14T08:53:18.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd0d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd0d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60084/0 (socket says 172.21.15.6:60084) 2023-10-14T08:53:18.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe75bfff700 1 -- 172.21.15.6:0/346304801 learned_addr learned my addr 172.21.15.6:0/346304801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:18.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.176+0000 7fe75affd700 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd0eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe75affd700 1 -- 172.21.15.6:0/346304801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 msgr2=0x55babcd0d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:18.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe75affd700 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd0d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe75affd700 1 -- 172.21.15.6:0/346304801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 msgr2=0x55babcd0e040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe75affd700 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd0e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe75affd700 1 -- 172.21.15.6:0/346304801 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55babcc1d3f0 con 0x55babcd0e620 2023-10-14T08:53:18.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe75affd700 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd0eaa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe74c007800 tx=0x7fe74c007b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b5d46ea847b02d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.177+0000 7fe741ffb700 1 -- 172.21.15.6:0/346304801 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0125f0 con 0x55babcd0e620 2023-10-14T08:53:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.178+0000 7fe741ffb700 1 -- 172.21.15.6:0/346304801 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe74c012c10 con 0x55babcd0e620 2023-10-14T08:53:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.178+0000 7fe741ffb700 1 -- 172.21.15.6:0/346304801 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c013d10 con 0x55babcd0e620 2023-10-14T08:53:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.178+0000 7fe758ff9700 1 -- 172.21.15.6:0/3406194289 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe750004950 con 0x7fe75c10b980 2023-10-14T08:53:18.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.178+0000 7fe758ff9700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe7440a15d0 0x7fe7440a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/346304801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 msgr2=0x55babcd0eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd0eaa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe74c007800 tx=0x7fe74c007b10 comp rx=0 tx=0).stop 2023-10-14T08:53:18.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe758ff9700 1 -- 172.21.15.6:0/3406194289 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe7500cdb70 con 0x7fe75c10b980 2023-10-14T08:53:18.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe75bfff700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe7440a15d0 0x7fe7440a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/346304801 shutdown_connections 2023-10-14T08:53:18.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd0eaa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd0d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/346304801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd0e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.179+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/346304801 >> 172.21.15.6:0/346304801 conn(0x55babcc3add0 msgr2=0x55babcd07fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.180+0000 7fe75bfff700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe7440a15d0 0x7fe7440a3a90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe754009550 tx=0x7fe754009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.180+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/346304801 shutdown_connections 2023-10-14T08:53:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.180+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/346304801 wait complete. 2023-10-14T08:53:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.180+0000 7fe76e1fcb80 1 -- start start 2023-10-14T08:53:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.180+0000 7fe76e1fcb80 1 Processor -- start 2023-10-14T08:53:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd1f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd1fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd26a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcc5fe70 con 0x55babcd0d780 2023-10-14T08:53:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcbfc710 con 0x55babcd0ce20 2023-10-14T08:53:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcbfc3b0 con 0x55babcd0e620 2023-10-14T08:53:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe76e1fcb80 10 client.0 _ll_register_callbacks cb 0x55babca59800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.181+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd26a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd26a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58734/0 (socket says 172.21.15.6:58734) 2023-10-14T08:53:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 -- 172.21.15.6:0/2060006453 learned_addr learned my addr 172.21.15.6:0/2060006453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd1f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 -- 172.21.15.6:0/2060006453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 msgr2=0x55babcd1f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd1f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 -- 172.21.15.6:0/2060006453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 msgr2=0x55babcd1fa20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd1fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 -- 172.21.15.6:0/2060006453 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c00e040 con 0x55babcd0e620 2023-10-14T08:53:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe75bfff700 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd26a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe754016e50 tx=0x7fe754004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12bd4ac247f97899 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.182+0000 7fe73affd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.183+0000 7fe73affd700 1 -- 172.21.15.6:0/2060006453 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754017890 con 0x55babcd0e620 2023-10-14T08:53:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.183+0000 7fe73affd700 1 -- 172.21.15.6:0/2060006453 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe7540179f0 con 0x55babcd0e620 2023-10-14T08:53:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.183+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55babcc64ef0 con 0x55babcd0e620 2023-10-14T08:53:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.183+0000 7fe73affd700 1 -- 172.21.15.6:0/2060006453 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe754017bb0 con 0x55babcd0e620 2023-10-14T08:53:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.183+0000 7fe76e1fcb80 10 client.25177 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.183+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55babca8ade0 con 0x55babcd0e620 2023-10-14T08:53:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.184+0000 7fe73affd700 1 -- 172.21.15.6:0/2060006453 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe754031020 con 0x55babcd0e620 2023-10-14T08:53:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe73affd700 1 -- 172.21.15.6:0/2060006453 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe754022440 con 0x55babcd0e620 2023-10-14T08:53:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe76e1fcb80 10 client.25177 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe76e1fcb80 10 client.25177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe76e1fcb80 20 client.25177 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd1ad40 0x55babcd1d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe76e1fcb80 4 client.25177 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55babccdcc10 con 0x55babcd1ad40 2023-10-14T08:53:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.185+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd1ad40 0x55babcd1d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.186+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd1ad40 0x55babcd1d160 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593c21dc90b7015e server_cookie=fe239c362f3ee213 in_seq=0 out_seq=0 2023-10-14T08:53:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.186+0000 7fe73affd700 10 client.25177 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.187+0000 7fe73affd700 1 -- 172.21.15.6:0/2060006453 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55babccdcc10 con 0x55babcd1ad40 2023-10-14T08:53:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.187+0000 7fe73affd700 10 client.25177 handle_command_reply: tid=0 2023-10-14T08:53:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.187+0000 7fe76e1fcb80 1 client.25177 shutdown 2023-10-14T08:53:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 msgr2=0x55babcd26a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd26a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe754016e50 tx=0x7fe754004b40 comp rx=0 tx=0).stop 2023-10-14T08:53:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 shutdown_connections 2023-10-14T08:53:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd1ad40 0x55babcd1d160 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd26a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd1f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2060006453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd1fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 >> 172.21.15.6:0/2060006453 conn(0x55babcc3add0 msgr2=0x55babcd07bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe73affd700 0 client.25177 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 shutdown_connections 2023-10-14T08:53:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.188+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2060006453 wait complete. 2023-10-14T08:53:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.189+0000 7fe76e1fcb80 20 client.25177 trim_cache size 0 max 16384 2023-10-14T08:53:18.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.218+0000 7fe76e1fcb80 1 Processor -- start 2023-10-14T08:53:18.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 -- start start 2023-10-14T08:53:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd26a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd07b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcae0920 con 0x55babcd0d780 2023-10-14T08:53:18.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcd16840 con 0x55babcd0ce20 2023-10-14T08:53:18.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcd16180 con 0x55babcd0e620 2023-10-14T08:53:18.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd26a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd26a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33106/0 (socket says 172.21.15.6:33106) 2023-10-14T08:53:18.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75affd700 1 -- 172.21.15.6:0/2906995613 learned_addr learned my addr 172.21.15.6:0/2906995613 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:18.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75bfff700 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd07b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75affd700 1 -- 172.21.15.6:0/2906995613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 msgr2=0x55babcd07b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:18.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75affd700 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd07b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.219+0000 7fe75affd700 1 -- 172.21.15.6:0/2906995613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 msgr2=0x55babcd149f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:18.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.220+0000 7fe75affd700 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.220+0000 7fe75affd700 1 -- 172.21.15.6:0/2906995613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55babca73c60 con 0x55babcd0d780 2023-10-14T08:53:18.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.220+0000 7fe75affd700 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd26a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe74c007720 tx=0x7fe74c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55267800cc88913b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.220+0000 7fe7427fc700 1 -- 172.21.15.6:0/2906995613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c012e40 con 0x55babcd0d780 2023-10-14T08:53:18.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.220+0000 7fe7427fc700 1 -- 172.21.15.6:0/2906995613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe74c013480 con 0x55babcd0d780 2023-10-14T08:53:18.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.220+0000 7fe7427fc700 1 -- 172.21.15.6:0/2906995613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c027410 con 0x55babcd0d780 2023-10-14T08:53:18.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2906995613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 msgr2=0x55babcd26a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd26a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe74c007720 tx=0x7fe74c004740 comp rx=0 tx=0).stop 2023-10-14T08:53:18.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2906995613 shutdown_connections 2023-10-14T08:53:18.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0e620 0x55babcd07b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd149f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/2906995613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0d780 0x55babcd26a20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2906995613 >> 172.21.15.6:0/2906995613 conn(0x55babcc3add0 msgr2=0x55babcd1cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2906995613 shutdown_connections 2023-10-14T08:53:18.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/2906995613 wait complete. 2023-10-14T08:53:18.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.221+0000 7fe76e1fcb80 1 -- start start 2023-10-14T08:53:18.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 Processor -- start 2023-10-14T08:53:18.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd21560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 0x55babcd21aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0e620 0x55babcd87060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcd26ad0 con 0x55babcd0e620 2023-10-14T08:53:18.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcd26c40 con 0x55babcd0ce20 2023-10-14T08:53:18.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babcd26e00 con 0x55babcd0d780 2023-10-14T08:53:18.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe76e1fcb80 10 client.0 _ll_register_callbacks cb 0x7fe7540167f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:18.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe75affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 0x55babcd21aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe75affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 0x55babcd21aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58746/0 (socket says 172.21.15.6:58746) 2023-10-14T08:53:18.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.222+0000 7fe75affd700 1 -- 172.21.15.6:0/3673704515 learned_addr learned my addr 172.21.15.6:0/3673704515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:18.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe75affd700 1 -- 172.21.15.6:0/3673704515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 msgr2=0x55babcd21560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:18.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe75affd700 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd21560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe75affd700 1 -- 172.21.15.6:0/3673704515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0e620 msgr2=0x55babcd87060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:18.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe75affd700 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0e620 0x55babcd87060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe75affd700 1 -- 172.21.15.6:0/3673704515 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55babcc1d3f0 con 0x55babcd0d780 2023-10-14T08:53:18.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe75affd700 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 0x55babcd21aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0048a0 tx=0x7fe74c012eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef749e93e51b1aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe73affd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:18.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe73affd700 1 -- 172.21.15.6:0/3673704515 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0125f0 con 0x55babcd0d780 2023-10-14T08:53:18.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe73affd700 1 -- 172.21.15.6:0/3673704515 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe74c012750 con 0x55babcd0d780 2023-10-14T08:53:18.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.223+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe74c012c10 con 0x55babcd0d780 2023-10-14T08:53:18.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe73affd700 1 -- 172.21.15.6:0/3673704515 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe74c012910 con 0x55babcd0d780 2023-10-14T08:53:18.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 10 client.25183 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:18.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55babcab1250 con 0x55babcd0d780 2023-10-14T08:53:18.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe73affd700 1 -- 172.21.15.6:0/3673704515 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe74c012c10 con 0x55babcd0d780 2023-10-14T08:53:18.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe73affd700 1 -- 172.21.15.6:0/3673704515 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe74c0274a0 con 0x55babcd0d780 2023-10-14T08:53:18.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 10 client.25183 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:18.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 10 client.25183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:18.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 20 client.25183 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:18.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd889c0 0x55babcd8ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 4 client.25183 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-14T08:53:18.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.224+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55babcc58e50 con 0x55babcd889c0 2023-10-14T08:53:18.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.226+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd889c0 0x55babcd8ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.226+0000 7fe75b7fe700 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd889c0 0x55babcd8ade0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b434d975229080db server_cookie=81322221fff8dc3 in_seq=0 out_seq=0 2023-10-14T08:53:18.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.226+0000 7fe73affd700 10 client.25183 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:18.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.226+0000 7fe73affd700 1 -- 172.21.15.6:0/3673704515 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55babcc58e50 con 0x55babcd889c0 2023-10-14T08:53:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.226+0000 7fe73affd700 10 client.25183 handle_command_reply: tid=0 2023-10-14T08:53:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 client.25183 shutdown 2023-10-14T08:53:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 msgr2=0x55babcd21aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 0x55babcd21aa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0048a0 tx=0x7fe74c012eb0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 shutdown_connections 2023-10-14T08:53:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55babcd889c0 0x55babcd8ade0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babcd0e620 0x55babcd87060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe73affd700 0 client.25183 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55babcd0ce20 0x55babcd21560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 --2- 172.21.15.6:0/3673704515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55babcd0d780 0x55babcd21aa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 >> 172.21.15.6:0/3673704515 conn(0x55babcc3add0 msgr2=0x55babcd11530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 shutdown_connections 2023-10-14T08:53:18.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.227+0000 7fe76e1fcb80 1 -- 172.21.15.6:0/3673704515 wait complete. 2023-10-14T08:53:18.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.228+0000 7fe76e1fcb80 20 client.25183 trim_cache size 0 max 16384 2023-10-14T08:53:18.240 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:53:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-10-14T08:53:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-10-14T08:53:18.241 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:53:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe7440a15d0 msgr2=0x7fe7440a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe7440a15d0 0x7fe7440a3a90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe754009550 tx=0x7fe754009040 comp rx=0 tx=0).stop 2023-10-14T08:53:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 msgr2=0x7fe75c1a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 0x7fe75c1a1750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe750006010 tx=0x7fe750005b00 comp rx=0 tx=0).stop 2023-10-14T08:53:18.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 shutdown_connections 2023-10-14T08:53:18.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe75c10d510 0x7fe75c1a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe7440a15d0 0x7fe7440a3a90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe75c10b980 0x7fe75c1a1750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 --2- 172.21.15.6:0/3406194289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe75c10cb70 0x7fe75c1a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.229+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 >> 172.21.15.6:0/3406194289 conn(0x7fe75c06b6d0 msgr2=0x7fe75c10a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.230+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 shutdown_connections 2023-10-14T08:53:18.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.230+0000 7fe762012700 1 -- 172.21.15.6:0/3406194289 wait complete. 2023-10-14T08:53:18.258 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-14T08:53:18.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:53:18.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.477+0000 7f24a432a700 1 -- 172.21.15.6:0/3516251481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c100fd0 msgr2=0x7f249c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.477+0000 7f24a432a700 1 --2- 172.21.15.6:0/3516251481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c100fd0 0x7f249c101430 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f248c0098f0 tx=0x7f248c009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 -- 172.21.15.6:0/3516251481 shutdown_connections 2023-10-14T08:53:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 --2- 172.21.15.6:0/3516251481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c101970 0x7f249c108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 --2- 172.21.15.6:0/3516251481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c0ffde0 0x7f249c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 --2- 172.21.15.6:0/3516251481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c100fd0 0x7f249c101430 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 -- 172.21.15.6:0/3516251481 >> 172.21.15.6:0/3516251481 conn(0x7f249c0fb310 msgr2=0x7f249c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 -- 172.21.15.6:0/3516251481 shutdown_connections 2023-10-14T08:53:18.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.478+0000 7f24a432a700 1 -- 172.21.15.6:0/3516251481 wait complete. 2023-10-14T08:53:18.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 Processor -- start 2023-10-14T08:53:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 -- start start 2023-10-14T08:53:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c0ffde0 0x7f249c194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 0x7f249c194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c101970 0x7f249c19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c19c590 con 0x7f249c0ffde0 2023-10-14T08:53:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c19c6d0 con 0x7f249c100fd0 2023-10-14T08:53:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a432a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c19c860 con 0x7f249c101970 2023-10-14T08:53:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a18c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 0x7f249c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a18c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 0x7f249c194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60114/0 (socket says 172.21.15.6:60114) 2023-10-14T08:53:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.479+0000 7f24a18c5700 1 -- 172.21.15.6:0/1950149693 learned_addr learned my addr 172.21.15.6:0/1950149693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a28c7700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c101970 0x7f249c19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a20c6700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c0ffde0 0x7f249c194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a18c5700 1 -- 172.21.15.6:0/1950149693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c101970 msgr2=0x7f249c19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a18c5700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c101970 0x7f249c19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a18c5700 1 -- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c0ffde0 msgr2=0x7f249c194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a18c5700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c0ffde0 0x7f249c194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a18c5700 1 -- 172.21.15.6:0/1950149693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c009520 con 0x7f249c100fd0 2023-10-14T08:53:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a20c6700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c0ffde0 0x7f249c194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:18.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a28c7700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c101970 0x7f249c19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:18.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24a18c5700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 0x7f249c194f50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f248c00fad0 tx=0x7f248c00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.480+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c01c070 con 0x7f249c100fd0 2023-10-14T08:53:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.481+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c19cae0 con 0x7f249c100fd0 2023-10-14T08:53:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.481+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c19cf60 con 0x7f249c100fd0 2023-10-14T08:53:18.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.483+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c10a770 con 0x7f249c100fd0 2023-10-14T08:53:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.486+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f248c00bac0 con 0x7f249c100fd0 2023-10-14T08:53:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.486+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c003c30 con 0x7f249c100fd0 2023-10-14T08:53:18.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.488+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f248c005040 con 0x7f249c100fd0 2023-10-14T08:53:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.489+0000 7f24937fe700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24880a5910 0x7f24880a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:18.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.489+0000 7f24a20c6700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24880a5910 0x7f24880a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.489+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f248c0ce1b0 con 0x7f249c100fd0 2023-10-14T08:53:18.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.492+0000 7f24a20c6700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24880a5910 0x7f24880a7dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f249c100e30 tx=0x7f2498009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:18.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.494+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f248c0978a0 con 0x7f249c100fd0 2023-10-14T08:53:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.895+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f249c106d10 con 0x7f249c100fd0 2023-10-14T08:53:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:53:18.898 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:51:24.158921+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:53:18.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.897+0000 7f24937fe700 1 -- 172.21.15.6:0/1950149693 <== mon.2 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11352 (secure 0 0 0) 0x7f248c097070 con 0x7f249c100fd0 2023-10-14T08:53:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.903+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24880a5910 msgr2=0x7f24880a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.903+0000 7f24a432a700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24880a5910 0x7f24880a7dd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f249c100e30 tx=0x7f2498009310 comp rx=0 tx=0).stop 2023-10-14T08:53:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.903+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 msgr2=0x7f249c194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.903+0000 7f24a432a700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 0x7f249c194f50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f248c00fad0 tx=0x7f248c00b610 comp rx=0 tx=0).stop 2023-10-14T08:53:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 shutdown_connections 2023-10-14T08:53:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f249c101970 0x7f249c19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f249c0ffde0 0x7f249c194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24880a5910 0x7f24880a7dd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 --2- 172.21.15.6:0/1950149693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f249c100fd0 0x7f249c194f50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 >> 172.21.15.6:0/1950149693 conn(0x7f249c0fb310 msgr2=0x7f249c0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 shutdown_connections 2023-10-14T08:53:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:18.904+0000 7f24a432a700 1 -- 172.21.15.6:0/1950149693 wait complete. 2023-10-14T08:53:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-10-14T08:53:18.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-14T08:53:19.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.143+0000 7fbd451a0700 1 -- 172.21.15.6:0/2606610090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40108810 msgr2=0x7fbd4010f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.143+0000 7fbd451a0700 1 --2- 172.21.15.6:0/2606610090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40108810 0x7fbd4010f1f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009990 tx=0x7fbd30009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 -- 172.21.15.6:0/2606610090 shutdown_connections 2023-10-14T08:53:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 --2- 172.21.15.6:0/2606610090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4010f730 0x7fbd40111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 --2- 172.21.15.6:0/2606610090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd40107eb0 0x7fbd401082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 --2- 172.21.15.6:0/2606610090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40108810 0x7fbd4010f1f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 -- 172.21.15.6:0/2606610090 >> 172.21.15.6:0/2606610090 conn(0x7fbd4006dd90 msgr2=0x7fbd40070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 -- 172.21.15.6:0/2606610090 shutdown_connections 2023-10-14T08:53:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.144+0000 7fbd451a0700 1 -- 172.21.15.6:0/2606610090 wait complete. 2023-10-14T08:53:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.145+0000 7fbd451a0700 1 Processor -- start 2023-10-14T08:53:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.145+0000 7fbd451a0700 1 -- start start 2023-10-14T08:53:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd451a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 0x7fbd4019d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd451a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd40108810 0x7fbd401a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd451a0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4010f730 0x7fbd4019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd451a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401b5ea0 con 0x7fbd40108810 2023-10-14T08:53:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd451a0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401b5fe0 con 0x7fbd40107eb0 2023-10-14T08:53:19.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd451a0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401b61a0 con 0x7fbd4010f730 2023-10-14T08:53:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 0x7fbd4019d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 0x7fbd4019d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60128/0 (socket says 172.21.15.6:60128) 2023-10-14T08:53:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/3440348924 learned_addr learned my addr 172.21.15.6:0/3440348924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3f59e700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4010f730 0x7fbd4019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3659c700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd40108810 0x7fbd401a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/3440348924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4010f730 msgr2=0x7fbd4019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.146+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4010f730 0x7fbd4019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd40108810 msgr2=0x7fbd401a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd40108810 0x7fbd401a28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/3440348924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38009c40 con 0x7fbd40107eb0 2023-10-14T08:53:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 0x7fbd4019d320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800e970 tx=0x7fbd2800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3cd99700 1 -- 172.21.15.6:0/3440348924 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28009790 con 0x7fbd40107eb0 2023-10-14T08:53:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd300095f0 con 0x7fbd40107eb0 2023-10-14T08:53:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3cd99700 1 -- 172.21.15.6:0/3440348924 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2800eeb0 con 0x7fbd40107eb0 2023-10-14T08:53:19.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd3cd99700 1 -- 172.21.15.6:0/3440348924 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28003d20 con 0x7fbd40107eb0 2023-10-14T08:53:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.147+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd401b6850 con 0x7fbd40107eb0 2023-10-14T08:53:19.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.150+0000 7fbd3cd99700 1 -- 172.21.15.6:0/3440348924 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbd28003e80 con 0x7fbd40107eb0 2023-10-14T08:53:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.151+0000 7fbd3cd99700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd2c0a14d0 0x7fbd2c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.152+0000 7fbd3cd99700 1 -- 172.21.15.6:0/3440348924 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd28014070 con 0x7fbd40107eb0 2023-10-14T08:53:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.152+0000 7fbd5138ab80 1 Processor -- start 2023-10-14T08:53:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.152+0000 7fbd5138ab80 1 -- start start 2023-10-14T08:53:19.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.152+0000 7fbd3659c700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd2c0a14d0 0x7fbd2c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.152+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd4d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.152+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd4e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd4eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bcc1c70 con 0x55b02bd4ce20 2023-10-14T08:53:19.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bca6c60 con 0x55b02bd4d780 2023-10-14T08:53:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bca4580 con 0x55b02bd4e620 2023-10-14T08:53:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd4d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd4d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33146/0 (socket says 172.21.15.6:33146) 2023-10-14T08:53:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/2219932853 learned_addr learned my addr 172.21.15.6:0/2219932853 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd3659c700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd2c0a14d0 0x7fbd2c0a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000b2e0 tx=0x7fbd30005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd3659c700 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd4e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.153+0000 7fbd3f59e700 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd4eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3659c700 1 -- 172.21.15.6:0/2219932853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 msgr2=0x55b02bd4eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3659c700 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd4eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3659c700 1 -- 172.21.15.6:0/2219932853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 msgr2=0x55b02bd4d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3659c700 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd4d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3659c700 1 -- 172.21.15.6:0/2219932853 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b02bc5d3f0 con 0x55b02bd4d780 2023-10-14T08:53:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3659c700 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd4e040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd300098e0 tx=0x7fbd3001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b567c28a8893c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3559a700 1 -- 172.21.15.6:0/2219932853 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3002b070 con 0x55b02bd4d780 2023-10-14T08:53:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3559a700 1 -- 172.21.15.6:0/2219932853 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd3001e040 con 0x55b02bd4d780 2023-10-14T08:53:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.154+0000 7fbd3559a700 1 -- 172.21.15.6:0/2219932853 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30004e90 con 0x55b02bd4d780 2023-10-14T08:53:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.155+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2219932853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 msgr2=0x55b02bd4e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.155+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd4e040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd300098e0 tx=0x7fbd3001f000 comp rx=0 tx=0).stop 2023-10-14T08:53:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2219932853 shutdown_connections 2023-10-14T08:53:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd4eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd4d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2219932853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd4e040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2219932853 >> 172.21.15.6:0/2219932853 conn(0x55b02bc7add0 msgr2=0x55b02bd47fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2219932853 shutdown_connections 2023-10-14T08:53:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2219932853 wait complete. 2023-10-14T08:53:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.156+0000 7fbd5138ab80 1 -- start start 2023-10-14T08:53:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 Processor -- start 2023-10-14T08:53:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd56ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 0x55b02bd571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 0x55b02bd5e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bc9fe70 con 0x55b02bd4d780 2023-10-14T08:53:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bc3c710 con 0x55b02bd4e620 2023-10-14T08:53:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bc3c3b0 con 0x55b02bd4ce20 2023-10-14T08:53:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd5138ab80 10 client.0 _ll_register_callbacks cb 0x55b02ba99800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd56ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 0x55b02bd571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 0x55b02bd5e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd56ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58786/0 (socket says 172.21.15.6:58786) 2023-10-14T08:53:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 0x55b02bd5e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60146/0 (socket says 172.21.15.6:60146) 2023-10-14T08:53:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 0x55b02bd571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33154/0 (socket says 172.21.15.6:33154) 2023-10-14T08:53:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/4025638138 learned_addr learned my addr 172.21.15.6:0/4025638138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 msgr2=0x55b02bd5e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 0x55b02bd5e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/4025638138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 msgr2=0x55b02bd571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 0x55b02bd571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/4025638138 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd40112610 con 0x55b02bd4ce20 2023-10-14T08:53:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3f59e700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 0x55b02bd5e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.157+0000 7fbd3659c700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 0x55b02bd571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.158+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd56ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd28095ff0 tx=0x7fbd2809a970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd63c196cae90a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.158+0000 7fbd267fc700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.158+0000 7fbd267fc700 1 -- 172.21.15.6:0/4025638138 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2809e3c0 con 0x55b02bd4ce20 2023-10-14T08:53:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.158+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b02bca4ef0 con 0x55b02bd4ce20 2023-10-14T08:53:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.158+0000 7fbd267fc700 1 -- 172.21.15.6:0/4025638138 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd280a2600 con 0x55b02bd4ce20 2023-10-14T08:53:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.159+0000 7fbd267fc700 1 -- 172.21.15.6:0/4025638138 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd28098610 con 0x55b02bd4ce20 2023-10-14T08:53:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.159+0000 7fbd5138ab80 10 client.25201 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.159+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b02bacade0 con 0x55b02bd4ce20 2023-10-14T08:53:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.159+0000 7fbd267fc700 1 -- 172.21.15.6:0/4025638138 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b02bca4ef0 con 0x55b02bd4ce20 2023-10-14T08:53:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd267fc700 1 -- 172.21.15.6:0/4025638138 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd280a2170 con 0x55b02bd4ce20 2023-10-14T08:53:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd5138ab80 10 client.25201 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd5138ab80 10 client.25201 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-10-14T08:53:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd5138ab80 20 client.25201 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bd62a00 0x55b02bd64e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd5138ab80 4 client.25201 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.160+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b02bd1cc10 con 0x55b02bd62a00 2023-10-14T08:53:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.161+0000 7fbd3659c700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bd62a00 0x55b02bd64e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.161+0000 7fbd267fc700 10 client.25201 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.161+0000 7fbd3659c700 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bd62a00 0x55b02bd64e20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fedb2cedd35c9e5a server_cookie=9d71492e7b345ffb in_seq=0 out_seq=0 2023-10-14T08:53:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd267fc700 1 -- 172.21.15.6:0/4025638138 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b02bd1cc10 con 0x55b02bd62a00 2023-10-14T08:53:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd267fc700 10 client.25201 handle_command_reply: tid=0 2023-10-14T08:53:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 client.25201 shutdown 2023-10-14T08:53:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 msgr2=0x55b02bd56ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd56ca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd28095ff0 tx=0x7fbd2809a970 comp rx=0 tx=0).stop 2023-10-14T08:53:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 shutdown_connections 2023-10-14T08:53:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bd62a00 0x55b02bd64e20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4e620 0x55b02bd5e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd267fc700 0 client.25201 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd56ca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/4025638138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4d780 0x55b02bd571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 >> 172.21.15.6:0/4025638138 conn(0x55b02bc7add0 msgr2=0x55b02bd47bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.162+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 shutdown_connections 2023-10-14T08:53:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.163+0000 7fbd5138ab80 1 -- 172.21.15.6:0/4025638138 wait complete. 2023-10-14T08:53:19.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.164+0000 7fbd5138ab80 20 client.25201 trim_cache size 0 max 16384 2023-10-14T08:53:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 Processor -- start 2023-10-14T08:53:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 -- start start 2023-10-14T08:53:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd54a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd47b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bb20920 con 0x55b02bd4ce20 2023-10-14T08:53:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bd57e20 con 0x55b02bd4d780 2023-10-14T08:53:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.188+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bd56150 con 0x55b02bd4e620 2023-10-14T08:53:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd54a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd54a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33160/0 (socket says 172.21.15.6:33160) 2023-10-14T08:53:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/2607943834 learned_addr learned my addr 172.21.15.6:0/2607943834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3f59e700 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd47b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3659c700 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/2607943834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 msgr2=0x55b02bd47b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd47b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/2607943834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 msgr2=0x55b02bd5e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/2607943834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b02bab3c60 con 0x55b02bd4ce20 2023-10-14T08:53:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd54a70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd28096c90 tx=0x7fbd28003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe735d069619eec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd35d9b700 1 -- 172.21.15.6:0/2607943834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a2600 con 0x55b02bd4ce20 2023-10-14T08:53:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd35d9b700 1 -- 172.21.15.6:0/2607943834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2809e3c0 con 0x55b02bd4ce20 2023-10-14T08:53:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.189+0000 7fbd35d9b700 1 -- 172.21.15.6:0/2607943834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800cdf0 con 0x55b02bd4ce20 2023-10-14T08:53:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2607943834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 msgr2=0x55b02bd54a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd54a70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbd28096c90 tx=0x7fbd28003780 comp rx=0 tx=0).stop 2023-10-14T08:53:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2607943834 shutdown_connections 2023-10-14T08:53:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4e620 0x55b02bd47b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4ce20 0x55b02bd54a70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/2607943834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2607943834 >> 172.21.15.6:0/2607943834 conn(0x55b02bc7add0 msgr2=0x55b02bd558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.190+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2607943834 shutdown_connections 2023-10-14T08:53:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 -- 172.21.15.6:0/2607943834 wait complete. 2023-10-14T08:53:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 -- start start 2023-10-14T08:53:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 Processor -- start 2023-10-14T08:53:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd5bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 0x55b02bd5d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bd5d740 con 0x55b02bd4e620 2023-10-14T08:53:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bd5d8b0 con 0x55b02bd4d780 2023-10-14T08:53:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b02bd5da70 con 0x55b02bd4ce20 2023-10-14T08:53:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.191+0000 7fbd5138ab80 10 client.0 _ll_register_callbacks cb 0x7fbd28099db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 0x55b02bd5d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd5bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd5bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58800/0 (socket says 172.21.15.6:58800) 2023-10-14T08:53:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/1383970989 learned_addr learned my addr 172.21.15.6:0/1383970989 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 0x55b02bd5d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33170/0 (socket says 172.21.15.6:33170) 2023-10-14T08:53:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3659c700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 msgr2=0x55b02bd5c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/1383970989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 msgr2=0x55b02bd5d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 0x55b02bd5d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 -- 172.21.15.6:0/1383970989 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b02bacade0 con 0x55b02bd4ce20 2023-10-14T08:53:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3f59e700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 0x55b02bd5d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd3ed9d700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd5bd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd280a20d0 tx=0x7fbd28099e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f2de32e1e8b93e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd267fc700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd267fc700 1 -- 172.21.15.6:0/1383970989 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280a2380 con 0x55b02bd4ce20 2023-10-14T08:53:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd267fc700 1 -- 172.21.15.6:0/1383970989 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbd2800cdb0 con 0x55b02bd4ce20 2023-10-14T08:53:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.192+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd3001e040 con 0x55b02bd4ce20 2023-10-14T08:53:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd267fc700 1 -- 172.21.15.6:0/1383970989 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd280a2600 con 0x55b02bd4ce20 2023-10-14T08:53:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 10 client.25207 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b02baf1250 con 0x55b02bd4ce20 2023-10-14T08:53:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd267fc700 1 -- 172.21.15.6:0/1383970989 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd3001e040 con 0x55b02bd4ce20 2023-10-14T08:53:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd267fc700 1 -- 172.21.15.6:0/1383970989 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd2809f100 con 0x55b02bd4ce20 2023-10-14T08:53:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 10 client.25207 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 10 client.25207 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-10-14T08:53:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 20 client.25207 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bdb6f10 0x55b02bdb9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 4 client.25207 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b02bc98e50 con 0x55b02bdb6f10 2023-10-14T08:53:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.193+0000 7fbd3659c700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bdb6f10 0x55b02bdb9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.194+0000 7fbd3659c700 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bdb6f10 0x55b02bdb9330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e70510ec5f236752 server_cookie=1be986d91182a5a8 in_seq=0 out_seq=0 2023-10-14T08:53:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.194+0000 7fbd267fc700 10 client.25207 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.194+0000 7fbd267fc700 1 -- 172.21.15.6:0/1383970989 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b02bc98e50 con 0x55b02bdb6f10 2023-10-14T08:53:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.194+0000 7fbd267fc700 10 client.25207 handle_command_reply: tid=0 2023-10-14T08:53:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.194+0000 7fbd5138ab80 1 client.25207 shutdown 2023-10-14T08:53:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 msgr2=0x55b02bd5bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd5bd20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd280a20d0 tx=0x7fbd28099e80 comp rx=0 tx=0).stop 2023-10-14T08:53:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 shutdown_connections 2023-10-14T08:53:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b02bd4e620 0x55b02bd5d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b02bd4ce20 0x55b02bd5bd20 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd280a20d0 tx=0x7fbd28099e80 comp rx=0 tx=0).stop 2023-10-14T08:53:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55b02bdb6f10 0x55b02bdb9330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 --2- 172.21.15.6:0/1383970989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b02bd4d780 0x55b02bd5c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 >> 172.21.15.6:0/1383970989 conn(0x55b02bc7add0 msgr2=0x55b02bd51580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.195+0000 7fbd267fc700 0 client.25207 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.196+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 shutdown_connections 2023-10-14T08:53:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.196+0000 7fbd5138ab80 1 -- 172.21.15.6:0/1383970989 wait complete. 2023-10-14T08:53:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.198+0000 7fbd5138ab80 20 client.25207 trim_cache size 0 max 16384 2023-10-14T08:53:19.212 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.199+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd2c0a14d0 msgr2=0x7fbd2c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd2c0a14d0 0x7fbd2c0a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000b2e0 tx=0x7fbd30005c00 comp rx=0 tx=0).stop 2023-10-14T08:53:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 msgr2=0x7fbd4019d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 0x7fbd4019d320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800e970 tx=0x7fbd2800ed30 comp rx=0 tx=0).stop 2023-10-14T08:53:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 shutdown_connections 2023-10-14T08:53:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4010f730 0x7fbd4019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbd2c0a14d0 0x7fbd2c0a3990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd40107eb0 0x7fbd4019d320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 --2- 172.21.15.6:0/3440348924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd40108810 0x7fbd401a28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.200+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 >> 172.21.15.6:0/3440348924 conn(0x7fbd4006dd90 msgr2=0x7fbd4006fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.201+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 shutdown_connections 2023-10-14T08:53:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.203+0000 7fbd451a0700 1 -- 172.21.15.6:0/3440348924 wait complete. 2023-10-14T08:53:19.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-14T08:53:19.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.423+0000 7f4bb4465700 1 -- 172.21.15.6:0/3140232184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac104350 msgr2=0x7f4bac106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.423+0000 7f4bb4465700 1 --2- 172.21.15.6:0/3140232184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac104350 0x7f4bac106740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00098f0 tx=0x7f4ba0009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 -- 172.21.15.6:0/3140232184 shutdown_connections 2023-10-14T08:53:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 --2- 172.21.15.6:0/3140232184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac106c80 0x7f4bac1090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 --2- 172.21.15.6:0/3140232184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bac101a20 0x7f4bac103e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 --2- 172.21.15.6:0/3140232184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac104350 0x7f4bac106740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 -- 172.21.15.6:0/3140232184 >> 172.21.15.6:0/3140232184 conn(0x7f4bac0fb430 msgr2=0x7f4bac0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 -- 172.21.15.6:0/3140232184 shutdown_connections 2023-10-14T08:53:19.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.424+0000 7f4bb4465700 1 -- 172.21.15.6:0/3140232184 wait complete. 2023-10-14T08:53:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 Processor -- start 2023-10-14T08:53:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 -- start start 2023-10-14T08:53:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 0x7f4bac198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bac104350 0x7f4bac1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac106c80 0x7f4bac1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1a0a20 con 0x7f4bac104350 2023-10-14T08:53:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1a0b60 con 0x7f4bac101a20 2023-10-14T08:53:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb4465700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1a0cf0 con 0x7f4bac106c80 2023-10-14T08:53:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb2201700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 0x7f4bac198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb1a00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bac104350 0x7f4bac1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb2a02700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac106c80 0x7f4bac1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb2201700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 0x7f4bac198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60170/0 (socket says 172.21.15.6:60170) 2023-10-14T08:53:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.425+0000 7f4bb2201700 1 -- 172.21.15.6:0/1390113893 learned_addr learned my addr 172.21.15.6:0/1390113893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb2201700 1 -- 172.21.15.6:0/1390113893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac106c80 msgr2=0x7f4bac1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb2201700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac106c80 0x7f4bac1a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb2201700 1 -- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bac104350 msgr2=0x7f4bac1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb2201700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bac104350 0x7f4bac1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb2201700 1 -- 172.21.15.6:0/1390113893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0009520 con 0x7f4bac101a20 2023-10-14T08:53:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb2201700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 0x7f4bac198ea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400ada0 tx=0x7f4ba400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bab7fe700 1 -- 172.21.15.6:0/1390113893 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400f070 con 0x7f4bac101a20 2023-10-14T08:53:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac1a0fd0 con 0x7f4bac101a20 2023-10-14T08:53:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bab7fe700 1 -- 172.21.15.6:0/1390113893 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ba4007bf0 con 0x7f4bac101a20 2023-10-14T08:53:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.426+0000 7f4bab7fe700 1 -- 172.21.15.6:0/1390113893 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4005310 con 0x7f4bac101a20 2023-10-14T08:53:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.427+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac1a1400 con 0x7f4bac101a20 2023-10-14T08:53:19.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.430+0000 7f4bab7fe700 1 -- 172.21.15.6:0/1390113893 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4ba400c980 con 0x7f4bac101a20 2023-10-14T08:53:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.432+0000 7f4bc064fb80 1 Processor -- start 2023-10-14T08:53:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.432+0000 7f4bc064fb80 1 -- start start 2023-10-14T08:53:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.432+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab0ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab0f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708aa7ac70 con 0x55708ab0ef90 2023-10-14T08:53:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708aa5fc60 con 0x55708ab0e630 2023-10-14T08:53:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708aa5d580 con 0x55708ab0fe30 2023-10-14T08:53:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab0ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab0ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60176/0 (socket says 172.21.15.6:60176) 2023-10-14T08:53:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 -- 172.21.15.6:0/2347844069 learned_addr learned my addr 172.21.15.6:0/2347844069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2201700 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab0f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bab7fe700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b940a1580 0x7f4b940a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 -- 172.21.15.6:0/2347844069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 msgr2=0x55708ab102b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab102b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 -- 172.21.15.6:0/2347844069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 msgr2=0x55708ab0f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab0f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bb2a02700 1 -- 172.21.15.6:0/2347844069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55708aa163f0 con 0x55708ab0e630 2023-10-14T08:53:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.433+0000 7f4bab7fe700 1 -- 172.21.15.6:0/1390113893 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4ba40cc2a0 con 0x7f4bac101a20 2023-10-14T08:53:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.434+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b940a1580 0x7f4b940a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.434+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab0ea50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009e70 tx=0x7f4b9c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967b47f815791b96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.434+0000 7f4ba8d82700 1 -- 172.21.15.6:0/2347844069 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c03dc70 con 0x55708ab0e630 2023-10-14T08:53:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.434+0000 7f4ba8d82700 1 -- 172.21.15.6:0/2347844069 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b9c03ddd0 con 0x55708ab0e630 2023-10-14T08:53:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.434+0000 7f4ba8d82700 1 -- 172.21.15.6:0/2347844069 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00e610 con 0x55708ab0e630 2023-10-14T08:53:19.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 -- 172.21.15.6:0/2347844069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 msgr2=0x55708ab0ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab0ea50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009e70 tx=0x7f4b9c011720 comp rx=0 tx=0).stop 2023-10-14T08:53:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b940a1580 0x7f4b940a3a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c045000 tx=0x7f4b9c046000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 -- 172.21.15.6:0/2347844069 shutdown_connections 2023-10-14T08:53:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab0ea50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/2347844069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab0f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.435+0000 7f4bc064fb80 1 -- 172.21.15.6:0/2347844069 >> 172.21.15.6:0/2347844069 conn(0x55708aa33dd0 msgr2=0x55708ab00fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.436+0000 7f4bc064fb80 1 -- 172.21.15.6:0/2347844069 shutdown_connections 2023-10-14T08:53:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.436+0000 7f4bc064fb80 1 -- 172.21.15.6:0/2347844069 wait complete. 2023-10-14T08:53:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.436+0000 7f4bc064fb80 1 -- start start 2023-10-14T08:53:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.436+0000 7f4bc064fb80 1 Processor -- start 2023-10-14T08:53:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab0d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab0da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab171b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708aa58e70 con 0x55708ab0e630 2023-10-14T08:53:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708a9f5710 con 0x55708ab0fe30 2023-10-14T08:53:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708a9f53b0 con 0x55708ab0ef90 2023-10-14T08:53:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bc064fb80 10 client.0 _ll_register_callbacks cb 0x55708a852800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bb2201700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab0d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bb2201700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab0d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33192/0 (socket says 172.21.15.6:33192) 2023-10-14T08:53:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bb2201700 1 -- 172.21.15.6:0/1999748744 learned_addr learned my addr 172.21.15.6:0/1999748744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab171b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.437+0000 7f4bb1a00700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab0da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2a02700 1 -- 172.21.15.6:0/1999748744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 msgr2=0x55708ab0da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab0da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2a02700 1 -- 172.21.15.6:0/1999748744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 msgr2=0x55708ab0d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab0d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2a02700 1 -- 172.21.15.6:0/1999748744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c0099f0 con 0x55708ab0fe30 2023-10-14T08:53:19.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2201700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab0d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:19.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab171b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c011a70 tx=0x7f4b9c048670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de746e30e20e61d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:19.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4b91ffb700 1 -- 172.21.15.6:0/1999748744 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00e5f0 con 0x55708ab0fe30 2023-10-14T08:53:19.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4b91ffb700 1 -- 172.21.15.6:0/1999748744 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4b9c04c030 con 0x55708ab0fe30 2023-10-14T08:53:19.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.438+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55708aa5def0 con 0x55708ab0fe30 2023-10-14T08:53:19.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4b91ffb700 1 -- 172.21.15.6:0/1999748744 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b9c00e3b0 con 0x55708ab0fe30 2023-10-14T08:53:19.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 10 client.25142 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:19.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55708a883de0 con 0x55708ab0fe30 2023-10-14T08:53:19.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4b91ffb700 1 -- 172.21.15.6:0/1999748744 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55708aa5def0 con 0x55708ab0fe30 2023-10-14T08:53:19.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4b91ffb700 1 -- 172.21.15.6:0/1999748744 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4b9c0052c0 con 0x55708ab0fe30 2023-10-14T08:53:19.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 10 client.25142 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:19.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 10 client.25142 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-14T08:53:19.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 20 client.25142 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:19.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab1dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.439+0000 7f4bc064fb80 4 client.25142 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:19.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.440+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55708aad5c10 con 0x55708ab1b9c0 2023-10-14T08:53:19.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.440+0000 7f4bb2201700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab1dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.440+0000 7f4b91ffb700 10 client.25142 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:19.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.440+0000 7f4bb2201700 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab1dde0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae394826ac7d4e87 server_cookie=987113d86dd9edfe in_seq=0 out_seq=0 2023-10-14T08:53:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.442+0000 7f4b91ffb700 1 -- 172.21.15.6:0/1999748744 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55708aad5c10 con 0x55708ab1b9c0 2023-10-14T08:53:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.442+0000 7f4b91ffb700 10 client.25142 handle_command_reply: tid=0 2023-10-14T08:53:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.442+0000 7f4bc064fb80 1 client.25142 shutdown 2023-10-14T08:53:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 msgr2=0x55708ab171b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab171b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c011a70 tx=0x7f4b9c048670 comp rx=0 tx=0).stop 2023-10-14T08:53:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 shutdown_connections 2023-10-14T08:53:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab1dde0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab171b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4b91ffb700 0 client.25142 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab0d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/1999748744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab0da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 >> 172.21.15.6:0/1999748744 conn(0x55708aa33dd0 msgr2=0x55708ab00b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 shutdown_connections 2023-10-14T08:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 1 -- 172.21.15.6:0/1999748744 wait complete. 2023-10-14T08:53:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.443+0000 7f4bc064fb80 20 client.25142 trim_cache size 0 max 16384 2023-10-14T08:53:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.466+0000 7f4bc064fb80 1 Processor -- start 2023-10-14T08:53:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 -- start start 2023-10-14T08:53:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab10210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab17170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab083e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708ab0d090 con 0x55708ab0ef90 2023-10-14T08:53:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708a8d9920 con 0x55708ab0e630 2023-10-14T08:53:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.467+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708ab0fcb0 con 0x55708ab0fe30 2023-10-14T08:53:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab083e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58834/0 (socket says 172.21.15.6:58834) 2023-10-14T08:53:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3094005347 learned_addr learned my addr 172.21.15.6:0/3094005347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2201700 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab10210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3094005347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 msgr2=0x55708ab10210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab10210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3094005347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 msgr2=0x55708ab17170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab17170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3094005347 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55708a86cc60 con 0x55708ab0fe30 2023-10-14T08:53:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.468+0000 7f4bb2201700 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab10210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:19.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.469+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab083e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c005d60 tx=0x7f4b9c009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ec977f87ea23f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.469+0000 7f4ba9583700 1 -- 172.21.15.6:0/3094005347 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c048d80 con 0x55708ab0fe30 2023-10-14T08:53:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.469+0000 7f4ba9583700 1 -- 172.21.15.6:0/3094005347 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b9c048ac0 con 0x55708ab0fe30 2023-10-14T08:53:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.469+0000 7f4ba9583700 1 -- 172.21.15.6:0/3094005347 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0526a0 con 0x55708ab0fe30 2023-10-14T08:53:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.470+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3094005347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 msgr2=0x55708ab083e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.470+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab083e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c005d60 tx=0x7f4b9c009400 comp rx=0 tx=0).stop 2023-10-14T08:53:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.474+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3094005347 shutdown_connections 2023-10-14T08:53:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.474+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0fe30 0x55708ab083e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.474+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0e630 0x55708ab10210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.474+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3094005347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0ef90 0x55708ab17170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.474+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3094005347 >> 172.21.15.6:0/3094005347 conn(0x55708aa33dd0 msgr2=0x55708ab00240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.478+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3094005347 shutdown_connections 2023-10-14T08:53:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.478+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3094005347 wait complete. 2023-10-14T08:53:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.478+0000 7f4bc064fb80 1 -- start start 2023-10-14T08:53:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.478+0000 7f4bc064fb80 1 Processor -- start 2023-10-14T08:53:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab14c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab15160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab16170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708ab166b0 con 0x55708ab0e630 2023-10-14T08:53:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708ab16820 con 0x55708ab0fe30 2023-10-14T08:53:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708ab169e0 con 0x55708ab0ef90 2023-10-14T08:53:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bc064fb80 10 client.0 _ll_register_callbacks cb 0x7f4ba40959d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bb2201700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab14c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bb2201700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab14c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33204/0 (socket says 172.21.15.6:33204) 2023-10-14T08:53:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bb2201700 1 -- 172.21.15.6:0/3825596173 learned_addr learned my addr 172.21.15.6:0/3825596173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab16170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.479+0000 7f4bb1a00700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab15160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.480+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3825596173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 msgr2=0x55708ab15160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.480+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab15160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.480+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3825596173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 msgr2=0x55708ab14c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.480+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab14c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.480+0000 7f4bb2a02700 1 -- 172.21.15.6:0/3825596173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55708a883de0 con 0x55708ab0fe30 2023-10-14T08:53:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.480+0000 7f4bb2a02700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab16170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0486b0 tx=0x7f4b9c011e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8313262cb03b1af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.481+0000 7f4b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:19.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.481+0000 7f4b91ffb700 1 -- 172.21.15.6:0/3825596173 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00eab0 con 0x55708ab0fe30 2023-10-14T08:53:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.481+0000 7f4b91ffb700 1 -- 172.21.15.6:0/3825596173 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4b9c04c070 con 0x55708ab0fe30 2023-10-14T08:53:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.481+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b9c03ddd0 con 0x55708ab0fe30 2023-10-14T08:53:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.481+0000 7f4b91ffb700 1 -- 172.21.15.6:0/3825596173 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b9c00ec10 con 0x55708ab0fe30 2023-10-14T08:53:19.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:19 smithi006 ceph-mon[99452]: pgmap v321: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 89 MiB/s wr, 1.21k op/s 2023-10-14T08:53:19.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:19 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1950149693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:53:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.483+0000 7f4bc064fb80 10 client.25145 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.483+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55708a8aa250 con 0x55708ab0fe30 2023-10-14T08:53:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.485+0000 7f4b91ffb700 1 -- 172.21.15.6:0/3825596173 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b9c07d020 con 0x55708ab0fe30 2023-10-14T08:53:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.485+0000 7f4b91ffb700 1 -- 172.21.15.6:0/3825596173 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4b9c052550 con 0x55708ab0fe30 2023-10-14T08:53:19.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bc064fb80 10 client.25145 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bc064fb80 10 client.25145 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-14T08:53:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bc064fb80 20 client.25145 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab71fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bc064fb80 4 client.25145 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:19.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55708aa51e50 con 0x55708ab1b9c0 2023-10-14T08:53:19.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.486+0000 7f4bb2201700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab71fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.487+0000 7f4b91ffb700 10 client.25145 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:19.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.487+0000 7f4bb2201700 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab71fb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a1596e71e760b400 server_cookie=56a533e415500b61 in_seq=0 out_seq=0 2023-10-14T08:53:19.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4b91ffb700 1 -- 172.21.15.6:0/3825596173 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55708aa51e50 con 0x55708ab1b9c0 2023-10-14T08:53:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4b91ffb700 10 client.25145 handle_command_reply: tid=0 2023-10-14T08:53:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 client.25145 shutdown 2023-10-14T08:53:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 msgr2=0x55708ab16170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab16170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0486b0 tx=0x7f4b9c011e40 comp rx=0 tx=0).stop 2023-10-14T08:53:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 shutdown_connections 2023-10-14T08:53:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x55708ab1b9c0 0x55708ab71fb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55708ab0fe30 0x55708ab16170 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55708ab0e630 0x55708ab14c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4b91ffb700 0 client.25145 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:19.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 --2- 172.21.15.6:0/3825596173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55708ab0ef90 0x55708ab15160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.488+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 >> 172.21.15.6:0/3825596173 conn(0x55708aa33dd0 msgr2=0x55708ab083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.489+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 shutdown_connections 2023-10-14T08:53:19.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.489+0000 7f4bc064fb80 1 -- 172.21.15.6:0/3825596173 wait complete. 2023-10-14T08:53:19.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.492+0000 7f4bc064fb80 20 client.25145 trim_cache size 0 max 16384 2023-10-14T08:53:19.495 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.493+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b940a1580 msgr2=0x7f4b940a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.493+0000 7f4bb4465700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b940a1580 0x7f4b940a3a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c045000 tx=0x7f4b9c046000 comp rx=0 tx=0).stop 2023-10-14T08:53:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.493+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 msgr2=0x7f4bac198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.493+0000 7f4bb4465700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 0x7f4bac198ea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400ada0 tx=0x7f4ba400c330 comp rx=0 tx=0).stop 2023-10-14T08:53:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 shutdown_connections 2023-10-14T08:53:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bac106c80 0x7f4bac1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b940a1580 0x7f4b940a3a40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bac101a20 0x7f4bac198ea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 --2- 172.21.15.6:0/1390113893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bac104350 0x7f4bac1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 >> 172.21.15.6:0/1390113893 conn(0x7f4bac0fb430 msgr2=0x7f4bac102690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 shutdown_connections 2023-10-14T08:53:19.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.494+0000 7f4bb4465700 1 -- 172.21.15.6:0/1390113893 wait complete. 2023-10-14T08:53:19.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-14T08:53:19.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:19 smithi178 ceph-mon[103612]: pgmap v321: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 89 MiB/s wr, 1.21k op/s 2023-10-14T08:53:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:19 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1950149693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:53:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:19 smithi057 ceph-mon[103313]: pgmap v321: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 89 MiB/s wr, 1.21k op/s 2023-10-14T08:53:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:19 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1950149693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:53:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3970573777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 msgr2=0x7fb624101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3970573777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb624101470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb614009990 tx=0x7fb614009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3970573777 shutdown_connections 2023-10-14T08:53:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3970573777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6241019b0 0x7fb6241082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3970573777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240ffea0 0x7fb6241002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3970573777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb624101470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3970573777 >> 172.21.15.6:0/3970573777 conn(0x7fb6240fb430 msgr2=0x7fb6240fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3970573777 shutdown_connections 2023-10-14T08:53:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.741+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3970573777 wait complete. 2023-10-14T08:53:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.742+0000 7fb62a8b5700 1 Processor -- start 2023-10-14T08:53:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.742+0000 7fb62a8b5700 1 -- start start 2023-10-14T08:53:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb62a8b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 0x7fb62419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb62a8b5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb62419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb62a8b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6241019b0 0x7fb6241a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb62a8b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241a4d40 con 0x7fb6240ffea0 2023-10-14T08:53:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb62a8b5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241a4eb0 con 0x7fb6241019b0 2023-10-14T08:53:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb62a8b5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241a5070 con 0x7fb624100ff0 2023-10-14T08:53:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 0x7fb62419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb62419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 0x7fb62419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33218/0 (socket says 172.21.15.6:33218) 2023-10-14T08:53:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb62419dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58854/0 (socket says 172.21.15.6:58854) 2023-10-14T08:53:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 -- 172.21.15.6:0/3726217379 learned_addr learned my addr 172.21.15.6:0/3726217379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb628e52700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6241019b0 0x7fb6241a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 -- 172.21.15.6:0/3726217379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 msgr2=0x7fb62419dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb62419dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 -- 172.21.15.6:0/3726217379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6241019b0 msgr2=0x7fb6241a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6241019b0 0x7fb6241a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.743+0000 7fb623fff700 1 -- 172.21.15.6:0/3726217379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c009c40 con 0x7fb6240ffea0 2023-10-14T08:53:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.745+0000 7fb623fff700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 0x7fb62419d6e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c370 tx=0x7fb61c00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.746+0000 7fb6217fa700 1 -- 172.21.15.6:0/3726217379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c017070 con 0x7fb6240ffea0 2023-10-14T08:53:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.746+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6140095f0 con 0x7fb6240ffea0 2023-10-14T08:53:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.746+0000 7fb6217fa700 1 -- 172.21.15.6:0/3726217379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb61c00f040 con 0x7fb6240ffea0 2023-10-14T08:53:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.746+0000 7fb6217fa700 1 -- 172.21.15.6:0/3726217379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00e050 con 0x7fb6240ffea0 2023-10-14T08:53:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.746+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6241a5640 con 0x7fb6240ffea0 2023-10-14T08:53:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.749+0000 7fb6217fa700 1 -- 172.21.15.6:0/3726217379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb61c003a00 con 0x7fb6240ffea0 2023-10-14T08:53:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.750+0000 7fb6217fa700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6100a14d0 0x7fb6100a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.750+0000 7fb6217fa700 1 -- 172.21.15.6:0/3726217379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb61c0cc740 con 0x7fb6240ffea0 2023-10-14T08:53:19.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.752+0000 7fb636a9fb80 1 Processor -- start 2023-10-14T08:53:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 -- start start 2023-10-14T08:53:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131ee20 0x5603d131f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1320040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 0x5603d1320aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d1293c70 con 0x5603d1320620 2023-10-14T08:53:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d1278c60 con 0x5603d131ee20 2023-10-14T08:53:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d1276580 con 0x5603d131f780 2023-10-14T08:53:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb628e52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 0x5603d1320aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1320040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1320040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58864/0 (socket says 172.21.15.6:58864) 2023-10-14T08:53:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb6237fe700 1 -- 172.21.15.6:0/958085883 learned_addr learned my addr 172.21.15.6:0/958085883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb628e52700 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 0x5603d1320aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33228/0 (socket says 172.21.15.6:33228) 2023-10-14T08:53:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.753+0000 7fb623fff700 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131ee20 0x5603d131f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb628e52700 1 -- 172.21.15.6:0/958085883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 msgr2=0x5603d1320040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb628e52700 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1320040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb628e52700 1 -- 172.21.15.6:0/958085883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131ee20 msgr2=0x5603d131f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb628e52700 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131ee20 0x5603d131f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb628e52700 1 -- 172.21.15.6:0/958085883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d122f3f0 con 0x5603d1320620 2023-10-14T08:53:19.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb623fff700 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131ee20 0x5603d131f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb6237fe700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6100a14d0 0x7fb6100a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.754+0000 7fb628e52700 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 0x5603d1320aa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009b80 tx=0x7fb60c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6102d728feedd89b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.755+0000 7fb61a7fc700 1 -- 172.21.15.6:0/958085883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c011b90 con 0x5603d1320620 2023-10-14T08:53:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.755+0000 7fb6237fe700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6100a14d0 0x7fb6100a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb614005950 tx=0x7fb6140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.755+0000 7fb61a7fc700 1 -- 172.21.15.6:0/958085883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb60c011cf0 con 0x5603d1320620 2023-10-14T08:53:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.755+0000 7fb61a7fc700 1 -- 172.21.15.6:0/958085883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00f680 con 0x5603d1320620 2023-10-14T08:53:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 -- 172.21.15.6:0/958085883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 msgr2=0x5603d1320aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 0x5603d1320aa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009b80 tx=0x7fb60c009e90 comp rx=0 tx=0).stop 2023-10-14T08:53:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 -- 172.21.15.6:0/958085883 shutdown_connections 2023-10-14T08:53:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d1320620 0x5603d1320aa0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131ee20 0x5603d131f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/958085883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1320040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 -- 172.21.15.6:0/958085883 >> 172.21.15.6:0/958085883 conn(0x5603d124cdd0 msgr2=0x5603d1319fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 -- 172.21.15.6:0/958085883 shutdown_connections 2023-10-14T08:53:19.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 -- 172.21.15.6:0/958085883 wait complete. 2023-10-14T08:53:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.756+0000 7fb636a9fb80 1 -- start start 2023-10-14T08:53:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 Processor -- start 2023-10-14T08:53:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131ee20 0x5603d134acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131f780 0x5603d134b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1352230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d1271e70 con 0x5603d131f780 2023-10-14T08:53:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d120e710 con 0x5603d1320620 2023-10-14T08:53:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d120e3b0 con 0x5603d131ee20 2023-10-14T08:53:19.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb636a9fb80 10 client.0 _ll_register_callbacks cb 0x5603d106b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131f780 0x5603d134b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131f780 0x5603d134b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33234/0 (socket says 172.21.15.6:33234) 2023-10-14T08:53:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.757+0000 7fb6237fe700 1 -- 172.21.15.6:0/1581092137 learned_addr learned my addr 172.21.15.6:0/1581092137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb628e52700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1352230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131ee20 0x5603d134acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 -- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 msgr2=0x5603d1352230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1352230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 -- 172.21.15.6:0/1581092137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131f780 msgr2=0x5603d134b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131f780 0x5603d134b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 -- 172.21.15.6:0/1581092137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6241a5640 con 0x5603d131ee20 2023-10-14T08:53:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb623fff700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131ee20 0x5603d134acb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0ca240 tx=0x7fb61c003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e93728472391bae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb6037fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.758+0000 7fb6037fe700 1 -- 172.21.15.6:0/1581092137 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c099150 con 0x5603d131ee20 2023-10-14T08:53:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb6037fe700 1 -- 172.21.15.6:0/1581092137 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb61c099a60 con 0x5603d131ee20 2023-10-14T08:53:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603d1276ef0 con 0x5603d131ee20 2023-10-14T08:53:19.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb6037fe700 1 -- 172.21.15.6:0/1581092137 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb61c09dbb0 con 0x5603d131ee20 2023-10-14T08:53:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 10 client.25234 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fb60c009830 con 0x5603d131ee20 2023-10-14T08:53:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb6037fe700 1 -- 172.21.15.6:0/1581092137 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb61c0b6080 con 0x5603d131ee20 2023-10-14T08:53:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb6037fe700 1 -- 172.21.15.6:0/1581092137 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb61c0a1960 con 0x5603d131ee20 2023-10-14T08:53:19.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 10 client.25234 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 10 client.25234 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-14T08:53:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 20 client.25234 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d1356ac0 0x5603d1358ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 4 client.25234 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:19.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.759+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603d12eec10 con 0x5603d1356ac0 2023-10-14T08:53:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.760+0000 7fb6237fe700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d1356ac0 0x5603d1358ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.760+0000 7fb6037fe700 10 client.25234 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.760+0000 7fb6237fe700 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d1356ac0 0x5603d1358ee0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=979148b928385923 server_cookie=c9d75fb90e40b601 in_seq=0 out_seq=0 2023-10-14T08:53:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb6037fe700 1 -- 172.21.15.6:0/1581092137 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5603d12eec10 con 0x5603d1356ac0 2023-10-14T08:53:19.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb6037fe700 10 client.25234 handle_command_reply: tid=0 2023-10-14T08:53:19.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 client.25234 shutdown 2023-10-14T08:53:19.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131ee20 msgr2=0x5603d134acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131ee20 0x5603d134acb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0ca240 tx=0x7fb61c003f90 comp rx=0 tx=0).stop 2023-10-14T08:53:19.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 shutdown_connections 2023-10-14T08:53:19.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d1356ac0 0x5603d1358ee0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1352230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131ee20 0x5603d134acb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb6037fe700 0 client.25234 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:19.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/1581092137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131f780 0x5603d134b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 >> 172.21.15.6:0/1581092137 conn(0x5603d124cdd0 msgr2=0x5603d1319bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 shutdown_connections 2023-10-14T08:53:19.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.762+0000 7fb636a9fb80 1 -- 172.21.15.6:0/1581092137 wait complete. 2023-10-14T08:53:19.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.763+0000 7fb636a9fb80 20 client.25234 trim_cache size 0 max 16384 2023-10-14T08:53:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 Processor -- start 2023-10-14T08:53:19.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 -- start start 2023-10-14T08:53:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d131f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131f780 0x5603d13521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d1320620 0x5603d1352a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d10f2920 con 0x5603d131ee20 2023-10-14T08:53:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d131fb60 con 0x5603d131f780 2023-10-14T08:53:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d134a160 con 0x5603d1320620 2023-10-14T08:53:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d131f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d131f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33240/0 (socket says 172.21.15.6:33240) 2023-10-14T08:53:19.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 -- 172.21.15.6:0/2810371837 learned_addr learned my addr 172.21.15.6:0/2810371837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb628e52700 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d1320620 0x5603d1352a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb6237fe700 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131f780 0x5603d13521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 -- 172.21.15.6:0/2810371837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d1320620 msgr2=0x5603d1352a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d1320620 0x5603d1352a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 -- 172.21.15.6:0/2810371837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131f780 msgr2=0x5603d13521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131f780 0x5603d13521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb623fff700 1 -- 172.21.15.6:0/2810371837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d109cde0 con 0x5603d131ee20 2023-10-14T08:53:19.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.786+0000 7fb6237fe700 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131f780 0x5603d13521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.787+0000 7fb623fff700 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d131f200 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0964d0 tx=0x7fb61c098010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae442ec443a69099 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.787+0000 7fb61affd700 1 -- 172.21.15.6:0/2810371837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0b90c0 con 0x5603d131ee20 2023-10-14T08:53:19.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.788+0000 7fb61affd700 1 -- 172.21.15.6:0/2810371837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5603d1276ef0 con 0x5603d131ee20 2023-10-14T08:53:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.788+0000 7fb61affd700 1 -- 172.21.15.6:0/2810371837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0b92b0 con 0x5603d131ee20 2023-10-14T08:53:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.788+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2810371837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 msgr2=0x5603d131f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.788+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d131f200 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0964d0 tx=0x7fb61c098010 comp rx=0 tx=0).stop 2023-10-14T08:53:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2810371837 shutdown_connections 2023-10-14T08:53:19.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d1320620 0x5603d1352a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d131f200 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2810371837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d131f780 0x5603d13521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2810371837 >> 172.21.15.6:0/2810371837 conn(0x5603d124cdd0 msgr2=0x5603d1319240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2810371837 shutdown_connections 2023-10-14T08:53:19.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.789+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2810371837 wait complete. 2023-10-14T08:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 -- start start 2023-10-14T08:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 Processor -- start 2023-10-14T08:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d13502e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1350820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1351830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d1351d70 con 0x5603d131ee20 2023-10-14T08:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d1351ee0 con 0x5603d1320620 2023-10-14T08:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d13520a0 con 0x5603d131f780 2023-10-14T08:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.790+0000 7fb636a9fb80 10 client.0 _ll_register_callbacks cb 0x7fb61c0995a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1350820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1350820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58880/0 (socket says 172.21.15.6:58880) 2023-10-14T08:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 -- 172.21.15.6:0/2780019047 learned_addr learned my addr 172.21.15.6:0/2780019047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb623fff700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d13502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb628e52700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1351830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 -- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 msgr2=0x5603d1351830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1351830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 -- 172.21.15.6:0/2780019047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 msgr2=0x5603d13502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:19.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d13502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.791+0000 7fb6237fe700 1 -- 172.21.15.6:0/2780019047 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61401d070 con 0x5603d131f780 2023-10-14T08:53:19.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.792+0000 7fb6237fe700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1350820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb614009990 tx=0x7fb614009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d1c7b4a5d7d208 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb6037fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb6037fe700 1 -- 172.21.15.6:0/2780019047 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61402f040 con 0x5603d131f780 2023-10-14T08:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb60c011cf0 con 0x5603d131f780 2023-10-14T08:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb6037fe700 1 -- 172.21.15.6:0/2780019047 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb614035470 con 0x5603d131f780 2023-10-14T08:53:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb6037fe700 1 -- 172.21.15.6:0/2780019047 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb614035970 con 0x5603d131f780 2023-10-14T08:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb636a9fb80 10 client.25240 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fb60c009830 con 0x5603d131f780 2023-10-14T08:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.793+0000 7fb6037fe700 1 -- 172.21.15.6:0/2780019047 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb60c011cf0 con 0x5603d131f780 2023-10-14T08:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb6037fe700 1 -- 172.21.15.6:0/2780019047 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb614035ad0 con 0x5603d131f780 2023-10-14T08:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb636a9fb80 10 client.25240 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb636a9fb80 10 client.25240 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-14T08:53:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb636a9fb80 20 client.25240 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d13abb00 0x5603d13adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb636a9fb80 4 client.25240 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.800+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5603d126ae50 con 0x5603d13abb00 2023-10-14T08:53:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.808+0000 7fb623fff700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d13abb00 0x5603d13adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.809+0000 7fb623fff700 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d13abb00 0x5603d13adf20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3f31b842b5dea0d server_cookie=5538fa554a937b3b in_seq=0 out_seq=0 2023-10-14T08:53:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.809+0000 7fb6037fe700 10 client.25240 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.810+0000 7fb6037fe700 1 -- 172.21.15.6:0/2780019047 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5603d126ae50 con 0x5603d13abb00 2023-10-14T08:53:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.810+0000 7fb6037fe700 10 client.25240 handle_command_reply: tid=0 2023-10-14T08:53:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.810+0000 7fb636a9fb80 1 client.25240 shutdown 2023-10-14T08:53:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.813+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 msgr2=0x5603d1350820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.813+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1350820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb614009990 tx=0x7fb614009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 shutdown_connections 2023-10-14T08:53:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x5603d13abb00 0x5603d13adf20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5603d1320620 0x5603d1351830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5603d131ee20 0x5603d13502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 --2- 172.21.15.6:0/2780019047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5603d131f780 0x5603d1350820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 >> 172.21.15.6:0/2780019047 conn(0x5603d124cdd0 msgr2=0x5603d1352a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb6037fe700 0 client.25240 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 shutdown_connections 2023-10-14T08:53:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 1 -- 172.21.15.6:0/2780019047 wait complete. 2023-10-14T08:53:19.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.815+0000 7fb636a9fb80 20 client.25240 trim_cache size 0 max 16384 2023-10-14T08:53:19.819 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6100a14d0 msgr2=0x7fb6100a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6100a14d0 0x7fb6100a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb614005950 tx=0x7fb6140058e0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 msgr2=0x7fb62419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 0x7fb62419d6e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c370 tx=0x7fb61c00c680 comp rx=0 tx=0).stop 2023-10-14T08:53:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 shutdown_connections 2023-10-14T08:53:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6100a14d0 0x7fb6100a3990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6241019b0 0x7fb6241a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240ffea0 0x7fb62419d6e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 --2- 172.21.15.6:0/3726217379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb624100ff0 0x7fb62419dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 >> 172.21.15.6:0/3726217379 conn(0x7fb6240fb430 msgr2=0x7fb6240fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 shutdown_connections 2023-10-14T08:53:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:19.823+0000 7fb62a8b5700 1 -- 172.21.15.6:0/3726217379 wait complete. 2023-10-14T08:53:19.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-14T08:53:20.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.040+0000 7f981ff6c700 1 -- 172.21.15.6:0/113074094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 msgr2=0x7f9818109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.040+0000 7f981ff6c700 1 --2- 172.21.15.6:0/113074094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 0x7f9818109410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f981000f400 tx=0x7f981000f710 comp rx=0 tx=0).stop 2023-10-14T08:53:20.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.040+0000 7f981ff6c700 1 -- 172.21.15.6:0/113074094 shutdown_connections 2023-10-14T08:53:20.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.040+0000 7f981ff6c700 1 --2- 172.21.15.6:0/113074094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 0x7f9818109410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.040+0000 7f981ff6c700 1 --2- 172.21.15.6:0/113074094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9818100fd0 0x7f98181013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.040+0000 7f981ff6c700 1 --2- 172.21.15.6:0/113074094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f9818102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.041+0000 7f981ff6c700 1 -- 172.21.15.6:0/113074094 >> 172.21.15.6:0/113074094 conn(0x7f98180fc520 msgr2=0x7f98180fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.044+0000 7f981ff6c700 1 -- 172.21.15.6:0/113074094 shutdown_connections 2023-10-14T08:53:20.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.044+0000 7f981ff6c700 1 -- 172.21.15.6:0/113074094 wait complete. 2023-10-14T08:53:20.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 Processor -- start 2023-10-14T08:53:20.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 -- start start 2023-10-14T08:53:20.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9818100fd0 0x7f981819d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f981819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 0x7f98181a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98181a4e10 con 0x7f98181021c0 2023-10-14T08:53:20.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98181a4f50 con 0x7f9818100fd0 2023-10-14T08:53:20.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981ff6c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98181a50e0 con 0x7f9818102b60 2023-10-14T08:53:20.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.045+0000 7f981d507700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f981819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f981819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33260/0 (socket says 172.21.15.6:33260) 2023-10-14T08:53:20.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 -- 172.21.15.6:0/3115472354 learned_addr learned my addr 172.21.15.6:0/3115472354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981dd08700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9818100fd0 0x7f981819d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981e509700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 0x7f98181a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 -- 172.21.15.6:0/3115472354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 msgr2=0x7f98181a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 0x7f98181a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 -- 172.21.15.6:0/3115472354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9818100fd0 msgr2=0x7f981819d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9818100fd0 0x7f981819d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.046+0000 7f981d507700 1 -- 172.21.15.6:0/3115472354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981000f0b0 con 0x7f98181021c0 2023-10-14T08:53:20.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.047+0000 7f981d507700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f981819d7d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f981400e9a0 tx=0x7f981400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.047+0000 7f980effd700 1 -- 172.21.15.6:0/3115472354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814009790 con 0x7f98181021c0 2023-10-14T08:53:20.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.047+0000 7f980effd700 1 -- 172.21.15.6:0/3115472354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f981400ce80 con 0x7f98181021c0 2023-10-14T08:53:20.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.047+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98181a53c0 con 0x7f98181021c0 2023-10-14T08:53:20.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.047+0000 7f980effd700 1 -- 172.21.15.6:0/3115472354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814018680 con 0x7f98181021c0 2023-10-14T08:53:20.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.047+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98181a5920 con 0x7f98181021c0 2023-10-14T08:53:20.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.052+0000 7f980effd700 1 -- 172.21.15.6:0/3115472354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9814010430 con 0x7f98181021c0 2023-10-14T08:53:20.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 Processor -- start 2023-10-14T08:53:20.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f980effd700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f98040a1550 0x7f98040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 -- start start 2023-10-14T08:53:20.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fc6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f981e509700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f98040a1550 0x7f98040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc6780 0x5646a6fc7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fc7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6f3ac70 con 0x5646a6fc5e20 2023-10-14T08:53:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6f1fc60 con 0x5646a6fc6780 2023-10-14T08:53:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f982c156b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6f1d580 con 0x5646a6fc7620 2023-10-14T08:53:20.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f980effd700 1 -- 172.21.15.6:0/3115472354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9814014070 con 0x7f98181021c0 2023-10-14T08:53:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f981dd08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fc6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f981dd08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fc6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33268/0 (socket says 172.21.15.6:33268) 2023-10-14T08:53:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.053+0000 7f981dd08700 1 -- 172.21.15.6:0/346708706 learned_addr learned my addr 172.21.15.6:0/346708706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fc7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981d507700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc6780 0x5646a6fc7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f98040a1550 0x7f98040a3a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9810011010 tx=0x7f981000d110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 -- 172.21.15.6:0/346708706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc6780 msgr2=0x5646a6fc7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc6780 0x5646a6fc7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 -- 172.21.15.6:0/346708706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 msgr2=0x5646a6fc6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fc6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 -- 172.21.15.6:0/346708706 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646a6ed63f0 con 0x5646a6fc7620 2023-10-14T08:53:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981d507700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc6780 0x5646a6fc7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981dd08700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fc6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:20.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f981e509700 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fc7aa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9810019040 tx=0x7f9810026000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e20d18348b2f96af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.054+0000 7f9803fff700 1 -- 172.21.15.6:0/346708706 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810012070 con 0x5646a6fc7620 2023-10-14T08:53:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.055+0000 7f9803fff700 1 -- 172.21.15.6:0/346708706 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f981000b590 con 0x5646a6fc7620 2023-10-14T08:53:20.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.055+0000 7f9803fff700 1 -- 172.21.15.6:0/346708706 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810005840 con 0x5646a6fc7620 2023-10-14T08:53:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.056+0000 7f982c156b80 1 -- 172.21.15.6:0/346708706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 msgr2=0x5646a6fc7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.056+0000 7f982c156b80 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fc7aa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9810019040 tx=0x7f9810026000 comp rx=0 tx=0).stop 2023-10-14T08:53:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.056+0000 7f982c156b80 1 -- 172.21.15.6:0/346708706 shutdown_connections 2023-10-14T08:53:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.056+0000 7f982c156b80 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fc7aa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.056+0000 7f982c156b80 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fc6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.056+0000 7f982c156b80 1 --2- 172.21.15.6:0/346708706 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc6780 0x5646a6fc7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.057+0000 7f982c156b80 1 -- 172.21.15.6:0/346708706 >> 172.21.15.6:0/346708706 conn(0x5646a6ef3dd0 msgr2=0x5646a6fc0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.057+0000 7f982c156b80 1 -- 172.21.15.6:0/346708706 shutdown_connections 2023-10-14T08:53:20.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.057+0000 7f982c156b80 1 -- 172.21.15.6:0/346708706 wait complete. 2023-10-14T08:53:20.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.057+0000 7f982c156b80 1 -- start start 2023-10-14T08:53:20.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.057+0000 7f982c156b80 1 Processor -- start 2023-10-14T08:53:20.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.058+0000 7f982c156b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc5e20 0x5646a6fcfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f982c156b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f982c156b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fd7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f982c156b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6f18e70 con 0x5646a6fc6780 2023-10-14T08:53:20.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f982c156b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6eb5710 con 0x5646a6fc5e20 2023-10-14T08:53:20.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f982c156b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6eb53b0 con 0x5646a6fc7620 2023-10-14T08:53:20.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f982c156b80 10 client.0 _ll_register_callbacks cb 0x5646a6d12800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:20.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981e509700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fd7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981e509700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fd7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58910/0 (socket says 172.21.15.6:58910) 2023-10-14T08:53:20.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981e509700 1 -- 172.21.15.6:0/3708546291 learned_addr learned my addr 172.21.15.6:0/3708546291 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981d507700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981dd08700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc5e20 0x5646a6fcfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981e509700 1 -- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc5e20 msgr2=0x5646a6fcfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.059+0000 7f981e509700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc5e20 0x5646a6fcfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.060+0000 7f981e509700 1 -- 172.21.15.6:0/3708546291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 msgr2=0x5646a6fd01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.060+0000 7f981e509700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.060+0000 7f981e509700 1 -- 172.21.15.6:0/3708546291 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98181a5920 con 0x5646a6fc7620 2023-10-14T08:53:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.060+0000 7f981e509700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fd7220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f981000f750 tx=0x7f981000b520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbb74992cda4ef5b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.061+0000 7f98017fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.061+0000 7f98017fa700 1 -- 172.21.15.6:0/3708546291 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810012040 con 0x5646a6fc7620 2023-10-14T08:53:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.061+0000 7f98017fa700 1 -- 172.21.15.6:0/3708546291 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9810005740 con 0x5646a6fc7620 2023-10-14T08:53:20.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.061+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646a6f1def0 con 0x5646a6fc7620 2023-10-14T08:53:20.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f98017fa700 1 -- 172.21.15.6:0/3708546291 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9810005900 con 0x5646a6fc7620 2023-10-14T08:53:20.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 10 client.25252 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:20.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f9818109d60 con 0x5646a6fc7620 2023-10-14T08:53:20.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f98017fa700 1 -- 172.21.15.6:0/3708546291 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646a6f1def0 con 0x5646a6fc7620 2023-10-14T08:53:20.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f98017fa700 1 -- 172.21.15.6:0/3708546291 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9810045070 con 0x5646a6fc7620 2023-10-14T08:53:20.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 10 client.25252 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 10 client.25252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2023-10-14T08:53:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 20 client.25252 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a6fdb610 0x5646a6fdda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 4 client.25252 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646a6f95c10 con 0x5646a6fdb610 2023-10-14T08:53:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.062+0000 7f981dd08700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a6fdb610 0x5646a6fdda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.063+0000 7f98017fa700 10 client.25252 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.063+0000 7f981dd08700 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a6fdb610 0x5646a6fdda30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e08f914f60df2650 server_cookie=3008d805e91a384e in_seq=0 out_seq=0 2023-10-14T08:53:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f98017fa700 1 -- 172.21.15.6:0/3708546291 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5646a6f95c10 con 0x5646a6fdb610 2023-10-14T08:53:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f98017fa700 10 client.25252 handle_command_reply: tid=0 2023-10-14T08:53:20.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f982c156b80 1 client.25252 shutdown 2023-10-14T08:53:20.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 msgr2=0x5646a6fd7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f982c156b80 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fd7220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f981000f750 tx=0x7f981000b520 comp rx=0 tx=0).stop 2023-10-14T08:53:20.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 shutdown_connections 2023-10-14T08:53:20.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f982c156b80 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a6fdb610 0x5646a6fdda30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.064+0000 7f982c156b80 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc7620 0x5646a6fd7220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.065+0000 7f982c156b80 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc5e20 0x5646a6fcfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.065+0000 7f982c156b80 1 --2- 172.21.15.6:0/3708546291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.065+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 >> 172.21.15.6:0/3708546291 conn(0x5646a6ef3dd0 msgr2=0x5646a6fc0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.065+0000 7f98017fa700 0 client.25252 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.065+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 shutdown_connections 2023-10-14T08:53:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.065+0000 7f982c156b80 1 -- 172.21.15.6:0/3708546291 wait complete. 2023-10-14T08:53:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.066+0000 7f982c156b80 20 client.25252 trim_cache size 0 max 16384 2023-10-14T08:53:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.094+0000 7f982c156b80 1 Processor -- start 2023-10-14T08:53:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 -- start start 2023-10-14T08:53:20.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc5e20 0x5646a6fc7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fcda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6fcf870 con 0x5646a6fc6780 2023-10-14T08:53:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6d99920 con 0x5646a6fc7620 2023-10-14T08:53:20.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.096+0000 7f982c156b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6fcf150 con 0x5646a6fc5e20 2023-10-14T08:53:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.098+0000 7f981e509700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fcda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.098+0000 7f981e509700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fcda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60272/0 (socket says 172.21.15.6:60272) 2023-10-14T08:53:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.098+0000 7f981e509700 1 -- 172.21.15.6:0/2284555748 learned_addr learned my addr 172.21.15.6:0/2284555748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.098+0000 7f981dd08700 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc5e20 0x5646a6fc7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.099+0000 7f981e509700 1 -- 172.21.15.6:0/2284555748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc5e20 msgr2=0x5646a6fc7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.099+0000 7f981e509700 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc5e20 0x5646a6fc7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.099+0000 7f981e509700 1 -- 172.21.15.6:0/2284555748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 msgr2=0x5646a6fd71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.099+0000 7f981e509700 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.099+0000 7f981e509700 1 -- 172.21.15.6:0/2284555748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646a6d43de0 con 0x5646a6fc7620 2023-10-14T08:53:20.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.099+0000 7f981e509700 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fcda80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f981000f400 tx=0x7f9810003ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588cafc1969e82c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.102+0000 7f980cff9700 1 -- 172.21.15.6:0/2284555748 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810077020 con 0x5646a6fc7620 2023-10-14T08:53:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.103+0000 7f980cff9700 1 -- 172.21.15.6:0/2284555748 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f981002cd70 con 0x5646a6fc7620 2023-10-14T08:53:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.103+0000 7f980cff9700 1 -- 172.21.15.6:0/2284555748 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810012070 con 0x5646a6fc7620 2023-10-14T08:53:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 -- 172.21.15.6:0/2284555748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 msgr2=0x5646a6fcda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fcda80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f981000f400 tx=0x7f9810003ef0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 -- 172.21.15.6:0/2284555748 shutdown_connections 2023-10-14T08:53:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fcda80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc5e20 0x5646a6fc7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 --2- 172.21.15.6:0/2284555748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc6780 0x5646a6fd71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 -- 172.21.15.6:0/2284555748 >> 172.21.15.6:0/2284555748 conn(0x5646a6ef3dd0 msgr2=0x5646a6fdd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 -- 172.21.15.6:0/2284555748 shutdown_connections 2023-10-14T08:53:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.105+0000 7f982c156b80 1 -- 172.21.15.6:0/2284555748 wait complete. 2023-10-14T08:53:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 -- start start 2023-10-14T08:53:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 Processor -- start 2023-10-14T08:53:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fd4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 0x5646a6fd4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fd5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6fd61b0 con 0x5646a6fc5e20 2023-10-14T08:53:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6fd6320 con 0x5646a6fc7620 2023-10-14T08:53:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a6fd64e0 con 0x5646a6fc6780 2023-10-14T08:53:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.106+0000 7f982c156b80 10 client.0 _ll_register_callbacks cb 0x7f9808009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 0x5646a6fd4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 0x5646a6fd4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58920/0 (socket says 172.21.15.6:58920) 2023-10-14T08:53:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 -- 172.21.15.6:0/991236847 learned_addr learned my addr 172.21.15.6:0/991236847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 -- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 msgr2=0x5646a6fd5c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fd5c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 -- 172.21.15.6:0/991236847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 msgr2=0x5646a6fd4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fd4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.107+0000 7f981d507700 1 -- 172.21.15.6:0/991236847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9818109d60 con 0x5646a6fc6780 2023-10-14T08:53:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.108+0000 7f981d507700 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 0x5646a6fd4c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9814010ac0 tx=0x7f981409a6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c2eb2d6adb4c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.108+0000 7f98017fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.108+0000 7f98017fa700 1 -- 172.21.15.6:0/991236847 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981409e2f0 con 0x5646a6fc6780 2023-10-14T08:53:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.108+0000 7f98017fa700 1 -- 172.21.15.6:0/991236847 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f98140cae40 con 0x5646a6fc6780 2023-10-14T08:53:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.111+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f981000b590 con 0x5646a6fc6780 2023-10-14T08:53:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.111+0000 7f98017fa700 1 -- 172.21.15.6:0/991236847 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98140a2530 con 0x5646a6fc6780 2023-10-14T08:53:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.111+0000 7f982c156b80 10 client.25258 fetch_fsmap learned FSMap version 27 2023-10-14T08:53:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.111+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5646a6d2cc60 con 0x5646a6fc6780 2023-10-14T08:53:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f98017fa700 1 -- 172.21.15.6:0/991236847 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f981000b590 con 0x5646a6fc6780 2023-10-14T08:53:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f98017fa700 1 -- 172.21.15.6:0/991236847 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9814095f90 con 0x5646a6fc6780 2023-10-14T08:53:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f982c156b80 10 client.25258 fetch_fsmap finished waiting for FSMap version 27 2023-10-14T08:53:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f982c156b80 10 client.25258 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2023-10-14T08:53:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f982c156b80 20 client.25258 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f982c156b80 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a702fc10 0x5646a7032030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f982c156b80 4 client.25258 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.114+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5646a6f11e50 con 0x5646a702fc10 2023-10-14T08:53:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.118+0000 7f981dd08700 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a702fc10 0x5646a7032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f98017fa700 10 client.25258 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f981dd08700 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a702fc10 0x5646a7032030 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8911ed58cba53d39 server_cookie=19f06176015bea5e in_seq=0 out_seq=0 2023-10-14T08:53:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f98017fa700 1 -- 172.21.15.6:0/991236847 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5646a6f11e50 con 0x5646a702fc10 2023-10-14T08:53:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f98017fa700 10 client.25258 handle_command_reply: tid=0 2023-10-14T08:53:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f982c156b80 1 client.25258 shutdown 2023-10-14T08:53:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 msgr2=0x5646a6fd4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.119+0000 7f982c156b80 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 0x5646a6fd4c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9814010ac0 tx=0x7f981409a6e0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 shutdown_connections 2023-10-14T08:53:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f982c156b80 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x5646a702fc10 0x5646a7032030 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f982c156b80 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646a6fc7620 0x5646a6fd5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f982c156b80 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646a6fc5e20 0x5646a6fd4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f982c156b80 1 --2- 172.21.15.6:0/991236847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646a6fc6780 0x5646a6fd4c60 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9814010ac0 tx=0x7f981409a6e0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 >> 172.21.15.6:0/991236847 conn(0x5646a6ef3dd0 msgr2=0x5646a6fcda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.120+0000 7f98017fa700 0 client.25258 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.127+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 shutdown_connections 2023-10-14T08:53:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.127+0000 7f982c156b80 1 -- 172.21.15.6:0/991236847 wait complete. 2023-10-14T08:53:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.127+0000 7f982c156b80 20 client.25258 trim_cache size 0 max 16384 2023-10-14T08:53:20.129 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f98040a1550 msgr2=0x7f98040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f98040a1550 0x7f98040a3a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9810011010 tx=0x7f981000d110 comp rx=0 tx=0).stop 2023-10-14T08:53:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 msgr2=0x7f981819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f981819d7d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f981400e9a0 tx=0x7f981400ecb0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 shutdown_connections 2023-10-14T08:53:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9818102b60 0x7f98181a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f98040a1550 0x7f98040a3a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9818100fd0 0x7f981819d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 --2- 172.21.15.6:0/3115472354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98181021c0 0x7f981819d7d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.128+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 >> 172.21.15.6:0/3115472354 conn(0x7f98180fc520 msgr2=0x7f98180fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.131+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 shutdown_connections 2023-10-14T08:53:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.133+0000 7f981ff6c700 1 -- 172.21.15.6:0/3115472354 wait complete. 2023-10-14T08:53:20.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-14T08:53:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 -- 172.21.15.6:0/3345835201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b80ff270 msgr2=0x7f80b80ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 --2- 172.21.15.6:0/3345835201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b80ff270 0x7f80b80ff690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009990 tx=0x7f80b4009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 -- 172.21.15.6:0/3345835201 shutdown_connections 2023-10-14T08:53:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 --2- 172.21.15.6:0/3345835201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b8102be0 0x7f80b8109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 --2- 172.21.15.6:0/3345835201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b80ff270 0x7f80b80ff690 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 --2- 172.21.15.6:0/3345835201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b81026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.364+0000 7f80c000b700 1 -- 172.21.15.6:0/3345835201 >> 172.21.15.6:0/3345835201 conn(0x7f80b80fab80 msgr2=0x7f80b80fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.365+0000 7f80c000b700 1 -- 172.21.15.6:0/3345835201 shutdown_connections 2023-10-14T08:53:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.365+0000 7f80c000b700 1 -- 172.21.15.6:0/3345835201 wait complete. 2023-10-14T08:53:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.365+0000 7f80c000b700 1 Processor -- start 2023-10-14T08:53:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.366+0000 7f80c000b700 1 -- start start 2023-10-14T08:53:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.366+0000 7f80c000b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b80ff270 0x7f80b8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80c000b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80c000b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b8102be0 0x7f80b819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80c000b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b819e870 con 0x7f80b8102be0 2023-10-14T08:53:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80c000b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b819e9e0 con 0x7f80b80ff270 2023-10-14T08:53:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80c000b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b819eba0 con 0x7f80b8102240 2023-10-14T08:53:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bdda7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b80ff270 0x7f80b8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bdda7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b80ff270 0x7f80b8196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60290/0 (socket says 172.21.15.6:60290) 2023-10-14T08:53:20.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b8197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58936/0 (socket says 172.21.15.6:58936) 2023-10-14T08:53:20.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bdda7700 1 -- 172.21.15.6:0/1613684100 learned_addr learned my addr 172.21.15.6:0/1613684100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 -- 172.21.15.6:0/1613684100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b80ff270 msgr2=0x7f80b8196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b80ff270 0x7f80b8196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 -- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b8102be0 msgr2=0x7f80b819e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b8102be0 0x7f80b819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.367+0000 7f80bd5a6700 1 -- 172.21.15.6:0/1613684100 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40095f0 con 0x7f80b8102240 2023-10-14T08:53:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.368+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b8197270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9f0 tx=0x7f80a800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.368+0000 7f80aeffd700 1 -- 172.21.15.6:0/1613684100 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80096d0 con 0x7f80b8102240 2023-10-14T08:53:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.368+0000 7f80aeffd700 1 -- 172.21.15.6:0/1613684100 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80a800cbd0 con 0x7f80b8102240 2023-10-14T08:53:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.368+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b819ee80 con 0x7f80b8102240 2023-10-14T08:53:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.368+0000 7f80aeffd700 1 -- 172.21.15.6:0/1613684100 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8018680 con 0x7f80b8102240 2023-10-14T08:53:20.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.368+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b819f350 con 0x7f80b8102240 2023-10-14T08:53:20.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.371+0000 7f80aeffd700 1 -- 172.21.15.6:0/1613684100 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f80a800cd40 con 0x7f80b8102240 2023-10-14T08:53:20.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.372+0000 7f80aeffd700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f80a40a1500 0x7f80a40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.372+0000 7f80aeffd700 1 -- 172.21.15.6:0/1613684100 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f80a8014070 con 0x7f80b8102240 2023-10-14T08:53:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.372+0000 7f80bdda7700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f80a40a1500 0x7f80a40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.373+0000 7f80cc1f5b80 1 Processor -- start 2023-10-14T08:53:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.373+0000 7f80cc1f5b80 1 -- start start 2023-10-14T08:53:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8a790 0x562140e8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8b630 0x562140e8bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140dedc70 con 0x562140e89e30 2023-10-14T08:53:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140dd2c60 con 0x562140e8a790 2023-10-14T08:53:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140dd0580 con 0x562140e8b630 2023-10-14T08:53:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80bd5a6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8a790 0x562140e8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80be5a8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8b630 0x562140e8bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80bd5a6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8a790 0x562140e8b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60298/0 (socket says 172.21.15.6:60298) 2023-10-14T08:53:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80bd5a6700 1 -- 172.21.15.6:0/851101849 learned_addr learned my addr 172.21.15.6:0/851101849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80bdda7700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f80a40a1500 0x7f80a40a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80b400b2e0 tx=0x7f80b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80bdda7700 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80be5a8700 1 -- 172.21.15.6:0/851101849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8a790 msgr2=0x562140e8b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80be5a8700 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8a790 0x562140e8b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80be5a8700 1 -- 172.21.15.6:0/851101849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 msgr2=0x562140e8a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80be5a8700 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80be5a8700 1 -- 172.21.15.6:0/851101849 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562140d893f0 con 0x562140e8b630 2023-10-14T08:53:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.374+0000 7f80bdda7700 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.375+0000 7f80be5a8700 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8b630 0x562140e8bab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009cc0 tx=0x7f80b000b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54e36724e7ac9b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.375+0000 7f80a3fff700 1 -- 172.21.15.6:0/851101849 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000bcf0 con 0x562140e8b630 2023-10-14T08:53:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.375+0000 7f80a3fff700 1 -- 172.21.15.6:0/851101849 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b000be50 con 0x562140e8b630 2023-10-14T08:53:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.375+0000 7f80a3fff700 1 -- 172.21.15.6:0/851101849 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00127d0 con 0x562140e8b630 2023-10-14T08:53:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.376+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/851101849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8b630 msgr2=0x562140e8bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.376+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8b630 0x562140e8bab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009cc0 tx=0x7f80b000b410 comp rx=0 tx=0).stop 2023-10-14T08:53:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.376+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/851101849 shutdown_connections 2023-10-14T08:53:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.376+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8b630 0x562140e8bab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.376+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.376+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/851101849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8a790 0x562140e8b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.377+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/851101849 >> 172.21.15.6:0/851101849 conn(0x562140da6dd0 msgr2=0x562140e73fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.377+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/851101849 shutdown_connections 2023-10-14T08:53:20.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.377+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/851101849 wait complete. 2023-10-14T08:53:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.377+0000 7f80cc1f5b80 1 -- start start 2023-10-14T08:53:20.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.377+0000 7f80cc1f5b80 1 Processor -- start 2023-10-14T08:53:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 0x562140e93ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e8a790 0x562140e94220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140dcbe70 con 0x562140e8a790 2023-10-14T08:53:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140d68710 con 0x562140e8b630 2023-10-14T08:53:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140d683b0 con 0x562140e89e30 2023-10-14T08:53:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80cc1f5b80 10 client.0 _ll_register_callbacks cb 0x562140bc5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80bdda7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 0x562140e93ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80be5a8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80bdda7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 0x562140e93ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58948/0 (socket says 172.21.15.6:58948) 2023-10-14T08:53:20.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.378+0000 7f80bdda7700 1 -- 172.21.15.6:0/2983666273 learned_addr learned my addr 172.21.15.6:0/2983666273 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80bdda7700 1 -- 172.21.15.6:0/2983666273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 msgr2=0x562140e9b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80bdda7700 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80bdda7700 1 -- 172.21.15.6:0/2983666273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e8a790 msgr2=0x562140e94220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:20.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80bdda7700 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e8a790 0x562140e94220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80bdda7700 1 -- 172.21.15.6:0/2983666273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b00098f0 con 0x562140e89e30 2023-10-14T08:53:20.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80be5a8700 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:20.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80bdda7700 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 0x562140e93ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80b4024bf0 tx=0x7f80b401a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba264656e511a648 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:20.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.379+0000 7f80a17fa700 1 -- 172.21.15.6:0/2983666273 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4010b00 con 0x562140e89e30 2023-10-14T08:53:20.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80a17fa700 1 -- 172.21.15.6:0/2983666273 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f80b4010c60 con 0x562140e89e30 2023-10-14T08:53:20.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562140dd0ef0 con 0x562140e89e30 2023-10-14T08:53:20.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80a17fa700 1 -- 172.21.15.6:0/2983666273 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80b4010e20 con 0x562140e89e30 2023-10-14T08:53:20.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 10 client.25270 fetch_fsmap learned FSMap version 28 2023-10-14T08:53:20.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562140bf6de0 con 0x562140e89e30 2023-10-14T08:53:20.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80a17fa700 1 -- 172.21.15.6:0/2983666273 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562140dd0ef0 con 0x562140e89e30 2023-10-14T08:53:20.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80a17fa700 1 -- 172.21.15.6:0/2983666273 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f80b403a3e0 con 0x562140e89e30 2023-10-14T08:53:20.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 10 client.25270 fetch_fsmap finished waiting for FSMap version 28 2023-10-14T08:53:20.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 10 client.25270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:20.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 20 client.25270 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:20.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea8490 0x562140eaa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 4 client.25270 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:20.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.380+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562140e48c10 con 0x562140ea8490 2023-10-14T08:53:20.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.381+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea8490 0x562140eaa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.382+0000 7f80a17fa700 10 client.25270 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:20.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.382+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea8490 0x562140eaa880 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d81708b04026b91 server_cookie=8fea8d1620016986 in_seq=0 out_seq=0 2023-10-14T08:53:20.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.382+0000 7f80a17fa700 1 -- 172.21.15.6:0/2983666273 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562140e48c10 con 0x562140ea8490 2023-10-14T08:53:20.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.382+0000 7f80a17fa700 10 client.25270 handle_command_reply: tid=0 2023-10-14T08:53:20.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.382+0000 7f80cc1f5b80 1 client.25270 shutdown 2023-10-14T08:53:20.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 msgr2=0x562140e93ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 0x562140e93ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80b4024bf0 tx=0x7f80b401a050 comp rx=0 tx=0).stop 2023-10-14T08:53:20.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 shutdown_connections 2023-10-14T08:53:20.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea8490 0x562140eaa880 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e89e30 0x562140e93ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/2983666273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e8a790 0x562140e94220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80a17fa700 0 client.25270 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:20.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 >> 172.21.15.6:0/2983666273 conn(0x562140da6dd0 msgr2=0x562140e73bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.383+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 shutdown_connections 2023-10-14T08:53:20.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.384+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/2983666273 wait complete. 2023-10-14T08:53:20.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.384+0000 7f80cc1f5b80 20 client.25270 trim_cache size 0 max 16384 2023-10-14T08:53:20.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 Processor -- start 2023-10-14T08:53:20.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 -- start start 2023-10-14T08:53:20.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e9b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140c4c920 con 0x562140e89e30 2023-10-14T08:53:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140e92780 con 0x562140e8b630 2023-10-14T08:53:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140e93190 con 0x562140e8a790 2023-10-14T08:53:20.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80be5a8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80be5a8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60310/0 (socket says 172.21.15.6:60310) 2023-10-14T08:53:20.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.404+0000 7f80be5a8700 1 -- 172.21.15.6:0/850572912 learned_addr learned my addr 172.21.15.6:0/850572912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80bdda7700 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80be5a8700 1 -- 172.21.15.6:0/850572912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 msgr2=0x562140e9b220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:20.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80be5a8700 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e9b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80be5a8700 1 -- 172.21.15.6:0/850572912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 msgr2=0x562140e8ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80be5a8700 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80be5a8700 1 -- 172.21.15.6:0/850572912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562140bdfc60 con 0x562140e8b630 2023-10-14T08:53:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80bdda7700 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80be5a8700 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009cc0 tx=0x7f80b0007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94d50c658aefea0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.405+0000 7f80acff9700 1 -- 172.21.15.6:0/850572912 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0013720 con 0x562140e8b630 2023-10-14T08:53:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.406+0000 7f80acff9700 1 -- 172.21.15.6:0/850572912 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b0013d40 con 0x562140e8b630 2023-10-14T08:53:20.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.406+0000 7f80acff9700 1 -- 172.21.15.6:0/850572912 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0012cf0 con 0x562140e8b630 2023-10-14T08:53:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.407+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/850572912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 msgr2=0x562140e9b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.407+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009cc0 tx=0x7f80b0007000 comp rx=0 tx=0).stop 2023-10-14T08:53:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.408+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/850572912 shutdown_connections 2023-10-14T08:53:20.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.408+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9b9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.408+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e8ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.408+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/850572912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e9b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.408+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/850572912 >> 172.21.15.6:0/850572912 conn(0x562140da6dd0 msgr2=0x562140e92990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.409+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/850572912 shutdown_connections 2023-10-14T08:53:20.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.411+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/850572912 wait complete. 2023-10-14T08:53:20.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.411+0000 7f80cc1f5b80 1 -- start start 2023-10-14T08:53:20.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 Processor -- start 2023-10-14T08:53:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e96b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e97080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140e9a5e0 con 0x562140e89e30 2023-10-14T08:53:20.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140e9a750 con 0x562140e8b630 2023-10-14T08:53:20.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562140e9a8c0 con 0x562140e8a790 2023-10-14T08:53:20.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80cc1f5b80 10 client.0 _ll_register_callbacks cb 0x7f80b4024720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:20.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80bdda7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e96b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80bdda7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e96b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33324/0 (socket says 172.21.15.6:33324) 2023-10-14T08:53:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80bdda7700 1 -- 172.21.15.6:0/1478533285 learned_addr learned my addr 172.21.15.6:0/1478533285 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.412+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80bdda7700 1 -- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 msgr2=0x562140e97080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80bdda7700 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e97080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80bdda7700 1 -- 172.21.15.6:0/1478533285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 msgr2=0x562140e9a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80bdda7700 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80bdda7700 1 -- 172.21.15.6:0/1478533285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562140d893f0 con 0x562140e89e30 2023-10-14T08:53:20.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80bdda7700 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e96b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f80b4005d90 tx=0x7f80b4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b4cc6d08e23cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:20.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:20.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80a17fa700 1 -- 172.21.15.6:0/1478533285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4069070 con 0x562140e89e30 2023-10-14T08:53:20.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.413+0000 7f80a17fa700 1 -- 172.21.15.6:0/1478533285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f80b4010750 con 0x562140e89e30 2023-10-14T08:53:20.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.414+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80b000be50 con 0x562140e89e30 2023-10-14T08:53:20.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.414+0000 7f80a17fa700 1 -- 172.21.15.6:0/1478533285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80b4010910 con 0x562140e89e30 2023-10-14T08:53:20.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.414+0000 7f80cc1f5b80 10 client.15573 fetch_fsmap learned FSMap version 28 2023-10-14T08:53:20.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.414+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562140c1d250 con 0x562140e89e30 2023-10-14T08:53:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.414+0000 7f80a17fa700 1 -- 172.21.15.6:0/1478533285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b000be50 con 0x562140e89e30 2023-10-14T08:53:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80a17fa700 1 -- 172.21.15.6:0/1478533285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f80b406c030 con 0x562140e89e30 2023-10-14T08:53:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80cc1f5b80 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2023-10-14T08:53:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80cc1f5b80 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80cc1f5b80 20 client.15573 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea0370 0x562140ea27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80cc1f5b80 4 client.15573 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.415+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562140dc4e50 con 0x562140ea0370 2023-10-14T08:53:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.416+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea0370 0x562140ea27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.417+0000 7f80bd5a6700 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea0370 0x562140ea27b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87b6c12c3fafb178 server_cookie=d486e27ff4e8637d in_seq=0 out_seq=0 2023-10-14T08:53:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.418+0000 7f80a17fa700 10 client.15573 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.423+0000 7f80a17fa700 1 -- 172.21.15.6:0/1478533285 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562140dc4e50 con 0x562140ea0370 2023-10-14T08:53:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.423+0000 7f80a17fa700 10 client.15573 handle_command_reply: tid=0 2023-10-14T08:53:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.423+0000 7f80cc1f5b80 1 client.15573 shutdown 2023-10-14T08:53:20.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.423+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 msgr2=0x562140e96b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e96b40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f80b4005d90 tx=0x7f80b4005f10 comp rx=0 tx=0).stop 2023-10-14T08:53:20.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 shutdown_connections 2023-10-14T08:53:20.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562140ea0370 0x562140ea27b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562140e8b630 0x562140e9a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562140e89e30 0x562140e96b40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 --2- 172.21.15.6:0/1478533285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562140e8a790 0x562140e97080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 >> 172.21.15.6:0/1478533285 conn(0x562140da6dd0 msgr2=0x562140e9b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80a17fa700 0 client.15573 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 shutdown_connections 2023-10-14T08:53:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 1 -- 172.21.15.6:0/1478533285 wait complete. 2023-10-14T08:53:20.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.424+0000 7f80cc1f5b80 20 client.15573 trim_cache size 0 max 16384 2023-10-14T08:53:20.429 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:20.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f80a40a1500 msgr2=0x7f80a40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f80a40a1500 0x7f80a40a39c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80b400b2e0 tx=0x7f80b4005fb0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 msgr2=0x7f80b8197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b8197270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80a800e9f0 tx=0x7f80a800ed00 comp rx=0 tx=0).stop 2023-10-14T08:53:20.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 shutdown_connections 2023-10-14T08:53:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b8102be0 0x7f80b819e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f80a40a1500 0x7f80a40a39c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80b80ff270 0x7f80b8196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 --2- 172.21.15.6:0/1613684100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80b8102240 0x7f80b8197270 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:20.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.425+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 >> 172.21.15.6:0/1613684100 conn(0x7f80b80fab80 msgr2=0x7f80b80fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:20.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.427+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 shutdown_connections 2023-10-14T08:53:20.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:20.427+0000 7f80c000b700 1 -- 172.21.15.6:0/1613684100 wait complete. 2023-10-14T08:53:20.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:20 smithi006 ceph-mon[99452]: pgmap v322: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 79 MiB/s wr, 1.15k op/s 2023-10-14T08:53:20.446 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:20 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:20.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:20 smithi178 ceph-mon[103612]: pgmap v322: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 79 MiB/s wr, 1.15k op/s 2023-10-14T08:53:20.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:20 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:20.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:20 smithi057 ceph-mon[103313]: pgmap v322: 97 pgs: 97 active+clean; 1.3 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 79 MiB/s wr, 1.15k op/s 2023-10-14T08:53:20.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:20 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 20.0 s, 3671.6 tps, lat 27.194 ms stddev 33.495 2023-10-14T08:53:21.448 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-14T08:53:21.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-14T08:53:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 -- 172.21.15.6:0/1697764198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1114101070 msgr2=0x7f11141014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 --2- 172.21.15.6:0/1697764198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1114101070 0x7f11141014f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1108009990 tx=0x7f1108009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 -- 172.21.15.6:0/1697764198 shutdown_connections 2023-10-14T08:53:21.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 --2- 172.21.15.6:0/1697764198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1114101a30 0x7f1114108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 --2- 172.21.15.6:0/1697764198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11140ffe90 0x7f11141002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 --2- 172.21.15.6:0/1697764198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1114101070 0x7f11141014f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 -- 172.21.15.6:0/1697764198 >> 172.21.15.6:0/1697764198 conn(0x7f11140fb450 msgr2=0x7f11140fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 -- 172.21.15.6:0/1697764198 shutdown_connections 2023-10-14T08:53:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.626+0000 7f1118e45700 1 -- 172.21.15.6:0/1697764198 wait complete. 2023-10-14T08:53:21.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.627+0000 7f1118e45700 1 Processor -- start 2023-10-14T08:53:21.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 -- start start 2023-10-14T08:53:21.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 0x7f1114195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1114101070 0x7f11141960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1114101a30 0x7f111419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111419d700 con 0x7f11140ffe90 2023-10-14T08:53:21.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111419d840 con 0x7f1114101070 2023-10-14T08:53:21.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1118e45700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111419d9d0 con 0x7f1114101a30 2023-10-14T08:53:21.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 0x7f1114195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 0x7f1114195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33338/0 (socket says 172.21.15.6:33338) 2023-10-14T08:53:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 -- 172.21.15.6:0/660029658 learned_addr learned my addr 172.21.15.6:0/660029658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1111d9b700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1114101070 0x7f11141960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f1112d9d700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1114101a30 0x7f111419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 -- 172.21.15.6:0/660029658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1114101a30 msgr2=0x7f111419d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1114101a30 0x7f111419d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 -- 172.21.15.6:0/660029658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1114101070 msgr2=0x7f11141960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1114101070 0x7f11141960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 -- 172.21.15.6:0/660029658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11080095f0 con 0x7f11140ffe90 2023-10-14T08:53:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.628+0000 7f111259c700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 0x7f1114195b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f110400c370 tx=0x7f110400c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.629+0000 7f11037fe700 1 -- 172.21.15.6:0/660029658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040090d0 con 0x7f11140ffe90 2023-10-14T08:53:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.629+0000 7f11037fe700 1 -- 172.21.15.6:0/660029658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1104009230 con 0x7f11140ffe90 2023-10-14T08:53:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.629+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114068f00 con 0x7f11140ffe90 2023-10-14T08:53:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.629+0000 7f11037fe700 1 -- 172.21.15.6:0/660029658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040048a0 con 0x7f11140ffe90 2023-10-14T08:53:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.629+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1114069410 con 0x7f11140ffe90 2023-10-14T08:53:21.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.631+0000 7f11037fe700 1 -- 172.21.15.6:0/660029658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1104003a00 con 0x7f11140ffe90 2023-10-14T08:53:21.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.631+0000 7f11037fe700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f10fc0a1480 0x7f10fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.632+0000 7f1111d9b700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f10fc0a1480 0x7f10fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.632+0000 7f11037fe700 1 -- 172.21.15.6:0/660029658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1104016070 con 0x7f11140ffe90 2023-10-14T08:53:21.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.632+0000 7f1111d9b700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f10fc0a1480 0x7f10fc0a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f110800b2e0 tx=0x7f1108005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 Processor -- start 2023-10-14T08:53:21.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 -- start start 2023-10-14T08:53:21.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 0x561c76a271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a27730 0x561c76a28040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a28a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c7699bcf0 con 0x561c76a26dd0 2023-10-14T08:53:21.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76980ce0 con 0x561c76a27730 2023-10-14T08:53:21.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.633+0000 7f112502fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c7697e600 con 0x561c76a285d0 2023-10-14T08:53:21.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.634+0000 7f1111d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a27730 0x561c76a28040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.634+0000 7f1111d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a27730 0x561c76a28040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60338/0 (socket says 172.21.15.6:60338) 2023-10-14T08:53:21.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.634+0000 7f1111d9b700 1 -- 172.21.15.6:0/809827777 learned_addr learned my addr 172.21.15.6:0/809827777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a28a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 -- 172.21.15.6:0/809827777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a27730 msgr2=0x561c76a28040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a27730 0x561c76a28040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 -- 172.21.15.6:0/809827777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 msgr2=0x561c76a271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 0x561c76a271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 -- 172.21.15.6:0/809827777 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c76937470 con 0x561c76a285d0 2023-10-14T08:53:21.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.635+0000 7f1112d9d700 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a28a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f110c00abf0 tx=0x7f110c00af00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beea18ab7a4db518 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.636+0000 7f1100ff9700 1 -- 172.21.15.6:0/809827777 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00fd80 con 0x561c76a285d0 2023-10-14T08:53:21.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.636+0000 7f1100ff9700 1 -- 172.21.15.6:0/809827777 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f110c004cf0 con 0x561c76a285d0 2023-10-14T08:53:21.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.636+0000 7f1100ff9700 1 -- 172.21.15.6:0/809827777 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c018440 con 0x561c76a285d0 2023-10-14T08:53:21.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 -- 172.21.15.6:0/809827777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 msgr2=0x561c76a28a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a28a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f110c00abf0 tx=0x7f110c00af00 comp rx=0 tx=0).stop 2023-10-14T08:53:21.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 -- 172.21.15.6:0/809827777 shutdown_connections 2023-10-14T08:53:21.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a28a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 0x561c76a271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 --2- 172.21.15.6:0/809827777 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a27730 0x561c76a28040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 -- 172.21.15.6:0/809827777 >> 172.21.15.6:0/809827777 conn(0x561c76954e50 msgr2=0x561c76a22060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 -- 172.21.15.6:0/809827777 shutdown_connections 2023-10-14T08:53:21.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.637+0000 7f112502fb80 1 -- 172.21.15.6:0/809827777 wait complete. 2023-10-14T08:53:21.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 -- start start 2023-10-14T08:53:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 Processor -- start 2023-10-14T08:53:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 0x561c76a30dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a27730 0x561c76a31300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 0x561c76a38340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76979ef0 con 0x561c76a26dd0 2023-10-14T08:53:21.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76916790 con 0x561c76a285d0 2023-10-14T08:53:21.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76916430 con 0x561c76a27730 2023-10-14T08:53:21.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f112502fb80 10 client.0 _ll_register_callbacks cb 0x561c76773880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:21.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 0x561c76a38340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 0x561c76a38340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60342/0 (socket says 172.21.15.6:60342) 2023-10-14T08:53:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.638+0000 7f1112d9d700 1 -- 172.21.15.6:0/2586119778 learned_addr learned my addr 172.21.15.6:0/2586119778 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.639+0000 7f1112d9d700 1 -- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a27730 msgr2=0x561c76a31300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.639+0000 7f1112d9d700 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a27730 0x561c76a31300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.639+0000 7f1112d9d700 1 -- 172.21.15.6:0/2586119778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 msgr2=0x561c76a30dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.639+0000 7f1112d9d700 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 0x561c76a30dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.639+0000 7f1112d9d700 1 -- 172.21.15.6:0/2586119778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c00a820 con 0x561c76a285d0 2023-10-14T08:53:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f1112d9d700 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 0x561c76a38340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f110c000c00 tx=0x7f110c005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bb0febe33a1c26 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f10f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:21.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2586119778 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c004960 con 0x561c76a285d0 2023-10-14T08:53:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c7697ef70 con 0x561c76a285d0 2023-10-14T08:53:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2586119778 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f110c004ac0 con 0x561c76a285d0 2023-10-14T08:53:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2586119778 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f110c022450 con 0x561c76a285d0 2023-10-14T08:53:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f112502fb80 10 client.25199 fetch_fsmap learned FSMap version 28 2023-10-14T08:53:21.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.640+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561c767a4e60 con 0x561c76a285d0 2023-10-14T08:53:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2586119778 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561c7697ef70 con 0x561c76a285d0 2023-10-14T08:53:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2586119778 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f110c020070 con 0x561c76a285d0 2023-10-14T08:53:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f112502fb80 10 client.25199 fetch_fsmap finished waiting for FSMap version 28 2023-10-14T08:53:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f112502fb80 10 client.25199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f112502fb80 20 client.25199 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:21.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f112502fb80 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76a4dba0 0x561c76a4ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f112502fb80 4 client.25199 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:21.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c769f6c90 con 0x561c76a4dba0 2023-10-14T08:53:21.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f111259c700 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76a4dba0 0x561c76a4ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f111259c700 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76a4dba0 0x561c76a4ffc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33a54c4083f8147 server_cookie=f430806fe7c23cfd in_seq=0 out_seq=0 2023-10-14T08:53:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.641+0000 7f10f9ffb700 10 client.25199 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.642+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2586119778 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c769f6c90 con 0x561c76a4dba0 2023-10-14T08:53:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.642+0000 7f10f9ffb700 10 client.25199 handle_command_reply: tid=0 2023-10-14T08:53:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.642+0000 7f112502fb80 1 client.25199 shutdown 2023-10-14T08:53:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 msgr2=0x561c76a38340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 0x561c76a38340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f110c000c00 tx=0x7f110c005280 comp rx=0 tx=0).stop 2023-10-14T08:53:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 shutdown_connections 2023-10-14T08:53:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76a4dba0 0x561c76a4ffc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a285d0 0x561c76a38340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f10f9ffb700 0 client.25199 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a26dd0 0x561c76a30dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 --2- 172.21.15.6:0/2586119778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a27730 0x561c76a31300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 >> 172.21.15.6:0/2586119778 conn(0x561c76954e50 msgr2=0x561c76a21c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 shutdown_connections 2023-10-14T08:53:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.643+0000 7f112502fb80 1 -- 172.21.15.6:0/2586119778 wait complete. 2023-10-14T08:53:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.644+0000 7f112502fb80 20 client.25199 trim_cache size 0 max 16384 2023-10-14T08:53:21.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.677+0000 7f112502fb80 1 Processor -- start 2023-10-14T08:53:21.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 -- start start 2023-10-14T08:53:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a219d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a38300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a21f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c767fa9a0 con 0x561c76a27730 2023-10-14T08:53:21.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76a22450 con 0x561c76a26dd0 2023-10-14T08:53:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f112502fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76a20a70 con 0x561c76a285d0 2023-10-14T08:53:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a21f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a21f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:58994/0 (socket says 172.21.15.6:58994) 2023-10-14T08:53:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f1112d9d700 1 -- 172.21.15.6:0/3759221241 learned_addr learned my addr 172.21.15.6:0/3759221241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f111259c700 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f1111d9b700 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a38300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f111259c700 1 -- 172.21.15.6:0/3759221241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 msgr2=0x561c76a21f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f111259c700 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a21f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f111259c700 1 -- 172.21.15.6:0/3759221241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 msgr2=0x561c76a38300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f111259c700 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a38300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f111259c700 1 -- 172.21.15.6:0/3759221241 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c7678dce0 con 0x561c76a26dd0 2023-10-14T08:53:21.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.678+0000 7f1112d9d700 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a21f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:21.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.679+0000 7f111259c700 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a219d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x561c76a26b70 tx=0x7f1104087040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32320c851ee0643b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.680+0000 7f11017fa700 1 -- 172.21.15.6:0/3759221241 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400e050 con 0x561c76a26dd0 2023-10-14T08:53:21.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.681+0000 7f11017fa700 1 -- 172.21.15.6:0/3759221241 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f11040093a0 con 0x561c76a26dd0 2023-10-14T08:53:21.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.681+0000 7f11017fa700 1 -- 172.21.15.6:0/3759221241 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110409a9e0 con 0x561c76a26dd0 2023-10-14T08:53:21.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.681+0000 7f112502fb80 1 -- 172.21.15.6:0/3759221241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 msgr2=0x561c76a219d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.681+0000 7f112502fb80 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a219d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x561c76a26b70 tx=0x7f1104087040 comp rx=0 tx=0).stop 2023-10-14T08:53:21.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.682+0000 7f112502fb80 1 -- 172.21.15.6:0/3759221241 shutdown_connections 2023-10-14T08:53:21.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.682+0000 7f112502fb80 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76a21f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.682+0000 7f112502fb80 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a219d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.682+0000 7f112502fb80 1 --2- 172.21.15.6:0/3759221241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a38300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.682+0000 7f112502fb80 1 -- 172.21.15.6:0/3759221241 >> 172.21.15.6:0/3759221241 conn(0x561c76954e50 msgr2=0x561c76a212c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.684+0000 7f112502fb80 1 -- 172.21.15.6:0/3759221241 shutdown_connections 2023-10-14T08:53:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.684+0000 7f112502fb80 1 -- 172.21.15.6:0/3759221241 wait complete. 2023-10-14T08:53:21.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.684+0000 7f112502fb80 1 -- start start 2023-10-14T08:53:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.684+0000 7f112502fb80 1 Processor -- start 2023-10-14T08:53:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a37260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76aa19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76a37e80 con 0x561c76a27730 2023-10-14T08:53:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76aa1ee0 con 0x561c76a26dd0 2023-10-14T08:53:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c76aa2020 con 0x561c76a285d0 2023-10-14T08:53:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f112502fb80 10 client.0 _ll_register_callbacks cb 0x7f110800bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76aa19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1111d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76aa19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59002/0 (socket says 172.21.15.6:59002) 2023-10-14T08:53:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 -- 172.21.15.6:0/2213408130 learned_addr learned my addr 172.21.15.6:0/2213408130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1111d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a377a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33364/0 (socket says 172.21.15.6:33364) 2023-10-14T08:53:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f111259c700 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a37260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 -- 172.21.15.6:0/2213408130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 msgr2=0x561c76a37260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a37260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 -- 172.21.15.6:0/2213408130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 msgr2=0x561c76a377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a377a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.685+0000 7f1112d9d700 1 -- 172.21.15.6:0/2213408130 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c767a4e60 con 0x561c76a285d0 2023-10-14T08:53:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f1112d9d700 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76aa19a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f110c018dd0 tx=0x7f110c018e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b351d1a2b406dba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f10f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2213408130 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0057b0 con 0x561c76a285d0 2023-10-14T08:53:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2213408130 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f110c000e40 con 0x561c76a285d0 2023-10-14T08:53:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f110c004cf0 con 0x561c76a285d0 2023-10-14T08:53:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2213408130 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f110c018870 con 0x561c76a285d0 2023-10-14T08:53:21.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f112502fb80 10 client.25288 fetch_fsmap learned FSMap version 28 2023-10-14T08:53:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.686+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f1114069410 con 0x561c76a285d0 2023-10-14T08:53:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2213408130 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f110c004cf0 con 0x561c76a285d0 2023-10-14T08:53:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2213408130 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f110c020070 con 0x561c76a285d0 2023-10-14T08:53:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f112502fb80 10 client.25288 fetch_fsmap finished waiting for FSMap version 28 2023-10-14T08:53:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f112502fb80 10 client.25288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f112502fb80 20 client.25288 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f112502fb80 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76aa3830 0x561c76aa5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f112502fb80 4 client.25288 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-14T08:53:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561c76972ed0 con 0x561c76aa3830 2023-10-14T08:53:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.687+0000 7f111259c700 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76aa3830 0x561c76aa5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.688+0000 7f111259c700 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76aa3830 0x561c76aa5c50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cc23bcdb4c21fe3 server_cookie=bef5f08a8d317a40 in_seq=0 out_seq=0 2023-10-14T08:53:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.688+0000 7f10f9ffb700 10 client.25288 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f10f9ffb700 1 -- 172.21.15.6:0/2213408130 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561c76972ed0 con 0x561c76aa3830 2023-10-14T08:53:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f10f9ffb700 10 client.25288 handle_command_reply: tid=0 2023-10-14T08:53:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 client.25288 shutdown 2023-10-14T08:53:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 msgr2=0x561c76aa19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76aa19a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f110c018dd0 tx=0x7f110c018e00 comp rx=0 tx=0).stop 2023-10-14T08:53:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 shutdown_connections 2023-10-14T08:53:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561c76aa3830 0x561c76aa5c50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c76a285d0 0x561c76aa19a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561c76a26dd0 0x561c76a37260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f10f9ffb700 0 client.25288 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 --2- 172.21.15.6:0/2213408130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c76a27730 0x561c76a377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 >> 172.21.15.6:0/2213408130 conn(0x561c76954e50 msgr2=0x561c76a21b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 shutdown_connections 2023-10-14T08:53:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.689+0000 7f112502fb80 1 -- 172.21.15.6:0/2213408130 wait complete. 2023-10-14T08:53:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.690+0000 7f112502fb80 20 client.25288 trim_cache size 0 max 16384 2023-10-14T08:53:21.701 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:53:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-10-14T08:53:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "1eb93b51-061b-4fe1-94e4-83ca1e4c431a", 2023-10-14T08:53:21.702 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-10-14T08:53:21.702 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:53:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f10fc0a1480 msgr2=0x7f10fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f10fc0a1480 0x7f10fc0a3940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f110800b2e0 tx=0x7f1108005fb0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 msgr2=0x7f1114195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 0x7f1114195b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f110400c370 tx=0x7f110400c680 comp rx=0 tx=0).stop 2023-10-14T08:53:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 shutdown_connections 2023-10-14T08:53:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1114101a30 0x7f111419d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11140ffe90 0x7f1114195b80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f10fc0a1480 0x7f10fc0a3940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 --2- 172.21.15.6:0/660029658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1114101070 0x7f11141960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 >> 172.21.15.6:0/660029658 conn(0x7f11140fb450 msgr2=0x7f11140fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 shutdown_connections 2023-10-14T08:53:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.692+0000 7f1118e45700 1 -- 172.21.15.6:0/660029658 wait complete. 2023-10-14T08:53:21.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-14T08:53:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 -- 172.21.15.6:0/3591277126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970075ce0 msgr2=0x7fe970078170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 --2- 172.21.15.6:0/3591277126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970075ce0 0x7fe970078170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe958009850 tx=0x7fe958009b60 comp rx=0 tx=0).stop 2023-10-14T08:53:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 -- 172.21.15.6:0/3591277126 shutdown_connections 2023-10-14T08:53:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 --2- 172.21.15.6:0/3591277126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9700786b0 0x7fe97007ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 --2- 172.21.15.6:0/3591277126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970072e00 0x7fe970073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 --2- 172.21.15.6:0/3591277126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970075ce0 0x7fe970078170 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 -- 172.21.15.6:0/3591277126 >> 172.21.15.6:0/3591277126 conn(0x7fe97006dd90 msgr2=0x7fe970070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 -- 172.21.15.6:0/3591277126 shutdown_connections 2023-10-14T08:53:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.939+0000 7fe975496700 1 -- 172.21.15.6:0/3591277126 wait complete. 2023-10-14T08:53:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 Processor -- start 2023-10-14T08:53:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 -- start start 2023-10-14T08:53:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970072e00 0x7fe9701b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 0x7fe9701b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9700786b0 0x7fe9701b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701b8010 con 0x7fe9700786b0 2023-10-14T08:53:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701b8180 con 0x7fe970075ce0 2023-10-14T08:53:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe975496700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701b8340 con 0x7fe970072e00 2023-10-14T08:53:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe9667fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 0x7fe9701b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9700786b0 0x7fe9701b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe9667fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 0x7fe9701b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60370/0 (socket says 172.21.15.6:60370) 2023-10-14T08:53:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.940+0000 7fe9667fc700 1 -- 172.21.15.6:0/3374178698 learned_addr learned my addr 172.21.15.6:0/3374178698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe96effd700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970072e00 0x7fe9701b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe9667fc700 1 -- 172.21.15.6:0/3374178698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970072e00 msgr2=0x7fe9701b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe9667fc700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970072e00 0x7fe9701b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe9667fc700 1 -- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9700786b0 msgr2=0x7fe9701b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe9667fc700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9700786b0 0x7fe9701b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe9667fc700 1 -- 172.21.15.6:0/3374178698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580094c0 con 0x7fe970075ce0 2023-10-14T08:53:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.941+0000 7fe9667fc700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 0x7fe9701b5340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe958009720 tx=0x7fe9580057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.942+0000 7fe96cff9700 1 -- 172.21.15.6:0/3374178698 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958005da0 con 0x7fe970075ce0 2023-10-14T08:53:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.942+0000 7fe96cff9700 1 -- 172.21.15.6:0/3374178698 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe95800cd90 con 0x7fe970075ce0 2023-10-14T08:53:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.942+0000 7fe96cff9700 1 -- 172.21.15.6:0/3374178698 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580296d0 con 0x7fe970075ce0 2023-10-14T08:53:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.942+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9701aebd0 con 0x7fe970075ce0 2023-10-14T08:53:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.942+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701af030 con 0x7fe970075ce0 2023-10-14T08:53:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.947+0000 7fe981680b80 1 Processor -- start 2023-10-14T08:53:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.947+0000 7fe981680b80 1 -- start start 2023-10-14T08:53:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe981680b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 0x561b153eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe981680b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153ed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe981680b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe981680b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b15358c70 con 0x561b153ecf90 2023-10-14T08:53:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe981680b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b1533dc60 con 0x561b153ec630 2023-10-14T08:53:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe981680b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b1533b580 con 0x561b153ede30 2023-10-14T08:53:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 0x561b153eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 0x561b153eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60374/0 (socket says 172.21.15.6:60374) 2023-10-14T08:53:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4054875147 learned_addr learned my addr 172.21.15.6:0/4054875147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4054875147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 msgr2=0x561b153ee2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153ee2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4054875147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 msgr2=0x561b153ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4054875147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b152f43f0 con 0x561b153ec630 2023-10-14T08:53:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96cff9700 1 -- 172.21.15.6:0/3374178698 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe958026070 con 0x7fe970075ce0 2023-10-14T08:53:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.948+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 0x561b153eca50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe96800a430 tx=0x7fe968009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a05da03c458e46 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.949+0000 7fe9657fa700 1 -- 172.21.15.6:0/4054875147 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968010040 con 0x561b153ec630 2023-10-14T08:53:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.949+0000 7fe96cff9700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe95c0a15d0 0x7fe95c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.949+0000 7fe96cff9700 1 -- 172.21.15.6:0/3374178698 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe958012070 con 0x7fe970075ce0 2023-10-14T08:53:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.950+0000 7fe96effd700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe95c0a15d0 0x7fe95c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.951+0000 7fe9657fa700 1 -- 172.21.15.6:0/4054875147 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe968014ae0 con 0x561b153ec630 2023-10-14T08:53:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.951+0000 7fe9657fa700 1 -- 172.21.15.6:0/4054875147 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968013a80 con 0x561b153ec630 2023-10-14T08:53:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 -- 172.21.15.6:0/4054875147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 msgr2=0x561b153eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 0x561b153eca50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe96800a430 tx=0x7fe968009650 comp rx=0 tx=0).stop 2023-10-14T08:53:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe96effd700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe95c0a15d0 0x7fe95c0a3a90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe960009e30 tx=0x7fe960009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 -- 172.21.15.6:0/4054875147 shutdown_connections 2023-10-14T08:53:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153ee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ec630 0x561b153eca50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 --2- 172.21.15.6:0/4054875147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.952+0000 7fe981680b80 1 -- 172.21.15.6:0/4054875147 >> 172.21.15.6:0/4054875147 conn(0x561b15311dd0 msgr2=0x561b153def90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.953+0000 7fe981680b80 1 -- 172.21.15.6:0/4054875147 shutdown_connections 2023-10-14T08:53:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.953+0000 7fe981680b80 1 -- 172.21.15.6:0/4054875147 wait complete. 2023-10-14T08:53:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.953+0000 7fe981680b80 1 -- start start 2023-10-14T08:53:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.953+0000 7fe981680b80 1 Processor -- start 2023-10-14T08:53:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ecf90 0x561b153f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153fda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b15336e70 con 0x561b153ec630 2023-10-14T08:53:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b152d3710 con 0x561b153ecf90 2023-10-14T08:53:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b152d33b0 con 0x561b153ede30 2023-10-14T08:53:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe981680b80 10 client.0 _ll_register_callbacks cb 0x561b15130800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33390/0 (socket says 172.21.15.6:33390) 2023-10-14T08:53:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96effd700 1 -- 172.21.15.6:0/4004466757 learned_addr learned my addr 172.21.15.6:0/4004466757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe9667fc700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ecf90 0x561b153f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4004466757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ecf90 msgr2=0x561b153f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ecf90 0x561b153f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4004466757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 msgr2=0x561b153f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 -- 172.21.15.6:0/4004466757 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe968009c60 con 0x561b153ede30 2023-10-14T08:53:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153fda60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe96800a430 tx=0x7fe968015ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2416de982538a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.954+0000 7fe9567fc700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.955+0000 7fe9567fc700 1 -- 172.21.15.6:0/4004466757 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968010070 con 0x561b153ede30 2023-10-14T08:53:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.955+0000 7fe9567fc700 1 -- 172.21.15.6:0/4004466757 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe968006e40 con 0x561b153ede30 2023-10-14T08:53:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.955+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b1533bef0 con 0x561b153ede30 2023-10-14T08:53:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.955+0000 7fe9567fc700 1 -- 172.21.15.6:0/4004466757 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9680148b0 con 0x561b153ede30 2023-10-14T08:53:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.955+0000 7fe981680b80 10 client.25297 fetch_fsmap learned FSMap version 28 2023-10-14T08:53:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.955+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561b15161de0 con 0x561b153ede30 2023-10-14T08:53:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.956+0000 7fe9567fc700 1 -- 172.21.15.6:0/4004466757 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561b1533bef0 con 0x561b153ede30 2023-10-14T08:53:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.956+0000 7fe9567fc700 1 -- 172.21.15.6:0/4004466757 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe968008030 con 0x561b153ede30 2023-10-14T08:53:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.957+0000 7fe981680b80 10 client.25297 fetch_fsmap finished waiting for FSMap version 28 2023-10-14T08:53:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.957+0000 7fe981680b80 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.957+0000 7fe981680b80 20 client.25297 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.957+0000 7fe981680b80 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b153e5820 0x561b153e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.957+0000 7fe981680b80 4 client.25297 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.957+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b153b3c10 con 0x561b153e5820 2023-10-14T08:53:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.958+0000 7fe96effd700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b153e5820 0x561b153e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.960+0000 7fe96effd700 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b153e5820 0x561b153e7c40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb87228c5bc06e1 server_cookie=829c771b522f9052 in_seq=0 out_seq=0 2023-10-14T08:53:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.960+0000 7fe9567fc700 10 client.25297 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.960+0000 7fe9567fc700 1 -- 172.21.15.6:0/4004466757 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561b153b3c10 con 0x561b153e5820 2023-10-14T08:53:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.960+0000 7fe9567fc700 10 client.25297 handle_command_reply: tid=0 2023-10-14T08:53:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.960+0000 7fe981680b80 1 client.25297 shutdown 2023-10-14T08:53:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 msgr2=0x561b153fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153fda60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe96800a430 tx=0x7fe968015ef0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 shutdown_connections 2023-10-14T08:53:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b153e5820 0x561b153e7c40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ede30 0x561b153fda60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 --2- 172.21.15.6:0/4004466757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ecf90 0x561b153f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 >> 172.21.15.6:0/4004466757 conn(0x561b15311dd0 msgr2=0x561b153deba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe9567fc700 0 client.25297 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 shutdown_connections 2023-10-14T08:53:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 1 -- 172.21.15.6:0/4004466757 wait complete. 2023-10-14T08:53:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.962+0000 7fe981680b80 20 client.25297 trim_cache size 0 max 16384 2023-10-14T08:53:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.989+0000 7fe981680b80 1 Processor -- start 2023-10-14T08:53:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.989+0000 7fe981680b80 1 -- start start 2023-10-14T08:53:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.990+0000 7fe981680b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ec630 0x561b153e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.990+0000 7fe981680b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153fda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.990+0000 7fe981680b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.990+0000 7fe981680b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b151b7920 con 0x561b153ecf90 2023-10-14T08:53:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.990+0000 7fe981680b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b153f57e0 con 0x561b153ede30 2023-10-14T08:53:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.990+0000 7fe981680b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b153f5990 con 0x561b153ec630 2023-10-14T08:53:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153fda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33398/0 (socket says 172.21.15.6:33398) 2023-10-14T08:53:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 -- 172.21.15.6:0/209255654 learned_addr learned my addr 172.21.15.6:0/209255654 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe96effd700 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ec630 0x561b153e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 -- 172.21.15.6:0/209255654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ec630 msgr2=0x561b153e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ec630 0x561b153e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 -- 172.21.15.6:0/209255654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 msgr2=0x561b153f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe9667fc700 1 -- 172.21.15.6:0/209255654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b1514ac60 con 0x561b153ecf90 2023-10-14T08:53:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe96effd700 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ec630 0x561b153e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.991+0000 7fe96f7fe700 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.992+0000 7fe9667fc700 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153fda20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe958005b40 tx=0x7fe958020c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c48b61e623bc00 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.992+0000 7fe965ffb700 1 -- 172.21.15.6:0/209255654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95809afd0 con 0x561b153ecf90 2023-10-14T08:53:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.992+0000 7fe965ffb700 1 -- 172.21.15.6:0/209255654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe95809bd70 con 0x561b153ecf90 2023-10-14T08:53:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.992+0000 7fe965ffb700 1 -- 172.21.15.6:0/209255654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95809ab60 con 0x561b153ecf90 2023-10-14T08:53:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 -- 172.21.15.6:0/209255654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 msgr2=0x561b153fda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153fda20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe958005b40 tx=0x7fe958020c20 comp rx=0 tx=0).stop 2023-10-14T08:53:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 -- 172.21.15.6:0/209255654 shutdown_connections 2023-10-14T08:53:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ec630 0x561b153e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 --2- 172.21.15.6:0/209255654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ecf90 0x561b153fda20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 -- 172.21.15.6:0/209255654 >> 172.21.15.6:0/209255654 conn(0x561b15311dd0 msgr2=0x561b153e7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 -- 172.21.15.6:0/209255654 shutdown_connections 2023-10-14T08:53:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 -- 172.21.15.6:0/209255654 wait complete. 2023-10-14T08:53:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.993+0000 7fe981680b80 1 -- start start 2023-10-14T08:53:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 Processor -- start 2023-10-14T08:53:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ecf90 0x561b153fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b153fa320 con 0x561b153ec630 2023-10-14T08:53:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b153fa490 con 0x561b153ede30 2023-10-14T08:53:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b153fa650 con 0x561b153ecf90 2023-10-14T08:53:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe981680b80 10 client.0 _ll_register_callbacks cb 0x7fe960009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe96effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe96effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33404/0 (socket says 172.21.15.6:33404) 2023-10-14T08:53:22.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.994+0000 7fe96effd700 1 -- 172.21.15.6:0/2231092078 learned_addr learned my addr 172.21.15.6:0/2231092078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe96effd700 1 -- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ecf90 msgr2=0x561b153fd7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe96effd700 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ecf90 0x561b153fd7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe96effd700 1 -- 172.21.15.6:0/2231092078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 msgr2=0x561b153f9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:22.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe96effd700 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe96effd700 1 -- 172.21.15.6:0/2231092078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe960004160 con 0x561b153ec630 2023-10-14T08:53:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe96effd700 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153fd2a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x561b153e84e0 tx=0x7fe960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191c98ea64848eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.995+0000 7fe9567fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.996+0000 7fe9567fc700 1 -- 172.21.15.6:0/2231092078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960024040 con 0x561b153ec630 2023-10-14T08:53:22.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.996+0000 7fe9567fc700 1 -- 172.21.15.6:0/2231092078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe960003680 con 0x561b153ec630 2023-10-14T08:53:22.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.996+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe968014ae0 con 0x561b153ec630 2023-10-14T08:53:22.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe9567fc700 1 -- 172.21.15.6:0/2231092078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe960017070 con 0x561b153ec630 2023-10-14T08:53:22.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 10 client.15600 fetch_fsmap learned FSMap version 28 2023-10-14T08:53:22.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x561b15161de0 con 0x561b153ec630 2023-10-14T08:53:22.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe9567fc700 1 -- 172.21.15.6:0/2231092078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe968014ae0 con 0x561b153ec630 2023-10-14T08:53:22.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe9567fc700 1 -- 172.21.15.6:0/2231092078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 28) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe960039070 con 0x561b153ec630 2023-10-14T08:53:22.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 10 client.15600 fetch_fsmap finished waiting for FSMap version 28 2023-10-14T08:53:22.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:22.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 20 client.15600 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:22.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b1545f690 0x561b15461ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:22.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 4 client.15600 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-14T08:53:22.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.998+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561b1532fe50 con 0x561b1545f690 2023-10-14T08:53:22.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.999+0000 7fe9667fc700 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b1545f690 0x561b15461ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.999+0000 7fe9567fc700 10 client.15600 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:21.999+0000 7fe9667fc700 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b1545f690 0x561b15461ab0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00b413125a0b386 server_cookie=9907a566a5dbed4a in_seq=0 out_seq=0 2023-10-14T08:53:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe9567fc700 1 -- 172.21.15.6:0/2231092078 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561b1532fe50 con 0x561b1545f690 2023-10-14T08:53:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe9567fc700 10 client.15600 handle_command_reply: tid=0 2023-10-14T08:53:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 client.15600 shutdown 2023-10-14T08:53:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 msgr2=0x561b153fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153fd2a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x561b153e84e0 tx=0x7fe960004750 comp rx=0 tx=0).stop 2023-10-14T08:53:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 shutdown_connections 2023-10-14T08:53:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561b1545f690 0x561b15461ab0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561b153ede30 0x561b153f9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b153ec630 0x561b153fd2a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 --2- 172.21.15.6:0/2231092078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b153ecf90 0x561b153fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 >> 172.21.15.6:0/2231092078 conn(0x561b15311dd0 msgr2=0x561b153f42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe9567fc700 0 client.15600 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 shutdown_connections 2023-10-14T08:53:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.000+0000 7fe981680b80 1 -- 172.21.15.6:0/2231092078 wait complete. 2023-10-14T08:53:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.001+0000 7fe981680b80 20 client.15600 trim_cache size 0 max 16384 2023-10-14T08:53:22.016 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:53:22.016 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-14T08:53:22.016 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-10-14T08:53:22.016 INFO:teuthology.orchestra.run.smithi006.stdout: "1eb93b51-061b-4fe1-94e4-83ca1e4c431a": { 2023-10-14T08:53:22.016 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-10-14T08:53:22.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "1eb93b51-061b-4fe1-94e4-83ca1e4c431a", 2023-10-14T08:53:22.017 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-10-14T08:53:22.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T08:53:22.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T08:53:22.017 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:53:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe95c0a15d0 msgr2=0x7fe95c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe95c0a15d0 0x7fe95c0a3a90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe960009e30 tx=0x7fe960009260 comp rx=0 tx=0).stop 2023-10-14T08:53:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 msgr2=0x7fe9701b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 0x7fe9701b5340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe958009720 tx=0x7fe9580057c0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 shutdown_connections 2023-10-14T08:53:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9700786b0 0x7fe9701b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe970072e00 0x7fe9701b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe95c0a15d0 0x7fe95c0a3a90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 --2- 172.21.15.6:0/3374178698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe970075ce0 0x7fe9701b5340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.002+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 >> 172.21.15.6:0/3374178698 conn(0x7fe97006dd90 msgr2=0x7fe97007a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.004+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 shutdown_connections 2023-10-14T08:53:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:22.004+0000 7fe975496700 1 -- 172.21.15.6:0/3374178698 wait complete. 2023-10-14T08:53:22.024 INFO:tasks.cephfs.filesystem:scrub status for tag:1eb93b51-061b-4fe1-94e4-83ca1e4c431a - {'path': '/', 'tag': '1eb93b51-061b-4fe1-94e4-83ca1e4c431a', 'options': 'recursive,force'} 2023-10-14T08:53:22.145 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 08:53:21 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: 2023-10-14T08:53:21.740+0000 7f809c456700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000406 [2,head] /volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e/postgres/data/base/12347/16403 auth v706 ap=1 s=2723840 n(v0 rc2023-10-14T08:53:13.430812+0000 b2723840 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25051=0-8388608@1} caps={25051=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25051 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55883bbaa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000406:[<0x1000000041d/16403 v706>,<0x10000000014/12347 v3389>,<0x10000000006/base v1575>,<0x10000000005/data v143>,<0x100000001fb/postgres v53>,<0x100000001fa/04bf4793-66c9-4714-b8a8-1582bc07509e v65>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v67>,<0x1/volumes v63>]//[]","memoryvalue":"(3)0x10000000406:[<0x1000000041d/16403 v706>,<0x10000000014/12347 v3389>,<0x10000000006/base v1485>,<0x10000000005/data v159>,<0x100000001fb/postgres v69>,<0x100000001fa/04bf4793-66c9-4714-b8a8-1582bc07509e v68>,<0x10000000001/sv_1 v99>,<0x10000000000/_nogroup v83>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-14T08:53:22.145 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub queued for path: / 2023-10-14T08:53:22.145 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.146 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:22.146 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:22.146 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.146 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:22.146 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.147 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:22.147 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.147 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:22 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub queued for path: / 2023-10-14T08:53:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:22.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:22.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:22.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:22.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:22 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub queued for path: / 2023-10-14T08:53:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:22.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:22.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:22.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:22 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: pgmap v323: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 MiB/s wr, 1.33k op/s 2023-10-14T08:53:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: Scrub error on inode 0x10000000406 (/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e/postgres/data/base/12347/16403) see mds.b log and `damage ls` output for details 2023-10-14T08:53:23.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: active paths [/] 2023-10-14T08:53:23.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:23.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:23 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:53:23.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: pgmap v323: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 MiB/s wr, 1.33k op/s 2023-10-14T08:53:23.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: Scrub error on inode 0x10000000406 (/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e/postgres/data/base/12347/16403) see mds.b log and `damage ls` output for details 2023-10-14T08:53:23.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: active paths [/] 2023-10-14T08:53:23.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:23.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:23 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:53:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: pgmap v323: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 MiB/s wr, 1.33k op/s 2023-10-14T08:53:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: Scrub error on inode 0x10000000406 (/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e/postgres/data/base/12347/16403) see mds.b log and `damage ls` output for details 2023-10-14T08:53:23.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: active paths [/] 2023-10-14T08:53:23.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: scrub summary: idle+waiting paths [/] 2023-10-14T08:53:23.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:23.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:23 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:53:25.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:25 smithi057 ceph-mon[103313]: pgmap v324: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 47 MiB/s wr, 1.03k op/s 2023-10-14T08:53:25.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:25 smithi006 ceph-mon[99452]: pgmap v324: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 47 MiB/s wr, 1.03k op/s 2023-10-14T08:53:25.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:25 smithi178 ceph-mon[103612]: pgmap v324: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 47 MiB/s wr, 1.03k op/s 2023-10-14T08:53:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 25.0 s, 3138.6 tps, lat 31.179 ms stddev 38.142 2023-10-14T08:53:26.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:26 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:26.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:26 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:26 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:26 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.446 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:26 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:26 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:26.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.484 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:26 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:26 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:26.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:26 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:26 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:26 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:26.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:26 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:27.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 -- 172.21.15.6:0/1089195900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14106be0 msgr2=0x7f5a14109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 --2- 172.21.15.6:0/1089195900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14106be0 0x7f5a14109050 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00b0a0 tx=0x7f5a0c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 -- 172.21.15.6:0/1089195900 shutdown_connections 2023-10-14T08:53:27.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 --2- 172.21.15.6:0/1089195900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14106be0 0x7f5a14109050 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 --2- 172.21.15.6:0/1089195900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a14101980 0x7f5a14103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 --2- 172.21.15.6:0/1089195900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a141042b0 0x7f5a141066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 -- 172.21.15.6:0/1089195900 >> 172.21.15.6:0/1089195900 conn(0x7f5a140fb370 msgr2=0x7f5a140fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 -- 172.21.15.6:0/1089195900 shutdown_connections 2023-10-14T08:53:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.410+0000 7f5a189aa700 1 -- 172.21.15.6:0/1089195900 wait complete. 2023-10-14T08:53:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 Processor -- start 2023-10-14T08:53:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 -- start start 2023-10-14T08:53:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 0x7f5a14196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a141042b0 0x7f5a141971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a14106be0 0x7f5a1419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1419e800 con 0x7f5a14101980 2023-10-14T08:53:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1419e970 con 0x7f5a14106be0 2023-10-14T08:53:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.411+0000 7f5a189aa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1419eb30 con 0x7f5a141042b0 2023-10-14T08:53:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 0x7f5a14196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 0x7f5a14196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33416/0 (socket says 172.21.15.6:33416) 2023-10-14T08:53:27.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 -- 172.21.15.6:0/97409040 learned_addr learned my addr 172.21.15.6:0/97409040 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a141042b0 0x7f5a141971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a14106be0 0x7f5a1419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 -- 172.21.15.6:0/97409040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a141042b0 msgr2=0x7f5a141971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a141042b0 0x7f5a141971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 -- 172.21.15.6:0/97409040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a14106be0 msgr2=0x7f5a1419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a14106be0 0x7f5a1419e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 -- 172.21.15.6:0/97409040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009d00 con 0x7f5a14101980 2023-10-14T08:53:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a1259c700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 0x7f5a14196c90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400e9a0 tx=0x7f5a0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:27.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a037fe700 1 -- 172.21.15.6:0/97409040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04009790 con 0x7f5a14101980 2023-10-14T08:53:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a037fe700 1 -- 172.21.15.6:0/97409040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a0400cbd0 con 0x7f5a14101980 2023-10-14T08:53:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1419ee10 con 0x7f5a14101980 2023-10-14T08:53:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a037fe700 1 -- 172.21.15.6:0/97409040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04018680 con 0x7f5a14101980 2023-10-14T08:53:27.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.412+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1419f230 con 0x7f5a14101980 2023-10-14T08:53:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.416+0000 7f5a037fe700 1 -- 172.21.15.6:0/97409040 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5a0400cd40 con 0x7f5a14101980 2023-10-14T08:53:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.416+0000 7f5a037fe700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59fc0a1480 0x7f59fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.416+0000 7f5a037fe700 1 -- 172.21.15.6:0/97409040 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5a04014070 con 0x7f5a14101980 2023-10-14T08:53:27.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.416+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59fc0a1480 0x7f59fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 Processor -- start 2023-10-14T08:53:27.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 -- start start 2023-10-14T08:53:27.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59fc0a1480 0x7f59fc0a3940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a14198190 tx=0x7f5a08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:27.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86ec60 0x558f2a86f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86f5c0 0x558f2a86fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a870930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a7dfc10 con 0x558f2a86ec60 2023-10-14T08:53:27.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a7c4c00 con 0x558f2a86f5c0 2023-10-14T08:53:27.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a7c2520 con 0x558f2a8704b0 2023-10-14T08:53:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a11d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86f5c0 0x558f2a86fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86ec60 0x558f2a86f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a11d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86f5c0 0x558f2a86fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60416/0 (socket says 172.21.15.6:60416) 2023-10-14T08:53:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a11d9b700 1 -- 172.21.15.6:0/1653808775 learned_addr learned my addr 172.21.15.6:0/1653808775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:27.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.417+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a870930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a12d9d700 1 -- 172.21.15.6:0/1653808775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86f5c0 msgr2=0x558f2a86fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:27.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86f5c0 0x558f2a86fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a12d9d700 1 -- 172.21.15.6:0/1653808775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86ec60 msgr2=0x558f2a86f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:27.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86ec60 0x558f2a86f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a12d9d700 1 -- 172.21.15.6:0/1653808775 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f2a77b390 con 0x558f2a8704b0 2023-10-14T08:53:27.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a870930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009fd0 tx=0x7f5a0c009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c645a071f13e12d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:27.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a00ff9700 1 -- 172.21.15.6:0/1653808775 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c00e050 con 0x558f2a8704b0 2023-10-14T08:53:27.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a00ff9700 1 -- 172.21.15.6:0/1653808775 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a0c009460 con 0x558f2a8704b0 2023-10-14T08:53:27.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.418+0000 7f5a00ff9700 1 -- 172.21.15.6:0/1653808775 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0052a0 con 0x558f2a8704b0 2023-10-14T08:53:27.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1653808775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 msgr2=0x558f2a870930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a870930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009fd0 tx=0x7f5a0c009c60 comp rx=0 tx=0).stop 2023-10-14T08:53:27.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1653808775 shutdown_connections 2023-10-14T08:53:27.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a870930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86ec60 0x558f2a86f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.429 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1653808775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86f5c0 0x558f2a86fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.419+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1653808775 >> 172.21.15.6:0/1653808775 conn(0x558f2a798d70 msgr2=0x558f2a865c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:27.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.420+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1653808775 shutdown_connections 2023-10-14T08:53:27.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.420+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1653808775 wait complete. 2023-10-14T08:53:27.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 -- start start 2023-10-14T08:53:27.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 Processor -- start 2023-10-14T08:53:27.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a874530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a874a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a875a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a7bde10 con 0x558f2a86f5c0 2023-10-14T08:53:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a75a6b0 con 0x558f2a86ec60 2023-10-14T08:53:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a75a350 con 0x558f2a8704b0 2023-10-14T08:53:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a24b94b80 10 client.0 _ll_register_callbacks cb 0x558f2a5b77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a874530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a874530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60420/0 (socket says 172.21.15.6:60420) 2023-10-14T08:53:27.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a1259c700 1 -- 172.21.15.6:0/3756413359 learned_addr learned my addr 172.21.15.6:0/3756413359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a875a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.421+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a874a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.422+0000 7f5a11d9b700 1 -- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 msgr2=0x558f2a875a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:27.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.422+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a875a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.422+0000 7f5a11d9b700 1 -- 172.21.15.6:0/3756413359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 msgr2=0x558f2a874530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.422+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a874530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.422+0000 7f5a11d9b700 1 -- 172.21.15.6:0/3756413359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a14109c40 con 0x558f2a86f5c0 2023-10-14T08:53:27.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.423+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a874a70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5a0801e780 tx=0x7f5a080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc399b88e340dedd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.423+0000 7f59f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.424+0000 7f59f9ffb700 1 -- 172.21.15.6:0/3756413359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08004230 con 0x558f2a86f5c0 2023-10-14T08:53:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.424+0000 7f59f9ffb700 1 -- 172.21.15.6:0/3756413359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5a08004390 con 0x558f2a86f5c0 2023-10-14T08:53:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.424+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f2a7c2e90 con 0x558f2a86f5c0 2023-10-14T08:53:27.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.424+0000 7f59f9ffb700 1 -- 172.21.15.6:0/3756413359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a08004550 con 0x558f2a86f5c0 2023-10-14T08:53:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.424+0000 7f5a24b94b80 10 client.15612 fetch_fsmap learned FSMap version 30 2023-10-14T08:53:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.424+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558f2a5e8d80 con 0x558f2a86f5c0 2023-10-14T08:53:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f59f9ffb700 1 -- 172.21.15.6:0/3756413359 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558f2a7c2e90 con 0x558f2a86f5c0 2023-10-14T08:53:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f59f9ffb700 1 -- 172.21.15.6:0/3756413359 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f5a08003c20 con 0x558f2a86f5c0 2023-10-14T08:53:27.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a24b94b80 10 client.15612 fetch_fsmap finished waiting for FSMap version 30 2023-10-14T08:53:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a24b94b80 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a24b94b80 20 client.15612 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a880650 0x558f2a882a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a24b94b80 4 client.15612 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:27.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f2a83abb0 con 0x558f2a880650 2023-10-14T08:53:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.425+0000 7f5a1259c700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a880650 0x558f2a882a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.426+0000 7f5a1259c700 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a880650 0x558f2a882a70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4240f8c4e615c0db server_cookie=7d6198e7af76b3eb in_seq=0 out_seq=0 2023-10-14T08:53:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.426+0000 7f59f9ffb700 10 client.15612 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.427+0000 7f59f9ffb700 1 -- 172.21.15.6:0/3756413359 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f2a83abb0 con 0x558f2a880650 2023-10-14T08:53:27.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.427+0000 7f59f9ffb700 10 client.15612 handle_command_reply: tid=0 2023-10-14T08:53:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 client.15612 shutdown 2023-10-14T08:53:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 msgr2=0x558f2a874a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a874a70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5a0801e780 tx=0x7f5a080047c0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 shutdown_connections 2023-10-14T08:53:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a880650 0x558f2a882a70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a875a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a874530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/3756413359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a874a70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 >> 172.21.15.6:0/3756413359 conn(0x558f2a798d70 msgr2=0x558f2a865830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:27.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f59f9ffb700 0 client.15612 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:27.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 shutdown_connections 2023-10-14T08:53:27.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 1 -- 172.21.15.6:0/3756413359 wait complete. 2023-10-14T08:53:27.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.428+0000 7f5a24b94b80 20 client.15612 trim_cache size 0 max 16384 2023-10-14T08:53:27.443 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:27 smithi057 ceph-mon[103313]: pgmap v325: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 57 MiB/s wr, 1.31k op/s 2023-10-14T08:53:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:27.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:27 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:27.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 Processor -- start 2023-10-14T08:53:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 -- start start 2023-10-14T08:53:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a865740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a865c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a8742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a63e8c0 con 0x558f2a86f5c0 2023-10-14T08:53:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a86c840 con 0x558f2a86ec60 2023-10-14T08:53:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.454+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a8661c0 con 0x558f2a8704b0 2023-10-14T08:53:27.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a865740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a865740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60428/0 (socket says 172.21.15.6:60428) 2023-10-14T08:53:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 -- 172.21.15.6:0/864363748 learned_addr learned my addr 172.21.15.6:0/864363748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:27.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a12d9d700 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a8742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 -- 172.21.15.6:0/864363748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 msgr2=0x558f2a8742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a8742e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 -- 172.21.15.6:0/864363748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 msgr2=0x558f2a865c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a865c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.455+0000 7f5a1259c700 1 -- 172.21.15.6:0/864363748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f2a5d1c00 con 0x558f2a86ec60 2023-10-14T08:53:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.456+0000 7f5a1259c700 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a865740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a04099fc0 tx=0x7f5a0401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14053a75766d5ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.456+0000 7f5a017fa700 1 -- 172.21.15.6:0/864363748 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0409a2c0 con 0x558f2a86ec60 2023-10-14T08:53:27.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.456+0000 7f5a017fa700 1 -- 172.21.15.6:0/864363748 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a040b0070 con 0x558f2a86ec60 2023-10-14T08:53:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.457+0000 7f5a017fa700 1 -- 172.21.15.6:0/864363748 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0409e1e0 con 0x558f2a86ec60 2023-10-14T08:53:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.457+0000 7f5a24b94b80 1 -- 172.21.15.6:0/864363748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 msgr2=0x558f2a865740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.457+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a865740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a04099fc0 tx=0x7f5a0401a040 comp rx=0 tx=0).stop 2023-10-14T08:53:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 -- 172.21.15.6:0/864363748 shutdown_connections 2023-10-14T08:53:27.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a8704b0 0x558f2a8742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a86ec60 0x558f2a865740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/864363748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a865c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 -- 172.21.15.6:0/864363748 >> 172.21.15.6:0/864363748 conn(0x558f2a798d70 msgr2=0x558f2a86cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:27.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 -- 172.21.15.6:0/864363748 shutdown_connections 2023-10-14T08:53:27.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 -- 172.21.15.6:0/864363748 wait complete. 2023-10-14T08:53:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.458+0000 7f5a24b94b80 1 -- start start 2023-10-14T08:53:27.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 Processor -- start 2023-10-14T08:53:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 0x558f2a878ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a878ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a8704b0 0x558f2a87c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a87c550 con 0x558f2a86f5c0 2023-10-14T08:53:27.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a87c6c0 con 0x558f2a8704b0 2023-10-14T08:53:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f2a87c880 con 0x558f2a86ec60 2023-10-14T08:53:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a24b94b80 10 client.0 _ll_register_callbacks cb 0x7f5a08011f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 0x558f2a878ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a1259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 0x558f2a878ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59078/0 (socket says 172.21.15.6:59078) 2023-10-14T08:53:27.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a1259c700 1 -- 172.21.15.6:0/1552141049 learned_addr learned my addr 172.21.15.6:0/1552141049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.459+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a878ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a1259c700 1 -- 172.21.15.6:0/1552141049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a8704b0 msgr2=0x558f2a87c010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a1259c700 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a8704b0 0x558f2a87c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a1259c700 1 -- 172.21.15.6:0/1552141049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 msgr2=0x558f2a878ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:27.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a1259c700 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a878ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a1259c700 1 -- 172.21.15.6:0/1552141049 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1419f230 con 0x558f2a86ec60 2023-10-14T08:53:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a1259c700 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 0x558f2a878ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a040967c0 tx=0x7f5a04095f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bacaf1315818d99a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f59f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:27.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f59f9ffb700 1 -- 172.21.15.6:0/1552141049 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04062050 con 0x558f2a86ec60 2023-10-14T08:53:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f59f9ffb700 1 -- 172.21.15.6:0/1552141049 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5a0409e1c0 con 0x558f2a86ec60 2023-10-14T08:53:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.460+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a0c009460 con 0x558f2a86ec60 2023-10-14T08:53:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.461+0000 7f59f9ffb700 1 -- 172.21.15.6:0/1552141049 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a0409a2c0 con 0x558f2a86ec60 2023-10-14T08:53:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.461+0000 7f5a24b94b80 10 client.25318 fetch_fsmap learned FSMap version 30 2023-10-14T08:53:27.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.461+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558f2a60f1f0 con 0x558f2a86ec60 2023-10-14T08:53:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.464+0000 7f59f9ffb700 1 -- 172.21.15.6:0/1552141049 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a0c009460 con 0x558f2a86ec60 2023-10-14T08:53:27.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.464+0000 7f59f9ffb700 1 -- 172.21.15.6:0/1552141049 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f5a04065070 con 0x558f2a86ec60 2023-10-14T08:53:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a24b94b80 10 client.25318 fetch_fsmap finished waiting for FSMap version 30 2023-10-14T08:53:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a24b94b80 10 client.25318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a24b94b80 20 client.25318 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a8e6160 0x558f2a8e8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:27.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a24b94b80 4 client.25318 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:53:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f2a7b6df0 con 0x558f2a8e6160 2023-10-14T08:53:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.465+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a8e6160 0x558f2a8e8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.466+0000 7f59f9ffb700 10 client.25318 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:27.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.466+0000 7f5a11d9b700 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a8e6160 0x558f2a8e8580 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15be3b1aa175f1b server_cookie=f8d6ca47d79d2232 in_seq=0 out_seq=0 2023-10-14T08:53:27.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:27 smithi006 ceph-mon[99452]: pgmap v325: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 57 MiB/s wr, 1.31k op/s 2023-10-14T08:53:27.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:27.486 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:27 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f59f9ffb700 1 -- 172.21.15.6:0/1552141049 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f2a7b6df0 con 0x558f2a8e6160 2023-10-14T08:53:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f59f9ffb700 10 client.25318 handle_command_reply: tid=0 2023-10-14T08:53:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 client.25318 shutdown 2023-10-14T08:53:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 msgr2=0x558f2a878ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 0x558f2a878ab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5a040967c0 tx=0x7f5a04095f60 comp rx=0 tx=0).stop 2023-10-14T08:53:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 shutdown_connections 2023-10-14T08:53:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x558f2a8e6160 0x558f2a8e8580 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558f2a8704b0 0x558f2a87c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f2a86ec60 0x558f2a878ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 --2- 172.21.15.6:0/1552141049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f2a86f5c0 0x558f2a878ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 >> 172.21.15.6:0/1552141049 conn(0x558f2a798d70 msgr2=0x558f2a86cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.503+0000 7f59f9ffb700 0 client.25318 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.504+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 shutdown_connections 2023-10-14T08:53:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.504+0000 7f5a24b94b80 1 -- 172.21.15.6:0/1552141049 wait complete. 2023-10-14T08:53:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.504+0000 7f5a24b94b80 20 client.25318 trim_cache size 0 max 16384 2023-10-14T08:53:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:53:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:53:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:53:27.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:53:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59fc0a1480 msgr2=0x7f59fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59fc0a1480 0x7f59fc0a3940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a14198190 tx=0x7f5a08009260 comp rx=0 tx=0).stop 2023-10-14T08:53:27.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 msgr2=0x7f5a14196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:27.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 0x7f5a14196c90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400e9a0 tx=0x7f5a0400ecb0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 shutdown_connections 2023-10-14T08:53:27.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59fc0a1480 0x7f59fc0a3940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a14106be0 0x7f5a1419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a14101980 0x7f5a14196c90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 --2- 172.21.15.6:0/97409040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a141042b0 0x7f5a141971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 >> 172.21.15.6:0/97409040 conn(0x7f5a140fb370 msgr2=0x7f5a141025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 shutdown_connections 2023-10-14T08:53:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:27.505+0000 7f5a189aa700 1 -- 172.21.15.6:0/97409040 wait complete. 2023-10-14T08:53:27.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:27 smithi178 ceph-mon[103612]: pgmap v325: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 57 MiB/s wr, 1.31k op/s 2023-10-14T08:53:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:27 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:28 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:53:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:28 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:53:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:28 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:28.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:53:28.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:53:28.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:28.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:28 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:53:28.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:28 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:53:28.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:28 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:53:28.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T08:53:28.627+0000 7f9827670700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-14T08:53:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:29 smithi057 ceph-mon[103313]: pgmap v326: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 58 MiB/s wr, 1.47k op/s 2023-10-14T08:53:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:29 smithi057 ceph-mon[103313]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-14T08:53:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:29 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:active 2023-10-14T08:53:29.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:29 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:29 smithi006 ceph-mon[99452]: pgmap v326: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 58 MiB/s wr, 1.47k op/s 2023-10-14T08:53:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:29 smithi006 ceph-mon[99452]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-14T08:53:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:29 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:active 2023-10-14T08:53:29.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:29 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:29.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:29 smithi178 ceph-mon[103612]: pgmap v326: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 58 MiB/s wr, 1.47k op/s 2023-10-14T08:53:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:29 smithi178 ceph-mon[103612]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-14T08:53:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:29 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] up:active 2023-10-14T08:53:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:29 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:53:30.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:30 smithi006 ceph-mon[99452]: scrub summary: idle 2023-10-14T08:53:30.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:30 smithi178 ceph-mon[103612]: scrub summary: idle 2023-10-14T08:53:30.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:30 smithi057 ceph-mon[103313]: scrub summary: idle 2023-10-14T08:53:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 30.0 s, 3627.8 tps, lat 28.201 ms stddev 51.385 2023-10-14T08:53:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:31 smithi006 ceph-mon[99452]: pgmap v327: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 60 MiB/s wr, 1.79k op/s 2023-10-14T08:53:31.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:31 smithi006 ceph-mon[99452]: scrub summary: idle 2023-10-14T08:53:31.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:31 smithi178 ceph-mon[103612]: pgmap v327: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 60 MiB/s wr, 1.79k op/s 2023-10-14T08:53:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:31 smithi178 ceph-mon[103612]: scrub summary: idle 2023-10-14T08:53:31.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:31 smithi057 ceph-mon[103313]: pgmap v327: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 60 MiB/s wr, 1.79k op/s 2023-10-14T08:53:31.760 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:31 smithi057 ceph-mon[103313]: scrub summary: idle 2023-10-14T08:53:33.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:33 smithi006 ceph-mon[99452]: pgmap v328: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 78 MiB/s wr, 2.80k op/s 2023-10-14T08:53:33.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:33 smithi178 ceph-mon[103612]: pgmap v328: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 78 MiB/s wr, 2.80k op/s 2023-10-14T08:53:33.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:33 smithi057 ceph-mon[103313]: pgmap v328: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 78 MiB/s wr, 2.80k op/s 2023-10-14T08:53:35.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:35 smithi006 ceph-mon[99452]: pgmap v329: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 67 MiB/s wr, 2.59k op/s 2023-10-14T08:53:35.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:35 smithi178 ceph-mon[103612]: pgmap v329: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 67 MiB/s wr, 2.59k op/s 2023-10-14T08:53:35.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:35 smithi057 ceph-mon[103313]: pgmap v329: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 67 MiB/s wr, 2.59k op/s 2023-10-14T08:53:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 35.0 s, 4993.3 tps, lat 20.003 ms stddev 22.610 2023-10-14T08:53:37.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:37 smithi006 ceph-mon[99452]: pgmap v330: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 74 MiB/s wr, 2.85k op/s 2023-10-14T08:53:37.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:37 smithi178 ceph-mon[103612]: pgmap v330: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 74 MiB/s wr, 2.85k op/s 2023-10-14T08:53:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:37 smithi057 ceph-mon[103313]: pgmap v330: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 74 MiB/s wr, 2.85k op/s 2023-10-14T08:53:39.488 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:39 smithi006 ceph-mon[99452]: pgmap v331: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 65 MiB/s wr, 2.69k op/s 2023-10-14T08:53:39.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:39 smithi178 ceph-mon[103612]: pgmap v331: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 65 MiB/s wr, 2.69k op/s 2023-10-14T08:53:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:39 smithi057 ceph-mon[103313]: pgmap v331: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 65 MiB/s wr, 2.69k op/s 2023-10-14T08:53:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.689+0000 7fd3e7b92700 1 -- 172.21.15.6:0/3442733819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0075c50 msgr2=0x7fd3e00780e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/3442733819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0075c50 0x7fd3e00780e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009990 tx=0x7fd3dc009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 -- 172.21.15.6:0/3442733819 shutdown_connections 2023-10-14T08:53:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/3442733819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3e0078620 0x7fd3e007aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/3442733819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 0x7fd3e0073190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/3442733819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0075c50 0x7fd3e00780e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 -- 172.21.15.6:0/3442733819 >> 172.21.15.6:0/3442733819 conn(0x7fd3e006dcf0 msgr2=0x7fd3e0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 -- 172.21.15.6:0/3442733819 shutdown_connections 2023-10-14T08:53:40.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.690+0000 7fd3e7b92700 1 -- 172.21.15.6:0/3442733819 wait complete. 2023-10-14T08:53:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 Processor -- start 2023-10-14T08:53:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 -- start start 2023-10-14T08:53:40.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 0x7fd3e0076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3e0075c50 0x7fd3e01b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0078620 0x7fd3e01b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01b7fa0 con 0x7fd3e0072d70 2023-10-14T08:53:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01b8110 con 0x7fd3e0075c50 2023-10-14T08:53:40.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.691+0000 7fd3e7b92700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01b82d0 con 0x7fd3e0078620 2023-10-14T08:53:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e592e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 0x7fd3e0076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e592e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 0x7fd3e0076be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33458/0 (socket says 172.21.15.6:33458) 2023-10-14T08:53:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e592e700 1 -- 172.21.15.6:0/2058916484 learned_addr learned my addr 172.21.15.6:0/2058916484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e612f700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0078620 0x7fd3e01b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e512d700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3e0075c50 0x7fd3e01b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e612f700 1 -- 172.21.15.6:0/2058916484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3e0075c50 msgr2=0x7fd3e01b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e612f700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3e0075c50 0x7fd3e01b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e612f700 1 -- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 msgr2=0x7fd3e0076be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e612f700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 0x7fd3e0076be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.692+0000 7fd3e612f700 1 -- 172.21.15.6:0/2058916484 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0095f0 con 0x7fd3e0078620 2023-10-14T08:53:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.693+0000 7fd3e612f700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0078620 0x7fd3e01b7800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009ed0 tx=0x7fd3d8009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.693+0000 7fd3d6ffd700 1 -- 172.21.15.6:0/2058916484 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8018640 con 0x7fd3e0078620 2023-10-14T08:53:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.693+0000 7fd3d6ffd700 1 -- 172.21.15.6:0/2058916484 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d8010e40 con 0x7fd3e0078620 2023-10-14T08:53:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.693+0000 7fd3d6ffd700 1 -- 172.21.15.6:0/2058916484 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8016c30 con 0x7fd3e0078620 2023-10-14T08:53:40.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.693+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e01aeff0 con 0x7fd3e0078620 2023-10-14T08:53:40.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.693+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e01af530 con 0x7fd3e0078620 2023-10-14T08:53:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.696+0000 7fd3d6ffd700 1 -- 172.21.15.6:0/2058916484 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd3d8022440 con 0x7fd3e0078620 2023-10-14T08:53:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.697+0000 7fd3d6ffd700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3cc0a1530 0x7fd3cc0a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.697+0000 7fd3d6ffd700 1 -- 172.21.15.6:0/2058916484 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd3d8006e40 con 0x7fd3e0078620 2023-10-14T08:53:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.697+0000 7fd3e592e700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3cc0a1530 0x7fd3cc0a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.698+0000 7fd3e592e700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3cc0a1530 0x7fd3cc0a39f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009d60 tx=0x7fd3d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.698+0000 7fd3f3d7cb80 1 Processor -- start 2023-10-14T08:53:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 -- start start 2023-10-14T08:53:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea63861c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea63862ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63863520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea637d6c10 con 0x55ea638630a0 2023-10-14T08:53:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea637bbc00 con 0x55ea638621b0 2023-10-14T08:53:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea637b9520 con 0x55ea63861850 2023-10-14T08:53:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3e512d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea63862ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3e512d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea63862ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60456/0 (socket says 172.21.15.6:60456) 2023-10-14T08:53:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3e512d700 1 -- 172.21.15.6:0/3260977691 learned_addr learned my addr 172.21.15.6:0/3260977691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.699+0000 7fd3e612f700 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63863520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e592e700 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea63861c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e512d700 1 -- 172.21.15.6:0/3260977691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 msgr2=0x55ea63861c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e512d700 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea63861c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e512d700 1 -- 172.21.15.6:0/3260977691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 msgr2=0x55ea63863520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e512d700 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63863520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e512d700 1 -- 172.21.15.6:0/3260977691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea63772390 con 0x55ea638621b0 2023-10-14T08:53:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e592e700 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea63861c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3e512d700 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea63862ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc015000 tx=0x7fd3dc00b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a11f1b1380236b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3cbfff700 1 -- 172.21.15.6:0/3260977691 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc005040 con 0x55ea638621b0 2023-10-14T08:53:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3cbfff700 1 -- 172.21.15.6:0/3260977691 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3dc01e040 con 0x55ea638621b0 2023-10-14T08:53:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.700+0000 7fd3cbfff700 1 -- 172.21.15.6:0/3260977691 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004e00 con 0x55ea638621b0 2023-10-14T08:53:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3260977691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 msgr2=0x55ea63862ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea63862ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc015000 tx=0x7fd3dc00b870 comp rx=0 tx=0).stop 2023-10-14T08:53:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3260977691 shutdown_connections 2023-10-14T08:53:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63863520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea63861c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3260977691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea63862ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3260977691 >> 172.21.15.6:0/3260977691 conn(0x55ea6378fd70 msgr2=0x55ea6385cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3260977691 shutdown_connections 2023-10-14T08:53:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3260977691 wait complete. 2023-10-14T08:53:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.701+0000 7fd3f3d7cb80 1 -- start start 2023-10-14T08:53:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 Processor -- start 2023-10-14T08:53:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea6386b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63872cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea637b4e10 con 0x55ea638630a0 2023-10-14T08:53:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea637516b0 con 0x55ea638621b0 2023-10-14T08:53:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea63751350 con 0x55ea63861850 2023-10-14T08:53:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3f3d7cb80 10 client.0 _ll_register_callbacks cb 0x55ea635ae7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3e612f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63872cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3e512d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3e612f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63872cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33476/0 (socket says 172.21.15.6:33476) 2023-10-14T08:53:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3e512d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60464/0 (socket says 172.21.15.6:60464) 2023-10-14T08:53:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3e612f700 1 -- 172.21.15.6:0/1742911986 learned_addr learned my addr 172.21.15.6:0/1742911986 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.702+0000 7fd3e592e700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea6386b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e592e700 1 -- 172.21.15.6:0/1742911986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 msgr2=0x55ea6386bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e592e700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e592e700 1 -- 172.21.15.6:0/1742911986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 msgr2=0x55ea63872cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e592e700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63872cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e592e700 1 -- 172.21.15.6:0/1742911986 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e007b4e0 con 0x55ea63861850 2023-10-14T08:53:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e612f700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63872cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e512d700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:40.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3e592e700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea6386b740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3d001dc50 tx=0x7fd3d00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7929a4cbd55fcb7f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3c97fa700 1 -- 172.21.15.6:0/1742911986 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d001b820 con 0x55ea63861850 2023-10-14T08:53:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3c97fa700 1 -- 172.21.15.6:0/1742911986 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd3d001b980 con 0x55ea63861850 2023-10-14T08:53:40.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea637b9e90 con 0x55ea63861850 2023-10-14T08:53:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.703+0000 7fd3c97fa700 1 -- 172.21.15.6:0/1742911986 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3d001bb40 con 0x55ea63861850 2023-10-14T08:53:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.704+0000 7fd3f3d7cb80 10 client.25327 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.704+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ea635dfd80 con 0x55ea63861850 2023-10-14T08:53:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3c97fa700 1 -- 172.21.15.6:0/1742911986 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ea637b9e90 con 0x55ea63861850 2023-10-14T08:53:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3c97fa700 1 -- 172.21.15.6:0/1742911986 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd3d00253f0 con 0x55ea63861850 2023-10-14T08:53:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3f3d7cb80 10 client.25327 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3f3d7cb80 10 client.25327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3f3d7cb80 20 client.25327 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea63877670 0x55ea63879a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3f3d7cb80 4 client.25327 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea63831bb0 con 0x55ea63877670 2023-10-14T08:53:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.705+0000 7fd3e512d700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea63877670 0x55ea63879a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.706+0000 7fd3c97fa700 10 client.25327 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.706+0000 7fd3e512d700 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea63877670 0x55ea63879a90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8859af934ec750e5 server_cookie=276a3887bfa25965 in_seq=0 out_seq=0 2023-10-14T08:53:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3c97fa700 1 -- 172.21.15.6:0/1742911986 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ea63831bb0 con 0x55ea63877670 2023-10-14T08:53:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3c97fa700 10 client.25327 handle_command_reply: tid=0 2023-10-14T08:53:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 client.25327 shutdown 2023-10-14T08:53:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 msgr2=0x55ea6386b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea6386b740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3d001dc50 tx=0x7fd3d00047c0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 shutdown_connections 2023-10-14T08:53:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea63877670 0x55ea63879a90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea638630a0 0x55ea63872cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea63861850 0x55ea6386b740 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/1742911986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.707+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 >> 172.21.15.6:0/1742911986 conn(0x55ea6378fd70 msgr2=0x55ea6385c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.708+0000 7fd3c97fa700 0 client.25327 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.708+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 shutdown_connections 2023-10-14T08:53:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.708+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/1742911986 wait complete. 2023-10-14T08:53:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.708+0000 7fd3f3d7cb80 20 client.25327 trim_cache size 0 max 16384 2023-10-14T08:53:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 Processor -- start 2023-10-14T08:53:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 -- start start 2023-10-14T08:53:40.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea63861c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638621b0 0x55ea63872c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638630a0 0x55ea63869470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea636358c0 con 0x55ea63861850 2023-10-14T08:53:40.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea63877200 con 0x55ea638630a0 2023-10-14T08:53:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.731+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6386b2e0 con 0x55ea638621b0 2023-10-14T08:53:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e592e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea63861c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e592e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea63861c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33480/0 (socket says 172.21.15.6:33480) 2023-10-14T08:53:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e592e700 1 -- 172.21.15.6:0/489421409 learned_addr learned my addr 172.21.15.6:0/489421409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e612f700 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638630a0 0x55ea63869470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e512d700 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638621b0 0x55ea63872c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e612f700 1 -- 172.21.15.6:0/489421409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638621b0 msgr2=0x55ea63872c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e612f700 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638621b0 0x55ea63872c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e612f700 1 -- 172.21.15.6:0/489421409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 msgr2=0x55ea63861c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e612f700 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea63861c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.732+0000 7fd3e612f700 1 -- 172.21.15.6:0/489421409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea635c8c00 con 0x55ea638630a0 2023-10-14T08:53:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.733+0000 7fd3e612f700 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638630a0 0x55ea63869470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800bdf0 tx=0x7fd3d8009320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7478b4b171f26d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.733+0000 7fd3d4d82700 1 -- 172.21.15.6:0/489421409 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80a6120 con 0x55ea638630a0 2023-10-14T08:53:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.733+0000 7fd3d4d82700 1 -- 172.21.15.6:0/489421409 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d809c130 con 0x55ea638630a0 2023-10-14T08:53:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.733+0000 7fd3d4d82700 1 -- 172.21.15.6:0/489421409 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d809d4e0 con 0x55ea638630a0 2023-10-14T08:53:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.734+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/489421409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638630a0 msgr2=0x55ea63869470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.734+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638630a0 0x55ea63869470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800bdf0 tx=0x7fd3d8009320 comp rx=0 tx=0).stop 2023-10-14T08:53:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.735+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/489421409 shutdown_connections 2023-10-14T08:53:40.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.735+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638630a0 0x55ea63869470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.735+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea63861c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.735+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/489421409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638621b0 0x55ea63872c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.735+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/489421409 >> 172.21.15.6:0/489421409 conn(0x55ea6378fd70 msgr2=0x55ea6386a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:40.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/489421409 shutdown_connections 2023-10-14T08:53:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/489421409 wait complete. 2023-10-14T08:53:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 -- start start 2023-10-14T08:53:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 Processor -- start 2023-10-14T08:53:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea6386e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638630a0 0x55ea63871f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea63872490 con 0x55ea63861850 2023-10-14T08:53:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.736+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea63872600 con 0x55ea638621b0 2023-10-14T08:53:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3f3d7cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea638727c0 con 0x55ea638630a0 2023-10-14T08:53:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3f3d7cb80 10 client.0 _ll_register_callbacks cb 0x7fd3d001d830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e592e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea6386e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e592e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea6386e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33486/0 (socket says 172.21.15.6:33486) 2023-10-14T08:53:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60480/0 (socket says 172.21.15.6:60480) 2023-10-14T08:53:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e592e700 1 -- 172.21.15.6:0/3990277219 learned_addr learned my addr 172.21.15.6:0/3990277219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e612f700 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638630a0 0x55ea63871f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 -- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638630a0 msgr2=0x55ea63871f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638630a0 0x55ea63871f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 -- 172.21.15.6:0/3990277219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 msgr2=0x55ea6386e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea6386e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 -- 172.21.15.6:0/3990277219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e01af530 con 0x55ea638621b0 2023-10-14T08:53:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.737+0000 7fd3e512d700 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386ef30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0098e0 tx=0x7fd3dc009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f3b04861a623f32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.738+0000 7fd3c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.738+0000 7fd3c97fa700 1 -- 172.21.15.6:0/3990277219 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004a80 con 0x55ea638621b0 2023-10-14T08:53:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.738+0000 7fd3c97fa700 1 -- 172.21.15.6:0/3990277219 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd3dc030170 con 0x55ea638621b0 2023-10-14T08:53:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.738+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3dc01e040 con 0x55ea638621b0 2023-10-14T08:53:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3c97fa700 1 -- 172.21.15.6:0/3990277219 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3dc030330 con 0x55ea638621b0 2023-10-14T08:53:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 10 client.25250 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ea636061f0 con 0x55ea638621b0 2023-10-14T08:53:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3c97fa700 1 -- 172.21.15.6:0/3990277219 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3dc01e040 con 0x55ea638621b0 2023-10-14T08:53:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3c97fa700 1 -- 172.21.15.6:0/3990277219 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd3dc005520 con 0x55ea638621b0 2023-10-14T08:53:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 10 client.25250 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:40.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 10 client.25250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 20 client.25250 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea638cc160 0x55ea638ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 4 client.25250 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:53:40.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.739+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea637addf0 con 0x55ea638cc160 2023-10-14T08:53:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.740+0000 7fd3e592e700 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea638cc160 0x55ea638ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.742+0000 7fd3c97fa700 10 client.25250 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:40.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.742+0000 7fd3e592e700 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea638cc160 0x55ea638ce580 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=894acb4875a734d4 server_cookie=db7a85fe23ff68b0 in_seq=0 out_seq=0 2023-10-14T08:53:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.767+0000 7fd3c97fa700 1 -- 172.21.15.6:0/3990277219 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea637addf0 con 0x55ea638cc160 2023-10-14T08:53:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.767+0000 7fd3c97fa700 10 client.25250 handle_command_reply: tid=0 2023-10-14T08:53:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.767+0000 7fd3f3d7cb80 1 client.25250 shutdown 2023-10-14T08:53:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.767+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 msgr2=0x55ea6386ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.767+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386ef30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0098e0 tx=0x7fd3dc009310 comp rx=0 tx=0).stop 2023-10-14T08:53:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 shutdown_connections 2023-10-14T08:53:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ea638cc160 0x55ea638ce580 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ea638630a0 0x55ea63871f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea63861850 0x55ea6386e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3c97fa700 0 client.25250 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 --2- 172.21.15.6:0/3990277219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ea638621b0 0x55ea6386ef30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 >> 172.21.15.6:0/3990277219 conn(0x55ea6378fd70 msgr2=0x55ea6385c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 shutdown_connections 2023-10-14T08:53:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 1 -- 172.21.15.6:0/3990277219 wait complete. 2023-10-14T08:53:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.768+0000 7fd3f3d7cb80 20 client.25250 trim_cache size 0 max 16384 2023-10-14T08:53:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:53:40.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:53:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3cc0a1530 msgr2=0x7fd3cc0a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3cc0a1530 0x7fd3cc0a39f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009d60 tx=0x7fd3d0009260 comp rx=0 tx=0).stop 2023-10-14T08:53:40.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0078620 msgr2=0x7fd3e01b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0078620 0x7fd3e01b7800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009ed0 tx=0x7fd3d8009f00 comp rx=0 tx=0).stop 2023-10-14T08:53:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 shutdown_connections 2023-10-14T08:53:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3e0078620 0x7fd3e01b7800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3e0072d70 0x7fd3e0076be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd3cc0a1530 0x7fd3cc0a39f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 --2- 172.21.15.6:0/2058916484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3e0075c50 0x7fd3e01b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 >> 172.21.15.6:0/2058916484 conn(0x7fd3e006dcf0 msgr2=0x7fd3e0077a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 shutdown_connections 2023-10-14T08:53:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:40.769+0000 7fd3e7b92700 1 -- 172.21.15.6:0/2058916484 wait complete. 2023-10-14T08:53:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 40.0 s, 4038.1 tps, lat 24.697 ms stddev 26.869 2023-10-14T08:53:41.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:41 smithi006 ceph-mon[99452]: pgmap v332: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 56 MiB/s wr, 2.45k op/s 2023-10-14T08:53:41.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:41 smithi178 ceph-mon[103612]: pgmap v332: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 56 MiB/s wr, 2.45k op/s 2023-10-14T08:53:41.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:41 smithi057 ceph-mon[103313]: pgmap v332: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 56 MiB/s wr, 2.45k op/s 2023-10-14T08:53:43.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:43 smithi006 ceph-mon[99452]: pgmap v333: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 54 MiB/s wr, 2.27k op/s 2023-10-14T08:53:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:43 smithi178 ceph-mon[103612]: pgmap v333: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 54 MiB/s wr, 2.27k op/s 2023-10-14T08:53:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:43 smithi057 ceph-mon[103313]: pgmap v333: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 54 MiB/s wr, 2.27k op/s 2023-10-14T08:53:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:45 smithi006 ceph-mon[99452]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 1.22k op/s 2023-10-14T08:53:45.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:45 smithi178 ceph-mon[103612]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 1.22k op/s 2023-10-14T08:53:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:45 smithi057 ceph-mon[103313]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 1.22k op/s 2023-10-14T08:53:45.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 45.0 s, 4064.5 tps, lat 23.309 ms stddev 24.533 2023-10-14T08:53:47.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:47 smithi178 ceph-mon[103612]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 1.37k op/s 2023-10-14T08:53:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:47 smithi057 ceph-mon[103313]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 1.37k op/s 2023-10-14T08:53:47.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:47 smithi006 ceph-mon[99452]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 MiB/s wr, 1.37k op/s 2023-10-14T08:53:49.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:49 smithi178 ceph-mon[103612]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 42 MiB/s wr, 1.59k op/s 2023-10-14T08:53:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:49 smithi057 ceph-mon[103313]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 42 MiB/s wr, 1.59k op/s 2023-10-14T08:53:49.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:49 smithi006 ceph-mon[99452]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 42 MiB/s wr, 1.59k op/s 2023-10-14T08:53:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 50.0 s, 4095.5 tps, lat 25.767 ms stddev 44.312 2023-10-14T08:53:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:51 smithi178 ceph-mon[103612]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 43 MiB/s wr, 1.82k op/s 2023-10-14T08:53:51.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:51 smithi057 ceph-mon[103313]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 43 MiB/s wr, 1.82k op/s 2023-10-14T08:53:51.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:51 smithi006 ceph-mon[99452]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 43 MiB/s wr, 1.82k op/s 2023-10-14T08:53:52.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-14T08:53:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 -- 172.21.15.6:0/313931376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb92010a820 msgr2=0x7fb9201115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 --2- 172.21.15.6:0/313931376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb92010a820 0x7fb9201115f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098f0 tx=0x7fb90c009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:52.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 -- 172.21.15.6:0/313931376 shutdown_connections 2023-10-14T08:53:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 --2- 172.21.15.6:0/313931376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92010ad20 0x7fb920113b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 --2- 172.21.15.6:0/313931376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb920107eb0 0x7fb92010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 --2- 172.21.15.6:0/313931376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb92010a820 0x7fb9201115f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 -- 172.21.15.6:0/313931376 >> 172.21.15.6:0/313931376 conn(0x7fb92006dd90 msgr2=0x7fb920070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 -- 172.21.15.6:0/313931376 shutdown_connections 2023-10-14T08:53:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.249+0000 7fb926e23700 1 -- 172.21.15.6:0/313931376 wait complete. 2023-10-14T08:53:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.250+0000 7fb926e23700 1 Processor -- start 2023-10-14T08:53:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.250+0000 7fb926e23700 1 -- start start 2023-10-14T08:53:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.250+0000 7fb926e23700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb920107eb0 0x7fb9201a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.250+0000 7fb926e23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92010a820 0x7fb9201a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb926e23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 0x7fb9201ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb926e23700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9201ad660 con 0x7fb92010a820 2023-10-14T08:53:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb926e23700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9201ad7a0 con 0x7fb92010ad20 2023-10-14T08:53:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb926e23700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9201ad930 con 0x7fb920107eb0 2023-10-14T08:53:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 0x7fb9201ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 0x7fb9201ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60490/0 (socket says 172.21.15.6:60490) 2023-10-14T08:53:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 -- 172.21.15.6:0/3718547275 learned_addr learned my addr 172.21.15.6:0/3718547275 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb924bbf700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb920107eb0 0x7fb9201a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 -- 172.21.15.6:0/3718547275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb920107eb0 msgr2=0x7fb9201a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb920107eb0 0x7fb9201a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 -- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92010a820 msgr2=0x7fb9201a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92010a820 0x7fb9201a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.251+0000 7fb9253c0700 1 -- 172.21.15.6:0/3718547275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c009520 con 0x7fb92010ad20 2023-10-14T08:53:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.252+0000 7fb9253c0700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 0x7fb9201ad090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb918007fd0 tx=0x7fb91800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.252+0000 7fb91dffb700 1 -- 172.21.15.6:0/3718547275 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918017070 con 0x7fb92010ad20 2023-10-14T08:53:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.252+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9201adc10 con 0x7fb92010ad20 2023-10-14T08:53:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.252+0000 7fb91dffb700 1 -- 172.21.15.6:0/3718547275 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91800f040 con 0x7fb92010ad20 2023-10-14T08:53:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.252+0000 7fb91dffb700 1 -- 172.21.15.6:0/3718547275 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918005740 con 0x7fb92010ad20 2023-10-14T08:53:52.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.252+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9201ae120 con 0x7fb92010ad20 2023-10-14T08:53:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.255+0000 7fb91dffb700 1 -- 172.21.15.6:0/3718547275 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb9180058a0 con 0x7fb92010ad20 2023-10-14T08:53:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.256+0000 7fb91dffb700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb9100a1500 0x7fb9100a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.256+0000 7fb91dffb700 1 -- 172.21.15.6:0/3718547275 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb9180cc370 con 0x7fb92010ad20 2023-10-14T08:53:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.256+0000 7fb924bbf700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb9100a1500 0x7fb9100a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.256+0000 7fb924bbf700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb9100a1500 0x7fb9100a39c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb920072090 tx=0x7fb91400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 Processor -- start 2023-10-14T08:53:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 -- start start 2023-10-14T08:53:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bbfe20 0x561798bc0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bc1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798b34c70 con 0x561798bbfe20 2023-10-14T08:53:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798b19c60 con 0x561798bc1620 2023-10-14T08:53:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.257+0000 7fb93300db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798b17580 con 0x561798bc0780 2023-10-14T08:53:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60498/0 (socket says 172.21.15.6:60498) 2023-10-14T08:53:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 -- 172.21.15.6:0/1316412535 learned_addr learned my addr 172.21.15.6:0/1316412535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bbfe20 0x561798bc0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 -- 172.21.15.6:0/1316412535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 msgr2=0x561798bc1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bc1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 -- 172.21.15.6:0/1316412535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bbfe20 msgr2=0x561798bc0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bbfe20 0x561798bc0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 -- 172.21.15.6:0/1316412535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561798ad03f0 con 0x561798bc1620 2023-10-14T08:53:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc1aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb918099620 tx=0x7fb91801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ede36a3c231d2f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb90affd700 1 -- 172.21.15.6:0/1316412535 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918004ad0 con 0x561798bc1620 2023-10-14T08:53:52.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb90affd700 1 -- 172.21.15.6:0/1316412535 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb918099d90 con 0x561798bc1620 2023-10-14T08:53:52.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.259+0000 7fb90affd700 1 -- 172.21.15.6:0/1316412535 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180841a0 con 0x561798bc1620 2023-10-14T08:53:52.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 -- 172.21.15.6:0/1316412535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 msgr2=0x561798bc1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc1aa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb918099620 tx=0x7fb91801c000 comp rx=0 tx=0).stop 2023-10-14T08:53:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 -- 172.21.15.6:0/1316412535 shutdown_connections 2023-10-14T08:53:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc1aa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bbfe20 0x561798bc0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 --2- 172.21.15.6:0/1316412535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bc1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.260+0000 7fb93300db80 1 -- 172.21.15.6:0/1316412535 >> 172.21.15.6:0/1316412535 conn(0x561798aeddd0 msgr2=0x561798bbafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.261+0000 7fb93300db80 1 -- 172.21.15.6:0/1316412535 shutdown_connections 2023-10-14T08:53:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.261+0000 7fb93300db80 1 -- 172.21.15.6:0/1316412535 wait complete. 2023-10-14T08:53:52.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 -- start start 2023-10-14T08:53:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 Processor -- start 2023-10-14T08:53:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bc9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798b12e70 con 0x561798bc1620 2023-10-14T08:53:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798aaf710 con 0x561798bbfe20 2023-10-14T08:53:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798aaf3b0 con 0x561798bc0780 2023-10-14T08:53:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb93300db80 10 client.0 _ll_register_callbacks cb 0x56179890c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb924bbf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bc9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.262+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33518/0 (socket says 172.21.15.6:33518) 2023-10-14T08:53:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb9253c0700 1 -- 172.21.15.6:0/1921246540 learned_addr learned my addr 172.21.15.6:0/1921246540 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb9253c0700 1 -- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 msgr2=0x561798bca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb9253c0700 1 -- 172.21.15.6:0/1921246540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 msgr2=0x561798bc9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bc9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb9253c0700 1 -- 172.21.15.6:0/1921246540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9201ae120 con 0x561798bc1620 2023-10-14T08:53:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb91ffff700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:52.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.263+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bc9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:52.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.264+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd1250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb9180a14f0 tx=0x7fb9180b9140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc646a9917bd886 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.264+0000 7fb8fffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:52.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.264+0000 7fb8fffff700 1 -- 172.21.15.6:0/1921246540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918004ad0 con 0x561798bc1620 2023-10-14T08:53:52.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.264+0000 7fb8fffff700 1 -- 172.21.15.6:0/1921246540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb91809d7e0 con 0x561798bc1620 2023-10-14T08:53:52.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.264+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561798b17ef0 con 0x561798bc1620 2023-10-14T08:53:52.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.264+0000 7fb8fffff700 1 -- 172.21.15.6:0/1921246540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb918099690 con 0x561798bc1620 2023-10-14T08:53:52.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 10 client.15642 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:52.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56179893dde0 con 0x561798bc1620 2023-10-14T08:53:52.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb8fffff700 1 -- 172.21.15.6:0/1921246540 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561798b17ef0 con 0x561798bc1620 2023-10-14T08:53:52.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb8fffff700 1 -- 172.21.15.6:0/1921246540 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fb9180b7b90 con 0x561798bc1620 2023-10-14T08:53:52.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 10 client.15642 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:52.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:52.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 20 client.15642 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:52.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798bd5a50 0x561798bd7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 4 client.15642 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561798b8fc10 con 0x561798bd5a50 2023-10-14T08:53:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.265+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798bd5a50 0x561798bd7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.266+0000 7fb8fffff700 10 client.15642 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:52.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.266+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798bd5a50 0x561798bd7e70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6861f2524b51b504 server_cookie=d39e6502397ce3c8 in_seq=0 out_seq=0 2023-10-14T08:53:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb8fffff700 1 -- 172.21.15.6:0/1921246540 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561798b8fc10 con 0x561798bd5a50 2023-10-14T08:53:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb8fffff700 10 client.15642 handle_command_reply: tid=0 2023-10-14T08:53:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 client.15642 shutdown 2023-10-14T08:53:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 msgr2=0x561798bd1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd1250 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb9180a14f0 tx=0x7fb9180b9140 comp rx=0 tx=0).stop 2023-10-14T08:53:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 shutdown_connections 2023-10-14T08:53:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798bd5a50 0x561798bd7e70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd1250 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb8fffff700 0 client.15642 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bc9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 --2- 172.21.15.6:0/1921246540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 >> 172.21.15.6:0/1921246540 conn(0x561798aeddd0 msgr2=0x561798bbabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 shutdown_connections 2023-10-14T08:53:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.267+0000 7fb93300db80 1 -- 172.21.15.6:0/1921246540 wait complete. 2023-10-14T08:53:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.268+0000 7fb93300db80 20 client.15642 trim_cache size 0 max 16384 2023-10-14T08:53:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.295+0000 7fb93300db80 1 Processor -- start 2023-10-14T08:53:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 -- start start 2023-10-14T08:53:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bbfe20 0x561798bc4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc0780 0x561798bd1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798993920 con 0x561798bc0780 2023-10-14T08:53:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798bc8180 con 0x561798bc1620 2023-10-14T08:53:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb93300db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798bb5c00 con 0x561798bbfe20 2023-10-14T08:53:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc0780 0x561798bd1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc0780 0x561798bd1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33522/0 (socket says 172.21.15.6:33522) 2023-10-14T08:53:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.296+0000 7fb91ffff700 1 -- 172.21.15.6:0/377562633 learned_addr learned my addr 172.21.15.6:0/377562633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb924bbf700 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bbfe20 0x561798bc4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 -- 172.21.15.6:0/377562633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bbfe20 msgr2=0x561798bc4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bbfe20 0x561798bc4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 -- 172.21.15.6:0/377562633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc0780 msgr2=0x561798bd1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc0780 0x561798bd1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 -- 172.21.15.6:0/377562633 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561798926c60 con 0x561798bc1620 2023-10-14T08:53:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.297+0000 7fb9253c0700 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc4ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb918099480 tx=0x7fb9180b9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46380786f8488bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.298+0000 7fb90b7fe700 1 -- 172.21.15.6:0/377562633 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918004ad0 con 0x561798bc1620 2023-10-14T08:53:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.298+0000 7fb90b7fe700 1 -- 172.21.15.6:0/377562633 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91809d7e0 con 0x561798bc1620 2023-10-14T08:53:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.298+0000 7fb90b7fe700 1 -- 172.21.15.6:0/377562633 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180a1a20 con 0x561798bc1620 2023-10-14T08:53:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.299+0000 7fb93300db80 1 -- 172.21.15.6:0/377562633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 msgr2=0x561798bc4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.299+0000 7fb93300db80 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc4ac0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb918099480 tx=0x7fb9180b9040 comp rx=0 tx=0).stop 2023-10-14T08:53:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.300+0000 7fb93300db80 1 -- 172.21.15.6:0/377562633 shutdown_connections 2023-10-14T08:53:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.300+0000 7fb93300db80 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bc1620 0x561798bc4ac0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.300+0000 7fb93300db80 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bbfe20 0x561798bc4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.300+0000 7fb93300db80 1 --2- 172.21.15.6:0/377562633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc0780 0x561798bd1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.300+0000 7fb93300db80 1 -- 172.21.15.6:0/377562633 >> 172.21.15.6:0/377562633 conn(0x561798aeddd0 msgr2=0x561798bc7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.301+0000 7fb93300db80 1 -- 172.21.15.6:0/377562633 shutdown_connections 2023-10-14T08:53:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.301+0000 7fb93300db80 1 -- 172.21.15.6:0/377562633 wait complete. 2023-10-14T08:53:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.301+0000 7fb93300db80 1 -- start start 2023-10-14T08:53:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.301+0000 7fb93300db80 1 Processor -- start 2023-10-14T08:53:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bcef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bcf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798bd0a20 con 0x561798bc1620 2023-10-14T08:53:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798bd0b90 con 0x561798bbfe20 2023-10-14T08:53:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561798bd0d50 con 0x561798bc0780 2023-10-14T08:53:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb93300db80 10 client.0 _ll_register_callbacks cb 0x7fb918095a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb9253c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bcf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bcf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59162/0 (socket says 172.21.15.6:59162) 2023-10-14T08:53:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 -- 172.21.15.6:0/1337217139 learned_addr learned my addr 172.21.15.6:0/1337217139 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:52.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bcef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 -- 172.21.15.6:0/1337217139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 msgr2=0x561798bcef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bcef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 -- 172.21.15.6:0/1337217139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 msgr2=0x561798bd04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:52.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb91ffff700 1 -- 172.21.15.6:0/1337217139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56179893dde0 con 0x561798bc0780 2023-10-14T08:53:52.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.302+0000 7fb9253c0700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:52.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.303+0000 7fb91ffff700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bcf4d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098f0 tx=0x7fb90c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=571b424720ccdd78 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.303+0000 7fb8fffff700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:52.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.303+0000 7fb8fffff700 1 -- 172.21.15.6:0/1337217139 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c01d040 con 0x561798bc0780 2023-10-14T08:53:52.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.303+0000 7fb8fffff700 1 -- 172.21.15.6:0/1337217139 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb90c005270 con 0x561798bc0780 2023-10-14T08:53:52.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.304+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb918099d90 con 0x561798bc0780 2023-10-14T08:53:52.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.304+0000 7fb8fffff700 1 -- 172.21.15.6:0/1337217139 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb90c005430 con 0x561798bc0780 2023-10-14T08:53:52.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.304+0000 7fb93300db80 10 client.25348 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:52.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.304+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561798964250 con 0x561798bc0780 2023-10-14T08:53:52.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.304+0000 7fb8fffff700 1 -- 172.21.15.6:0/1337217139 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb918099d90 con 0x561798bc0780 2023-10-14T08:53:52.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.304+0000 7fb8fffff700 1 -- 172.21.15.6:0/1337217139 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fb90c02a070 con 0x561798bc0780 2023-10-14T08:53:52.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb93300db80 10 client.25348 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:52.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb93300db80 10 client.25348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:52.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb93300db80 20 client.25348 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:52.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb93300db80 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798c2a8d0 0x561798c2ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb93300db80 4 client.25348 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-14T08:53:52.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561798b0be50 con 0x561798c2a8d0 2023-10-14T08:53:52.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.306+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798c2a8d0 0x561798c2ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb8fffff700 10 client.25348 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb924bbf700 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798c2a8d0 0x561798c2ccf0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3d8ee3b3edcfce server_cookie=b567a354f88c7cd6 in_seq=0 out_seq=0 2023-10-14T08:53:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb8fffff700 1 -- 172.21.15.6:0/1337217139 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561798b0be50 con 0x561798c2a8d0 2023-10-14T08:53:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb8fffff700 10 client.25348 handle_command_reply: tid=0 2023-10-14T08:53:52.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 client.25348 shutdown 2023-10-14T08:53:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 msgr2=0x561798bcf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bcf4d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0098f0 tx=0x7fb90c00b8b0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 shutdown_connections 2023-10-14T08:53:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561798c2a8d0 0x561798c2ccf0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561798bc1620 0x561798bd04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb8fffff700 0 client.25348 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561798bbfe20 0x561798bcef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 --2- 172.21.15.6:0/1337217139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561798bc0780 0x561798bcf4d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 >> 172.21.15.6:0/1337217139 conn(0x561798aeddd0 msgr2=0x561798bc4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 shutdown_connections 2023-10-14T08:53:52.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 1 -- 172.21.15.6:0/1337217139 wait complete. 2023-10-14T08:53:52.320 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T08:53:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-10-14T08:53:52.320 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-10-14T08:53:52.320 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T08:53:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.307+0000 7fb93300db80 20 client.25348 trim_cache size 0 max 16384 2023-10-14T08:53:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.308+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb9100a1500 msgr2=0x7fb9100a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.308+0000 7fb926e23700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb9100a1500 0x7fb9100a39c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb920072090 tx=0x7fb91400b410 comp rx=0 tx=0).stop 2023-10-14T08:53:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.308+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 msgr2=0x7fb9201ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.308+0000 7fb926e23700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 0x7fb9201ad090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb918007fd0 tx=0x7fb91800d3b0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.309+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 shutdown_connections 2023-10-14T08:53:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.309+0000 7fb926e23700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb9100a1500 0x7fb9100a39c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.309+0000 7fb926e23700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb92010ad20 0x7fb9201ad090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.309+0000 7fb926e23700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb920107eb0 0x7fb9201a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.309+0000 7fb926e23700 1 --2- 172.21.15.6:0/3718547275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb92010a820 0x7fb9201a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.309+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 >> 172.21.15.6:0/3718547275 conn(0x7fb92006dd90 msgr2=0x7fb92006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.310+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 shutdown_connections 2023-10-14T08:53:52.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.310+0000 7fb926e23700 1 -- 172.21.15.6:0/3718547275 wait complete. 2023-10-14T08:53:52.333 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-14T08:53:52.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T08:53:52.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.542+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1049627407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb881090a0 msgr2=0x7fbb8810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.542+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1049627407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb881090a0 0x7fbb8810f950 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0099c0 tx=0x7fbb7c009cd0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1049627407 shutdown_connections 2023-10-14T08:53:52.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1049627407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb881090a0 0x7fbb8810f950 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1049627407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb88107510 0x7fbb88107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1049627407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88108700 0x7fbb88108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1049627407 >> 172.21.15.6:0/1049627407 conn(0x7fbb88076490 msgr2=0x7fbb880788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:52.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1049627407 shutdown_connections 2023-10-14T08:53:52.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.543+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1049627407 wait complete. 2023-10-14T08:53:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 Processor -- start 2023-10-14T08:53:52.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 -- start start 2023-10-14T08:53:52.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 0x7fbb880706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88108700 0x7fbb88070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb881090a0 0x7fbb88071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88072230 con 0x7fbb88107510 2023-10-14T08:53:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880723a0 con 0x7fbb88108700 2023-10-14T08:53:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.544+0000 7fbb8e65b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88072560 con 0x7fbb881090a0 2023-10-14T08:53:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 0x7fbb880706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 0x7fbb880706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33536/0 (socket says 172.21.15.6:33536) 2023-10-14T08:53:52.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 -- 172.21.15.6:0/1159129280 learned_addr learned my addr 172.21.15.6:0/1159129280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:52.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb8cbf8700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb881090a0 0x7fbb88071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 -- 172.21.15.6:0/1159129280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb881090a0 msgr2=0x7fbb88071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:52.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb881090a0 0x7fbb88071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 -- 172.21.15.6:0/1159129280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88108700 msgr2=0x7fbb88070c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:53:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88108700 0x7fbb88070c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb87fff700 1 -- 172.21.15.6:0/1159129280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0095f0 con 0x7fbb88107510 2023-10-14T08:53:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.545+0000 7fbb8cbf8700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb881090a0 0x7fbb88071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:52.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.546+0000 7fbb87fff700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 0x7fbb880706e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000efc0 tx=0x7fbb8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.546+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80018070 con 0x7fbb88107510 2023-10-14T08:53:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.546+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb88072780 con 0x7fbb88107510 2023-10-14T08:53:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.546+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb88072ce0 con 0x7fbb88107510 2023-10-14T08:53:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.546+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb8000f040 con 0x7fbb88107510 2023-10-14T08:53:52.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.546+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80004380 con 0x7fbb88107510 2023-10-14T08:53:52.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.547+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb74005310 con 0x7fbb88107510 2023-10-14T08:53:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.549+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbb80003a00 con 0x7fbb88107510 2023-10-14T08:53:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.550+0000 7fbb857fa700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb700a1550 0x7fbb700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.550+0000 7fbb877fe700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb700a1550 0x7fbb700a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.551+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbb800092e0 con 0x7fbb88107510 2023-10-14T08:53:52.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.551+0000 7fbb877fe700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb700a1550 0x7fbb700a3a10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009af0 tx=0x7fbb78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:52.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:52.559+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb800d1060 con 0x7fbb88107510 2023-10-14T08:53:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.009+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb74005180 con 0x7fbb88107510 2023-10-14T08:53:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.010+0000 7fbb857fa700 1 -- 172.21.15.6:0/1159129280 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11362 (secure 0 0 0) 0x7fbb80095c50 con 0x7fbb88107510 2023-10-14T08:53:53.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T08:53:53.012 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T08:53:28.142232+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":36,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T08:53:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.014+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb700a1550 msgr2=0x7fbb700a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.014+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb700a1550 0x7fbb700a3a10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009af0 tx=0x7fbb78009260 comp rx=0 tx=0).stop 2023-10-14T08:53:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.014+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 msgr2=0x7fbb880706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.014+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 0x7fbb880706e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000efc0 tx=0x7fbb8000c3a0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 shutdown_connections 2023-10-14T08:53:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb881090a0 0x7fbb88071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb88107510 0x7fbb880706e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb700a1550 0x7fbb700a3a10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 --2- 172.21.15.6:0/1159129280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb88108700 0x7fbb88070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 >> 172.21.15.6:0/1159129280 conn(0x7fbb88076490 msgr2=0x7fbb88078610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 shutdown_connections 2023-10-14T08:53:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.015+0000 7fbb8e65b700 1 -- 172.21.15.6:0/1159129280 wait complete. 2023-10-14T08:53:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 31 2023-10-14T08:53:53.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-14T08:53:53.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.239+0000 7f4d7499b700 1 -- 172.21.15.6:0/2779910032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 msgr2=0x7f4d701025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.239+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2779910032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d701025e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009990 tx=0x7f4d64009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 -- 172.21.15.6:0/2779910032 shutdown_connections 2023-10-14T08:53:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2779910032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d70102b20 0x7f4d7010b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2779910032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d700ff2b0 0x7f4d700ff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2779910032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d701025e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 -- 172.21.15.6:0/2779910032 >> 172.21.15.6:0/2779910032 conn(0x7f4d700fabc0 msgr2=0x7f4d700fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 -- 172.21.15.6:0/2779910032 shutdown_connections 2023-10-14T08:53:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.241+0000 7f4d7499b700 1 -- 172.21.15.6:0/2779910032 wait complete. 2023-10-14T08:53:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 Processor -- start 2023-10-14T08:53:53.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 -- start start 2023-10-14T08:53:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d700ff2b0 0x7f4d70198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d70199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d70102b20 0x7f4d701a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701a09d0 con 0x7f4d70102b20 2023-10-14T08:53:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006a8d0 con 0x7f4d70102160 2023-10-14T08:53:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.242+0000 7f4d7499b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006aa60 con 0x7f4d700ff2b0 2023-10-14T08:53:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d70199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d70199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60538/0 (socket says 172.21.15.6:60538) 2023-10-14T08:53:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/2294554702 learned_addr learned my addr 172.21.15.6:0/2294554702 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d700ff2b0 0x7f4d70198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/2294554702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d700ff2b0 msgr2=0x7f4d70198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d700ff2b0 0x7f4d70198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d70102b20 msgr2=0x7f4d701a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d70102b20 0x7f4d701a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/2294554702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640095f0 con 0x7f4d70102160 2023-10-14T08:53:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.243+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d70199390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c000 tx=0x7f4d64009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.244+0000 7f4d5f7fe700 1 -- 172.21.15.6:0/2294554702 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400fb30 con 0x7f4d70102160 2023-10-14T08:53:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.244+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d70103580 con 0x7f4d70102160 2023-10-14T08:53:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.244+0000 7f4d5f7fe700 1 -- 172.21.15.6:0/2294554702 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d64027070 con 0x7f4d70102160 2023-10-14T08:53:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.244+0000 7f4d5f7fe700 1 -- 172.21.15.6:0/2294554702 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640179b0 con 0x7f4d70102160 2023-10-14T08:53:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.244+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70103a80 con 0x7f4d70102160 2023-10-14T08:53:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.247+0000 7f4d5f7fe700 1 -- 172.21.15.6:0/2294554702 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4d64029030 con 0x7f4d70102160 2023-10-14T08:53:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.247+0000 7f4d5f7fe700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4d580a1480 0x7f4d580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.248+0000 7f4d5f7fe700 1 -- 172.21.15.6:0/2294554702 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4d640d6710 con 0x7f4d70102160 2023-10-14T08:53:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.248+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4d580a1480 0x7f4d580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.248+0000 7f4d80b85b80 1 Processor -- start 2023-10-14T08:53:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4d580a1480 0x7f4d580a3940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d70068fe0 tx=0x7f4d6800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 -- start start 2023-10-14T08:53:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e953baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e94aec70 con 0x55e7e953b620 2023-10-14T08:53:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9493c60 con 0x55e7e9539e20 2023-10-14T08:53:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9491580 con 0x55e7e953a780 2023-10-14T08:53:53.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60546/0 (socket says 172.21.15.6:60546) 2023-10-14T08:53:53.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.249+0000 7f4d6e59c700 1 -- 172.21.15.6:0/1510506228 learned_addr learned my addr 172.21.15.6:0/1510506228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6e59c700 1 -- 172.21.15.6:0/1510506228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 msgr2=0x55e7e953b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6ed9d700 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e953baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6e59c700 1 -- 172.21.15.6:0/1510506228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 msgr2=0x55e7e953baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e953baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6e59c700 1 -- 172.21.15.6:0/1510506228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e944a3f0 con 0x55e7e9539e20 2023-10-14T08:53:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6ed9d700 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e953baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.250+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953a240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d68017760 tx=0x7f4d68014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56495b6a7afd4b64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.251+0000 7f4d5cff9700 1 -- 172.21.15.6:0/1510506228 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800e040 con 0x55e7e9539e20 2023-10-14T08:53:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.251+0000 7f4d5cff9700 1 -- 172.21.15.6:0/1510506228 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d6800f040 con 0x55e7e9539e20 2023-10-14T08:53:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.251+0000 7f4d5cff9700 1 -- 172.21.15.6:0/1510506228 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68021ba0 con 0x55e7e9539e20 2023-10-14T08:53:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 -- 172.21.15.6:0/1510506228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 msgr2=0x55e7e953a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953a240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d68017760 tx=0x7f4d68014000 comp rx=0 tx=0).stop 2023-10-14T08:53:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 -- 172.21.15.6:0/1510506228 shutdown_connections 2023-10-14T08:53:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e953baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953a240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/1510506228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.252+0000 7f4d80b85b80 1 -- 172.21.15.6:0/1510506228 >> 172.21.15.6:0/1510506228 conn(0x55e7e9467dd0 msgr2=0x55e7e9534fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 -- 172.21.15.6:0/1510506228 shutdown_connections 2023-10-14T08:53:53.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 -- 172.21.15.6:0/1510506228 wait complete. 2023-10-14T08:53:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 -- start start 2023-10-14T08:53:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 Processor -- start 2023-10-14T08:53:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9543d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9544290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e948ce70 con 0x55e7e9539e20 2023-10-14T08:53:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e9429710 con 0x55e7e953b620 2023-10-14T08:53:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.253+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e94293b0 con 0x55e7e953a780 2023-10-14T08:53:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d80b85b80 10 client.0 _ll_register_callbacks cb 0x55e7e9286800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9543d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9543d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33562/0 (socket says 172.21.15.6:33562) 2023-10-14T08:53:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6e59c700 1 -- 172.21.15.6:0/3284557129 learned_addr learned my addr 172.21.15.6:0/3284557129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9544290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 -- 172.21.15.6:0/3284557129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 msgr2=0x55e7e9544290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9544290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 -- 172.21.15.6:0/3284557129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 msgr2=0x55e7e9543d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9543d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 -- 172.21.15.6:0/3284557129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d68017440 con 0x55e7e953b620 2023-10-14T08:53:53.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9544290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9543d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d6ed9d700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954b2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55e7e953ae00 tx=0x7f4d600108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f4e510020181401 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.254+0000 7f4d55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.255+0000 7f4d55ffb700 1 -- 172.21.15.6:0/3284557129 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60004230 con 0x55e7e953b620 2023-10-14T08:53:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.255+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7e9491ef0 con 0x55e7e953b620 2023-10-14T08:53:53.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.255+0000 7f4d55ffb700 1 -- 172.21.15.6:0/3284557129 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4d60016070 con 0x55e7e953b620 2023-10-14T08:53:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.255+0000 7f4d55ffb700 1 -- 172.21.15.6:0/3284557129 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d60010e70 con 0x55e7e953b620 2023-10-14T08:53:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 10 client.25283 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e7e92b7de0 con 0x55e7e953b620 2023-10-14T08:53:53.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d55ffb700 1 -- 172.21.15.6:0/3284557129 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e7e9491ef0 con 0x55e7e953b620 2023-10-14T08:53:53.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d55ffb700 1 -- 172.21.15.6:0/3284557129 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4d60012780 con 0x55e7e953b620 2023-10-14T08:53:53.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 10 client.25283 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 10 client.25283 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-10-14T08:53:53.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 20 client.25283 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e954fb50 0x55e7e9551f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 4 client.25283 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.256+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7e9509c10 con 0x55e7e954fb50 2023-10-14T08:53:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.257+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e954fb50 0x55e7e9551f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.257+0000 7f4d55ffb700 10 client.25283 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:53.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.257+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e954fb50 0x55e7e9551f70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=36997cae532c113f server_cookie=4a7af97af537618d in_seq=0 out_seq=0 2023-10-14T08:53:53.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d55ffb700 1 -- 172.21.15.6:0/3284557129 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7e9509c10 con 0x55e7e954fb50 2023-10-14T08:53:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d55ffb700 10 client.25283 handle_command_reply: tid=0 2023-10-14T08:53:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 client.25283 shutdown 2023-10-14T08:53:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 msgr2=0x55e7e954b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954b2d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55e7e953ae00 tx=0x7f4d600108d0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 shutdown_connections 2023-10-14T08:53:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e954fb50 0x55e7e9551f70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954b2d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d55ffb700 0 client.25283 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9543d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/3284557129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9544290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 >> 172.21.15.6:0/3284557129 conn(0x55e7e9467dd0 msgr2=0x55e7e9534bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 shutdown_connections 2023-10-14T08:53:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.259+0000 7f4d80b85b80 1 -- 172.21.15.6:0/3284557129 wait complete. 2023-10-14T08:53:53.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.260+0000 7f4d80b85b80 20 client.25283 trim_cache size 0 max 16384 2023-10-14T08:53:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 Processor -- start 2023-10-14T08:53:53.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 -- start start 2023-10-14T08:53:53.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e954b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e930d920 con 0x55e7e953b620 2023-10-14T08:53:53.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e95438c0 con 0x55e7e9539e20 2023-10-14T08:53:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.280+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e952fc00 con 0x55e7e953a780 2023-10-14T08:53:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59204/0 (socket says 172.21.15.6:59204) 2023-10-14T08:53:53.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/938023133 learned_addr learned my addr 172.21.15.6:0/938023133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/938023133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 msgr2=0x55e7e953e620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953e620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/938023133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 msgr2=0x55e7e954b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e954b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 -- 172.21.15.6:0/938023133 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e92a0c60 con 0x55e7e953a780 2023-10-14T08:53:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.281+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953eb60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005cb0 tx=0x7f4d640c3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62321e64083da36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.282+0000 7f4d5d7fa700 1 -- 172.21.15.6:0/938023133 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640a3ac0 con 0x55e7e953a780 2023-10-14T08:53:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.282+0000 7f4d5d7fa700 1 -- 172.21.15.6:0/938023133 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d640a7c10 con 0x55e7e953a780 2023-10-14T08:53:53.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.282+0000 7f4d5d7fa700 1 -- 172.21.15.6:0/938023133 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d640a3d20 con 0x55e7e953a780 2023-10-14T08:53:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 -- 172.21.15.6:0/938023133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 msgr2=0x55e7e953eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953eb60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005cb0 tx=0x7f4d640c3040 comp rx=0 tx=0).stop 2023-10-14T08:53:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 -- 172.21.15.6:0/938023133 shutdown_connections 2023-10-14T08:53:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e953b620 0x55e7e954b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e9539e20 0x55e7e953e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/938023133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e953eb60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 -- 172.21.15.6:0/938023133 >> 172.21.15.6:0/938023133 conn(0x55e7e9467dd0 msgr2=0x55e7e9542950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 -- 172.21.15.6:0/938023133 shutdown_connections 2023-10-14T08:53:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 -- 172.21.15.6:0/938023133 wait complete. 2023-10-14T08:53:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 -- start start 2023-10-14T08:53:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.283+0000 7f4d80b85b80 1 Processor -- start 2023-10-14T08:53:53.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9548dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9549300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e954a850 con 0x55e7e9539e20 2023-10-14T08:53:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e954a9c0 con 0x55e7e953b620 2023-10-14T08:53:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e954ab30 con 0x55e7e953a780 2023-10-14T08:53:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d80b85b80 10 client.0 _ll_register_callbacks cb 0x7f4d60009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9548dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9548dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33574/0 (socket says 172.21.15.6:33574) 2023-10-14T08:53:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d6e59c700 1 -- 172.21.15.6:0/4039962608 learned_addr learned my addr 172.21.15.6:0/4039962608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d6ed9d700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.284+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9549300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d6e59c700 1 -- 172.21.15.6:0/4039962608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 msgr2=0x55e7e9549300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9549300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d6e59c700 1 -- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 msgr2=0x55e7e954a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d6e59c700 1 -- 172.21.15.6:0/4039962608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70103a80 con 0x55e7e9539e20 2023-10-14T08:53:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d6e59c700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9548dc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d68017fd0 tx=0x7f4d68009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6285be66eb1cc19 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:53.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d55ffb700 1 -- 172.21.15.6:0/4039962608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6802f070 con 0x55e7e9539e20 2023-10-14T08:53:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d6800f040 con 0x55e7e9539e20 2023-10-14T08:53:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d55ffb700 1 -- 172.21.15.6:0/4039962608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4d6801c040 con 0x55e7e9539e20 2023-10-14T08:53:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.285+0000 7f4d55ffb700 1 -- 172.21.15.6:0/4039962608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d68033730 con 0x55e7e9539e20 2023-10-14T08:53:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 10 client.15663 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e7e92de250 con 0x55e7e9539e20 2023-10-14T08:53:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d55ffb700 1 -- 172.21.15.6:0/4039962608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d6800f040 con 0x55e7e9539e20 2023-10-14T08:53:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d55ffb700 1 -- 172.21.15.6:0/4039962608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4d68015a00 con 0x55e7e9539e20 2023-10-14T08:53:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 10 client.15663 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 10 client.15663 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2023-10-14T08:53:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 20 client.15663 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e95b5470 0x55e7e95b7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 4 client.15663 mds_command: new command op to 24434 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 --> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e7e9485e50 con 0x55e7e95b5470 2023-10-14T08:53:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.286+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e95b5470 0x55e7e95b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.287+0000 7f4d6dd9b700 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e95b5470 0x55e7e95b7890 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=83454f69e9ae4330 server_cookie=b27f9271e0d36f3d in_seq=0 out_seq=0 2023-10-14T08:53:53.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.287+0000 7f4d55ffb700 10 client.15663 ms_handle_connect on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.287+0000 7f4d55ffb700 1 -- 172.21.15.6:0/4039962608 <== mds.4 v2:172.21.15.57:6832/1834864415 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e7e9485e50 con 0x55e7e95b5470 2023-10-14T08:53:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d55ffb700 10 client.15663 handle_command_reply: tid=0 2023-10-14T08:53:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 client.15663 shutdown 2023-10-14T08:53:53.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 msgr2=0x55e7e9548dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9548dc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d68017fd0 tx=0x7f4d68009930 comp rx=0 tx=0).stop 2023-10-14T08:53:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 shutdown_connections 2023-10-14T08:53:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:6832/1834864415,v1:172.21.15.57:6833/1834864415] conn(0x55e7e95b5470 0x55e7e95b7890 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e7e953b620 0x55e7e954a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e7e9539e20 0x55e7e9548dc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 --2- 172.21.15.6:0/4039962608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7e953a780 0x55e7e9549300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 >> 172.21.15.6:0/4039962608 conn(0x55e7e9467dd0 msgr2=0x55e7e9542950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d55ffb700 0 client.15663 ms_handle_reset on v2:172.21.15.57:6832/1834864415 2023-10-14T08:53:53.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 shutdown_connections 2023-10-14T08:53:53.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 1 -- 172.21.15.6:0/4039962608 wait complete. 2023-10-14T08:53:53.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.288+0000 7f4d80b85b80 20 client.15663 trim_cache size 0 max 16384 2023-10-14T08:53:53.309 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:53.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4d580a1480 msgr2=0x7f4d580a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4d580a1480 0x7f4d580a3940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d70068fe0 tx=0x7f4d6800b040 comp rx=0 tx=0).stop 2023-10-14T08:53:53.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 msgr2=0x7f4d70199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d70199390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d6400c000 tx=0x7f4d64009580 comp rx=0 tx=0).stop 2023-10-14T08:53:53.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 shutdown_connections 2023-10-14T08:53:53.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d70102b20 0x7f4d701a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d700ff2b0 0x7f4d70198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4d580a1480 0x7f4d580a3940 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 --2- 172.21.15.6:0/2294554702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d70102160 0x7f4d70199390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 >> 172.21.15.6:0/2294554702 conn(0x7f4d700fabc0 msgr2=0x7f4d700fb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 shutdown_connections 2023-10-14T08:53:53.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.289+0000 7f4d7499b700 1 -- 172.21.15.6:0/2294554702 wait complete. 2023-10-14T08:53:53.315 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:53 smithi006 ceph-mon[99452]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 57 MiB/s wr, 2.38k op/s 2023-10-14T08:53:53.315 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:53 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1159129280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:53:53.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-14T08:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 -- 172.21.15.6:0/2891037363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c101a40 msgr2=0x7f462c103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 --2- 172.21.15.6:0/2891037363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c101a40 0x7f462c103e30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f461c0098f0 tx=0x7f461c009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 -- 172.21.15.6:0/2891037363 shutdown_connections 2023-10-14T08:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 --2- 172.21.15.6:0/2891037363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c106ca0 0x7f462c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 --2- 172.21.15.6:0/2891037363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c101a40 0x7f462c103e30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 --2- 172.21.15.6:0/2891037363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f462c104370 0x7f462c106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 -- 172.21.15.6:0/2891037363 >> 172.21.15.6:0/2891037363 conn(0x7f462c0fb410 msgr2=0x7f462c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.528+0000 7f4630fcd700 1 -- 172.21.15.6:0/2891037363 shutdown_connections 2023-10-14T08:53:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.529+0000 7f4630fcd700 1 -- 172.21.15.6:0/2891037363 wait complete. 2023-10-14T08:53:53.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 Processor -- start 2023-10-14T08:53:53.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 -- start start 2023-10-14T08:53:53.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 0x7f462c194880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c104370 0x7f462c194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f462c106ca0 0x7f462c1a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1956a0 con 0x7f462c104370 2023-10-14T08:53:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1a4fd0 con 0x7f462c101a40 2023-10-14T08:53:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.530+0000 7f4630fcd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c1a5110 con 0x7f462c106ca0 2023-10-14T08:53:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 0x7f462c194880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 0x7f462c194880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60578/0 (socket says 172.21.15.6:60578) 2023-10-14T08:53:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 -- 172.21.15.6:0/1270109902 learned_addr learned my addr 172.21.15.6:0/1270109902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f4629d9b700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c104370 0x7f462c194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462ad9d700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f462c106ca0 0x7f462c1a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 -- 172.21.15.6:0/1270109902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f462c106ca0 msgr2=0x7f462c1a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f462c106ca0 0x7f462c1a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 -- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c104370 msgr2=0x7f462c194dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c104370 0x7f462c194dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.531+0000 7f462a59c700 1 -- 172.21.15.6:0/1270109902 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c009520 con 0x7f462c101a40 2023-10-14T08:53:53.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.532+0000 7f462a59c700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 0x7f462c194880 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f461c0094f0 tx=0x7f461c00bb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.532+0000 7f461b7fe700 1 -- 172.21.15.6:0/1270109902 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c005520 con 0x7f462c101a40 2023-10-14T08:53:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.532+0000 7f461b7fe700 1 -- 172.21.15.6:0/1270109902 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f461c005ce0 con 0x7f462c101a40 2023-10-14T08:53:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.532+0000 7f461b7fe700 1 -- 172.21.15.6:0/1270109902 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c017980 con 0x7f462c101a40 2023-10-14T08:53:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.532+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c1a5390 con 0x7f462c101a40 2023-10-14T08:53:53.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.532+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c1a5760 con 0x7f462c101a40 2023-10-14T08:53:53.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.537+0000 7f463d1b7b80 1 Processor -- start 2023-10-14T08:53:53.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.537+0000 7f463d1b7b80 1 -- start start 2023-10-14T08:53:53.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9bf2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf2780 0x563cc9bf3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 0x563cc9bf3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9b66c70 con 0x563cc9bf2780 2023-10-14T08:53:53.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9b4bc60 con 0x563cc9bf1e20 2023-10-14T08:53:53.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9b49580 con 0x563cc9bf3620 2023-10-14T08:53:53.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9bf2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 0x563cc9bf3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 0x563cc9bf3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59228/0 (socket says 172.21.15.6:59228) 2023-10-14T08:53:53.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 -- 172.21.15.6:0/2709153117 learned_addr learned my addr 172.21.15.6:0/2709153117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 -- 172.21.15.6:0/2709153117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 msgr2=0x563cc9bf2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9bf2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 -- 172.21.15.6:0/2709153117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf2780 msgr2=0x563cc9bf3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf2780 0x563cc9bf3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f4629d9b700 1 -- 172.21.15.6:0/2709153117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc9b023f0 con 0x563cc9bf3620 2023-10-14T08:53:53.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.538+0000 7f462ad9d700 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9bf2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:53.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.539+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 0x563cc9bf3aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4620009d80 tx=0x7f4620011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f14dea94a02c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.539+0000 7f4618ff9700 1 -- 172.21.15.6:0/2709153117 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620004230 con 0x563cc9bf3620 2023-10-14T08:53:53.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.539+0000 7f4618ff9700 1 -- 172.21.15.6:0/2709153117 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4620004390 con 0x563cc9bf3620 2023-10-14T08:53:53.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.539+0000 7f4618ff9700 1 -- 172.21.15.6:0/2709153117 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620019860 con 0x563cc9bf3620 2023-10-14T08:53:53.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.540+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2709153117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 msgr2=0x563cc9bf3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.540+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 0x563cc9bf3aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4620009d80 tx=0x7f4620011720 comp rx=0 tx=0).stop 2023-10-14T08:53:53.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.540+0000 7f461b7fe700 1 -- 172.21.15.6:0/1270109902 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f461c017ae0 con 0x7f462c101a40 2023-10-14T08:53:53.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.541+0000 7f461b7fe700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46140a15d0 0x7f46140a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.541+0000 7f461b7fe700 1 -- 172.21.15.6:0/1270109902 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f461c0cfd30 con 0x7f462c101a40 2023-10-14T08:53:53.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.542+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2709153117 shutdown_connections 2023-10-14T08:53:53.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.542+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf3620 0x563cc9bf3aa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.542+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9bf2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.542+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2709153117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf2780 0x563cc9bf3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.542+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2709153117 >> 172.21.15.6:0/2709153117 conn(0x563cc9b1fdd0 msgr2=0x563cc9becfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.542+0000 7f462ad9d700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46140a15d0 0x7f46140a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.543+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2709153117 shutdown_connections 2023-10-14T08:53:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.543+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2709153117 wait complete. 2023-10-14T08:53:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.543+0000 7f462ad9d700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46140a15d0 0x7f46140a3a90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4624003ee0 tx=0x7f4624009130 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.543+0000 7f463d1b7b80 1 -- start start 2023-10-14T08:53:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.543+0000 7f463d1b7b80 1 Processor -- start 2023-10-14T08:53:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf1e20 0x563cc9c0cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c0d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 0x563cc9c141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9b44e70 con 0x563cc9bf1e20 2023-10-14T08:53:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9ae1710 con 0x563cc9bf3620 2023-10-14T08:53:53.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9ae13b0 con 0x563cc9bf2780 2023-10-14T08:53:53.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f463d1b7b80 10 client.0 _ll_register_callbacks cb 0x563cc993e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f4629d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c0d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 0x563cc9c141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f4629d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c0d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59236/0 (socket says 172.21.15.6:59236) 2023-10-14T08:53:53.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 0x563cc9c141e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60594/0 (socket says 172.21.15.6:60594) 2023-10-14T08:53:53.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f4629d9b700 1 -- 172.21.15.6:0/1148485010 learned_addr learned my addr 172.21.15.6:0/1148485010 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462a59c700 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf1e20 0x563cc9c0cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 -- 172.21.15.6:0/1148485010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 msgr2=0x563cc9c0d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c0d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 -- 172.21.15.6:0/1148485010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf1e20 msgr2=0x563cc9c0cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf1e20 0x563cc9c0cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.544+0000 7f462ad9d700 1 -- 172.21.15.6:0/1148485010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46200099e0 con 0x563cc9bf3620 2023-10-14T08:53:53.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f462ad9d700 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 0x563cc9c141e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4624009610 tx=0x7f4624004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee81b0664ec537ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f4611ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:53.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f4611ffb700 1 -- 172.21.15.6:0/1148485010 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624016450 con 0x563cc9bf3620 2023-10-14T08:53:53.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f4611ffb700 1 -- 172.21.15.6:0/1148485010 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f46240165b0 con 0x563cc9bf3620 2023-10-14T08:53:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cc9b49ef0 con 0x563cc9bf3620 2023-10-14T08:53:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f4611ffb700 1 -- 172.21.15.6:0/1148485010 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4624016770 con 0x563cc9bf3620 2023-10-14T08:53:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 10 client.25295 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563cc996fde0 con 0x563cc9bf3620 2023-10-14T08:53:53.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f4611ffb700 1 -- 172.21.15.6:0/1148485010 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4624031020 con 0x563cc9bf3620 2023-10-14T08:53:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f4611ffb700 1 -- 172.21.15.6:0/1148485010 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4624022910 con 0x563cc9bf3620 2023-10-14T08:53:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 10 client.25295 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 10 client.25295 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-14T08:53:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 20 client.25295 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c18ad0 0x563cc9c1aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 4 client.25295 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.545+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cc9bc1c10 con 0x563cc9c18ad0 2023-10-14T08:53:53.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.546+0000 7f462a59c700 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c18ad0 0x563cc9c1aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.547+0000 7f4611ffb700 10 client.25295 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.547+0000 7f462a59c700 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c18ad0 0x563cc9c1aef0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cbe99e867daa0808 server_cookie=4bc9c211a6a261e5 in_seq=0 out_seq=0 2023-10-14T08:53:53.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f4611ffb700 1 -- 172.21.15.6:0/1148485010 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563cc9bc1c10 con 0x563cc9c18ad0 2023-10-14T08:53:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f4611ffb700 10 client.25295 handle_command_reply: tid=0 2023-10-14T08:53:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 client.25295 shutdown 2023-10-14T08:53:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 msgr2=0x563cc9c141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 0x563cc9c141e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4624009610 tx=0x7f4624004b40 comp rx=0 tx=0).stop 2023-10-14T08:53:53.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 shutdown_connections 2023-10-14T08:53:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c18ad0 0x563cc9c1aef0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf3620 0x563cc9c141e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf1e20 0x563cc9c0cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/1148485010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c0d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 >> 172.21.15.6:0/1148485010 conn(0x563cc9b1fdd0 msgr2=0x563cc9becbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f4611ffb700 0 client.25295 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 shutdown_connections 2023-10-14T08:53:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.549+0000 7f463d1b7b80 1 -- 172.21.15.6:0/1148485010 wait complete. 2023-10-14T08:53:53.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.550+0000 7f463d1b7b80 20 client.25295 trim_cache size 0 max 16384 2023-10-14T08:53:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.571+0000 7f463d1b7b80 1 Processor -- start 2023-10-14T08:53:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.571+0000 7f463d1b7b80 1 -- start start 2023-10-14T08:53:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf1e20 0x563cc9bf3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf2780 0x563cc9c141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c0cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9c0c830 con 0x563cc9bf3620 2023-10-14T08:53:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc99c5920 con 0x563cc9bf2780 2023-10-14T08:53:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9c15e40 con 0x563cc9bf1e20 2023-10-14T08:53:53.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c0cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f462ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c0cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33612/0 (socket says 172.21.15.6:33612) 2023-10-14T08:53:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f462ad9d700 1 -- 172.21.15.6:0/553228045 learned_addr learned my addr 172.21.15.6:0/553228045 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.572+0000 7f462a59c700 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf1e20 0x563cc9bf3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462ad9d700 1 -- 172.21.15.6:0/553228045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf1e20 msgr2=0x563cc9bf3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462ad9d700 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf1e20 0x563cc9bf3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462ad9d700 1 -- 172.21.15.6:0/553228045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf2780 msgr2=0x563cc9c141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462ad9d700 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf2780 0x563cc9c141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462ad9d700 1 -- 172.21.15.6:0/553228045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cc9958c60 con 0x563cc9bf3620 2023-10-14T08:53:53.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462a59c700 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf1e20 0x563cc9bf3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:53.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f462ad9d700 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c0cc60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4624009fc0 tx=0x7f4624000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4ef0b4b3fea26c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.573+0000 7f46197fa700 1 -- 172.21.15.6:0/553228045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240045d0 con 0x563cc9bf3620 2023-10-14T08:53:53.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.574+0000 7f46197fa700 1 -- 172.21.15.6:0/553228045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4624031030 con 0x563cc9bf3620 2023-10-14T08:53:53.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.574+0000 7f46197fa700 1 -- 172.21.15.6:0/553228045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624016af0 con 0x563cc9bf3620 2023-10-14T08:53:53.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 -- 172.21.15.6:0/553228045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 msgr2=0x563cc9c0cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c0cc60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4624009fc0 tx=0x7f4624000f40 comp rx=0 tx=0).stop 2023-10-14T08:53:53.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 -- 172.21.15.6:0/553228045 shutdown_connections 2023-10-14T08:53:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c0cc60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf1e20 0x563cc9bf3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/553228045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf2780 0x563cc9c141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 -- 172.21.15.6:0/553228045 >> 172.21.15.6:0/553228045 conn(0x563cc9b1fdd0 msgr2=0x563cc9bf9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 -- 172.21.15.6:0/553228045 shutdown_connections 2023-10-14T08:53:53.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.575+0000 7f463d1b7b80 1 -- 172.21.15.6:0/553228045 wait complete. 2023-10-14T08:53:53.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.576+0000 7f463d1b7b80 1 -- start start 2023-10-14T08:53:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 Processor -- start 2023-10-14T08:53:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9c13b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c14070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9c12720 con 0x563cc9bf3620 2023-10-14T08:53:53.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9c12890 con 0x563cc9bf1e20 2023-10-14T08:53:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cc9c12a50 con 0x563cc9bf2780 2023-10-14T08:53:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f463d1b7b80 10 client.0 _ll_register_callbacks cb 0x7f4624007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f462a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9c13b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f462a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9c13b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60606/0 (socket says 172.21.15.6:60606) 2023-10-14T08:53:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f462a59c700 1 -- 172.21.15.6:0/2983081230 learned_addr learned my addr 172.21.15.6:0/2983081230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.577+0000 7f462ad9d700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.578+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c14070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.578+0000 7f4629d9b700 1 -- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 msgr2=0x563cc9c13b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.578+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9c13b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.578+0000 7f4629d9b700 1 -- 172.21.15.6:0/2983081230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 msgr2=0x563cc9c12140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.578+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c12140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.578+0000 7f4629d9b700 1 -- 172.21.15.6:0/2983081230 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c1a5760 con 0x563cc9bf2780 2023-10-14T08:53:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f4629d9b700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c14070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4620000c00 tx=0x7f46200057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dbca47aa0b3e34e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f4611ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:53:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f4611ffb700 1 -- 172.21.15.6:0/2983081230 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620004910 con 0x563cc9bf2780 2023-10-14T08:53:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f4611ffb700 1 -- 172.21.15.6:0/2983081230 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4620004a70 con 0x563cc9bf2780 2023-10-14T08:53:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4620004390 con 0x563cc9bf2780 2023-10-14T08:53:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f4611ffb700 1 -- 172.21.15.6:0/2983081230 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4620004c30 con 0x563cc9bf2780 2023-10-14T08:53:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f463d1b7b80 10 client.25384 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.579+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563cc996fde0 con 0x563cc9bf2780 2023-10-14T08:53:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f4611ffb700 1 -- 172.21.15.6:0/2983081230 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4620004390 con 0x563cc9bf2780 2023-10-14T08:53:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f4611ffb700 1 -- 172.21.15.6:0/2983081230 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f462002a020 con 0x563cc9bf2780 2023-10-14T08:53:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f463d1b7b80 10 client.25384 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f463d1b7b80 10 client.25384 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2023-10-14T08:53:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f463d1b7b80 20 client.25384 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c7ebc0 0x563cc9c80fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f463d1b7b80 4 client.25384 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 --> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563cc9b3de50 con 0x563cc9c7ebc0 2023-10-14T08:53:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.580+0000 7f462a59c700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c7ebc0 0x563cc9c80fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f462a59c700 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c7ebc0 0x563cc9c80fe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=282efa55a7aec9bb server_cookie=519f2edf0d0103c8 in_seq=0 out_seq=0 2023-10-14T08:53:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f4611ffb700 10 client.25384 ms_handle_connect on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f4611ffb700 1 -- 172.21.15.6:0/2983081230 <== mds.3 v2:172.21.15.57:6834/2935762756 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563cc9b3de50 con 0x563cc9c7ebc0 2023-10-14T08:53:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f4611ffb700 10 client.25384 handle_command_reply: tid=0 2023-10-14T08:53:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 client.25384 shutdown 2023-10-14T08:53:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 msgr2=0x563cc9c14070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c14070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4620000c00 tx=0x7f46200057b0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 shutdown_connections 2023-10-14T08:53:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:6834/2935762756,v1:172.21.15.57:6835/2935762756] conn(0x563cc9c7ebc0 0x563cc9c80fe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cc9bf3620 0x563cc9c12140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cc9bf1e20 0x563cc9c13b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f4611ffb700 0 client.25384 ms_handle_reset on v2:172.21.15.57:6834/2935762756 2023-10-14T08:53:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 --2- 172.21.15.6:0/2983081230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cc9bf2780 0x563cc9c14070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.581+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 >> 172.21.15.6:0/2983081230 conn(0x563cc9b1fdd0 msgr2=0x563cc9bf6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.582+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 shutdown_connections 2023-10-14T08:53:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.582+0000 7f463d1b7b80 1 -- 172.21.15.6:0/2983081230 wait complete. 2023-10-14T08:53:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f463d1b7b80 20 client.25384 trim_cache size 0 max 16384 2023-10-14T08:53:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46140a15d0 msgr2=0x7f46140a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46140a15d0 0x7f46140a3a90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4624003ee0 tx=0x7f4624009130 comp rx=0 tx=0).stop 2023-10-14T08:53:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 msgr2=0x7f462c194880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 0x7f462c194880 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f461c0094f0 tx=0x7f461c00bb00 comp rx=0 tx=0).stop 2023-10-14T08:53:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 shutdown_connections 2023-10-14T08:53:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f462c106ca0 0x7f462c1a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f46140a15d0 0x7f46140a3a90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f462c101a40 0x7f462c194880 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 --2- 172.21.15.6:0/1270109902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f462c104370 0x7f462c194dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.583+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 >> 172.21.15.6:0/1270109902 conn(0x7f462c0fb410 msgr2=0x7f462c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.584+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 shutdown_connections 2023-10-14T08:53:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.588+0000 7f4630fcd700 1 -- 172.21.15.6:0/1270109902 wait complete. 2023-10-14T08:53:53.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-14T08:53:53.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:53 smithi178 ceph-mon[103612]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 57 MiB/s wr, 2.38k op/s 2023-10-14T08:53:53.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:53 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1159129280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:53:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:53 smithi057 ceph-mon[103313]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 57 MiB/s wr, 2.38k op/s 2023-10-14T08:53:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:53 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1159129280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T08:53:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 -- 172.21.15.6:0/1064497403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 msgr2=0x7f7828109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 --2- 172.21.15.6:0/1064497403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 0x7f7828109110 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f782000b0a0 tx=0x7f782000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 -- 172.21.15.6:0/1064497403 shutdown_connections 2023-10-14T08:53:53.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 --2- 172.21.15.6:0/1064497403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 0x7f7828109110 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 --2- 172.21.15.6:0/1064497403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828101a40 0x7f7828103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 --2- 172.21.15.6:0/1064497403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f7828106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 -- 172.21.15.6:0/1064497403 >> 172.21.15.6:0/1064497403 conn(0x7f78280fb410 msgr2=0x7f78280fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 -- 172.21.15.6:0/1064497403 shutdown_connections 2023-10-14T08:53:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.816+0000 7f782f1fc700 1 -- 172.21.15.6:0/1064497403 wait complete. 2023-10-14T08:53:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 Processor -- start 2023-10-14T08:53:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 -- start start 2023-10-14T08:53:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828101a40 0x7f782806f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f782806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 0x7f7828195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7828070340 con 0x7f7828106ca0 2023-10-14T08:53:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78280704b0 con 0x7f7828101a40 2023-10-14T08:53:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.817+0000 7f782f1fc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78281963a0 con 0x7f7828104370 2023-10-14T08:53:53.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.818+0000 7f7827fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f782806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.818+0000 7f7827fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f782806fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59262/0 (socket says 172.21.15.6:59262) 2023-10-14T08:53:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.818+0000 7f7827fff700 1 -- 172.21.15.6:0/3513195630 learned_addr learned my addr 172.21.15.6:0/3513195630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f782cf98700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828101a40 0x7f782806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7827fff700 1 -- 172.21.15.6:0/3513195630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828101a40 msgr2=0x7f782806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7827fff700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828101a40 0x7f782806f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7827fff700 1 -- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 msgr2=0x7f7828195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7827fff700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 0x7f7828195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7827fff700 1 -- 172.21.15.6:0/3513195630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009d00 con 0x7f7828104370 2023-10-14T08:53:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7827fff700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f782806fd70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7814012db0 tx=0x7f781400c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7825ffb700 1 -- 172.21.15.6:0/3513195630 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814009790 con 0x7f7828104370 2023-10-14T08:53:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.819+0000 7f7825ffb700 1 -- 172.21.15.6:0/3513195630 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f781400cdd0 con 0x7f7828104370 2023-10-14T08:53:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.820+0000 7f7825ffb700 1 -- 172.21.15.6:0/3513195630 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814019890 con 0x7f7828104370 2023-10-14T08:53:53.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.820+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78280ff890 con 0x7f7828104370 2023-10-14T08:53:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.820+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78280ffd50 con 0x7f7828104370 2023-10-14T08:53:53.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.824+0000 7f783b3e6b80 1 Processor -- start 2023-10-14T08:53:53.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.824+0000 7f783b3e6b80 1 -- start start 2023-10-14T08:53:53.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5db240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5dc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b54fc70 con 0x560e7b5dc620 2023-10-14T08:53:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b534c60 con 0x560e7b5dae20 2023-10-14T08:53:53.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b532580 con 0x560e7b5db780 2023-10-14T08:53:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f782d799700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5db240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f782d799700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5db240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60624/0 (socket says 172.21.15.6:60624) 2023-10-14T08:53:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.825+0000 7f782d799700 1 -- 172.21.15.6:0/1086461444 learned_addr learned my addr 172.21.15.6:0/1086461444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.826+0000 7f782d799700 1 -- 172.21.15.6:0/1086461444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 msgr2=0x560e7b5dc040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:53:53.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.826+0000 7f782d799700 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5dc040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.826+0000 7f782d799700 1 -- 172.21.15.6:0/1086461444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 msgr2=0x560e7b5dcaa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.826+0000 7f782d799700 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5dcaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.827+0000 7f782d799700 1 -- 172.21.15.6:0/1086461444 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7b4eb3f0 con 0x560e7b5dae20 2023-10-14T08:53:53.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.827+0000 7f7825ffb700 1 -- 172.21.15.6:0/3513195630 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f781401ab40 con 0x7f7828104370 2023-10-14T08:53:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.827+0000 7f782d799700 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5db240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78200062a0 tx=0x7f7820009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac8af521fb9e0001 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.827+0000 7f7812ffd700 1 -- 172.21.15.6:0/1086461444 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000e040 con 0x560e7b5dae20 2023-10-14T08:53:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.827+0000 7f7812ffd700 1 -- 172.21.15.6:0/1086461444 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78200076e0 con 0x560e7b5dae20 2023-10-14T08:53:53.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.827+0000 7f7812ffd700 1 -- 172.21.15.6:0/1086461444 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820003c90 con 0x560e7b5dae20 2023-10-14T08:53:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.828+0000 7f7825ffb700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f78180a1500 0x7f78180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.828+0000 7f7825ffb700 1 -- 172.21.15.6:0/3513195630 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f78140cc5b0 con 0x7f7828104370 2023-10-14T08:53:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.828+0000 7f783b3e6b80 1 -- 172.21.15.6:0/1086461444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 msgr2=0x560e7b5db240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.828+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5db240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78200062a0 tx=0x7f7820009bc0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.829+0000 7f782cf98700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f78180a1500 0x7f78180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.830+0000 7f782cf98700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f78180a1500 0x7f78180a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f781c00dad0 tx=0x7f781c00d4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 -- 172.21.15.6:0/1086461444 shutdown_connections 2023-10-14T08:53:53.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5dcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5db240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/1086461444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5dc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 -- 172.21.15.6:0/1086461444 >> 172.21.15.6:0/1086461444 conn(0x560e7b508dd0 msgr2=0x560e7b5d5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 -- 172.21.15.6:0/1086461444 shutdown_connections 2023-10-14T08:53:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.837+0000 7f783b3e6b80 1 -- 172.21.15.6:0/1086461444 wait complete. 2023-10-14T08:53:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 -- start start 2023-10-14T08:53:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 Processor -- start 2023-10-14T08:53:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5e5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dc620 0x560e7b5ec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b52de70 con 0x560e7b5dae20 2023-10-14T08:53:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b4ca710 con 0x560e7b5dc620 2023-10-14T08:53:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b4ca3b0 con 0x560e7b5db780 2023-10-14T08:53:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.838+0000 7f783b3e6b80 10 client.0 _ll_register_callbacks cb 0x560e7b327800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782cf98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782cf98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5e4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33640/0 (socket says 172.21.15.6:33640) 2023-10-14T08:53:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782cf98700 1 -- 172.21.15.6:0/4058846810 learned_addr learned my addr 172.21.15.6:0/4058846810 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dc620 0x560e7b5ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f7827fff700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 -- 172.21.15.6:0/4058846810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 msgr2=0x560e7b5e5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5e5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 -- 172.21.15.6:0/4058846810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 msgr2=0x560e7b5e4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5e4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 -- 172.21.15.6:0/4058846810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7828109d00 con 0x560e7b5dc620 2023-10-14T08:53:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f782d799700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dc620 0x560e7b5ec250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f782000b780 tx=0x7f782000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dfd84bb0635c81f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.839+0000 7f780bfff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.840+0000 7f7827fff700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5e5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.840+0000 7f780bfff700 1 -- 172.21.15.6:0/4058846810 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000e050 con 0x560e7b5dc620 2023-10-14T08:53:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.840+0000 7f780bfff700 1 -- 172.21.15.6:0/4058846810 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f78200050b0 con 0x560e7b5dc620 2023-10-14T08:53:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.840+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e7b532ef0 con 0x560e7b5dc620 2023-10-14T08:53:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f780bfff700 1 -- 172.21.15.6:0/4058846810 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7820005270 con 0x560e7b5dc620 2023-10-14T08:53:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 10 client.25310 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560e7b358de0 con 0x560e7b5dc620 2023-10-14T08:53:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f780bfff700 1 -- 172.21.15.6:0/4058846810 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560e7b532ef0 con 0x560e7b5dc620 2023-10-14T08:53:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f780bfff700 1 -- 172.21.15.6:0/4058846810 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f78200127e0 con 0x560e7b5dc620 2023-10-14T08:53:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 10 client.25310 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 10 client.25310 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-14T08:53:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 20 client.25310 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b5f0760 0x560e7b5f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 4 client.25310 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e7b5aac10 con 0x560e7b5f0760 2023-10-14T08:53:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.841+0000 7f782cf98700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b5f0760 0x560e7b5f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.842+0000 7f782cf98700 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b5f0760 0x560e7b5f2b80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=778e1ceac7e25fcf server_cookie=ca708472184fff18 in_seq=0 out_seq=0 2023-10-14T08:53:53.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.842+0000 7f780bfff700 10 client.25310 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:53.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f780bfff700 1 -- 172.21.15.6:0/4058846810 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e7b5aac10 con 0x560e7b5f0760 2023-10-14T08:53:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f780bfff700 10 client.25310 handle_command_reply: tid=0 2023-10-14T08:53:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 client.25310 shutdown 2023-10-14T08:53:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dc620 msgr2=0x560e7b5ec250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dc620 0x560e7b5ec250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f782000b780 tx=0x7f782000bce0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 shutdown_connections 2023-10-14T08:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b5f0760 0x560e7b5f2b80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dc620 0x560e7b5ec250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5e4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/4058846810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5e5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.843+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 >> 172.21.15.6:0/4058846810 conn(0x560e7b508dd0 msgr2=0x560e7b5d5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.844+0000 7f780bfff700 0 client.25310 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.845+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 shutdown_connections 2023-10-14T08:53:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.845+0000 7f783b3e6b80 1 -- 172.21.15.6:0/4058846810 wait complete. 2023-10-14T08:53:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.845+0000 7f783b3e6b80 20 client.25310 trim_cache size 0 max 16384 2023-10-14T08:53:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 Processor -- start 2023-10-14T08:53:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 -- start start 2023-10-14T08:53:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5df590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5db780 0x560e7b5ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5dc620 0x560e7b5dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b3ae920 con 0x560e7b5dae20 2023-10-14T08:53:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b5dc4a0 con 0x560e7b5db780 2023-10-14T08:53:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b5e4180 con 0x560e7b5dc620 2023-10-14T08:53:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f782cf98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f782cf98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5df590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33648/0 (socket says 172.21.15.6:33648) 2023-10-14T08:53:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f7827fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5db780 0x560e7b5ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.874+0000 7f782cf98700 1 -- 172.21.15.6:0/3361864685 learned_addr learned my addr 172.21.15.6:0/3361864685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782d799700 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5dc620 0x560e7b5dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782cf98700 1 -- 172.21.15.6:0/3361864685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5dc620 msgr2=0x560e7b5dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782cf98700 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5dc620 0x560e7b5dfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782cf98700 1 -- 172.21.15.6:0/3361864685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5db780 msgr2=0x560e7b5ec210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782cf98700 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5db780 0x560e7b5ec210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782cf98700 1 -- 172.21.15.6:0/3361864685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e7b341c60 con 0x560e7b5dae20 2023-10-14T08:53:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f782cf98700 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5df590 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f781c005dc0 tx=0x7f781c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6755db00d1a7f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.875+0000 7f78137fe700 1 -- 172.21.15.6:0/3361864685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c024040 con 0x560e7b5dae20 2023-10-14T08:53:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.876+0000 7f78137fe700 1 -- 172.21.15.6:0/3361864685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f781c027530 con 0x560e7b5dae20 2023-10-14T08:53:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.876+0000 7f78137fe700 1 -- 172.21.15.6:0/3361864685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c01f690 con 0x560e7b5dae20 2023-10-14T08:53:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 -- 172.21.15.6:0/3361864685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 msgr2=0x560e7b5df590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5df590 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f781c005dc0 tx=0x7f781c015000 comp rx=0 tx=0).stop 2023-10-14T08:53:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 -- 172.21.15.6:0/3361864685 shutdown_connections 2023-10-14T08:53:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5dc620 0x560e7b5dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dae20 0x560e7b5df590 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/3361864685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5db780 0x560e7b5ec210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.877+0000 7f783b3e6b80 1 -- 172.21.15.6:0/3361864685 >> 172.21.15.6:0/3361864685 conn(0x560e7b508dd0 msgr2=0x560e7b5e2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.878+0000 7f783b3e6b80 1 -- 172.21.15.6:0/3361864685 shutdown_connections 2023-10-14T08:53:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.878+0000 7f783b3e6b80 1 -- 172.21.15.6:0/3361864685 wait complete. 2023-10-14T08:53:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.878+0000 7f783b3e6b80 1 -- start start 2023-10-14T08:53:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.878+0000 7f783b3e6b80 1 Processor -- start 2023-10-14T08:53:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5ea470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b5eb9c0 con 0x560e7b5dc620 2023-10-14T08:53:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b5ebb30 con 0x560e7b5dae20 2023-10-14T08:53:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7b5ebca0 con 0x560e7b5db780 2023-10-14T08:53:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f783b3e6b80 10 client.0 _ll_register_callbacks cb 0x7f7814005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782cf98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782cf98700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5e9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60644/0 (socket says 172.21.15.6:60644) 2023-10-14T08:53:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782cf98700 1 -- 172.21.15.6:0/2569016726 learned_addr learned my addr 172.21.15.6:0/2569016726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782d799700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f7827fff700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782d799700 1 -- 172.21.15.6:0/2569016726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 msgr2=0x560e7b5ea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782d799700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5ea470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782d799700 1 -- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 msgr2=0x560e7b5e9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782d799700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5e9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.880+0000 7f782d799700 1 -- 172.21.15.6:0/2569016726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c00f9d0 con 0x560e7b5dc620 2023-10-14T08:53:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.881+0000 7f782d799700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5eb480 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7820012ba0 tx=0x7f7820006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4ecc03eb2ebd86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.881+0000 7f780bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.881+0000 7f780bfff700 1 -- 172.21.15.6:0/2569016726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000e040 con 0x560e7b5dc620 2023-10-14T08:53:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.881+0000 7f780bfff700 1 -- 172.21.15.6:0/2569016726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7820036050 con 0x560e7b5dc620 2023-10-14T08:53:53.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.881+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78200076e0 con 0x560e7b5dc620 2023-10-14T08:53:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.882+0000 7f780bfff700 1 -- 172.21.15.6:0/2569016726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7820012d10 con 0x560e7b5dc620 2023-10-14T08:53:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.882+0000 7f783b3e6b80 10 client.15690 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.882+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560e7b37f250 con 0x560e7b5dc620 2023-10-14T08:53:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f780bfff700 1 -- 172.21.15.6:0/2569016726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f782003f080 con 0x560e7b5dc620 2023-10-14T08:53:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f780bfff700 1 -- 172.21.15.6:0/2569016726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7820019070 con 0x560e7b5dc620 2023-10-14T08:53:53.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f783b3e6b80 10 client.15690 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f783b3e6b80 10 client.15690 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-10-14T08:53:53.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f783b3e6b80 20 client.15690 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b655fd0 0x560e7b6583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f783b3e6b80 4 client.15690 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:53.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 --> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e7b526e50 con 0x560e7b655fd0 2023-10-14T08:53:53.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.883+0000 7f782cf98700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b655fd0 0x560e7b6583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f782cf98700 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b655fd0 0x560e7b6583f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71284c04d48e44c3 server_cookie=5c681e727daec9fb in_seq=0 out_seq=0 2023-10-14T08:53:53.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f780bfff700 10 client.15690 ms_handle_connect on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:53.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f780bfff700 1 -- 172.21.15.6:0/2569016726 <== mds.2 v2:172.21.15.57:6836/1275682296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e7b526e50 con 0x560e7b655fd0 2023-10-14T08:53:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f780bfff700 10 client.15690 handle_command_reply: tid=0 2023-10-14T08:53:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f783b3e6b80 1 client.15690 shutdown 2023-10-14T08:53:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 msgr2=0x560e7b5eb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.884+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5eb480 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7820012ba0 tx=0x7f7820006000 comp rx=0 tx=0).stop 2023-10-14T08:53:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 shutdown_connections 2023-10-14T08:53:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:6836/1275682296,v1:172.21.15.57:6837/1275682296] conn(0x560e7b655fd0 0x560e7b6583f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e7b5dc620 0x560e7b5eb480 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560e7b5dae20 0x560e7b5e9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f783b3e6b80 1 --2- 172.21.15.6:0/2569016726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e7b5db780 0x560e7b5ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 >> 172.21.15.6:0/2569016726 conn(0x560e7b508dd0 msgr2=0x560e7b5df590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.885+0000 7f780bfff700 0 client.15690 ms_handle_reset on v2:172.21.15.57:6836/1275682296 2023-10-14T08:53:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.886+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 shutdown_connections 2023-10-14T08:53:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.886+0000 7f783b3e6b80 1 -- 172.21.15.6:0/2569016726 wait complete. 2023-10-14T08:53:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.886+0000 7f783b3e6b80 20 client.15690 trim_cache size 0 max 16384 2023-10-14T08:53:53.896 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f78180a1500 msgr2=0x7f78180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f78180a1500 0x7f78180a39c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f781c00dad0 tx=0x7f781c00d4b0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 msgr2=0x7f782806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f782806fd70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7814012db0 tx=0x7f781400c5b0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 shutdown_connections 2023-10-14T08:53:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7828106ca0 0x7f7828195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f78180a1500 0x7f78180a39c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828101a40 0x7f782806f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 --2- 172.21.15.6:0/3513195630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7828104370 0x7f782806fd70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.887+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 >> 172.21.15.6:0/3513195630 conn(0x7f78280fb410 msgr2=0x7f78281026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.889+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 shutdown_connections 2023-10-14T08:53:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:53.889+0000 7f782f1fc700 1 -- 172.21.15.6:0/3513195630 wait complete. 2023-10-14T08:53:53.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-14T08:53:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 -- 172.21.15.6:0/3684289886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8858107eb0 msgr2=0x7f885810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 --2- 172.21.15.6:0/3684289886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8858107eb0 0x7f885810a2e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8854009990 tx=0x7f8854009ca0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 -- 172.21.15.6:0/3684289886 shutdown_connections 2023-10-14T08:53:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 --2- 172.21.15.6:0/3684289886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f885810d1f0 0x7f885810d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 --2- 172.21.15.6:0/3684289886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8858107eb0 0x7f885810a2e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 --2- 172.21.15.6:0/3684289886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885810a820 0x7f885810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.966+0000 7f885f2b2700 1 -- 172.21.15.6:0/3684289886 >> 172.21.15.6:0/3684289886 conn(0x7f885806dcf0 msgr2=0x7f8858070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.967+0000 7f885f2b2700 1 -- 172.21.15.6:0/3684289886 shutdown_connections 2023-10-14T08:53:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.967+0000 7f885f2b2700 1 -- 172.21.15.6:0/3684289886 wait complete. 2023-10-14T08:53:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 Processor -- start 2023-10-14T08:53:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 -- start start 2023-10-14T08:53:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 0x7f88581a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885810a820 0x7f88581a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885810d1f0 0x7f88581acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581ad560 con 0x7f885810a820 2023-10-14T08:53:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581ad6a0 con 0x7f8858107eb0 2023-10-14T08:53:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885f2b2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581ad830 con 0x7f885810d1f0 2023-10-14T08:53:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885d04e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 0x7f88581a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885d04e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 0x7f88581a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60658/0 (socket says 172.21.15.6:60658) 2023-10-14T08:53:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885d04e700 1 -- 172.21.15.6:0/175438645 learned_addr learned my addr 172.21.15.6:0/175438645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.968+0000 7f885d84f700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885810d1f0 0x7f88581acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f885d04e700 1 -- 172.21.15.6:0/175438645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885810d1f0 msgr2=0x7f88581acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f885d04e700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885810d1f0 0x7f88581acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f885d04e700 1 -- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885810a820 msgr2=0x7f88581a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f885d04e700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885810a820 0x7f88581a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f885d04e700 1 -- 172.21.15.6:0/175438645 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540095f0 con 0x7f8858107eb0 2023-10-14T08:53:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f885d04e700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 0x7f88581a59e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88540098e0 tx=0x7f885400f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.969+0000 7f884e7fc700 1 -- 172.21.15.6:0/175438645 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885401d070 con 0x7f8858107eb0 2023-10-14T08:53:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.970+0000 7f884e7fc700 1 -- 172.21.15.6:0/175438645 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f885400be60 con 0x7f8858107eb0 2023-10-14T08:53:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.970+0000 7f884e7fc700 1 -- 172.21.15.6:0/175438645 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854005630 con 0x7f8858107eb0 2023-10-14T08:53:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.971+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88581adab0 con 0x7f8858107eb0 2023-10-14T08:53:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.971+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88581ade20 con 0x7f8858107eb0 2023-10-14T08:53:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.974+0000 7f884e7fc700 1 -- 172.21.15.6:0/175438645 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8854004800 con 0x7f8858107eb0 2023-10-14T08:53:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.975+0000 7f884e7fc700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f88440a1550 0x7f88440a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f884e7fc700 1 -- 172.21.15.6:0/175438645 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f88540cdfa0 con 0x7f8858107eb0 2023-10-14T08:53:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f885c84d700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f88440a1550 0x7f88440a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 Processor -- start 2023-10-14T08:53:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 -- start start 2023-10-14T08:53:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa0f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa0f5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa068c10 con 0x55e1aa0f41b0 2023-10-14T08:53:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa04dc00 con 0x55e1aa0f3850 2023-10-14T08:53:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f886b49cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa04b520 con 0x55e1aa0f50a0 2023-10-14T08:53:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.976+0000 7f885d84f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa0f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa0f5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59310/0 (socket says 172.21.15.6:59310) 2023-10-14T08:53:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 -- 172.21.15.6:0/3858251666 learned_addr learned my addr 172.21.15.6:0/3858251666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d04e700 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 -- 172.21.15.6:0/3858251666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 msgr2=0x55e1aa0f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 -- 172.21.15.6:0/3858251666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 msgr2=0x55e1aa0f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa0f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.977+0000 7f885d84f700 1 -- 172.21.15.6:0/3858251666 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1aa004390 con 0x55e1aa0f50a0 2023-10-14T08:53:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.978+0000 7f885d84f700 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa0f5520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8850009440 tx=0x7f8850009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad23ac954da77e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.979+0000 7f88437fe700 1 -- 172.21.15.6:0/3858251666 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000e070 con 0x55e1aa0f50a0 2023-10-14T08:53:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.979+0000 7f88437fe700 1 -- 172.21.15.6:0/3858251666 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f885000f040 con 0x55e1aa0f50a0 2023-10-14T08:53:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.979+0000 7f88437fe700 1 -- 172.21.15.6:0/3858251666 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850015b90 con 0x55e1aa0f50a0 2023-10-14T08:53:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.980+0000 7f886b49cb80 1 -- 172.21.15.6:0/3858251666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 msgr2=0x55e1aa0f5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.980+0000 7f886b49cb80 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa0f5520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8850009440 tx=0x7f8850009920 comp rx=0 tx=0).stop 2023-10-14T08:53:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.981+0000 7f885c84d700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f88440a1550 0x7f88440a3a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8848005fd0 tx=0x7f8848005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.981+0000 7f886b49cb80 1 -- 172.21.15.6:0/3858251666 shutdown_connections 2023-10-14T08:53:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.981+0000 7f886b49cb80 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa0f5520 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.981+0000 7f886b49cb80 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.981+0000 7f886b49cb80 1 --2- 172.21.15.6:0/3858251666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa0f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.981+0000 7f886b49cb80 1 -- 172.21.15.6:0/3858251666 >> 172.21.15.6:0/3858251666 conn(0x55e1aa021d70 msgr2=0x55e1aa0eec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.982+0000 7f886b49cb80 1 -- 172.21.15.6:0/3858251666 shutdown_connections 2023-10-14T08:53:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.983+0000 7f886b49cb80 1 -- 172.21.15.6:0/3858251666 wait complete. 2023-10-14T08:53:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.983+0000 7f886b49cb80 1 -- start start 2023-10-14T08:53:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.983+0000 7f886b49cb80 1 Processor -- start 2023-10-14T08:53:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 0x55e1aa10e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f41b0 0x55e1aa10ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f50a0 0x55e1aa115d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa046e10 con 0x55e1aa0f3850 2023-10-14T08:53:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a9fe36b0 con 0x55e1aa0f50a0 2023-10-14T08:53:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a9fe3350 con 0x55e1aa0f41b0 2023-10-14T08:53:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f886b49cb80 10 client.0 _ll_register_callbacks cb 0x55e1a9e407a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 0x55e1aa10e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 0x55e1aa10e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33682/0 (socket says 172.21.15.6:33682) 2023-10-14T08:53:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 -- 172.21.15.6:0/1583592479 learned_addr learned my addr 172.21.15.6:0/1583592479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885c84d700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f41b0 0x55e1aa10ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d84f700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f50a0 0x55e1aa115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 -- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f41b0 msgr2=0x55e1aa10ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f41b0 0x55e1aa10ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 -- 172.21.15.6:0/1583592479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f50a0 msgr2=0x55e1aa115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f50a0 0x55e1aa115d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.984+0000 7f885d04e700 1 -- 172.21.15.6:0/1583592479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88500090f0 con 0x55e1aa0f3850 2023-10-14T08:53:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.986+0000 7f885d04e700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 0x55e1aa10e7a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f885400b2e0 tx=0x7f885409afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9860dd499fd30f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.986+0000 7f8840ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.986+0000 7f8840ff9700 1 -- 172.21.15.6:0/1583592479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885409f4a0 con 0x55e1aa0f3850 2023-10-14T08:53:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.986+0000 7f8840ff9700 1 -- 172.21.15.6:0/1583592479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f88540a3650 con 0x55e1aa0f3850 2023-10-14T08:53:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.986+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1aa04be90 con 0x55e1aa0f3850 2023-10-14T08:53:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.987+0000 7f8840ff9700 1 -- 172.21.15.6:0/1583592479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f885409f030 con 0x55e1aa0f3850 2023-10-14T08:53:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.989+0000 7f886b49cb80 10 client.15696 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.989+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e1a9e71d80 con 0x55e1aa0f3850 2023-10-14T08:53:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.990+0000 7f8840ff9700 1 -- 172.21.15.6:0/1583592479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1aa04be90 con 0x55e1aa0f3850 2023-10-14T08:53:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.990+0000 7f8840ff9700 1 -- 172.21.15.6:0/1583592479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f88540a31c0 con 0x55e1aa0f3850 2023-10-14T08:53:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.991+0000 7f886b49cb80 10 client.15696 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.991+0000 7f886b49cb80 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.991+0000 7f886b49cb80 20 client.15696 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.991+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa11a330 0x55e1aa11c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.991+0000 7f886b49cb80 4 client.15696 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.991+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1aa0c3bb0 con 0x55e1aa11a330 2023-10-14T08:53:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.994+0000 7f885c84d700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa11a330 0x55e1aa11c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.999+0000 7f885c84d700 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa11a330 0x55e1aa11c750 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85f39b16e0c9acf2 server_cookie=bd1416b36f6f3986 in_seq=0 out_seq=0 2023-10-14T08:53:54.002 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:53.999+0000 7f8840ff9700 10 client.15696 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.002+0000 7f8840ff9700 1 -- 172.21.15.6:0/1583592479 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e1aa0c3bb0 con 0x55e1aa11a330 2023-10-14T08:53:54.003 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.002+0000 7f8840ff9700 10 client.15696 handle_command_reply: tid=0 2023-10-14T08:53:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.003+0000 7f886b49cb80 1 client.15696 shutdown 2023-10-14T08:53:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.004+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 msgr2=0x55e1aa10e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.004+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 0x55e1aa10e7a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f885400b2e0 tx=0x7f885409afa0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.006+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 shutdown_connections 2023-10-14T08:53:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.006+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa11a330 0x55e1aa11c750 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.006+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f50a0 0x55e1aa115d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.006+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f3850 0x55e1aa10e7a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.006+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1583592479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f41b0 0x55e1aa10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.006+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 >> 172.21.15.6:0/1583592479 conn(0x55e1aa021d70 msgr2=0x55e1aa0ee830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.009 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.007+0000 7f8840ff9700 0 client.15696 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.009 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.008+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 shutdown_connections 2023-10-14T08:53:54.009 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.008+0000 7f886b49cb80 1 -- 172.21.15.6:0/1583592479 wait complete. 2023-10-14T08:53:54.010 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.008+0000 7f886b49cb80 20 client.15696 trim_cache size 0 max 16384 2023-10-14T08:53:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.035+0000 7f886b49cb80 1 Processor -- start 2023-10-14T08:53:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 -- start start 2023-10-14T08:53:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa10d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1a9ec78c0 con 0x55e1aa0f41b0 2023-10-14T08:53:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa04be90 con 0x55e1aa0f3850 2023-10-14T08:53:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f886b49cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa0f4950 con 0x55e1aa0f50a0 2023-10-14T08:53:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33692/0 (socket says 172.21.15.6:33692) 2023-10-14T08:53:54.041 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 -- 172.21.15.6:0/1737777594 learned_addr learned my addr 172.21.15.6:0/1737777594 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885d04e700 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885d84f700 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 -- 172.21.15.6:0/1737777594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 msgr2=0x55e1aa10d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa10d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.042 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 -- 172.21.15.6:0/1737777594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 msgr2=0x55e1aa0fb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0fb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.043 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.038+0000 7f885c84d700 1 -- 172.21.15.6:0/1737777594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1a9e5ac00 con 0x55e1aa0f41b0 2023-10-14T08:53:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.039+0000 7f885c84d700 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa115ce0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f88580727a0 tx=0x7f8848010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3055c69bdd6df1f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.039+0000 7f8843fff700 1 -- 172.21.15.6:0/1737777594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848023070 con 0x55e1aa0f41b0 2023-10-14T08:53:54.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.039+0000 7f8843fff700 1 -- 172.21.15.6:0/1737777594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8848024c40 con 0x55e1aa0f41b0 2023-10-14T08:53:54.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.039+0000 7f8843fff700 1 -- 172.21.15.6:0/1737777594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848017040 con 0x55e1aa0f41b0 2023-10-14T08:53:54.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 -- 172.21.15.6:0/1737777594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 msgr2=0x55e1aa115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa115ce0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f88580727a0 tx=0x7f8848010000 comp rx=0 tx=0).stop 2023-10-14T08:53:54.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 -- 172.21.15.6:0/1737777594 shutdown_connections 2023-10-14T08:53:54.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f50a0 0x55e1aa10d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa0f3850 0x55e1aa0fb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 --2- 172.21.15.6:0/1737777594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f41b0 0x55e1aa115ce0 secure :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f88580727a0 tx=0x7f8848010000 comp rx=0 tx=0).stop 2023-10-14T08:53:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.040+0000 7f886b49cb80 1 -- 172.21.15.6:0/1737777594 >> 172.21.15.6:0/1737777594 conn(0x55e1aa021d70 msgr2=0x55e1aa11c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.041+0000 7f886b49cb80 1 -- 172.21.15.6:0/1737777594 shutdown_connections 2023-10-14T08:53:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.042+0000 7f886b49cb80 1 -- 172.21.15.6:0/1737777594 wait complete. 2023-10-14T08:53:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.042+0000 7f886b49cb80 1 -- start start 2023-10-14T08:53:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.042+0000 7f886b49cb80 1 Processor -- start 2023-10-14T08:53:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f3850 0x55e1aa1117e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f50a0 0x55e1aa111d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 0x55e1aa1151c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa115700 con 0x55e1aa0f50a0 2023-10-14T08:53:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa115870 con 0x55e1aa114d40 2023-10-14T08:53:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1aa115a30 con 0x55e1aa0f3850 2023-10-14T08:53:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f886b49cb80 10 client.0 _ll_register_callbacks cb 0x7f885409ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 0x55e1aa1151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 0x55e1aa1151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60688/0 (socket says 172.21.15.6:60688) 2023-10-14T08:53:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 -- 172.21.15.6:0/513689111 learned_addr learned my addr 172.21.15.6:0/513689111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 -- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f3850 msgr2=0x55e1aa1117e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f3850 0x55e1aa1117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 -- 172.21.15.6:0/513689111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f50a0 msgr2=0x55e1aa111d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f50a0 0x55e1aa111d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.043+0000 7f885d84f700 1 -- 172.21.15.6:0/513689111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884800d980 con 0x55e1aa114d40 2023-10-14T08:53:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.044+0000 7f885d84f700 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 0x55e1aa1151c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55e1aa0f4880 tx=0x7f88500095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19c6ad5f9e2699d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f8840ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f8840ff9700 1 -- 172.21.15.6:0/513689111 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000e040 con 0x55e1aa114d40 2023-10-14T08:53:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f8840ff9700 1 -- 172.21.15.6:0/513689111 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8850013d90 con 0x55e1aa114d40 2023-10-14T08:53:54.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f885000f040 con 0x55e1aa114d40 2023-10-14T08:53:54.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f8840ff9700 1 -- 172.21.15.6:0/513689111 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f885004b470 con 0x55e1aa114d40 2023-10-14T08:53:54.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 10 client.25334 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:54.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e1a9e981f0 con 0x55e1aa114d40 2023-10-14T08:53:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f8840ff9700 1 -- 172.21.15.6:0/513689111 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f885000f040 con 0x55e1aa114d40 2023-10-14T08:53:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f8840ff9700 1 -- 172.21.15.6:0/513689111 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f885001c070 con 0x55e1aa114d40 2023-10-14T08:53:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 10 client.25334 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 10 client.25334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 20 client.25334 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:54.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa0fc600 0x55e1aa0fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 4 client.25334 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:53:54.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.046+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e1aa03fdf0 con 0x55e1aa0fc600 2023-10-14T08:53:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.047+0000 7f885d04e700 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa0fc600 0x55e1aa0fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.047+0000 7f885d04e700 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa0fc600 0x55e1aa0fea20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1acab3df78da17c server_cookie=a1556e9d5a4f030f in_seq=0 out_seq=0 2023-10-14T08:53:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.048+0000 7f8840ff9700 10 client.25334 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.070+0000 7f8840ff9700 1 -- 172.21.15.6:0/513689111 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e1aa03fdf0 con 0x55e1aa0fc600 2023-10-14T08:53:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.070+0000 7f8840ff9700 10 client.25334 handle_command_reply: tid=0 2023-10-14T08:53:54.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.070+0000 7f886b49cb80 1 client.25334 shutdown 2023-10-14T08:53:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.070+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 msgr2=0x55e1aa1151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.070+0000 7f886b49cb80 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 0x55e1aa1151c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55e1aa0f4880 tx=0x7f88500095e0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 shutdown_connections 2023-10-14T08:53:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e1aa0fc600 0x55e1aa0fea20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e1aa114d40 0x55e1aa1151c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1aa0f3850 0x55e1aa1117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 --2- 172.21.15.6:0/513689111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e1aa0f50a0 0x55e1aa111d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 >> 172.21.15.6:0/513689111 conn(0x55e1aa021d70 msgr2=0x55e1aa0fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f8840ff9700 0 client.25334 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 shutdown_connections 2023-10-14T08:53:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 1 -- 172.21.15.6:0/513689111 wait complete. 2023-10-14T08:53:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.071+0000 7f886b49cb80 20 client.25334 trim_cache size 0 max 16384 2023-10-14T08:53:54.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:53:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:53:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:53:54.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:53:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f88440a1550 msgr2=0x7f88440a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f88440a1550 0x7f88440a3a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8848005fd0 tx=0x7f8848005d00 comp rx=0 tx=0).stop 2023-10-14T08:53:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 msgr2=0x7f88581a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 0x7f88581a59e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88540098e0 tx=0x7f885400f740 comp rx=0 tx=0).stop 2023-10-14T08:53:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 shutdown_connections 2023-10-14T08:53:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885810d1f0 0x7f88581acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f88440a1550 0x7f88440a3a10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8858107eb0 0x7f88581a59e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 --2- 172.21.15.6:0/175438645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f885810a820 0x7f88581a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 >> 172.21.15.6:0/175438645 conn(0x7f885806dcf0 msgr2=0x7f885810b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 shutdown_connections 2023-10-14T08:53:54.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:53:54.072+0000 7f885f2b2700 1 -- 172.21.15.6:0/175438645 wait complete. 2023-10-14T08:53:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.152+0000 7f2f9448a700 1 -- 172.21.15.6:0/3272645289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c102180 msgr2=0x7f2f8c104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.152+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3272645289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c102180 0x7f2f8c104610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098f0 tx=0x7f2f7c009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 -- 172.21.15.6:0/3272645289 shutdown_connections 2023-10-14T08:53:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3272645289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c104b50 0x7f2f8c104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3272645289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3272645289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c102180 0x7f2f8c104610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 -- 172.21.15.6:0/3272645289 >> 172.21.15.6:0/3272645289 conn(0x7f2f8c0fb430 msgr2=0x7f2f8c0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 -- 172.21.15.6:0/3272645289 shutdown_connections 2023-10-14T08:53:54.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 -- 172.21.15.6:0/3272645289 wait complete. 2023-10-14T08:53:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.153+0000 7f2f9448a700 1 Processor -- start 2023-10-14T08:53:54.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 -- start start 2023-10-14T08:53:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c19d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c102180 0x7f2f8c19d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c104b50 0x7f2f8c1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c1a4e20 con 0x7f2f8c102180 2023-10-14T08:53:54.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c1a4f60 con 0x7f2f8c0ff810 2023-10-14T08:53:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f9448a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c1a50f0 con 0x7f2f8c104b50 2023-10-14T08:53:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f92226700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c19d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f92226700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c19d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60700/0 (socket says 172.21.15.6:60700) 2023-10-14T08:53:54.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f92226700 1 -- 172.21.15.6:0/3631014314 learned_addr learned my addr 172.21.15.6:0/3631014314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f92a27700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c104b50 0x7f2f8c1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.154+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c102180 0x7f2f8c19d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f92226700 1 -- 172.21.15.6:0/3631014314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c104b50 msgr2=0x7f2f8c1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f92226700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c104b50 0x7f2f8c1a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f92226700 1 -- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c102180 msgr2=0x7f2f8c19d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f92226700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c102180 0x7f2f8c19d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f92226700 1 -- 172.21.15.6:0/3631014314 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c009520 con 0x7f2f8c0ff810 2023-10-14T08:53:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c102180 0x7f2f8c19d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f92226700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c19d2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800e9a0 tx=0x7f2f8800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f837fe700 1 -- 172.21.15.6:0/3631014314 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88009790 con 0x7f2f8c0ff810 2023-10-14T08:53:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f837fe700 1 -- 172.21.15.6:0/3631014314 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f8800cbd0 con 0x7f2f8c0ff810 2023-10-14T08:53:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f837fe700 1 -- 172.21.15.6:0/3631014314 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88018680 con 0x7f2f8c0ff810 2023-10-14T08:53:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c1a53d0 con 0x7f2f8c0ff810 2023-10-14T08:53:54.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.155+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c1a5890 con 0x7f2f8c0ff810 2023-10-14T08:53:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.158+0000 7f2f837fe700 1 -- 172.21.15.6:0/3631014314 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2f8800cd40 con 0x7f2f8c0ff810 2023-10-14T08:53:54.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.159+0000 7f2f837fe700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f780a1650 0x7f2f780a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.159+0000 7f2f837fe700 1 -- 172.21.15.6:0/3631014314 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2f88014070 con 0x7f2f8c0ff810 2023-10-14T08:53:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.160+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f780a1650 0x7f2f780a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.161+0000 7f2fa0674b80 1 Processor -- start 2023-10-14T08:53:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.161+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f780a1650 0x7f2f780a3b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00fa40 tx=0x7f2f7c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 -- start start 2023-10-14T08:53:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df91e20 0x55616df92240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df92780 0x55616df93040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df93620 0x55616df93aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616df06c70 con 0x55616df93620 2023-10-14T08:53:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616deebc60 con 0x55616df91e20 2023-10-14T08:53:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.162+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616dee9580 con 0x55616df92780 2023-10-14T08:53:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f92226700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df91e20 0x55616df92240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df92780 0x55616df93040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f92a27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df93620 0x55616df93aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f92226700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df91e20 0x55616df92240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60708/0 (socket says 172.21.15.6:60708) 2023-10-14T08:53:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f92226700 1 -- 172.21.15.6:0/2865512249 learned_addr learned my addr 172.21.15.6:0/2865512249 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 -- 172.21.15.6:0/2865512249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df91e20 msgr2=0x55616df92240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df91e20 0x55616df92240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 -- 172.21.15.6:0/2865512249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df93620 msgr2=0x55616df93aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df93620 0x55616df93aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 -- 172.21.15.6:0/2865512249 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55616dea23f0 con 0x55616df92780 2023-10-14T08:53:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f91a25700 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df92780 0x55616df93040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009230 tx=0x7f2f7c01d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8077ca06ef0408b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.163+0000 7f2f80d82700 1 -- 172.21.15.6:0/2865512249 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c028070 con 0x55616df92780 2023-10-14T08:53:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.164+0000 7f2f80d82700 1 -- 172.21.15.6:0/2865512249 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7c005500 con 0x55616df92780 2023-10-14T08:53:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.164+0000 7f2f80d82700 1 -- 172.21.15.6:0/2865512249 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c01c040 con 0x55616df92780 2023-10-14T08:53:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.164+0000 7f2fa0674b80 1 -- 172.21.15.6:0/2865512249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df92780 msgr2=0x55616df93040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.164+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df92780 0x55616df93040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009230 tx=0x7f2f7c01d000 comp rx=0 tx=0).stop 2023-10-14T08:53:54.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 -- 172.21.15.6:0/2865512249 shutdown_connections 2023-10-14T08:53:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df93620 0x55616df93aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df91e20 0x55616df92240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/2865512249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df92780 0x55616df93040 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 -- 172.21.15.6:0/2865512249 >> 172.21.15.6:0/2865512249 conn(0x55616debfdd0 msgr2=0x55616df8cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 -- 172.21.15.6:0/2865512249 shutdown_connections 2023-10-14T08:53:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.165+0000 7f2fa0674b80 1 -- 172.21.15.6:0/2865512249 wait complete. 2023-10-14T08:53:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 -- start start 2023-10-14T08:53:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 Processor -- start 2023-10-14T08:53:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 0x55616df9bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df92780 0x55616df9c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df93620 0x55616dfa31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616dee4e70 con 0x55616df91e20 2023-10-14T08:53:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616de81710 con 0x55616df92780 2023-10-14T08:53:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616de813b0 con 0x55616df93620 2023-10-14T08:53:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2fa0674b80 10 client.0 _ll_register_callbacks cb 0x55616dcde800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.166+0000 7f2f92226700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 0x55616df9bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 0x55616df9bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33724/0 (socket says 172.21.15.6:33724) 2023-10-14T08:53:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 -- 172.21.15.6:0/3886993416 learned_addr learned my addr 172.21.15.6:0/3886993416 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df92780 0x55616df9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92a27700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df93620 0x55616dfa31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 -- 172.21.15.6:0/3886993416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df93620 msgr2=0x55616dfa31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df93620 0x55616dfa31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 -- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df92780 msgr2=0x55616df9c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df92780 0x55616df9c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 -- 172.21.15.6:0/3886993416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c105b00 con 0x55616df91e20 2023-10-14T08:53:54.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f92226700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 0x55616df9bc40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2f88096640 tx=0x7f2f8809a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bc7442cdf8efd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:53:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f75ffb700 1 -- 172.21.15.6:0/3886993416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880a2290 con 0x55616df91e20 2023-10-14T08:53:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2f75ffb700 1 -- 172.21.15.6:0/3886993416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2f8809a190 con 0x55616df91e20 2023-10-14T08:53:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.167+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55616dee9ef0 con 0x55616df91e20 2023-10-14T08:53:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.168+0000 7f2f75ffb700 1 -- 172.21.15.6:0/3886993416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f8809e2e0 con 0x55616df91e20 2023-10-14T08:53:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.168+0000 7f2fa0674b80 10 client.15711 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.168+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55616dd0fde0 con 0x55616df91e20 2023-10-14T08:53:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.168+0000 7f2f75ffb700 1 -- 172.21.15.6:0/3886993416 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f880a6020 con 0x55616df91e20 2023-10-14T08:53:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2f75ffb700 1 -- 172.21.15.6:0/3886993416 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2f880990f0 con 0x55616df91e20 2023-10-14T08:53:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2fa0674b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2fa0674b80 10 client.15711 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2023-10-14T08:53:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2fa0674b80 20 client.15711 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dfa7ab0 0x55616dfa9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2fa0674b80 4 client.15711 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55616df61c10 con 0x55616dfa7ab0 2023-10-14T08:53:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dfa7ab0 0x55616dfa9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2f75ffb700 10 client.15711 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.171+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dfa7ab0 0x55616dfa9ef0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef812ab854368aa4 server_cookie=2d8d3d3c712a5b03 in_seq=0 out_seq=0 2023-10-14T08:53:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.172+0000 7f2f75ffb700 1 -- 172.21.15.6:0/3886993416 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55616df61c10 con 0x55616dfa7ab0 2023-10-14T08:53:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.172+0000 7f2f75ffb700 10 client.15711 handle_command_reply: tid=0 2023-10-14T08:53:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.172+0000 7f2fa0674b80 1 client.15711 shutdown 2023-10-14T08:53:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.173+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 msgr2=0x55616df9bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.173+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 0x55616df9bc40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2f88096640 tx=0x7f2f8809a6d0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 shutdown_connections 2023-10-14T08:53:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dfa7ab0 0x55616dfa9ef0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df93620 0x55616dfa31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df91e20 0x55616df9bc40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3886993416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df92780 0x55616df9c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 >> 172.21.15.6:0/3886993416 conn(0x55616debfdd0 msgr2=0x55616df8cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2f75ffb700 0 client.15711 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 shutdown_connections 2023-10-14T08:53:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3886993416 wait complete. 2023-10-14T08:53:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.174+0000 7f2fa0674b80 20 client.15711 trim_cache size 0 max 16384 2023-10-14T08:53:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.201+0000 7f2fa0674b80 1 Processor -- start 2023-10-14T08:53:54.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 -- start start 2023-10-14T08:53:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616df8cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616dd65920 con 0x55616df92780 2023-10-14T08:53:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616df934a0 con 0x55616df93620 2023-10-14T08:53:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616df9b0f0 con 0x55616df91e20 2023-10-14T08:53:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2f91a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2f91a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33736/0 (socket says 172.21.15.6:33736) 2023-10-14T08:53:54.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2f91a25700 1 -- 172.21.15.6:0/3818838331 learned_addr learned my addr 172.21.15.6:0/3818838331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.202+0000 7f2f92a27700 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616df8cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f91a25700 1 -- 172.21.15.6:0/3818838331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 msgr2=0x55616dfa9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f91a25700 1 -- 172.21.15.6:0/3818838331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 msgr2=0x55616df8cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616df8cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f91a25700 1 -- 172.21.15.6:0/3818838331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55616dcf8c60 con 0x55616df92780 2023-10-14T08:53:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f92a27700 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616df8cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:53:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f91a25700 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa3150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098c0 tx=0x7f2f7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f366f02e08c0821 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.203+0000 7f2f81583700 1 -- 172.21.15.6:0/3818838331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c028040 con 0x55616df92780 2023-10-14T08:53:54.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.204+0000 7f2f81583700 1 -- 172.21.15.6:0/3818838331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7c039e60 con 0x55616df92780 2023-10-14T08:53:54.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.204+0000 7f2f81583700 1 -- 172.21.15.6:0/3818838331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c01c040 con 0x55616df92780 2023-10-14T08:53:54.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3818838331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 msgr2=0x55616dfa3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa3150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098c0 tx=0x7f2f7c009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:54.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3818838331 shutdown_connections 2023-10-14T08:53:54.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616df8cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/3818838331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa3150 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3818838331 >> 172.21.15.6:0/3818838331 conn(0x55616debfdd0 msgr2=0x55616df99a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3818838331 shutdown_connections 2023-10-14T08:53:54.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.205+0000 7f2fa0674b80 1 -- 172.21.15.6:0/3818838331 wait complete. 2023-10-14T08:53:54.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 -- start start 2023-10-14T08:53:54.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 Processor -- start 2023-10-14T08:53:54.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616dfa2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616dfa2790 con 0x55616df92780 2023-10-14T08:53:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616dfa2900 con 0x55616df93620 2023-10-14T08:53:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55616dfa2ac0 con 0x55616df91e20 2023-10-14T08:53:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2fa0674b80 10 client.0 _ll_register_callbacks cb 0x55616dcde800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2f92a27700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616dfa2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2f91a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2f92226700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.206+0000 7f2f92a27700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616dfa2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60730/0 (socket says 172.21.15.6:60730) 2023-10-14T08:53:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 -- 172.21.15.6:0/1038472966 learned_addr learned my addr 172.21.15.6:0/1038472966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 -- 172.21.15.6:0/1038472966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 msgr2=0x55616dfa0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 -- 172.21.15.6:0/1038472966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 msgr2=0x55616dfa12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 -- 172.21.15.6:0/1038472966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55616dea23f0 con 0x55616df93620 2023-10-14T08:53:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92226700 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:53:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.207+0000 7f2f92a27700 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616dfa2250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2f84007b20 tx=0x7f2f84007b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeca49ac0a2f104 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.208+0000 7f2f75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.208+0000 7f2f75ffb700 1 -- 172.21.15.6:0/1038472966 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400e040 con 0x55616df93620 2023-10-14T08:53:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.208+0000 7f2f75ffb700 1 -- 172.21.15.6:0/1038472966 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2f84003c00 con 0x55616df93620 2023-10-14T08:53:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.208+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f7c005500 con 0x55616df93620 2023-10-14T08:53:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.208+0000 7f2f75ffb700 1 -- 172.21.15.6:0/1038472966 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f84003dc0 con 0x55616df93620 2023-10-14T08:53:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 10 client.25352 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55616dd36250 con 0x55616df93620 2023-10-14T08:53:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2f75ffb700 1 -- 172.21.15.6:0/1038472966 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7c005500 con 0x55616df93620 2023-10-14T08:53:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2f75ffb700 1 -- 172.21.15.6:0/1038472966 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2f840042f0 con 0x55616df93620 2023-10-14T08:53:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 10 client.25352 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 10 client.25352 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2023-10-14T08:53:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 20 client.25352 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dffc780 0x55616dffeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 4 client.25352 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 --> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55616dedde50 con 0x55616dffc780 2023-10-14T08:53:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.209+0000 7f2f92226700 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dffc780 0x55616dffeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2f75ffb700 10 client.25352 ms_handle_connect on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2f92226700 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dffc780 0x55616dffeba0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2c40d7d5f9697df server_cookie=fb400678e3d59dd5 in_seq=0 out_seq=0 2023-10-14T08:53:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2f75ffb700 1 -- 172.21.15.6:0/1038472966 <== mds.1 v2:172.21.15.57:6838/2236865036 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+215 (crc 0 0 0) 0x55616dedde50 con 0x55616dffc780 2023-10-14T08:53:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2f75ffb700 10 client.25352 handle_command_reply: tid=0 2023-10-14T08:53:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2fa0674b80 1 client.25352 shutdown 2023-10-14T08:53:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 msgr2=0x55616dfa2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.210+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616dfa2250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2f84007b20 tx=0x7f2f84007b50 comp rx=0 tx=0).stop 2023-10-14T08:53:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 shutdown_connections 2023-10-14T08:53:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:6838/2236865036,v1:172.21.15.57:6839/2236865036] conn(0x55616dffc780 0x55616dffeba0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55616df93620 0x55616dfa2250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55616df91e20 0x55616dfa0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2f75ffb700 0 client.25352 ms_handle_reset on v2:172.21.15.57:6838/2236865036 2023-10-14T08:53:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 --2- 172.21.15.6:0/1038472966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55616df92780 0x55616dfa12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 >> 172.21.15.6:0/1038472966 conn(0x55616debfdd0 msgr2=0x55616df96590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 shutdown_connections 2023-10-14T08:53:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 1 -- 172.21.15.6:0/1038472966 wait complete. 2023-10-14T08:53:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.211+0000 7f2fa0674b80 20 client.25352 trim_cache size 0 max 16384 2023-10-14T08:53:54.226 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-10-14T08:53:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T08:53:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-10-14T08:53:54.226 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 99431424, 2023-10-14T08:53:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 1099511628806, 2023-10-14T08:53:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e/postgres/data/base/12347/16403" 2023-10-14T08:53:54.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T08:53:54.227 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-10-14T08:53:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f780a1650 msgr2=0x7f2f780a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f780a1650 0x7f2f780a3b10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00fa40 tx=0x7f2f7c019040 comp rx=0 tx=0).stop 2023-10-14T08:53:54.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 msgr2=0x7f2f8c19d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c19d2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800e9a0 tx=0x7f2f8800ecb0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 shutdown_connections 2023-10-14T08:53:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f8c104b50 0x7f2f8c1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f780a1650 0x7f2f780a3b10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f8c0ff810 0x7f2f8c19d2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 --2- 172.21.15.6:0/3631014314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f8c102180 0x7f2f8c19d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.212+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 >> 172.21.15.6:0/3631014314 conn(0x7f2f8c0fb430 msgr2=0x7f2f8c100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.213+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 shutdown_connections 2023-10-14T08:53:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.213+0000 7f2f9448a700 1 -- 172.21.15.6:0/3631014314 wait complete. 2023-10-14T08:53:54.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-14T08:53:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.483+0000 7f1a205c7700 1 -- 172.21.15.6:0/2222156839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a180ffe70 msgr2=0x7f1a18100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.483+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2222156839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a180ffe70 0x7f1a18100290 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098f0 tx=0x7f1a14009c00 comp rx=0 tx=0).stop 2023-10-14T08:53:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 -- 172.21.15.6:0/2222156839 shutdown_connections 2023-10-14T08:53:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2222156839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 0x7f1a18108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2222156839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a180ffe70 0x7f1a18100290 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2222156839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a18101050 0x7f1a181014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 -- 172.21.15.6:0/2222156839 >> 172.21.15.6:0/2222156839 conn(0x7f1a180fb410 msgr2=0x7f1a180fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 -- 172.21.15.6:0/2222156839 shutdown_connections 2023-10-14T08:53:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.485+0000 7f1a205c7700 1 -- 172.21.15.6:0/2222156839 wait complete. 2023-10-14T08:53:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 Processor -- start 2023-10-14T08:53:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 -- start start 2023-10-14T08:53:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a180ffe70 0x7f1a18071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a18101050 0x7f1a18071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 0x7f1a18193bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180723f0 con 0x7f1a18101a10 2023-10-14T08:53:54.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18194130 con 0x7f1a18101050 2023-10-14T08:53:54.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a205c7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181942f0 con 0x7f1a180ffe70 2023-10-14T08:53:54.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a1db62700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a18101050 0x7f1a18071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a1eb64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 0x7f1a18193bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a1db62700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a18101050 0x7f1a18071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60744/0 (socket says 172.21.15.6:60744) 2023-10-14T08:53:54.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a1db62700 1 -- 172.21.15.6:0/2075353424 learned_addr learned my addr 172.21.15.6:0/2075353424 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.486+0000 7f1a1e363700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a180ffe70 0x7f1a18071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1e363700 1 -- 172.21.15.6:0/2075353424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a18101050 msgr2=0x7f1a18071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1e363700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a18101050 0x7f1a18071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1e363700 1 -- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 msgr2=0x7f1a18193bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1e363700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 0x7f1a18193bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1e363700 1 -- 172.21.15.6:0/2075353424 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14009520 con 0x7f1a180ffe70 2023-10-14T08:53:54.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 0x7f1a18193bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:54.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a1e363700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a180ffe70 0x7f1a18071670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400b2e0 tx=0x7f1a1400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a0f7fe700 1 -- 172.21.15.6:0/2075353424 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1401c070 con 0x7f1a180ffe70 2023-10-14T08:53:54.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a0f7fe700 1 -- 172.21.15.6:0/2075353424 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a1400bc40 con 0x7f1a180ffe70 2023-10-14T08:53:54.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a0f7fe700 1 -- 172.21.15.6:0/2075353424 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14003db0 con 0x7f1a180ffe70 2023-10-14T08:53:54.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a18194570 con 0x7f1a180ffe70 2023-10-14T08:53:54.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.487+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a18194a70 con 0x7f1a180ffe70 2023-10-14T08:53:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.490+0000 7f1a0f7fe700 1 -- 172.21.15.6:0/2075353424 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1a14005050 con 0x7f1a180ffe70 2023-10-14T08:53:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.491+0000 7f1a0f7fe700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1a040a14e0 0x7f1a040a39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.491+0000 7f1a0f7fe700 1 -- 172.21.15.6:0/2075353424 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1a140cdde0 con 0x7f1a180ffe70 2023-10-14T08:53:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.492+0000 7f1a2c7b1b80 1 Processor -- start 2023-10-14T08:53:54.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.492+0000 7f1a2c7b1b80 1 -- start start 2023-10-14T08:53:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.492+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 0x56415763b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415763c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x56415763caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641575afc70 con 0x56415763ae20 2023-10-14T08:53:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157594c60 con 0x56415763c620 2023-10-14T08:53:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157592580 con 0x56415763b780 2023-10-14T08:53:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 0x56415763b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 0x56415763b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33760/0 (socket says 172.21.15.6:33760) 2023-10-14T08:53:54.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 -- 172.21.15.6:0/217456197 learned_addr learned my addr 172.21.15.6:0/217456197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x56415763caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 -- 172.21.15.6:0/217456197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 msgr2=0x56415763c040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:53:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415763c040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 -- 172.21.15.6:0/217456197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 msgr2=0x56415763caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1db62700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1a040a14e0 0x7f1a040a39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x56415763caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.493+0000 7f1a1e363700 1 -- 172.21.15.6:0/217456197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56415754b3f0 con 0x56415763ae20 2023-10-14T08:53:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.494+0000 7f1a1e363700 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 0x56415763b240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1a14097c00 tx=0x7f1a1409abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bcd103e58c732 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.494+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x56415763caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:53:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.494+0000 7f1a0cff9700 1 -- 172.21.15.6:0/217456197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1409b190 con 0x56415763ae20 2023-10-14T08:53:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.494+0000 7f1a1db62700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1a040a14e0 0x7f1a040a39a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a180730b0 tx=0x7f1a08009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.494+0000 7f1a0cff9700 1 -- 172.21.15.6:0/217456197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a1409f2e0 con 0x56415763ae20 2023-10-14T08:53:54.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.494+0000 7f1a0cff9700 1 -- 172.21.15.6:0/217456197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a140995c0 con 0x56415763ae20 2023-10-14T08:53:54.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.495+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/217456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 msgr2=0x56415763b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.495+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 0x56415763b240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1a14097c00 tx=0x7f1a1409abc0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/217456197 shutdown_connections 2023-10-14T08:53:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x56415763caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763ae20 0x56415763b240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/217456197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415763c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/217456197 >> 172.21.15.6:0/217456197 conn(0x564157568dd0 msgr2=0x564157635fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/217456197 shutdown_connections 2023-10-14T08:53:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/217456197 wait complete. 2023-10-14T08:53:54.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 -- start start 2023-10-14T08:53:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 Processor -- start 2023-10-14T08:53:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157644b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x5641576450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.496+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415764c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415758de70 con 0x56415763c620 2023-10-14T08:53:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415752a710 con 0x56415763ae20 2023-10-14T08:53:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415752a3b0 con 0x56415763b780 2023-10-14T08:53:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a2c7b1b80 10 client.0 _ll_register_callbacks cb 0x564157387800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:54.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157644b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157644b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60756/0 (socket says 172.21.15.6:60756) 2023-10-14T08:53:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 -- 172.21.15.6:0/3319021865 learned_addr learned my addr 172.21.15.6:0/3319021865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1db62700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x5641576450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415764c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 -- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 msgr2=0x5641576450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x5641576450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 -- 172.21.15.6:0/3319021865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 msgr2=0x56415764c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415764c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.497+0000 7f1a1e363700 1 -- 172.21.15.6:0/3319021865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1001acc0 con 0x56415763ae20 2023-10-14T08:53:54.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a1e363700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157644b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a1409b120 tx=0x7f1a140975c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f50728797dcbad18 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a01ffb700 1 -- 172.21.15.6:0/3319021865 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14005510 con 0x56415763ae20 2023-10-14T08:53:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a01ffb700 1 -- 172.21.15.6:0/3319021865 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1a1409b190 con 0x56415763ae20 2023-10-14T08:53:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564157592ef0 con 0x56415763ae20 2023-10-14T08:53:54.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a01ffb700 1 -- 172.21.15.6:0/3319021865 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a1409b3f0 con 0x56415763ae20 2023-10-14T08:53:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a2c7b1b80 10 client.25364 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.498+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1a18194a70 con 0x56415763ae20 2023-10-14T08:53:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a01ffb700 1 -- 172.21.15.6:0/3319021865 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a140a7080 con 0x56415763ae20 2023-10-14T08:53:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a01ffb700 1 -- 172.21.15.6:0/3319021865 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1a140a30d0 con 0x56415763ae20 2023-10-14T08:53:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a2c7b1b80 10 client.25364 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a2c7b1b80 10 client.25364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a2c7b1b80 20 client.25364 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576505b0 0x5641576529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a2c7b1b80 4 client.25364 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:53:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56415760ac10 con 0x5641576505b0 2023-10-14T08:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.499+0000 7f1a1db62700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576505b0 0x5641576529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.500+0000 7f1a1db62700 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576505b0 0x5641576529d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18840f792a18006c server_cookie=96bd876e8f19179b in_seq=0 out_seq=0 2023-10-14T08:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.500+0000 7f1a01ffb700 10 client.25364 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.500+0000 7f1a01ffb700 1 -- 172.21.15.6:0/3319021865 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56415760ac10 con 0x5641576505b0 2023-10-14T08:53:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.500+0000 7f1a01ffb700 10 client.25364 handle_command_reply: tid=0 2023-10-14T08:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.500+0000 7f1a2c7b1b80 1 client.25364 shutdown 2023-10-14T08:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 msgr2=0x564157644b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157644b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a1409b120 tx=0x7f1a140975c0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 shutdown_connections 2023-10-14T08:53:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576505b0 0x5641576529d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415764c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157644b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/3319021865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x5641576450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 >> 172.21.15.6:0/3319021865 conn(0x564157568dd0 msgr2=0x564157635bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a01ffb700 0 client.25364 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 shutdown_connections 2023-10-14T08:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/3319021865 wait complete. 2023-10-14T08:53:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.501+0000 7f1a2c7b1b80 20 client.25364 trim_cache size 0 max 16384 2023-10-14T08:53:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.523+0000 7f1a2c7b1b80 1 Processor -- start 2023-10-14T08:53:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 -- start start 2023-10-14T08:53:54.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157643620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415764c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415763f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415740e920 con 0x56415763c620 2023-10-14T08:53:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415763c4a0 con 0x56415763ae20 2023-10-14T08:53:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157644060 con 0x56415763b780 2023-10-14T08:53:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1eb64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415763f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1eb64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415763f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33778/0 (socket says 172.21.15.6:33778) 2023-10-14T08:53:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1db62700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415764c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1eb64700 1 -- 172.21.15.6:0/1306574599 learned_addr learned my addr 172.21.15.6:0/1306574599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1e363700 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157643620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1db62700 1 -- 172.21.15.6:0/1306574599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 msgr2=0x564157643620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1db62700 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157643620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1db62700 1 -- 172.21.15.6:0/1306574599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 msgr2=0x56415763f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1db62700 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415763f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.524+0000 7f1a1db62700 1 -- 172.21.15.6:0/1306574599 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641573b8de0 con 0x56415763b780 2023-10-14T08:53:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.525+0000 7f1a1db62700 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415764c070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x564157653240 tx=0x7f1a08011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16942ec9dac73d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.525+0000 7f1a0d7fa700 1 -- 172.21.15.6:0/1306574599 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800eec0 con 0x56415763b780 2023-10-14T08:53:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.525+0000 7f1a0d7fa700 1 -- 172.21.15.6:0/1306574599 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a0802a070 con 0x56415763b780 2023-10-14T08:53:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.525+0000 7f1a0d7fa700 1 -- 172.21.15.6:0/1306574599 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a080217e0 con 0x56415763b780 2023-10-14T08:53:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/1306574599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 msgr2=0x56415764c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415764c070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x564157653240 tx=0x7f1a08011000 comp rx=0 tx=0).stop 2023-10-14T08:53:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/1306574599 shutdown_connections 2023-10-14T08:53:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763c620 0x56415763f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763ae20 0x564157643620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/1306574599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763b780 0x56415764c070 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.526+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/1306574599 >> 172.21.15.6:0/1306574599 conn(0x564157568dd0 msgr2=0x564157635240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/1306574599 shutdown_connections 2023-10-14T08:53:54.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/1306574599 wait complete. 2023-10-14T08:53:54.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 -- start start 2023-10-14T08:53:54.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 Processor -- start 2023-10-14T08:53:54.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763ae20 0x56415764b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763b780 0x56415764bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x564157648320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641576488a0 con 0x56415763b780 2023-10-14T08:53:54.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157648a10 con 0x56415763c620 2023-10-14T08:53:54.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157648bd0 con 0x56415763ae20 2023-10-14T08:53:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.527+0000 7f1a2c7b1b80 10 client.0 _ll_register_callbacks cb 0x564157387800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:53:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1e363700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763ae20 0x56415764b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x564157648320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x564157648320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60772/0 (socket says 172.21.15.6:60772) 2023-10-14T08:53:54.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 -- 172.21.15.6:0/2873399051 learned_addr learned my addr 172.21.15.6:0/2873399051 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:53:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1db62700 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763b780 0x56415764bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 -- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763ae20 msgr2=0x56415764b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763ae20 0x56415764b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 -- 172.21.15.6:0/2873399051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763b780 msgr2=0x56415764bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:53:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763b780 0x56415764bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 -- 172.21.15.6:0/2873399051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0801a040 con 0x56415763c620 2023-10-14T08:53:54.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.528+0000 7f1a1eb64700 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x564157648320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a10018bf0 tx=0x7f1a10018c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad439a32ad752903 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:53:54.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:53:54.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a01ffb700 1 -- 172.21.15.6:0/2873399051 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100046c0 con 0x56415763c620 2023-10-14T08:53:54.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a01ffb700 1 -- 172.21.15.6:0/2873399051 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1a10004820 con 0x56415763c620 2023-10-14T08:53:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a1409f2e0 con 0x56415763c620 2023-10-14T08:53:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a01ffb700 1 -- 172.21.15.6:0/2873399051 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a10032470 con 0x56415763c620 2023-10-14T08:53:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a2c7b1b80 10 client.25370 fetch_fsmap learned FSMap version 31 2023-10-14T08:53:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5641573a1c60 con 0x56415763c620 2023-10-14T08:53:54.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.529+0000 7f1a01ffb700 1 -- 172.21.15.6:0/2873399051 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a1409f2e0 con 0x56415763c620 2023-10-14T08:53:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a01ffb700 1 -- 172.21.15.6:0/2873399051 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1a10029680 con 0x56415763c620 2023-10-14T08:53:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a2c7b1b80 10 client.25370 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:53:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a2c7b1b80 10 client.25370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-14T08:53:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a2c7b1b80 20 client.25370 populate_metadata read hostname 'smithi006' 2023-10-14T08:53:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576a5a30 0x5641576a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:53:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a2c7b1b80 4 client.25370 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-14T08:53:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564157586e50 con 0x5641576a5a30 2023-10-14T08:53:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.530+0000 7f1a1e363700 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576a5a30 0x5641576a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:53:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.531+0000 7f1a1e363700 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576a5a30 0x5641576a7e50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e42d7238b699aa05 server_cookie=220cdbbd6c29e1db in_seq=0 out_seq=0 2023-10-14T08:53:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.531+0000 7f1a01ffb700 10 client.25370 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.531+0000 7f1a01ffb700 1 -- 172.21.15.6:0/2873399051 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564157586e50 con 0x5641576a5a30 2023-10-14T08:53:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.531+0000 7f1a01ffb700 10 client.25370 handle_command_reply: tid=0 2023-10-14T08:53:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.531+0000 7f1a2c7b1b80 1 client.25370 shutdown 2023-10-14T08:53:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 msgr2=0x564157648320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x564157648320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a10018bf0 tx=0x7f1a10018c20 comp rx=0 tx=0).stop 2023-10-14T08:53:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 shutdown_connections 2023-10-14T08:53:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5641576a5a30 0x5641576a7e50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56415763c620 0x564157648320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56415763ae20 0x56415764b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 --2- 172.21.15.6:0/2873399051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56415763b780 0x56415764bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 >> 172.21.15.6:0/2873399051 conn(0x564157568dd0 msgr2=0x56415763f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a01ffb700 0 client.25370 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:53:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 shutdown_connections 2023-10-14T08:53:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 1 -- 172.21.15.6:0/2873399051 wait complete. 2023-10-14T08:53:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.532+0000 7f1a2c7b1b80 20 client.25370 trim_cache size 0 max 16384 2023-10-14T08:53:54.546 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-10-14T08:53:54.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1a040a14e0 msgr2=0x7f1a040a39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1a040a14e0 0x7f1a040a39a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a180730b0 tx=0x7f1a08009210 comp rx=0 tx=0).stop 2023-10-14T08:53:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a180ffe70 msgr2=0x7f1a18071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:53:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a180ffe70 0x7f1a18071670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400b2e0 tx=0x7f1a1400b840 comp rx=0 tx=0).stop 2023-10-14T08:53:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 shutdown_connections 2023-10-14T08:53:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a18101a10 0x7f1a18193bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a180ffe70 0x7f1a18071670 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1a040a14e0 0x7f1a040a39a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 --2- 172.21.15.6:0/2075353424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a18101050 0x7f1a18071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:53:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 >> 172.21.15.6:0/2075353424 conn(0x7f1a180fb410 msgr2=0x7f1a18104600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:53:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 shutdown_connections 2023-10-14T08:53:54.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T08:53:54.533+0000 7f1a205c7700 1 -- 172.21.15.6:0/2075353424 wait complete. 2023-10-14T08:53:54.554 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 99431424, 'ino': 1099511628806, 'path': '/volumes/_nogroup/sv_1/04bf4793-66c9-4714-b8a8-1582bc07509e/postgres/data/base/12347/16403'}] 2023-10-14T08:53:54.554 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-14T08:53:55.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:55 smithi178 ceph-mon[103612]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 MiB/s wr, 2.10k op/s 2023-10-14T08:53:55.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:55 smithi057 ceph-mon[103313]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 MiB/s wr, 2.10k op/s 2023-10-14T08:53:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:55 smithi006 ceph-mon[99452]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 MiB/s wr, 2.10k op/s 2023-10-14T08:53:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 55.0 s, 4304.4 tps, lat 23.226 ms stddev 24.327 2023-10-14T08:53:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:57 smithi178 ceph-mon[103612]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 52 MiB/s wr, 2.24k op/s 2023-10-14T08:53:57.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:57 smithi057 ceph-mon[103313]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 52 MiB/s wr, 2.24k op/s 2023-10-14T08:53:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:57 smithi006 ceph-mon[99452]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 52 MiB/s wr, 2.24k op/s 2023-10-14T08:53:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:53:59 smithi178 ceph-mon[103612]: pgmap v341: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 47 MiB/s wr, 2.08k op/s 2023-10-14T08:53:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:53:59 smithi057 ceph-mon[103313]: pgmap v341: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 47 MiB/s wr, 2.08k op/s 2023-10-14T08:53:59.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:53:59 smithi006 ceph-mon[99452]: pgmap v341: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 47 MiB/s wr, 2.08k op/s 2023-10-14T08:54:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 60.0 s, 3966.0 tps, lat 25.243 ms stddev 27.160 2023-10-14T08:54:01.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:01 smithi178 ceph-mon[103612]: pgmap v342: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 38 MiB/s wr, 1.64k op/s 2023-10-14T08:54:01.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:01 smithi057 ceph-mon[103313]: pgmap v342: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 38 MiB/s wr, 1.64k op/s 2023-10-14T08:54:01.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:01 smithi006 ceph-mon[99452]: pgmap v342: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 38 MiB/s wr, 1.64k op/s 2023-10-14T08:54:02.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:02 smithi178 ceph-mon[103612]: pgmap v343: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 35 MiB/s wr, 1.49k op/s 2023-10-14T08:54:02.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:02 smithi057 ceph-mon[103313]: pgmap v343: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 35 MiB/s wr, 1.49k op/s 2023-10-14T08:54:02.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:02 smithi006 ceph-mon[99452]: pgmap v343: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 35 MiB/s wr, 1.49k op/s 2023-10-14T08:54:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:04 smithi178 ceph-mon[103612]: pgmap v344: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 21 MiB/s wr, 871 op/s 2023-10-14T08:54:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:04 smithi057 ceph-mon[103313]: pgmap v344: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 21 MiB/s wr, 871 op/s 2023-10-14T08:54:04.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:04 smithi006 ceph-mon[99452]: pgmap v344: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 21 MiB/s wr, 871 op/s 2023-10-14T08:54:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 65.0 s, 3916.8 tps, lat 25.475 ms stddev 27.125 2023-10-14T08:54:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.261+0000 7fd76c17b700 1 -- 172.21.15.6:0/4266145615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 msgr2=0x7fd764108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.261+0000 7fd76c17b700 1 --2- 172.21.15.6:0/4266145615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd764108b80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd7600099c0 tx=0x7fd760009cd0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.262+0000 7fd76c17b700 1 -- 172.21.15.6:0/4266145615 shutdown_connections 2023-10-14T08:54:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.262+0000 7fd76c17b700 1 --2- 172.21.15.6:0/4266145615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7641090c0 0x7fd76410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.262+0000 7fd76c17b700 1 --2- 172.21.15.6:0/4266145615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd764107530 0x7fd764107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.262+0000 7fd76c17b700 1 --2- 172.21.15.6:0/4266145615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd764108b80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.262+0000 7fd76c17b700 1 -- 172.21.15.6:0/4266145615 >> 172.21.15.6:0/4266145615 conn(0x7fd764076500 msgr2=0x7fd764078920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.263+0000 7fd76c17b700 1 -- 172.21.15.6:0/4266145615 shutdown_connections 2023-10-14T08:54:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.263+0000 7fd76c17b700 1 -- 172.21.15.6:0/4266145615 wait complete. 2023-10-14T08:54:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 Processor -- start 2023-10-14T08:54:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 -- start start 2023-10-14T08:54:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd764107530 0x7fd76419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd76419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7641090c0 0x7fd7641a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641a4db0 con 0x7fd764108720 2023-10-14T08:54:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641a4ef0 con 0x7fd764107530 2023-10-14T08:54:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd76c17b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641a5080 con 0x7fd7641090c0 2023-10-14T08:54:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd769716700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd76419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd769716700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd76419d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33796/0 (socket says 172.21.15.6:33796) 2023-10-14T08:54:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.264+0000 7fd769716700 1 -- 172.21.15.6:0/1329127769 learned_addr learned my addr 172.21.15.6:0/1329127769 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.265+0000 7fd769716700 1 -- 172.21.15.6:0/1329127769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7641090c0 msgr2=0x7fd7641a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.266+0000 7fd76a718700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7641090c0 0x7fd7641a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.266+0000 7fd769716700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7641090c0 0x7fd7641a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.266+0000 7fd769716700 1 -- 172.21.15.6:0/1329127769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd764107530 msgr2=0x7fd76419d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.266+0000 7fd769716700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd764107530 0x7fd76419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.266+0000 7fd769716700 1 -- 172.21.15.6:0/1329127769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600095f0 con 0x7fd764108720 2023-10-14T08:54:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.266+0000 7fd769716700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd76419d770 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd760009f50 tx=0x7fd760005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.267+0000 7fd75affd700 1 -- 172.21.15.6:0/1329127769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76001d070 con 0x7fd764108720 2023-10-14T08:54:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.267+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7641a5300 con 0x7fd764108720 2023-10-14T08:54:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.267+0000 7fd75affd700 1 -- 172.21.15.6:0/1329127769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd760004180 con 0x7fd764108720 2023-10-14T08:54:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.267+0000 7fd75affd700 1 -- 172.21.15.6:0/1329127769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000f460 con 0x7fd764108720 2023-10-14T08:54:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.267+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7641a5780 con 0x7fd764108720 2023-10-14T08:54:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 Processor -- start 2023-10-14T08:54:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 -- start start 2023-10-14T08:54:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 0x564915486c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 0x564915487ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x564915488520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649153fbc10 con 0x5649154880a0 2023-10-14T08:54:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649153e0c00 con 0x5649154871b0 2023-10-14T08:54:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.272+0000 7fd778365b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649153de520 con 0x564915486850 2023-10-14T08:54:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.273+0000 7fd75affd700 1 -- 172.21.15.6:0/1329127769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd760003cc0 con 0x7fd764108720 2023-10-14T08:54:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.274+0000 7fd769f17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 0x564915487ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.274+0000 7fd769f17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 0x564915487ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60792/0 (socket says 172.21.15.6:60792) 2023-10-14T08:54:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.274+0000 7fd769f17700 1 -- 172.21.15.6:0/4071593735 learned_addr learned my addr 172.21.15.6:0/4071593735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.274+0000 7fd75affd700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7500a1500 0x7fd7500a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.274+0000 7fd75affd700 1 -- 172.21.15.6:0/1329127769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd7600cdfd0 con 0x7fd764108720 2023-10-14T08:54:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd769f17700 1 -- 172.21.15.6:0/4071593735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 msgr2=0x564915486c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:54:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd769f17700 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 0x564915486c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd769f17700 1 -- 172.21.15.6:0/4071593735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 msgr2=0x564915488520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd769f17700 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x564915488520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd769f17700 1 -- 172.21.15.6:0/4071593735 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564915397390 con 0x5649154871b0 2023-10-14T08:54:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd76a718700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7500a1500 0x7fd7500a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd769f17700 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 0x564915487ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bba0 tx=0x7fd75400beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6c0674b48a27ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd74ffff700 1 -- 172.21.15.6:0/4071593735 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400dac0 con 0x5649154871b0 2023-10-14T08:54:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd74ffff700 1 -- 172.21.15.6:0/4071593735 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd75400b680 con 0x5649154871b0 2023-10-14T08:54:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.275+0000 7fd74ffff700 1 -- 172.21.15.6:0/4071593735 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400f620 con 0x5649154871b0 2023-10-14T08:54:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.276+0000 7fd778365b80 1 -- 172.21.15.6:0/4071593735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 msgr2=0x564915487ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.276+0000 7fd778365b80 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 0x564915487ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bba0 tx=0x7fd75400beb0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.276+0000 7fd76a718700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7500a1500 0x7fd7500a39c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009a80 tx=0x7fd75c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.277+0000 7fd778365b80 1 -- 172.21.15.6:0/4071593735 shutdown_connections 2023-10-14T08:54:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.277+0000 7fd778365b80 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x564915488520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.277+0000 7fd778365b80 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 0x564915486c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.277+0000 7fd778365b80 1 --2- 172.21.15.6:0/4071593735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154871b0 0x564915487ac0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd75400bba0 tx=0x7fd75400beb0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.277+0000 7fd778365b80 1 -- 172.21.15.6:0/4071593735 >> 172.21.15.6:0/4071593735 conn(0x5649153b4d70 msgr2=0x564915481c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.293+0000 7fd778365b80 1 -- 172.21.15.6:0/4071593735 shutdown_connections 2023-10-14T08:54:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.296+0000 7fd778365b80 1 -- 172.21.15.6:0/4071593735 wait complete. 2023-10-14T08:54:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.296+0000 7fd778365b80 1 -- start start 2023-10-14T08:54:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.296+0000 7fd778365b80 1 Processor -- start 2023-10-14T08:54:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154880a0 0x5649154a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649153d9e10 con 0x5649154a6fb0 2023-10-14T08:54:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649153766b0 con 0x564915486850 2023-10-14T08:54:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564915376350 con 0x5649154880a0 2023-10-14T08:54:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.297+0000 7fd778365b80 10 client.0 _ll_register_callbacks cb 0x5649151d37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60800/0 (socket says 172.21.15.6:60800) 2023-10-14T08:54:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 -- 172.21.15.6:0/4208063890 learned_addr learned my addr 172.21.15.6:0/4208063890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 -- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154880a0 msgr2=0x5649154a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154880a0 0x5649154a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 -- 172.21.15.6:0/4208063890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 msgr2=0x5649154a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.298+0000 7fd769f17700 1 -- 172.21.15.6:0/4208063890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75400b800 con 0x564915486850 2023-10-14T08:54:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.299+0000 7fd769f17700 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154a1a40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd754000c00 tx=0x7fd754010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb5d7ccd7fefc7f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.300+0000 7fd74d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:54:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.300+0000 7fd74d7fa700 1 -- 172.21.15.6:0/4208063890 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754010b10 con 0x564915486850 2023-10-14T08:54:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.300+0000 7fd74d7fa700 1 -- 172.21.15.6:0/4208063890 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd75400dad0 con 0x564915486850 2023-10-14T08:54:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.300+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564915456bb0 con 0x564915486850 2023-10-14T08:54:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.302+0000 7fd74d7fa700 1 -- 172.21.15.6:0/4208063890 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd75400b680 con 0x564915486850 2023-10-14T08:54:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.304+0000 7fd778365b80 10 client.25379 fetch_fsmap learned FSMap version 31 2023-10-14T08:54:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.304+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564915204d80 con 0x564915486850 2023-10-14T08:54:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.304+0000 7fd74d7fa700 1 -- 172.21.15.6:0/4208063890 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564915456bb0 con 0x564915486850 2023-10-14T08:54:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.304+0000 7fd74d7fa700 1 -- 172.21.15.6:0/4208063890 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd754005150 con 0x564915486850 2023-10-14T08:54:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.304+0000 7fd778365b80 10 client.25379 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:54:07.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.304+0000 7fd778365b80 10 client.25379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.305+0000 7fd778365b80 20 client.25379 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.305+0000 7fd778365b80 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5649154adcb0 0x5649154b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.305+0000 7fd778365b80 4 client.25379 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:54:07.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.305+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649153d2df0 con 0x5649154adcb0 2023-10-14T08:54:07.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.306+0000 7fd769716700 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5649154adcb0 0x5649154b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.308+0000 7fd769716700 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5649154adcb0 0x5649154b00d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92946133cca416ee server_cookie=6f166d3696602f72 in_seq=0 out_seq=0 2023-10-14T08:54:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.308+0000 7fd74d7fa700 10 client.25379 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.308+0000 7fd74d7fa700 1 -- 172.21.15.6:0/4208063890 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5649153d2df0 con 0x5649154adcb0 2023-10-14T08:54:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.308+0000 7fd74d7fa700 10 client.25379 handle_command_reply: tid=0 2023-10-14T08:54:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.309+0000 7fd778365b80 1 client.25379 shutdown 2023-10-14T08:54:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 msgr2=0x5649154a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154a1a40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd754000c00 tx=0x7fd754010740 comp rx=0 tx=0).stop 2023-10-14T08:54:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 shutdown_connections 2023-10-14T08:54:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5649154adcb0 0x5649154b00d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154a1a40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd74d7fa700 0 client.25379 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 --2- 172.21.15.6:0/4208063890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154880a0 0x5649154a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 >> 172.21.15.6:0/4208063890 conn(0x5649153b4d70 msgr2=0x564915481830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 shutdown_connections 2023-10-14T08:54:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 1 -- 172.21.15.6:0/4208063890 wait complete. 2023-10-14T08:54:07.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.310+0000 7fd778365b80 20 client.25379 trim_cache size 0 max 16384 2023-10-14T08:54:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 Processor -- start 2023-10-14T08:54:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 -- start start 2023-10-14T08:54:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 0x56491548e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154880a0 0x564915480390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56491525a8c0 con 0x5649154a6fb0 2023-10-14T08:54:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649154b0730 con 0x5649154880a0 2023-10-14T08:54:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.337+0000 7fd778365b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649154808d0 con 0x564915486850 2023-10-14T08:54:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd76a718700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd76a718700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154bd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33820/0 (socket says 172.21.15.6:33820) 2023-10-14T08:54:07.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154880a0 0x564915480390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd76a718700 1 -- 172.21.15.6:0/3002855544 learned_addr learned my addr 172.21.15.6:0/3002855544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:07.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 -- 172.21.15.6:0/3002855544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 msgr2=0x56491548e780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:54:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 0x56491548e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 -- 172.21.15.6:0/3002855544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 msgr2=0x5649154bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 -- 172.21.15.6:0/3002855544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649151edc00 con 0x5649154880a0 2023-10-14T08:54:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd769716700 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154880a0 0x564915480390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x564915487880 tx=0x7fd7600042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d81a851809c92f18 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.338+0000 7fd758ff9700 1 -- 172.21.15.6:0/3002855544 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600b1030 con 0x5649154880a0 2023-10-14T08:54:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd758ff9700 1 -- 172.21.15.6:0/3002855544 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd76009aca0 con 0x5649154880a0 2023-10-14T08:54:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd758ff9700 1 -- 172.21.15.6:0/3002855544 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600a36d0 con 0x5649154880a0 2023-10-14T08:54:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 -- 172.21.15.6:0/3002855544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154880a0 msgr2=0x564915480390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154880a0 0x564915480390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x564915487880 tx=0x7fd7600042f0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 -- 172.21.15.6:0/3002855544 shutdown_connections 2023-10-14T08:54:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154a6fb0 0x5649154bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564915486850 0x56491548e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 --2- 172.21.15.6:0/3002855544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5649154880a0 0x564915480390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.339+0000 7fd778365b80 1 -- 172.21.15.6:0/3002855544 >> 172.21.15.6:0/3002855544 conn(0x5649153b4d70 msgr2=0x5649154b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.340+0000 7fd778365b80 1 -- 172.21.15.6:0/3002855544 shutdown_connections 2023-10-14T08:54:07.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.341+0000 7fd778365b80 1 -- 172.21.15.6:0/3002855544 wait complete. 2023-10-14T08:54:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.341+0000 7fd778365b80 1 -- start start 2023-10-14T08:54:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.342+0000 7fd778365b80 1 Processor -- start 2023-10-14T08:54:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x5649154bb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154a6fb0 0x5649154bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649154bc5a0 con 0x5649154880a0 2023-10-14T08:54:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649154bc710 con 0x564915486850 2023-10-14T08:54:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649154bc880 con 0x5649154a6fb0 2023-10-14T08:54:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd778365b80 10 client.0 _ll_register_callbacks cb 0x7fd75400ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769f17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x5649154bb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769f17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154bab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60812/0 (socket says 172.21.15.6:60812) 2023-10-14T08:54:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x5649154bb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33822/0 (socket says 172.21.15.6:33822) 2023-10-14T08:54:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769f17700 1 -- 172.21.15.6:0/1145012517 learned_addr learned my addr 172.21.15.6:0/1145012517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd76a718700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154a6fb0 0x5649154bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 -- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154a6fb0 msgr2=0x5649154bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154a6fb0 0x5649154bc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 -- 172.21.15.6:0/1145012517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 msgr2=0x5649154bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154bab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769716700 1 -- 172.21.15.6:0/1145012517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7641a5780 con 0x5649154880a0 2023-10-14T08:54:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.343+0000 7fd769f17700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:54:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd769716700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x5649154bb050 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x5649154b08c0 tx=0x7fd760009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64121060ab9bcc49 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd74d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:54:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd74d7fa700 1 -- 172.21.15.6:0/1145012517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600b1040 con 0x5649154880a0 2023-10-14T08:54:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd74d7fa700 1 -- 172.21.15.6:0/1145012517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd7600b2070 con 0x5649154880a0 2023-10-14T08:54:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649153dee90 con 0x5649154880a0 2023-10-14T08:54:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd74d7fa700 1 -- 172.21.15.6:0/1145012517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd76009b340 con 0x5649154880a0 2023-10-14T08:54:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd778365b80 10 client.15747 fetch_fsmap learned FSMap version 31 2023-10-14T08:54:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56491522b1f0 con 0x5649154880a0 2023-10-14T08:54:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.344+0000 7fd74d7fa700 1 -- 172.21.15.6:0/1145012517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5649153dee90 con 0x5649154880a0 2023-10-14T08:54:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd74d7fa700 1 -- 172.21.15.6:0/1145012517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd76009a830 con 0x5649154880a0 2023-10-14T08:54:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd778365b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 31 2023-10-14T08:54:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd778365b80 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd778365b80 20 client.15747 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd778365b80 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x564915513220 0x564915515610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd778365b80 4 client.15747 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:54:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.345+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5649153d2b10 con 0x564915513220 2023-10-14T08:54:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.348+0000 7fd769f17700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x564915513220 0x564915515610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.348+0000 7fd769f17700 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x564915513220 0x564915515610 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6712dda47312b0e server_cookie=43141b4cadc95504 in_seq=0 out_seq=0 2023-10-14T08:54:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.348+0000 7fd74d7fa700 10 client.15747 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd74d7fa700 1 -- 172.21.15.6:0/1145012517 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5649153d2b10 con 0x564915513220 2023-10-14T08:54:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd74d7fa700 10 client.15747 handle_command_reply: tid=0 2023-10-14T08:54:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 client.15747 shutdown 2023-10-14T08:54:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 msgr2=0x5649154bb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x5649154bb050 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x5649154b08c0 tx=0x7fd760009cd0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 shutdown_connections 2023-10-14T08:54:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x564915513220 0x564915515610 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5649154a6fb0 0x5649154bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x564915486850 0x5649154bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd74d7fa700 0 client.15747 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 --2- 172.21.15.6:0/1145012517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5649154880a0 0x5649154bb050 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 >> 172.21.15.6:0/1145012517 conn(0x5649153b4d70 msgr2=0x5649154878b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.364+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 shutdown_connections 2023-10-14T08:54:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.366+0000 7fd778365b80 1 -- 172.21.15.6:0/1145012517 wait complete. 2023-10-14T08:54:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.366+0000 7fd778365b80 20 client.15747 trim_cache size 0 max 16384 2023-10-14T08:54:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:54:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:54:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:54:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:54:07.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7500a1500 msgr2=0x7fd7500a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7500a1500 0x7fd7500a39c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009a80 tx=0x7fd75c009040 comp rx=0 tx=0).stop 2023-10-14T08:54:07.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 msgr2=0x7fd76419d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:07.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd76419d770 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd760009f50 tx=0x7fd760005ef0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 shutdown_connections 2023-10-14T08:54:07.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7641090c0 0x7fd7641a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7500a1500 0x7fd7500a39c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd764107530 0x7fd76419d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 --2- 172.21.15.6:0/1329127769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd764108720 0x7fd76419d770 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 >> 172.21.15.6:0/1329127769 conn(0x7fd764076500 msgr2=0x7fd764078780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 shutdown_connections 2023-10-14T08:54:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:07.367+0000 7fd76c17b700 1 -- 172.21.15.6:0/1329127769 wait complete. 2023-10-14T08:54:07.443 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:07 smithi057 ceph-mon[103313]: pgmap v345: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 28 MiB/s wr, 1.18k op/s 2023-10-14T08:54:07.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:07 smithi006 ceph-mon[99452]: pgmap v345: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 28 MiB/s wr, 1.18k op/s 2023-10-14T08:54:07.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:07 smithi178 ceph-mon[103612]: pgmap v345: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 28 MiB/s wr, 1.18k op/s 2023-10-14T08:54:09.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:09 smithi057 ceph-mon[103313]: pgmap v346: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 31 MiB/s wr, 1.22k op/s 2023-10-14T08:54:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:09 smithi006 ceph-mon[99452]: pgmap v346: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 31 MiB/s wr, 1.22k op/s 2023-10-14T08:54:09.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:09 smithi178 ceph-mon[103612]: pgmap v346: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 31 MiB/s wr, 1.22k op/s 2023-10-14T08:54:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 70.0 s, 3498.6 tps, lat 28.608 ms stddev 49.314 2023-10-14T08:54:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:11 smithi057 ceph-mon[103313]: pgmap v347: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 38 MiB/s wr, 1.53k op/s 2023-10-14T08:54:11.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:11 smithi006 ceph-mon[99452]: pgmap v347: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 38 MiB/s wr, 1.53k op/s 2023-10-14T08:54:11.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:11 smithi178 ceph-mon[103612]: pgmap v347: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 38 MiB/s wr, 1.53k op/s 2023-10-14T08:54:13.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:13 smithi057 ceph-mon[103313]: pgmap v348: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 56 MiB/s wr, 2.27k op/s 2023-10-14T08:54:13.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:13 smithi006 ceph-mon[99452]: pgmap v348: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 56 MiB/s wr, 2.27k op/s 2023-10-14T08:54:13.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:13 smithi178 ceph-mon[103612]: pgmap v348: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 56 MiB/s wr, 2.27k op/s 2023-10-14T08:54:15.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:15 smithi057 ceph-mon[103313]: pgmap v349: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 2.14k op/s 2023-10-14T08:54:15.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:15 smithi006 ceph-mon[99452]: pgmap v349: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 2.14k op/s 2023-10-14T08:54:15.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:15 smithi178 ceph-mon[103612]: pgmap v349: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 2.14k op/s 2023-10-14T08:54:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 75.0 s, 3826.6 tps, lat 26.086 ms stddev 27.905 2023-10-14T08:54:17.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:17 smithi006 ceph-mon[99452]: pgmap v350: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 MiB/s wr, 2.27k op/s 2023-10-14T08:54:17.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:17 smithi178 ceph-mon[103612]: pgmap v350: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 MiB/s wr, 2.27k op/s 2023-10-14T08:54:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:17 smithi057 ceph-mon[103313]: pgmap v350: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 MiB/s wr, 2.27k op/s 2023-10-14T08:54:19.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:19 smithi006 ceph-mon[99452]: pgmap v351: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 MiB/s wr, 2.05k op/s 2023-10-14T08:54:19.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:19 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:54:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:19 smithi178 ceph-mon[103612]: pgmap v351: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 MiB/s wr, 2.05k op/s 2023-10-14T08:54:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:19 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:54:19.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:19 smithi057 ceph-mon[103313]: pgmap v351: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 MiB/s wr, 2.05k op/s 2023-10-14T08:54:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:19 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:54:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.530+0000 7f6e502ad700 1 -- 172.21.15.6:0/3016523762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 msgr2=0x7f6e4810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.530+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3016523762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 0x7f6e4810a2e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009990 tx=0x7f6e44009ca0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.531+0000 7f6e502ad700 1 -- 172.21.15.6:0/3016523762 shutdown_connections 2023-10-14T08:54:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.531+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3016523762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810d1f0 0x7f6e4810d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.531+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3016523762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 0x7f6e4810a2e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.531+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3016523762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810a820 0x7f6e4810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.531+0000 7f6e502ad700 1 -- 172.21.15.6:0/3016523762 >> 172.21.15.6:0/3016523762 conn(0x7f6e4806dcf0 msgr2=0x7f6e48070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.531+0000 7f6e502ad700 1 -- 172.21.15.6:0/3016523762 shutdown_connections 2023-10-14T08:54:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.532+0000 7f6e502ad700 1 -- 172.21.15.6:0/3016523762 wait complete. 2023-10-14T08:54:20.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.532+0000 7f6e502ad700 1 Processor -- start 2023-10-14T08:54:20.535 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.533+0000 7f6e502ad700 1 -- start start 2023-10-14T08:54:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.533+0000 7f6e502ad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 0x7f6e481a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.533+0000 7f6e502ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810a820 0x7f6e481a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e502ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810d1f0 0x7f6e481ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e502ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e481ad600 con 0x7f6e4810d1f0 2023-10-14T08:54:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e502ad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e481ad740 con 0x7f6e4810a820 2023-10-14T08:54:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e502ad700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e481ad8d0 con 0x7f6e48107eb0 2023-10-14T08:54:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810a820 0x7f6e481a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810a820 0x7f6e481a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60826/0 (socket says 172.21.15.6:60826) 2023-10-14T08:54:20.537 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810d1f0 0x7f6e481ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4d848700 1 -- 172.21.15.6:0/3781512333 learned_addr learned my addr 172.21.15.6:0/3781512333 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:20.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 -- 172.21.15.6:0/3781512333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 msgr2=0x7f6e481a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 0x7f6e481a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 -- 172.21.15.6:0/3781512333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810a820 msgr2=0x7f6e481a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.538 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810a820 0x7f6e481a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 -- 172.21.15.6:0/3781512333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440095f0 con 0x7f6e4810d1f0 2023-10-14T08:54:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.534+0000 7f6e4e84a700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810d1f0 0x7f6e481ad030 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000e970 tx=0x7f6e4000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.536+0000 7f6e3b7fe700 1 -- 172.21.15.6:0/3781512333 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4000cbd0 con 0x7f6e4810d1f0 2023-10-14T08:54:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.536+0000 7f6e3b7fe700 1 -- 172.21.15.6:0/3781512333 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e4000ee60 con 0x7f6e4810d1f0 2023-10-14T08:54:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.536+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e481adbb0 con 0x7f6e4810d1f0 2023-10-14T08:54:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.536+0000 7f6e3b7fe700 1 -- 172.21.15.6:0/3781512333 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40004ea0 con 0x7f6e4810d1f0 2023-10-14T08:54:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.536+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e481ae0c0 con 0x7f6e4810d1f0 2023-10-14T08:54:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.541+0000 7f6e3b7fe700 1 -- 172.21.15.6:0/3781512333 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6e4000cd30 con 0x7f6e4810d1f0 2023-10-14T08:54:20.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.541+0000 7f6e5c497b80 1 Processor -- start 2023-10-14T08:54:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 -- start start 2023-10-14T08:54:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a16c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a171b0 0x55ef33a17ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a180a0 0x55ef33a18520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3398bc10 con 0x55ef33a171b0 2023-10-14T08:54:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33970c00 con 0x55ef33a180a0 2023-10-14T08:54:20.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3396e520 con 0x55ef33a16850 2023-10-14T08:54:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a16c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a16c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59476/0 (socket says 172.21.15.6:59476) 2023-10-14T08:54:20.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e4d848700 1 -- 172.21.15.6:0/4234874773 learned_addr learned my addr 172.21.15.6:0/4234874773 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:20.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e4e049700 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a171b0 0x55ef33a17ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e4d848700 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a180a0 0x55ef33a18520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.542+0000 7f6e3b7fe700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6e340a15d0 0x7f6e340a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4d848700 1 -- 172.21.15.6:0/4234874773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a180a0 msgr2=0x55ef33a18520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4d848700 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a180a0 0x55ef33a18520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4d848700 1 -- 172.21.15.6:0/4234874773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a171b0 msgr2=0x55ef33a17ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4d848700 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a171b0 0x55ef33a17ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4d848700 1 -- 172.21.15.6:0/4234874773 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef33927390 con 0x55ef33a16850 2023-10-14T08:54:20.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e3b7fe700 1 -- 172.21.15.6:0/3781512333 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6e40014070 con 0x7f6e4810d1f0 2023-10-14T08:54:20.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4d848700 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a16c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0094d0 tx=0x7f6e3c009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba3ae03bf5fcaf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e4e84a700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6e340a15d0 0x7f6e340a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e38d82700 1 -- 172.21.15.6:0/4234874773 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c015790 con 0x55ef33a16850 2023-10-14T08:54:20.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e38d82700 1 -- 172.21.15.6:0/4234874773 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e3c015db0 con 0x55ef33a16850 2023-10-14T08:54:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.543+0000 7f6e38d82700 1 -- 172.21.15.6:0/4234874773 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c01acb0 con 0x55ef33a16850 2023-10-14T08:54:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.544+0000 7f6e5c497b80 1 -- 172.21.15.6:0/4234874773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 msgr2=0x55ef33a16c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.544+0000 7f6e4e84a700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6e340a15d0 0x7f6e340a3a90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e40099ba0 tx=0x7f6e40004930 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.544+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a16c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0094d0 tx=0x7f6e3c009cb0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.544+0000 7f6e5c497b80 1 -- 172.21.15.6:0/4234874773 shutdown_connections 2023-10-14T08:54:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.545+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a180a0 0x55ef33a18520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.545+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a16c70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.545+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/4234874773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a171b0 0x55ef33a17ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.545+0000 7f6e5c497b80 1 -- 172.21.15.6:0/4234874773 >> 172.21.15.6:0/4234874773 conn(0x55ef33944d70 msgr2=0x55ef33a11c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.545+0000 7f6e5c497b80 1 -- 172.21.15.6:0/4234874773 shutdown_connections 2023-10-14T08:54:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.546+0000 7f6e5c497b80 1 -- 172.21.15.6:0/4234874773 wait complete. 2023-10-14T08:54:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.546+0000 7f6e5c497b80 1 -- start start 2023-10-14T08:54:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.546+0000 7f6e5c497b80 1 Processor -- start 2023-10-14T08:54:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a31d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a38d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33969e10 con 0x55ef33a16850 2023-10-14T08:54:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef339066b0 con 0x55ef33a171b0 2023-10-14T08:54:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33906350 con 0x55ef33a180a0 2023-10-14T08:54:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e5c497b80 10 client.0 _ll_register_callbacks cb 0x55ef337637a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e4e049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a31d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e4e049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a31d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60842/0 (socket says 172.21.15.6:60842) 2023-10-14T08:54:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e4e049700 1 -- 172.21.15.6:0/2713218079 learned_addr learned my addr 172.21.15.6:0/2713218079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.547+0000 7f6e4d848700 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a38d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e4d848700 1 -- 172.21.15.6:0/2713218079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 msgr2=0x55ef33a31d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e4d848700 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a31d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e4d848700 1 -- 172.21.15.6:0/2713218079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 msgr2=0x55ef33a317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e4d848700 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e4d848700 1 -- 172.21.15.6:0/2713218079 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3c011040 con 0x55ef33a180a0 2023-10-14T08:54:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e4d848700 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a38d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0094d0 tx=0x7f6e3c008420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a861bee4b1081e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:54:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e31ffb700 1 -- 172.21.15.6:0/2713218079 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c015790 con 0x55ef33a180a0 2023-10-14T08:54:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef3396ee90 con 0x55ef33a180a0 2023-10-14T08:54:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.548+0000 7f6e31ffb700 1 -- 172.21.15.6:0/2713218079 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6e3c0158f0 con 0x55ef33a180a0 2023-10-14T08:54:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e31ffb700 1 -- 172.21.15.6:0/2713218079 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3c015ab0 con 0x55ef33a180a0 2023-10-14T08:54:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 10 client.25450 fetch_fsmap learned FSMap version 32 2023-10-14T08:54:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ef33794d80 con 0x55ef33a180a0 2023-10-14T08:54:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e31ffb700 1 -- 172.21.15.6:0/2713218079 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e3c038080 con 0x55ef33a180a0 2023-10-14T08:54:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e31ffb700 1 -- 172.21.15.6:0/2713218079 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f6e3c021020 con 0x55ef33a180a0 2023-10-14T08:54:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 10 client.25450 fetch_fsmap finished waiting for FSMap version 32 2023-10-14T08:54:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 10 client.25450 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 20 client.25450 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a3d570 0x55ef33a3f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 4 client.25450 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:54:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.549+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef339e6bb0 con 0x55ef33a3d570 2023-10-14T08:54:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.550+0000 7f6e4e049700 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a3d570 0x55ef33a3f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.551+0000 7f6e4e049700 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a3d570 0x55ef33a3f990 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1937d855ddd8e661 server_cookie=e77e37b5010178e9 in_seq=0 out_seq=0 2023-10-14T08:54:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.552+0000 7f6e31ffb700 10 client.25450 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.552+0000 7f6e31ffb700 1 -- 172.21.15.6:0/2713218079 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ef339e6bb0 con 0x55ef33a3d570 2023-10-14T08:54:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.552+0000 7f6e31ffb700 10 client.25450 handle_command_reply: tid=0 2023-10-14T08:54:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.552+0000 7f6e5c497b80 1 client.25450 shutdown 2023-10-14T08:54:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.557+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 msgr2=0x55ef33a38d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.557+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a38d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0094d0 tx=0x7f6e3c008420 comp rx=0 tx=0).stop 2023-10-14T08:54:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 shutdown_connections 2023-10-14T08:54:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a3d570 0x55ef33a3f990 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a38d40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/2713218079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a31d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 >> 172.21.15.6:0/2713218079 conn(0x55ef33944d70 msgr2=0x55ef33a117d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.558+0000 7f6e31ffb700 0 client.25450 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.560+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 shutdown_connections 2023-10-14T08:54:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.561+0000 7f6e5c497b80 1 -- 172.21.15.6:0/2713218079 wait complete. 2023-10-14T08:54:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.562+0000 7f6e5c497b80 20 client.25450 trim_cache size 0 max 16384 2023-10-14T08:54:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.587+0000 7f6e5c497b80 1 Processor -- start 2023-10-14T08:54:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.587+0000 7f6e5c497b80 1 -- start start 2023-10-14T08:54:20.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a38d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a30410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33a31390 con 0x55ef33a16850 2023-10-14T08:54:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef337ea8c0 con 0x55ef33a171b0 2023-10-14T08:54:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33a17f20 con 0x55ef33a180a0 2023-10-14T08:54:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e4e049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a38d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.588+0000 7f6e4e049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a38d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60848/0 (socket says 172.21.15.6:60848) 2023-10-14T08:54:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 -- 172.21.15.6:0/1601513479 learned_addr learned my addr 172.21.15.6:0/1601513479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4d848700 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a30410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4d848700 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 -- 172.21.15.6:0/1601513479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 msgr2=0x55ef33a30410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a30410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 -- 172.21.15.6:0/1601513479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 msgr2=0x55ef33a1e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a1e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 -- 172.21.15.6:0/1601513479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef3377dc00 con 0x55ef33a171b0 2023-10-14T08:54:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.589+0000 7f6e4e049700 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a38d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e440098e0 tx=0x7f6e44009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf673d98c8607e76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.590+0000 7f6e39583700 1 -- 172.21.15.6:0/1601513479 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44027270 con 0x55ef33a171b0 2023-10-14T08:54:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.590+0000 7f6e39583700 1 -- 172.21.15.6:0/1601513479 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e4401e040 con 0x55ef33a171b0 2023-10-14T08:54:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.590+0000 7f6e39583700 1 -- 172.21.15.6:0/1601513479 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440038e0 con 0x55ef33a171b0 2023-10-14T08:54:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 -- 172.21.15.6:0/1601513479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 msgr2=0x55ef33a38d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a38d00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e440098e0 tx=0x7f6e44009310 comp rx=0 tx=0).stop 2023-10-14T08:54:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 -- 172.21.15.6:0/1601513479 shutdown_connections 2023-10-14T08:54:20.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a180a0 0x55ef33a30410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a16850 0x55ef33a1e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/1601513479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a38d00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.591+0000 7f6e5c497b80 1 -- 172.21.15.6:0/1601513479 >> 172.21.15.6:0/1601513479 conn(0x55ef33944d70 msgr2=0x55ef33a442f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.592+0000 7f6e5c497b80 1 -- 172.21.15.6:0/1601513479 shutdown_connections 2023-10-14T08:54:20.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.593+0000 7f6e5c497b80 1 -- 172.21.15.6:0/1601513479 wait complete. 2023-10-14T08:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.593+0000 7f6e5c497b80 1 -- start start 2023-10-14T08:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.593+0000 7f6e5c497b80 1 Processor -- start 2023-10-14T08:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.593+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a34d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e5c497b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a180a0 0x55ef33a382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33a38820 con 0x55ef33a180a0 2023-10-14T08:54:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33a38990 con 0x55ef33a171b0 2023-10-14T08:54:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e5c497b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef33a38b50 con 0x55ef33a16850 2023-10-14T08:54:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e5c497b80 10 client.0 _ll_register_callbacks cb 0x7f6e3c01d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:20.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a34d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4e049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a34d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59498/0 (socket says 172.21.15.6:59498) 2023-10-14T08:54:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4e049700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60856/0 (socket says 172.21.15.6:60856) 2023-10-14T08:54:20.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 -- 172.21.15.6:0/70153168 learned_addr learned my addr 172.21.15.6:0/70153168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a180a0 0x55ef33a382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 -- 172.21.15.6:0/70153168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 msgr2=0x55ef33a352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 -- 172.21.15.6:0/70153168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a180a0 msgr2=0x55ef33a382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:20.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a180a0 0x55ef33a382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 -- 172.21.15.6:0/70153168 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4810e240 con 0x55ef33a16850 2023-10-14T08:54:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4e049700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:54:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e4d848700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a34d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c01a4c0 tx=0x7f6e3c008510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f596a7d19570851b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:20.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:54:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.594+0000 7f6e31ffb700 1 -- 172.21.15.6:0/70153168 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c01a880 con 0x55ef33a16850 2023-10-14T08:54:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.595+0000 7f6e31ffb700 1 -- 172.21.15.6:0/70153168 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6e3c003ac0 con 0x55ef33a16850 2023-10-14T08:54:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.595+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e3c015db0 con 0x55ef33a16850 2023-10-14T08:54:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.595+0000 7f6e31ffb700 1 -- 172.21.15.6:0/70153168 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3c003c80 con 0x55ef33a16850 2023-10-14T08:54:20.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.595+0000 7f6e5c497b80 10 client.25456 fetch_fsmap learned FSMap version 32 2023-10-14T08:54:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.595+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ef337bb1f0 con 0x55ef33a16850 2023-10-14T08:54:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e31ffb700 1 -- 172.21.15.6:0/70153168 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e3c015db0 con 0x55ef33a16850 2023-10-14T08:54:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e31ffb700 1 -- 172.21.15.6:0/70153168 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 32) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f6e3c021030 con 0x55ef33a16850 2023-10-14T08:54:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e5c497b80 10 client.25456 fetch_fsmap finished waiting for FSMap version 32 2023-10-14T08:54:20.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e5c497b80 10 client.25456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e5c497b80 20 client.25456 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a923e0 0x55ef33a94800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e5c497b80 4 client.25456 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:54:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef33962df0 con 0x55ef33a923e0 2023-10-14T08:54:20.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.596+0000 7f6e4e049700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a923e0 0x55ef33a94800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.597+0000 7f6e31ffb700 10 client.25456 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:20.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.597+0000 7f6e4e049700 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a923e0 0x55ef33a94800 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a3e603f01497260 server_cookie=bcaae3ebfc0a74ef in_seq=0 out_seq=0 2023-10-14T08:54:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e31ffb700 1 -- 172.21.15.6:0/70153168 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef33962df0 con 0x55ef33a923e0 2023-10-14T08:54:20.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e31ffb700 10 client.25456 handle_command_reply: tid=0 2023-10-14T08:54:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 client.25456 shutdown 2023-10-14T08:54:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 msgr2=0x55ef33a34d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a34d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c01a4c0 tx=0x7f6e3c008510 comp rx=0 tx=0).stop 2023-10-14T08:54:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 shutdown_connections 2023-10-14T08:54:20.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef33a923e0 0x55ef33a94800 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef33a180a0 0x55ef33a382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef33a16850 0x55ef33a34d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e31ffb700 0 client.25456 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 --2- 172.21.15.6:0/70153168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef33a171b0 0x55ef33a352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 >> 172.21.15.6:0/70153168 conn(0x55ef33944d70 msgr2=0x55ef33a1e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 shutdown_connections 2023-10-14T08:54:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 1 -- 172.21.15.6:0/70153168 wait complete. 2023-10-14T08:54:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.622+0000 7f6e5c497b80 20 client.25456 trim_cache size 0 max 16384 2023-10-14T08:54:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:54:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:54:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:54:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:54:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6e340a15d0 msgr2=0x7f6e340a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6e340a15d0 0x7f6e340a3a90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e40099ba0 tx=0x7f6e40004930 comp rx=0 tx=0).stop 2023-10-14T08:54:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810d1f0 msgr2=0x7f6e481ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810d1f0 0x7f6e481ad030 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000e970 tx=0x7f6e4000ec80 comp rx=0 tx=0).stop 2023-10-14T08:54:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 shutdown_connections 2023-10-14T08:54:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e4810d1f0 0x7f6e481ad030 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e48107eb0 0x7f6e481a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f6e340a15d0 0x7f6e340a3a90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 --2- 172.21.15.6:0/3781512333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e4810a820 0x7f6e481a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.624+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 >> 172.21.15.6:0/3781512333 conn(0x7f6e4806dcf0 msgr2=0x7f6e4810b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.625+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 shutdown_connections 2023-10-14T08:54:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:20.625+0000 7f6e502ad700 1 -- 172.21.15.6:0/3781512333 wait complete. 2023-10-14T08:54:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 80.0 s, 4448.8 tps, lat 22.504 ms stddev 25.055 2023-10-14T08:54:21.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:21 smithi006 ceph-mon[99452]: pgmap v352: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 1.86k op/s 2023-10-14T08:54:21.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:21 smithi178 ceph-mon[103612]: pgmap v352: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 1.86k op/s 2023-10-14T08:54:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:21 smithi057 ceph-mon[103313]: pgmap v352: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 1.86k op/s 2023-10-14T08:54:23.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:23 smithi006 ceph-mon[99452]: pgmap v353: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 39 MiB/s wr, 1.65k op/s 2023-10-14T08:54:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:23 smithi178 ceph-mon[103612]: pgmap v353: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 39 MiB/s wr, 1.65k op/s 2023-10-14T08:54:23.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:23 smithi057 ceph-mon[103313]: pgmap v353: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 39 MiB/s wr, 1.65k op/s 2023-10-14T08:54:24.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:24 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:54:24.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:24 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:54:24.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:24 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:54:25.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:25 smithi178 ceph-mon[103612]: pgmap v354: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 19 MiB/s wr, 852 op/s 2023-10-14T08:54:25.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:25 smithi057 ceph-mon[103313]: pgmap v354: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 19 MiB/s wr, 852 op/s 2023-10-14T08:54:25.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:25 smithi006 ceph-mon[99452]: pgmap v354: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 19 MiB/s wr, 852 op/s 2023-10-14T08:54:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 85.0 s, 4117.4 tps, lat 24.180 ms stddev 28.737 2023-10-14T08:54:27.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:27 smithi178 ceph-mon[103612]: pgmap v355: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 937 op/s 2023-10-14T08:54:27.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:27 smithi057 ceph-mon[103313]: pgmap v355: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 937 op/s 2023-10-14T08:54:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:27 smithi006 ceph-mon[99452]: pgmap v355: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 MiB/s wr, 937 op/s 2023-10-14T08:54:28.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:28 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:54:28.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:28 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:54:28.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:28 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:54:29.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:29 smithi178 ceph-mon[103612]: pgmap v356: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 957 op/s 2023-10-14T08:54:29.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:54:29.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:54:29.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:54:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:29 smithi057 ceph-mon[103313]: pgmap v356: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 957 op/s 2023-10-14T08:54:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:54:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:54:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:54:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:29 smithi006 ceph-mon[99452]: pgmap v356: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 957 op/s 2023-10-14T08:54:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:54:29.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:54:29.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:54:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 90.0 s, 3587.0 tps, lat 27.983 ms stddev 30.187 2023-10-14T08:54:31.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:31 smithi178 ceph-mon[103612]: pgmap v357: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 941 op/s 2023-10-14T08:54:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:31 smithi057 ceph-mon[103313]: pgmap v357: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 941 op/s 2023-10-14T08:54:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:31 smithi006 ceph-mon[99452]: pgmap v357: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 MiB/s wr, 941 op/s 2023-10-14T08:54:32.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:32 smithi178 ceph-mon[103612]: pgmap v358: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 1.13k op/s 2023-10-14T08:54:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:32 smithi057 ceph-mon[103313]: pgmap v358: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 1.13k op/s 2023-10-14T08:54:32.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:32 smithi006 ceph-mon[99452]: pgmap v358: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 28 MiB/s wr, 1.13k op/s 2023-10-14T08:54:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 -- 172.21.15.6:0/2211307885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 msgr2=0x7f4b581017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2211307885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581017d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009990 tx=0x7f4b48009ca0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 -- 172.21.15.6:0/2211307885 shutdown_connections 2023-10-14T08:54:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2211307885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b581009c0 0x7f4b58108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2211307885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581017d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2211307885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b58100000 0x7f4b58100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.791 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 -- 172.21.15.6:0/2211307885 >> 172.21.15.6:0/2211307885 conn(0x7f4b580faaf0 msgr2=0x7f4b580fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 -- 172.21.15.6:0/2211307885 shutdown_connections 2023-10-14T08:54:33.792 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.788+0000 7f4b5d077700 1 -- 172.21.15.6:0/2211307885 wait complete. 2023-10-14T08:54:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 Processor -- start 2023-10-14T08:54:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 -- start start 2023-10-14T08:54:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b58100000 0x7f4b5819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b581009c0 0x7f4b581a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b581a4db0 con 0x7f4b581009c0 2023-10-14T08:54:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5806a900 con 0x7f4b581013b0 2023-10-14T08:54:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.789+0000 7f4b5d077700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5806aac0 con 0x7f4b58100000 2023-10-14T08:54:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.790+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b581009c0 0x7f4b581a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.790+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b581009c0 0x7f4b581a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33882/0 (socket says 172.21.15.6:33882) 2023-10-14T08:54:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.790+0000 7f4b5659c700 1 -- 172.21.15.6:0/2924420175 learned_addr learned my addr 172.21.15.6:0/2924420175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.790+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b58100000 0x7f4b5819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.790+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5759e700 1 -- 172.21.15.6:0/2924420175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b58100000 msgr2=0x7f4b5819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b58100000 0x7f4b5819fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5759e700 1 -- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b581009c0 msgr2=0x7f4b581a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b581009c0 0x7f4b581a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.800 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5759e700 1 -- 172.21.15.6:0/2924420175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480095f0 con 0x7f4b581013b0 2023-10-14T08:54:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581a45e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000efc0 tx=0x7f4b5000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b3ffff700 1 -- 172.21.15.6:0/2924420175 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50018070 con 0x7f4b581013b0 2023-10-14T08:54:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b3ffff700 1 -- 172.21.15.6:0/2924420175 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b5000f040 con 0x7f4b581013b0 2023-10-14T08:54:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5806ad40 con 0x7f4b581013b0 2023-10-14T08:54:33.801 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b3ffff700 1 -- 172.21.15.6:0/2924420175 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000cd40 con 0x7f4b581013b0 2023-10-14T08:54:33.802 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.791+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5806b220 con 0x7f4b581013b0 2023-10-14T08:54:33.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.795+0000 7f4b3ffff700 1 -- 172.21.15.6:0/2924420175 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4b50003a00 con 0x7f4b581013b0 2023-10-14T08:54:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b3ffff700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b400a1480 0x7f4b400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 Processor -- start 2023-10-14T08:54:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 -- start start 2023-10-14T08:54:33.809 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b3ffff700 1 -- 172.21.15.6:0/2924420175 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4b500cc840 con 0x7f4b581013b0 2023-10-14T08:54:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b400a1480 0x7f4b400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebcfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebd01b0 0x5601cebd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebd1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ceb44c10 con 0x5601cebcf850 2023-10-14T08:54:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ceb29c00 con 0x5601cebd10a0 2023-10-14T08:54:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b69261b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ceb27520 con 0x5601cebd01b0 2023-10-14T08:54:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b56d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebcfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b56d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebcfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33886/0 (socket says 172.21.15.6:33886) 2023-10-14T08:54:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b56d9d700 1 -- 172.21.15.6:0/1384215952 learned_addr learned my addr 172.21.15.6:0/1384215952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b5659c700 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebd01b0 0x5601cebd0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.796+0000 7f4b5759e700 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebd1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b5659c700 1 -- 172.21.15.6:0/1384215952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 msgr2=0x5601cebd1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b5659c700 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebd1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b400a1480 0x7f4b400a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b48000c00 tx=0x7f4b480054f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b5659c700 1 -- 172.21.15.6:0/1384215952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 msgr2=0x5601cebcfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b5659c700 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebcfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b5659c700 1 -- 172.21.15.6:0/1384215952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601ceae0390 con 0x5601cebd01b0 2023-10-14T08:54:33.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebcfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:54:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b5659c700 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebd01b0 0x5601cebd0ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009d10 tx=0x7f4b4c011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17d5985db0b67f46 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b3d7fa700 1 -- 172.21.15.6:0/1384215952 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c004250 con 0x5601cebd01b0 2023-10-14T08:54:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b3d7fa700 1 -- 172.21.15.6:0/1384215952 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b4c004cf0 con 0x5601cebd01b0 2023-10-14T08:54:33.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.797+0000 7f4b3d7fa700 1 -- 172.21.15.6:0/1384215952 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c005460 con 0x5601cebd01b0 2023-10-14T08:54:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 -- 172.21.15.6:0/1384215952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebd01b0 msgr2=0x5601cebd0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebd01b0 0x5601cebd0ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009d10 tx=0x7f4b4c011720 comp rx=0 tx=0).stop 2023-10-14T08:54:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 -- 172.21.15.6:0/1384215952 shutdown_connections 2023-10-14T08:54:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebd1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebcfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1384215952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebd01b0 0x5601cebd0ac0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c009d10 tx=0x7f4b4c011720 comp rx=0 tx=0).stop 2023-10-14T08:54:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.798+0000 7f4b69261b80 1 -- 172.21.15.6:0/1384215952 >> 172.21.15.6:0/1384215952 conn(0x5601ceafdd70 msgr2=0x5601cebcac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.799+0000 7f4b69261b80 1 -- 172.21.15.6:0/1384215952 shutdown_connections 2023-10-14T08:54:33.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.799+0000 7f4b69261b80 1 -- 172.21.15.6:0/1384215952 wait complete. 2023-10-14T08:54:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 -- start start 2023-10-14T08:54:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 Processor -- start 2023-10-14T08:54:33.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebd9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebe12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ceb22e10 con 0x5601cebd10a0 2023-10-14T08:54:33.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ceabf6b0 con 0x5601cebdeee0 2023-10-14T08:54:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ceabf350 con 0x5601cebcf850 2023-10-14T08:54:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b69261b80 10 client.0 _ll_register_callbacks cb 0x5601ce91c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebd9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b56d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b5759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebe12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebd9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33894/0 (socket says 172.21.15.6:33894) 2023-10-14T08:54:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b5659c700 1 -- 172.21.15.6:0/2013355802 learned_addr learned my addr 172.21.15.6:0/2013355802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.800+0000 7f4b56d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59526/0 (socket says 172.21.15.6:59526) 2023-10-14T08:54:33.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b5759e700 1 -- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 msgr2=0x5601cebd9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b5759e700 1 -- 172.21.15.6:0/2013355802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 msgr2=0x5601cebd9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebd9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b5759e700 1 -- 172.21.15.6:0/2013355802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b48020040 con 0x5601cebdeee0 2023-10-14T08:54:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:54:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebe12d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c6f0 tx=0x7f4b500997a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6052627980364eab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:54:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b3aff5700 1 -- 172.21.15.6:0/2013355802 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000cea0 con 0x5601cebdeee0 2023-10-14T08:54:33.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601ceb27e90 con 0x5601cebdeee0 2023-10-14T08:54:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b3aff5700 1 -- 172.21.15.6:0/2013355802 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4b5001b320 con 0x5601cebdeee0 2023-10-14T08:54:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b3aff5700 1 -- 172.21.15.6:0/2013355802 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b5009a2f0 con 0x5601cebdeee0 2023-10-14T08:54:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b69261b80 10 client.25415 fetch_fsmap learned FSMap version 33 2023-10-14T08:54:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.801+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f4b4c009970 con 0x5601cebdeee0 2023-10-14T08:54:33.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b3aff5700 1 -- 172.21.15.6:0/2013355802 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5601ceb27e90 con 0x5601cebdeee0 2023-10-14T08:54:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b3aff5700 1 -- 172.21.15.6:0/2013355802 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4b500b2190 con 0x5601cebdeee0 2023-10-14T08:54:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b69261b80 10 client.25415 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:54:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b69261b80 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b69261b80 20 client.25415 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:33.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cebe5c40 0x5601cebe8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b69261b80 4 client.25415 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:54:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601ceb9fbb0 con 0x5601cebe5c40 2023-10-14T08:54:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.802+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cebe5c40 0x5601cebe8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.803+0000 7f4b3aff5700 10 client.25415 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.803+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cebe5c40 0x5601cebe8060 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6d4c3fc99cd94ce server_cookie=7d2c60dbe4665c3c in_seq=0 out_seq=0 2023-10-14T08:54:33.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.805+0000 7f4b3aff5700 1 -- 172.21.15.6:0/2013355802 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5601ceb9fbb0 con 0x5601cebe5c40 2023-10-14T08:54:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.805+0000 7f4b3aff5700 10 client.25415 handle_command_reply: tid=0 2023-10-14T08:54:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.805+0000 7f4b69261b80 1 client.25415 shutdown 2023-10-14T08:54:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 msgr2=0x5601cebe12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebe12d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c6f0 tx=0x7f4b500997a0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 shutdown_connections 2023-10-14T08:54:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cebe5c40 0x5601cebe8060 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebe12d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2013355802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebd9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 >> 172.21.15.6:0/2013355802 conn(0x5601ceafdd70 msgr2=0x5601cebca830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b3aff5700 0 client.25415 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 shutdown_connections 2023-10-14T08:54:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 1 -- 172.21.15.6:0/2013355802 wait complete. 2023-10-14T08:54:33.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.806+0000 7f4b69261b80 20 client.25415 trim_cache size 0 max 16384 2023-10-14T08:54:33.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 Processor -- start 2023-10-14T08:54:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 -- start start 2023-10-14T08:54:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebf5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601ce9a38c0 con 0x5601cebd10a0 2023-10-14T08:54:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cebd0590 con 0x5601cebdeee0 2023-10-14T08:54:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b69261b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cebf5da0 con 0x5601cebcf850 2023-10-14T08:54:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebf5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b5759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b5759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebc9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60894/0 (socket says 172.21.15.6:60894) 2023-10-14T08:54:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebf5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33902/0 (socket says 172.21.15.6:33902) 2023-10-14T08:54:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b5759e700 1 -- 172.21.15.6:0/2521601651 learned_addr learned my addr 172.21.15.6:0/2521601651 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.828+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b5759e700 1 -- 172.21.15.6:0/2521601651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 msgr2=0x5601cebd1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b5759e700 1 -- 172.21.15.6:0/2521601651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 msgr2=0x5601cebf5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebf5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b5759e700 1 -- 172.21.15.6:0/2521601651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601ce94dd80 con 0x5601cebdeee0 2023-10-14T08:54:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b5759e700 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebc9390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b50096660 tx=0x7f4b50004bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7983c8198f7ea8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b3dffb700 1 -- 172.21.15.6:0/2521601651 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500992e0 con 0x5601cebdeee0 2023-10-14T08:54:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b3dffb700 1 -- 172.21.15.6:0/2521601651 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b500b2020 con 0x5601cebdeee0 2023-10-14T08:54:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.829+0000 7f4b3dffb700 1 -- 172.21.15.6:0/2521601651 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a1cc0 con 0x5601cebdeee0 2023-10-14T08:54:33.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 -- 172.21.15.6:0/2521601651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 msgr2=0x5601cebc9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebc9390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4b50096660 tx=0x7f4b50004bb0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 -- 172.21.15.6:0/2521601651 shutdown_connections 2023-10-14T08:54:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebdeee0 0x5601cebc9390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebcf850 0x5601cebd1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 --2- 172.21.15.6:0/2521601651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebd10a0 0x5601cebf5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 -- 172.21.15.6:0/2521601651 >> 172.21.15.6:0/2521601651 conn(0x5601ceafdd70 msgr2=0x5601cebd0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 -- 172.21.15.6:0/2521601651 shutdown_connections 2023-10-14T08:54:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 -- 172.21.15.6:0/2521601651 wait complete. 2023-10-14T08:54:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.830+0000 7f4b69261b80 1 -- start start 2023-10-14T08:54:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 Processor -- start 2023-10-14T08:54:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebf2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebf3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebdeee0 0x5601cec381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cebf3590 con 0x5601cebcf850 2023-10-14T08:54:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cebf3700 con 0x5601cebd10a0 2023-10-14T08:54:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601cec49730 con 0x5601cebdeee0 2023-10-14T08:54:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b69261b80 10 client.0 _ll_register_callbacks cb 0x7f4b500999c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebf3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b5659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebf3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60898/0 (socket says 172.21.15.6:60898) 2023-10-14T08:54:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b5659c700 1 -- 172.21.15.6:0/1563076508 learned_addr learned my addr 172.21.15.6:0/1563076508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b5759e700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebdeee0 0x5601cec381b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.831+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebf2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b56d9d700 1 -- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebdeee0 msgr2=0x5601cec381b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebdeee0 0x5601cec381b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b56d9d700 1 -- 172.21.15.6:0/1563076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 msgr2=0x5601cebf3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebf3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b56d9d700 1 -- 172.21.15.6:0/1563076508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c009970 con 0x5601cebcf850 2023-10-14T08:54:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b56d9d700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebf2ae0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800b2e0 tx=0x7f4b48009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33a92c2880b5ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.832+0000 7f4b3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:54:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b3aff5700 1 -- 172.21.15.6:0/1563076508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4801d040 con 0x5601cebcf850 2023-10-14T08:54:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b3aff5700 1 -- 172.21.15.6:0/1563076508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4b4800be00 con 0x5601cebcf850 2023-10-14T08:54:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b4c004cf0 con 0x5601cebcf850 2023-10-14T08:54:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b3aff5700 1 -- 172.21.15.6:0/1563076508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b480353b0 con 0x5601cebcf850 2023-10-14T08:54:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 10 client.15780 fetch_fsmap learned FSMap version 33 2023-10-14T08:54:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5601ce936c00 con 0x5601cebcf850 2023-10-14T08:54:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b3aff5700 1 -- 172.21.15.6:0/1563076508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b4c004cf0 con 0x5601cebcf850 2023-10-14T08:54:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b3aff5700 1 -- 172.21.15.6:0/1563076508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f4b4800f460 con 0x5601cebcf850 2023-10-14T08:54:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 10 client.15780 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:54:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 20 client.15780 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cec4b180 0x5601cec4d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 4 client.15780 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:54:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.833+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5601ceb1bdf0 con 0x5601cec4b180 2023-10-14T08:54:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.834+0000 7f4b5659c700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cec4b180 0x5601cec4d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.849+0000 7f4b5659c700 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cec4b180 0x5601cec4d5a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c90211762d56ae server_cookie=795601b915bfef2e in_seq=0 out_seq=0 2023-10-14T08:54:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.849+0000 7f4b3aff5700 10 client.15780 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b3aff5700 1 -- 172.21.15.6:0/1563076508 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5601ceb1bdf0 con 0x5601cec4b180 2023-10-14T08:54:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b3aff5700 10 client.15780 handle_command_reply: tid=0 2023-10-14T08:54:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 client.15780 shutdown 2023-10-14T08:54:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 msgr2=0x5601cebf2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebf2ae0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800b2e0 tx=0x7f4b48009ca0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 shutdown_connections 2023-10-14T08:54:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5601cec4b180 0x5601cec4d5a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601cebdeee0 0x5601cec381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5601cebcf850 0x5601cebf2ae0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b3aff5700 0 client.15780 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 --2- 172.21.15.6:0/1563076508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5601cebd10a0 0x5601cebf3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 >> 172.21.15.6:0/1563076508 conn(0x5601ceafdd70 msgr2=0x5601cebda5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 shutdown_connections 2023-10-14T08:54:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.907+0000 7f4b69261b80 1 -- 172.21.15.6:0/1563076508 wait complete. 2023-10-14T08:54:33.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b69261b80 20 client.15780 trim_cache size 0 max 16384 2023-10-14T08:54:33.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:54:33.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:54:33.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:54:33.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:54:33.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b400a1480 msgr2=0x7f4b400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b400a1480 0x7f4b400a3940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4b48000c00 tx=0x7f4b480054f0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 msgr2=0x7f4b581a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:33.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581a45e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000efc0 tx=0x7f4b5000c3a0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 shutdown_connections 2023-10-14T08:54:33.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4b400a1480 0x7f4b400a3940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b581013b0 0x7f4b581a45e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b58100000 0x7f4b5819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 --2- 172.21.15.6:0/2924420175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b581009c0 0x7f4b581a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 >> 172.21.15.6:0/2924420175 conn(0x7f4b580faaf0 msgr2=0x7f4b580fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 shutdown_connections 2023-10-14T08:54:33.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:33.908+0000 7f4b5d077700 1 -- 172.21.15.6:0/2924420175 wait complete. 2023-10-14T08:54:34.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:34 smithi178 ceph-mon[103612]: pgmap v359: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 964 op/s 2023-10-14T08:54:34.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:34 smithi057 ceph-mon[103313]: pgmap v359: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 964 op/s 2023-10-14T08:54:34.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:34 smithi006 ceph-mon[99452]: pgmap v359: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 964 op/s 2023-10-14T08:54:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 95.0 s, 3279.4 tps, lat 30.457 ms stddev 61.557 2023-10-14T08:54:37.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:37 smithi057 ceph-mon[103313]: pgmap v360: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 MiB/s wr, 1.77k op/s 2023-10-14T08:54:37.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:37 smithi006 ceph-mon[99452]: pgmap v360: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 MiB/s wr, 1.77k op/s 2023-10-14T08:54:37.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:37 smithi178 ceph-mon[103612]: pgmap v360: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 MiB/s wr, 1.77k op/s 2023-10-14T08:54:39.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:39 smithi057 ceph-mon[103313]: pgmap v361: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 2.10k op/s 2023-10-14T08:54:39.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:39 smithi006 ceph-mon[99452]: pgmap v361: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 2.10k op/s 2023-10-14T08:54:39.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:39 smithi178 ceph-mon[103612]: pgmap v361: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 2.10k op/s 2023-10-14T08:54:40.965 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 100.0 s, 3862.6 tps, lat 25.864 ms stddev 28.443 2023-10-14T08:54:41.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:41 smithi057 ceph-mon[103313]: pgmap v362: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 49 MiB/s wr, 1.96k op/s 2023-10-14T08:54:41.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:41 smithi006 ceph-mon[99452]: pgmap v362: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 49 MiB/s wr, 1.96k op/s 2023-10-14T08:54:41.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:41 smithi178 ceph-mon[103612]: pgmap v362: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 49 MiB/s wr, 1.96k op/s 2023-10-14T08:54:43.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:43 smithi057 ceph-mon[103313]: pgmap v363: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 MiB/s wr, 2.07k op/s 2023-10-14T08:54:43.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:43 smithi006 ceph-mon[99452]: pgmap v363: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 MiB/s wr, 2.07k op/s 2023-10-14T08:54:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:43 smithi178 ceph-mon[103612]: pgmap v363: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 MiB/s wr, 2.07k op/s 2023-10-14T08:54:45.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:45 smithi057 ceph-mon[103313]: pgmap v364: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 MiB/s wr, 1.84k op/s 2023-10-14T08:54:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:45 smithi006 ceph-mon[99452]: pgmap v364: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 MiB/s wr, 1.84k op/s 2023-10-14T08:54:45.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:45 smithi178 ceph-mon[103612]: pgmap v364: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 MiB/s wr, 1.84k op/s 2023-10-14T08:54:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 105.0 s, 4396.8 tps, lat 22.790 ms stddev 25.917 2023-10-14T08:54:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.080+0000 7f3707c2f700 1 -- 172.21.15.6:0/3046105824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010cad0 msgr2=0x7f370010cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.080+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3046105824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010cad0 0x7f370010cf30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009920 tx=0x7f36f4009c30 comp rx=0 tx=0).stop 2023-10-14T08:54:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.081+0000 7f3707c2f700 1 -- 172.21.15.6:0/3046105824 shutdown_connections 2023-10-14T08:54:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.081+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3046105824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f370010d470 0x7f3700113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.081+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3046105824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370010b8e0 0x7f370010bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.081+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3046105824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010cad0 0x7f370010cf30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.081+0000 7f3707c2f700 1 -- 172.21.15.6:0/3046105824 >> 172.21.15.6:0/3046105824 conn(0x7f370006b780 msgr2=0x7f370006bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.081+0000 7f3707c2f700 1 -- 172.21.15.6:0/3046105824 shutdown_connections 2023-10-14T08:54:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.082+0000 7f3707c2f700 1 -- 172.21.15.6:0/3046105824 wait complete. 2023-10-14T08:54:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.082+0000 7f3707c2f700 1 Processor -- start 2023-10-14T08:54:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.082+0000 7f3707c2f700 1 -- start start 2023-10-14T08:54:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f3707c2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f370010b8e0 0x7f37001a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f3707c2f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370010cad0 0x7f37001a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f3707c2f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 0x7f37001ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f3707c2f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37001ad630 con 0x7f370010b8e0 2023-10-14T08:54:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f3707c2f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37001ad770 con 0x7f370010d470 2023-10-14T08:54:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f3707c2f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37001ad900 con 0x7f370010cad0 2023-10-14T08:54:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 0x7f37001ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 0x7f37001ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60910/0 (socket says 172.21.15.6:60910) 2023-10-14T08:54:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 -- 172.21.15.6:0/3208344919 learned_addr learned my addr 172.21.15.6:0/3208344919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37059cb700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f370010b8e0 0x7f37001a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37051ca700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370010cad0 0x7f37001a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 -- 172.21.15.6:0/3208344919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370010cad0 msgr2=0x7f37001a5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370010cad0 0x7f37001a5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 -- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f370010b8e0 msgr2=0x7f37001a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f370010b8e0 0x7f37001a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.083+0000 7f37061cc700 1 -- 172.21.15.6:0/3208344919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0009d00 con 0x7f370010d470 2023-10-14T08:54:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.084+0000 7f37061cc700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 0x7f37001ad060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36f000e3c0 tx=0x7f36f000e6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.084+0000 7f36feffd700 1 -- 172.21.15.6:0/3208344919 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00090d0 con 0x7f370010d470 2023-10-14T08:54:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.084+0000 7f36feffd700 1 -- 172.21.15.6:0/3208344919 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36f000f040 con 0x7f370010d470 2023-10-14T08:54:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.084+0000 7f36feffd700 1 -- 172.21.15.6:0/3208344919 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0007c20 con 0x7f370010d470 2023-10-14T08:54:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.084+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f4009520 con 0x7f370010d470 2023-10-14T08:54:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.085+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001adf10 con 0x7f370010d470 2023-10-14T08:54:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.087+0000 7f36feffd700 1 -- 172.21.15.6:0/3208344919 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f36f0003a00 con 0x7f370010d470 2023-10-14T08:54:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.088+0000 7f36feffd700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f36e80a1580 0x7f36e80a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.088+0000 7f36feffd700 1 -- 172.21.15.6:0/3208344919 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f36f00cca40 con 0x7f370010d470 2023-10-14T08:54:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.089+0000 7f37059cb700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f36e80a1580 0x7f36e80a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.089+0000 7f3713e19b80 1 Processor -- start 2023-10-14T08:54:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f37059cb700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f36e80a1580 0x7f36e80a3a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f370010c930 tx=0x7f36f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 -- start start 2023-10-14T08:54:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae70850 0x555c1ae70c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae71ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae72520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ade5c10 con 0x555c1ae70850 2023-10-14T08:54:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1adcac00 con 0x555c1ae720a0 2023-10-14T08:54:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f3713e19b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1adc8520 con 0x555c1ae711b0 2023-10-14T08:54:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f37061cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae72520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f37061cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae72520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60916/0 (socket says 172.21.15.6:60916) 2023-10-14T08:54:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.090+0000 7f37061cc700 1 -- 172.21.15.6:0/43440660 learned_addr learned my addr 172.21.15.6:0/43440660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37051ca700 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae71ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37059cb700 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae70850 0x555c1ae70c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37061cc700 1 -- 172.21.15.6:0/43440660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 msgr2=0x555c1ae71ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37061cc700 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae71ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37061cc700 1 -- 172.21.15.6:0/43440660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae70850 msgr2=0x555c1ae70c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37061cc700 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae70850 0x555c1ae70c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.091+0000 7f37061cc700 1 -- 172.21.15.6:0/43440660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c1ad81390 con 0x555c1ae720a0 2023-10-14T08:54:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.092+0000 7f37061cc700 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae72520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f36f0099d40 tx=0x7f36f0099b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11faf8231f85f736 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.092+0000 7f36e7fff700 1 -- 172.21.15.6:0/43440660 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0099db0 con 0x555c1ae720a0 2023-10-14T08:54:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.093+0000 7f36e7fff700 1 -- 172.21.15.6:0/43440660 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36f009df00 con 0x555c1ae720a0 2023-10-14T08:54:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.093+0000 7f36e7fff700 1 -- 172.21.15.6:0/43440660 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00092c0 con 0x555c1ae720a0 2023-10-14T08:54:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 -- 172.21.15.6:0/43440660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 msgr2=0x555c1ae72520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae72520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f36f0099d40 tx=0x7f36f0099b80 comp rx=0 tx=0).stop 2023-10-14T08:54:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 -- 172.21.15.6:0/43440660 shutdown_connections 2023-10-14T08:54:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae72520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae70850 0x555c1ae70c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 --2- 172.21.15.6:0/43440660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae71ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 -- 172.21.15.6:0/43440660 >> 172.21.15.6:0/43440660 conn(0x555c1ad9ed70 msgr2=0x555c1ae6bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 -- 172.21.15.6:0/43440660 shutdown_connections 2023-10-14T08:54:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 -- 172.21.15.6:0/43440660 wait complete. 2023-10-14T08:54:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 -- start start 2023-10-14T08:54:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.094+0000 7f3713e19b80 1 Processor -- start 2023-10-14T08:54:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae70850 0x555c1ae7a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae7acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae720a0 0x555c1ae81d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1adc3e10 con 0x555c1ae720a0 2023-10-14T08:54:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ad606b0 con 0x555c1ae70850 2023-10-14T08:54:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ad60350 con 0x555c1ae711b0 2023-10-14T08:54:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.095+0000 7f3713e19b80 10 client.0 _ll_register_callbacks cb 0x555c1abbd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae7acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae7acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59570/0 (socket says 172.21.15.6:59570) 2023-10-14T08:54:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 -- 172.21.15.6:0/2303811236 learned_addr learned my addr 172.21.15.6:0/2303811236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37059cb700 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae70850 0x555c1ae7a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 -- 172.21.15.6:0/2303811236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae70850 msgr2=0x555c1ae7a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae70850 0x555c1ae7a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 -- 172.21.15.6:0/2303811236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae720a0 msgr2=0x555c1ae81d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae720a0 0x555c1ae81d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.096+0000 7f37051ca700 1 -- 172.21.15.6:0/2303811236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001adf10 con 0x555c1ae711b0 2023-10-14T08:54:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f37051ca700 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae7acc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009920 tx=0x7f36f400b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69c4370ffae6cf5c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f36e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:54:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f36e57fa700 1 -- 172.21.15.6:0/2303811236 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4005240 con 0x555c1ae711b0 2023-10-14T08:54:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f36e57fa700 1 -- 172.21.15.6:0/2303811236 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f36f400bbc0 con 0x555c1ae711b0 2023-10-14T08:54:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c1adc8e90 con 0x555c1ae711b0 2023-10-14T08:54:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f36e57fa700 1 -- 172.21.15.6:0/2303811236 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f40053a0 con 0x555c1ae711b0 2023-10-14T08:54:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f3713e19b80 10 client.25486 fetch_fsmap learned FSMap version 33 2023-10-14T08:54:47.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x555c1abeed80 con 0x555c1ae711b0 2023-10-14T08:54:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.097+0000 7f36e57fa700 1 -- 172.21.15.6:0/2303811236 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36f4032020 con 0x555c1ae711b0 2023-10-14T08:54:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f36e57fa700 1 -- 172.21.15.6:0/2303811236 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f36f4015020 con 0x555c1ae711b0 2023-10-14T08:54:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f3713e19b80 10 client.25486 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:54:47.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f3713e19b80 10 client.25486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f3713e19b80 20 client.25486 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f3713e19b80 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1ae86730 0x555c1ae88b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f3713e19b80 4 client.25486 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:54:47.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c1ae40bb0 con 0x555c1ae86730 2023-10-14T08:54:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.098+0000 7f37059cb700 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1ae86730 0x555c1ae88b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.100+0000 7f37059cb700 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1ae86730 0x555c1ae88b50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1b13bc46ed345b3 server_cookie=cbc8900609b01541 in_seq=0 out_seq=0 2023-10-14T08:54:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.100+0000 7f36e57fa700 10 client.25486 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:47.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f36e57fa700 1 -- 172.21.15.6:0/2303811236 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c1ae40bb0 con 0x555c1ae86730 2023-10-14T08:54:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f36e57fa700 10 client.25486 handle_command_reply: tid=0 2023-10-14T08:54:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 client.25486 shutdown 2023-10-14T08:54:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 msgr2=0x555c1ae7acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae7acc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009920 tx=0x7f36f400b790 comp rx=0 tx=0).stop 2023-10-14T08:54:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 shutdown_connections 2023-10-14T08:54:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1ae86730 0x555c1ae88b50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae720a0 0x555c1ae81d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f36e57fa700 0 client.25486 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae70850 0x555c1ae7a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 --2- 172.21.15.6:0/2303811236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae711b0 0x555c1ae7acc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 >> 172.21.15.6:0/2303811236 conn(0x555c1ad9ed70 msgr2=0x555c1ae6b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 shutdown_connections 2023-10-14T08:54:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 1 -- 172.21.15.6:0/2303811236 wait complete. 2023-10-14T08:54:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.101+0000 7f3713e19b80 20 client.25486 trim_cache size 0 max 16384 2023-10-14T08:54:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 Processor -- start 2023-10-14T08:54:47.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 -- start start 2023-10-14T08:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae70c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae81c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ac448c0 con 0x555c1ae711b0 2023-10-14T08:54:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ae71f20 con 0x555c1ae720a0 2023-10-14T08:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.128+0000 7f3713e19b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ae79c30 con 0x555c1ae70850 2023-10-14T08:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae70c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae70c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59574/0 (socket says 172.21.15.6:59574) 2023-10-14T08:54:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 -- 172.21.15.6:0/3277557390 learned_addr learned my addr 172.21.15.6:0/3277557390 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37061cc700 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 -- 172.21.15.6:0/3277557390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 msgr2=0x555c1ae784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 -- 172.21.15.6:0/3277557390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 msgr2=0x555c1ae81c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae81c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.129+0000 7f37059cb700 1 -- 172.21.15.6:0/3277557390 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c1abd7c00 con 0x555c1ae70850 2023-10-14T08:54:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.130+0000 7f37059cb700 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae70c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x555c1ae89450 tx=0x7f36f8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809fc04b6d964628 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.130+0000 7f36fcd82700 1 -- 172.21.15.6:0/3277557390 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8023040 con 0x555c1ae70850 2023-10-14T08:54:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.130+0000 7f36fcd82700 1 -- 172.21.15.6:0/3277557390 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36f801de90 con 0x555c1ae70850 2023-10-14T08:54:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.130+0000 7f36fcd82700 1 -- 172.21.15.6:0/3277557390 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8028b40 con 0x555c1ae70850 2023-10-14T08:54:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 -- 172.21.15.6:0/3277557390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 msgr2=0x555c1ae70c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae70c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x555c1ae89450 tx=0x7f36f8014000 comp rx=0 tx=0).stop 2023-10-14T08:54:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 -- 172.21.15.6:0/3277557390 shutdown_connections 2023-10-14T08:54:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae70c30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 --2- 172.21.15.6:0/3277557390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae81c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 -- 172.21.15.6:0/3277557390 >> 172.21.15.6:0/3277557390 conn(0x555c1ad9ed70 msgr2=0x555c1ae793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 -- 172.21.15.6:0/3277557390 shutdown_connections 2023-10-14T08:54:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 -- 172.21.15.6:0/3277557390 wait complete. 2023-10-14T08:54:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.131+0000 7f3713e19b80 1 -- start start 2023-10-14T08:54:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 Processor -- start 2023-10-14T08:54:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae7fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae7ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae80f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ae81490 con 0x555c1ae711b0 2023-10-14T08:54:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ae81600 con 0x555c1ae720a0 2023-10-14T08:54:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c1ae817c0 con 0x555c1ae70850 2023-10-14T08:54:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f3713e19b80 10 client.0 _ll_register_callbacks cb 0x7f36f4009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:54:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f37059cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae7fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f37061cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae80f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f37051ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae7ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f37059cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae7fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59580/0 (socket says 172.21.15.6:59580) 2023-10-14T08:54:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.132+0000 7f37059cb700 1 -- 172.21.15.6:0/798871715 learned_addr learned my addr 172.21.15.6:0/798871715 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:54:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.133+0000 7f37059cb700 1 -- 172.21.15.6:0/798871715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 msgr2=0x555c1ae80f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.133+0000 7f37059cb700 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae80f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.133+0000 7f37059cb700 1 -- 172.21.15.6:0/798871715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 msgr2=0x555c1ae7ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:54:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.133+0000 7f37059cb700 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae7ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.133+0000 7f37059cb700 1 -- 172.21.15.6:0/798871715 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f8017070 con 0x555c1ae70850 2023-10-14T08:54:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.133+0000 7f37059cb700 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae7fa00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36f80094f0 tx=0x7f36f80283b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa91ebb399cf1131 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:54:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f36e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:54:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f36e57fa700 1 -- 172.21.15.6:0/798871715 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8023050 con 0x555c1ae70850 2023-10-14T08:54:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f36e57fa700 1 -- 172.21.15.6:0/798871715 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f36f801dca0 con 0x555c1ae70850 2023-10-14T08:54:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36f009df00 con 0x555c1ae70850 2023-10-14T08:54:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f36e57fa700 1 -- 172.21.15.6:0/798871715 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f8028900 con 0x555c1ae70850 2023-10-14T08:54:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f3713e19b80 10 client.25492 fetch_fsmap learned FSMap version 33 2023-10-14T08:54:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x555c1ac151f0 con 0x555c1ae70850 2023-10-14T08:54:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.134+0000 7f36e57fa700 1 -- 172.21.15.6:0/798871715 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36f009df00 con 0x555c1ae70850 2023-10-14T08:54:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f36e57fa700 1 -- 172.21.15.6:0/798871715 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f36f802e070 con 0x555c1ae70850 2023-10-14T08:54:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f3713e19b80 10 client.25492 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:54:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f3713e19b80 10 client.25492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:54:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f3713e19b80 20 client.25492 populate_metadata read hostname 'smithi006' 2023-10-14T08:54:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f3713e19b80 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1aeec650 0x555c1aeeea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:54:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f3713e19b80 4 client.25492 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:54:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555c1adbcdf0 con 0x555c1aeec650 2023-10-14T08:54:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f37051ca700 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1aeec650 0x555c1aeeea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:54:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f36e57fa700 10 client.25492 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:47.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.135+0000 7f37051ca700 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1aeec650 0x555c1aeeea70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a778b55d2dba5a9 server_cookie=57db60aea7e8777 in_seq=0 out_seq=0 2023-10-14T08:54:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.190+0000 7f36e57fa700 1 -- 172.21.15.6:0/798871715 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555c1adbcdf0 con 0x555c1aeec650 2023-10-14T08:54:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.190+0000 7f36e57fa700 10 client.25492 handle_command_reply: tid=0 2023-10-14T08:54:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.191+0000 7f3713e19b80 1 client.25492 shutdown 2023-10-14T08:54:47.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 msgr2=0x555c1ae7fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae7fa00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36f80094f0 tx=0x7f36f80283b0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 shutdown_connections 2023-10-14T08:54:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555c1aeec650 0x555c1aeeea70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555c1ae720a0 0x555c1ae80f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c1ae70850 0x555c1ae7fa00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 --2- 172.21.15.6:0/798871715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c1ae711b0 0x555c1ae7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 >> 172.21.15.6:0/798871715 conn(0x555c1ad9ed70 msgr2=0x555c1ae784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f36e57fa700 0 client.25492 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:54:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 shutdown_connections 2023-10-14T08:54:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 1 -- 172.21.15.6:0/798871715 wait complete. 2023-10-14T08:54:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.192+0000 7f3713e19b80 20 client.25492 trim_cache size 0 max 16384 2023-10-14T08:54:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:54:47.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:54:47.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:54:47.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:54:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f36e80a1580 msgr2=0x7f36e80a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f36e80a1580 0x7f36e80a3a40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f370010c930 tx=0x7f36f8009260 comp rx=0 tx=0).stop 2023-10-14T08:54:47.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 msgr2=0x7f37001ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:54:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 0x7f37001ad060 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f36f000e3c0 tx=0x7f36f000e6d0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 shutdown_connections 2023-10-14T08:54:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f36e80a1580 0x7f36e80a3a40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f370010d470 0x7f37001ad060 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f370010b8e0 0x7f37001a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 --2- 172.21.15.6:0/3208344919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f370010cad0 0x7f37001a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:54:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 >> 172.21.15.6:0/3208344919 conn(0x7f370006b780 msgr2=0x7f370010a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:54:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 shutdown_connections 2023-10-14T08:54:47.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:54:47.193+0000 7f3707c2f700 1 -- 172.21.15.6:0/3208344919 wait complete. 2023-10-14T08:54:47.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:47 smithi057 ceph-mon[103313]: pgmap v365: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 48 MiB/s wr, 2.00k op/s 2023-10-14T08:54:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:47 smithi006 ceph-mon[99452]: pgmap v365: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 48 MiB/s wr, 2.00k op/s 2023-10-14T08:54:47.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:47 smithi178 ceph-mon[103612]: pgmap v365: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 48 MiB/s wr, 2.00k op/s 2023-10-14T08:54:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:49 smithi006 ceph-mon[99452]: pgmap v366: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 29 MiB/s wr, 1.28k op/s 2023-10-14T08:54:49.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:49 smithi178 ceph-mon[103612]: pgmap v366: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 29 MiB/s wr, 1.28k op/s 2023-10-14T08:54:49.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:49 smithi057 ceph-mon[103313]: pgmap v366: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 29 MiB/s wr, 1.28k op/s 2023-10-14T08:54:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 110.0 s, 3876.4 tps, lat 25.786 ms stddev 27.038 2023-10-14T08:54:51.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:51 smithi006 ceph-mon[99452]: pgmap v367: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 792 op/s 2023-10-14T08:54:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:51 smithi178 ceph-mon[103612]: pgmap v367: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 792 op/s 2023-10-14T08:54:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:51 smithi057 ceph-mon[103313]: pgmap v367: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 792 op/s 2023-10-14T08:54:53.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:53 smithi178 ceph-mon[103612]: pgmap v368: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 960 op/s 2023-10-14T08:54:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:53 smithi057 ceph-mon[103313]: pgmap v368: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 960 op/s 2023-10-14T08:54:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:53 smithi006 ceph-mon[99452]: pgmap v368: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 960 op/s 2023-10-14T08:54:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:55 smithi178 ceph-mon[103612]: pgmap v369: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 785 op/s 2023-10-14T08:54:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:55 smithi057 ceph-mon[103313]: pgmap v369: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 785 op/s 2023-10-14T08:54:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:55 smithi006 ceph-mon[99452]: pgmap v369: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 785 op/s 2023-10-14T08:54:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 115.0 s, 3249.5 tps, lat 30.858 ms stddev 34.402 2023-10-14T08:54:57.642 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:57 smithi178 ceph-mon[103612]: pgmap v370: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 MiB/s wr, 1.02k op/s 2023-10-14T08:54:57.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:57 smithi057 ceph-mon[103313]: pgmap v370: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 MiB/s wr, 1.02k op/s 2023-10-14T08:54:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:57 smithi006 ceph-mon[99452]: pgmap v370: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 MiB/s wr, 1.02k op/s 2023-10-14T08:54:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:54:59 smithi178 ceph-mon[103612]: pgmap v371: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 967 op/s 2023-10-14T08:54:59.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:54:59 smithi057 ceph-mon[103313]: pgmap v371: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 967 op/s 2023-10-14T08:54:59.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:54:59 smithi006 ceph-mon[99452]: pgmap v371: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 MiB/s wr, 967 op/s 2023-10-14T08:55:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.336+0000 7f13ba702700 1 -- 172.21.15.6:0/728289250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b410a820 msgr2=0x7f13b410ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.336+0000 7f13ba702700 1 --2- 172.21.15.6:0/728289250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b410a820 0x7f13b410ccb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009990 tx=0x7f13a4009ca0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.337+0000 7f13ba702700 1 -- 172.21.15.6:0/728289250 shutdown_connections 2023-10-14T08:55:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.337+0000 7f13ba702700 1 --2- 172.21.15.6:0/728289250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 0x7f13b410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.337+0000 7f13ba702700 1 --2- 172.21.15.6:0/728289250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b4107eb0 0x7f13b410a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.337+0000 7f13ba702700 1 --2- 172.21.15.6:0/728289250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b410a820 0x7f13b410ccb0 secure :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009990 tx=0x7f13a4009ca0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.337+0000 7f13ba702700 1 -- 172.21.15.6:0/728289250 >> 172.21.15.6:0/728289250 conn(0x7f13b406dcf0 msgr2=0x7f13b4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.340+0000 7f13ba702700 1 -- 172.21.15.6:0/728289250 shutdown_connections 2023-10-14T08:55:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.341+0000 7f13ba702700 1 -- 172.21.15.6:0/728289250 wait complete. 2023-10-14T08:55:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 Processor -- start 2023-10-14T08:55:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 -- start start 2023-10-14T08:55:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b4107eb0 0x7f13b4117830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 0x7f13b4117d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b4118db0 0x7f13b4119230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4119770 con 0x7f13b4107eb0 2023-10-14T08:55:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41198e0 con 0x7f13b410d1f0 2023-10-14T08:55:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13ba702700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4119aa0 con 0x7f13b4118db0 2023-10-14T08:55:00.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b4107eb0 0x7f13b4117830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b4107eb0 0x7f13b4117830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33958/0 (socket says 172.21.15.6:33958) 2023-10-14T08:55:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.342+0000 7f13b3fff700 1 -- 172.21.15.6:0/1330156729 learned_addr learned my addr 172.21.15.6:0/1330156729 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b4118db0 0x7f13b4119230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b37fe700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 0x7f13b4117d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b37fe700 1 -- 172.21.15.6:0/1330156729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b4118db0 msgr2=0x7f13b4119230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b37fe700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b4118db0 0x7f13b4119230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b37fe700 1 -- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b4107eb0 msgr2=0x7f13b4117830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b37fe700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b4107eb0 0x7f13b4117830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.343+0000 7f13b37fe700 1 -- 172.21.15.6:0/1330156729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40095f0 con 0x7f13b410d1f0 2023-10-14T08:55:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.344+0000 7f13b37fe700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 0x7f13b4117d70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f13b4072320 tx=0x7f13a4003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.344+0000 7f13b17fa700 1 -- 172.21.15.6:0/1330156729 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40052c0 con 0x7f13b410d1f0 2023-10-14T08:55:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.344+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b411af50 con 0x7f13b410d1f0 2023-10-14T08:55:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.344+0000 7f13b17fa700 1 -- 172.21.15.6:0/1330156729 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a403f070 con 0x7f13b410d1f0 2023-10-14T08:55:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.344+0000 7f13b17fa700 1 -- 172.21.15.6:0/1330156729 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400fda0 con 0x7f13b410d1f0 2023-10-14T08:55:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.344+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b411b400 con 0x7f13b410d1f0 2023-10-14T08:55:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.349+0000 7f13b17fa700 1 -- 172.21.15.6:0/1330156729 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f13a4041030 con 0x7f13b410d1f0 2023-10-14T08:55:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 Processor -- start 2023-10-14T08:55:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 -- start start 2023-10-14T08:55:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8beac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bebac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bec520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8b5fc10 con 0x5646d8bec0a0 2023-10-14T08:55:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8b44c00 con 0x5646d8bea850 2023-10-14T08:55:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8b42520 con 0x5646d8beb1b0 2023-10-14T08:55:00.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b8c9f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8beac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b8c9f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8beac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60954/0 (socket says 172.21.15.6:60954) 2023-10-14T08:55:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b8c9f700 1 -- 172.21.15.6:0/2057458340 learned_addr learned my addr 172.21.15.6:0/2057458340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:00.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b17fa700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f139c0a15d0 0x7f139c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.350+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bebac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59598/0 (socket says 172.21.15.6:59598) 2023-10-14T08:55:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f139c0a15d0 0x7f139c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 -- 172.21.15.6:0/2057458340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 msgr2=0x5646d8bebac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bebac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 -- 172.21.15.6:0/2057458340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 msgr2=0x5646d8bec520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bec520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b17fa700 1 -- 172.21.15.6:0/1330156729 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f13a40ef730 con 0x7f13b410d1f0 2023-10-14T08:55:00.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 -- 172.21.15.6:0/2057458340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646d8afb390 con 0x5646d8bea850 2023-10-14T08:55:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8beac70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13ac010340 tx=0x7f13ac007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85d5e5eda47f53fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f139a7fc700 1 -- 172.21.15.6:0/2057458340 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac014810 con 0x5646d8bea850 2023-10-14T08:55:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f139a7fc700 1 -- 172.21.15.6:0/2057458340 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13ac00a030 con 0x5646d8bea850 2023-10-14T08:55:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.351+0000 7f139a7fc700 1 -- 172.21.15.6:0/2057458340 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac01e6d0 con 0x5646d8bea850 2023-10-14T08:55:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 -- 172.21.15.6:0/2057458340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 msgr2=0x5646d8beac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f139c0a15d0 0x7f139c0a3a90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13ac010fd0 tx=0x7f13ac018000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8beac70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13ac010340 tx=0x7f13ac007f90 comp rx=0 tx=0).stop 2023-10-14T08:55:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 -- 172.21.15.6:0/2057458340 shutdown_connections 2023-10-14T08:55:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8beac70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/2057458340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.352+0000 7f13c68ecb80 1 -- 172.21.15.6:0/2057458340 >> 172.21.15.6:0/2057458340 conn(0x5646d8b18d70 msgr2=0x5646d8be5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.353+0000 7f13c68ecb80 1 -- 172.21.15.6:0/2057458340 shutdown_connections 2023-10-14T08:55:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.353+0000 7f13c68ecb80 1 -- 172.21.15.6:0/2057458340 wait complete. 2023-10-14T08:55:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.353+0000 7f13c68ecb80 1 -- start start 2023-10-14T08:55:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.353+0000 7f13c68ecb80 1 Processor -- start 2023-10-14T08:55:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 0x5646d8bf4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8b3de10 con 0x5646d8beb1b0 2023-10-14T08:55:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8ada6b0 con 0x5646d8bea850 2023-10-14T08:55:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8ada350 con 0x5646d8bec0a0 2023-10-14T08:55:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13c68ecb80 10 client.0 _ll_register_callbacks cb 0x5646d89377a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 0x5646d8bf4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 0x5646d8bf4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33972/0 (socket says 172.21.15.6:33972) 2023-10-14T08:55:00.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 -- 172.21.15.6:0/783673235 learned_addr learned my addr 172.21.15.6:0/783673235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 -- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bec0a0 msgr2=0x5646d8bfbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 -- 172.21.15.6:0/783673235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 msgr2=0x5646d8bf4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b37fe700 1 -- 172.21.15.6:0/783673235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac007b80 con 0x5646d8beb1b0 2023-10-14T08:55:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.354+0000 7f13b8c9f700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:55:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13b37fe700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 0x5646d8bf4c90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f13a400b5c0 tx=0x7f13a4005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd198be23bfb2cba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:00.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13937fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:55:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13937fe700 1 -- 172.21.15.6:0/783673235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40c4b10 con 0x5646d8beb1b0 2023-10-14T08:55:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13937fe700 1 -- 172.21.15.6:0/783673235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f13a40c4da0 con 0x5646d8beb1b0 2023-10-14T08:55:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646d8b42e90 con 0x5646d8beb1b0 2023-10-14T08:55:00.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13937fe700 1 -- 172.21.15.6:0/783673235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13a4042e40 con 0x5646d8beb1b0 2023-10-14T08:55:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 10 client.15804 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5646d8968d80 con 0x5646d8beb1b0 2023-10-14T08:55:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13937fe700 1 -- 172.21.15.6:0/783673235 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646d8b42e90 con 0x5646d8beb1b0 2023-10-14T08:55:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13937fe700 1 -- 172.21.15.6:0/783673235 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f13a40bcd00 con 0x5646d8beb1b0 2023-10-14T08:55:00.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 10 client.15804 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 20 client.15804 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c00240 0x5646d8c02660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 4 client.15804 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:55:00.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.355+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646d8bbabb0 con 0x5646d8c00240 2023-10-14T08:55:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.356+0000 7f13b3fff700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c00240 0x5646d8c02660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.356+0000 7f13937fe700 10 client.15804 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.356+0000 7f13b3fff700 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c00240 0x5646d8c02660 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5e2a5ea2e8a447 server_cookie=543db369eca677a6 in_seq=0 out_seq=0 2023-10-14T08:55:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13937fe700 1 -- 172.21.15.6:0/783673235 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5646d8bbabb0 con 0x5646d8c00240 2023-10-14T08:55:00.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13937fe700 10 client.15804 handle_command_reply: tid=0 2023-10-14T08:55:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 client.15804 shutdown 2023-10-14T08:55:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 msgr2=0x5646d8bf4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 0x5646d8bf4c90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f13a400b5c0 tx=0x7f13a4005ab0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 shutdown_connections 2023-10-14T08:55:00.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c00240 0x5646d8c02660 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13937fe700 0 client.15804 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/783673235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8beb1b0 0x5646d8bf4c90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 >> 172.21.15.6:0/783673235 conn(0x5646d8b18d70 msgr2=0x5646d8be5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 shutdown_connections 2023-10-14T08:55:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.357+0000 7f13c68ecb80 1 -- 172.21.15.6:0/783673235 wait complete. 2023-10-14T08:55:00.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.358+0000 7f13c68ecb80 20 client.15804 trim_cache size 0 max 16384 2023-10-14T08:55:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 Processor -- start 2023-10-14T08:55:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 -- start start 2023-10-14T08:55:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 0x5646d8bef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8beb1b0 0x5646d8bef550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d89be8c0 con 0x5646d8bec0a0 2023-10-14T08:55:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8beb950 con 0x5646d8beb1b0 2023-10-14T08:55:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8bf5940 con 0x5646d8bea850 2023-10-14T08:55:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b8c9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 0x5646d8bef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b8c9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33982/0 (socket says 172.21.15.6:33982) 2023-10-14T08:55:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b8c9f700 1 -- 172.21.15.6:0/1538861759 learned_addr learned my addr 172.21.15.6:0/1538861759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:00.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b3fff700 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 0x5646d8bef010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59612/0 (socket says 172.21.15.6:59612) 2023-10-14T08:55:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b3fff700 1 -- 172.21.15.6:0/1538861759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8beb1b0 msgr2=0x5646d8bef550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:55:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.378+0000 7f13b3fff700 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8beb1b0 0x5646d8bef550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f13b3fff700 1 -- 172.21.15.6:0/1538861759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 msgr2=0x5646d8bfbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f13b3fff700 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f13b3fff700 1 -- 172.21.15.6:0/1538861759 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646d8951c00 con 0x5646d8bea850 2023-10-14T08:55:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f13b3fff700 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 0x5646d8bef010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5646d8c02c40 tx=0x7f13a8009210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7390c8e0fea6f2d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f139affd700 1 -- 172.21.15.6:0/1538861759 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a801e2d0 con 0x5646d8bea850 2023-10-14T08:55:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f139affd700 1 -- 172.21.15.6:0/1538861759 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a801c040 con 0x5646d8bea850 2023-10-14T08:55:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.379+0000 7f139affd700 1 -- 172.21.15.6:0/1538861759 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8015c80 con 0x5646d8bea850 2023-10-14T08:55:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 -- 172.21.15.6:0/1538861759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 msgr2=0x5646d8bef010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 0x5646d8bef010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5646d8c02c40 tx=0x7f13a8009210 comp rx=0 tx=0).stop 2023-10-14T08:55:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 -- 172.21.15.6:0/1538861759 shutdown_connections 2023-10-14T08:55:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8bea850 0x5646d8bef010 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/1538861759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8beb1b0 0x5646d8bef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 -- 172.21.15.6:0/1538861759 >> 172.21.15.6:0/1538861759 conn(0x5646d8b18d70 msgr2=0x5646d8bf24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 -- 172.21.15.6:0/1538861759 shutdown_connections 2023-10-14T08:55:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.380+0000 7f13c68ecb80 1 -- 172.21.15.6:0/1538861759 wait complete. 2023-10-14T08:55:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 -- start start 2023-10-14T08:55:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 Processor -- start 2023-10-14T08:55:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bfa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8bfb5f0 con 0x5646d8bec0a0 2023-10-14T08:55:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8bfb760 con 0x5646d8bea850 2023-10-14T08:55:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646d8bfb920 con 0x5646d8beb1b0 2023-10-14T08:55:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13c68ecb80 10 client.0 _ll_register_callbacks cb 0x5646d89377a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bfa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13b8c9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13b3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60974/0 (socket says 172.21.15.6:60974) 2023-10-14T08:55:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13b37fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bfa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59620/0 (socket says 172.21.15.6:59620) 2023-10-14T08:55:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.381+0000 7f13b3fff700 1 -- 172.21.15.6:0/955166299 learned_addr learned my addr 172.21.15.6:0/955166299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b3fff700 1 -- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 msgr2=0x5646d8bfa0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b3fff700 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bfa0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b3fff700 1 -- 172.21.15.6:0/955166299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 msgr2=0x5646d8bfb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b3fff700 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b3fff700 1 -- 172.21.15.6:0/955166299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a8009da0 con 0x5646d8bea850 2023-10-14T08:55:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b37fe700 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bfa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:55:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13b3fff700 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf9b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000c00 tx=0x7f13a8015c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d188fc1dabda08 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13937fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:55:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13937fe700 1 -- 172.21.15.6:0/955166299 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a802b070 con 0x5646d8bea850 2023-10-14T08:55:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13ac00a030 con 0x5646d8bea850 2023-10-14T08:55:00.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13937fe700 1 -- 172.21.15.6:0/955166299 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f13a8005a00 con 0x5646d8bea850 2023-10-14T08:55:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13937fe700 1 -- 172.21.15.6:0/955166299 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13a8005bc0 con 0x5646d8bea850 2023-10-14T08:55:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13c68ecb80 10 client.25451 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.382+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5646d898f1f0 con 0x5646d8bea850 2023-10-14T08:55:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13937fe700 1 -- 172.21.15.6:0/955166299 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a8036020 con 0x5646d8bea850 2023-10-14T08:55:00.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13937fe700 1 -- 172.21.15.6:0/955166299 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f13a802e020 con 0x5646d8bea850 2023-10-14T08:55:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13c68ecb80 10 client.25451 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13c68ecb80 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13c68ecb80 20 client.25451 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c551d0 0x5646d8c575f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13c68ecb80 4 client.25451 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:55:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646d8b36df0 con 0x5646d8c551d0 2023-10-14T08:55:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13b37fe700 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c551d0 0x5646d8c575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13937fe700 10 client.25451 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.383+0000 7f13b37fe700 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c551d0 0x5646d8c575f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79e05a1109260c9 server_cookie=5eb4cf12e63bfc3c in_seq=0 out_seq=0 2023-10-14T08:55:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13937fe700 1 -- 172.21.15.6:0/955166299 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646d8b36df0 con 0x5646d8c551d0 2023-10-14T08:55:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13937fe700 10 client.25451 handle_command_reply: tid=0 2023-10-14T08:55:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 client.25451 shutdown 2023-10-14T08:55:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 msgr2=0x5646d8bf9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf9b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000c00 tx=0x7f13a8015c30 comp rx=0 tx=0).stop 2023-10-14T08:55:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 shutdown_connections 2023-10-14T08:55:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5646d8c551d0 0x5646d8c575f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5646d8bec0a0 0x5646d8bfb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13937fe700 0 client.25451 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5646d8bea850 0x5646d8bf9b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 --2- 172.21.15.6:0/955166299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646d8beb1b0 0x5646d8bfa0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 >> 172.21.15.6:0/955166299 conn(0x5646d8b18d70 msgr2=0x5646d8bef010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:00.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.401+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 shutdown_connections 2023-10-14T08:55:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13c68ecb80 1 -- 172.21.15.6:0/955166299 wait complete. 2023-10-14T08:55:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13c68ecb80 20 client.25451 trim_cache size 0 max 16384 2023-10-14T08:55:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:55:00.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:55:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:55:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:55:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f139c0a15d0 msgr2=0x7f139c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f139c0a15d0 0x7f139c0a3a90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f13ac010fd0 tx=0x7f13ac018000 comp rx=0 tx=0).stop 2023-10-14T08:55:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 msgr2=0x7f13b4117d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:00.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 0x7f13b4117d70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f13b4072320 tx=0x7f13a4003cd0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 shutdown_connections 2023-10-14T08:55:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13b4118db0 0x7f13b4119230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13b4107eb0 0x7f13b4117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f139c0a15d0 0x7f139c0a3a90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 --2- 172.21.15.6:0/1330156729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b410d1f0 0x7f13b4117d70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:00.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 >> 172.21.15.6:0/1330156729 conn(0x7f13b406dcf0 msgr2=0x7f13b40700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:00.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 shutdown_connections 2023-10-14T08:55:00.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:00.402+0000 7f13ba702700 1 -- 172.21.15.6:0/1330156729 wait complete. 2023-10-14T08:55:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 120.0 s, 2746.6 tps, lat 35.919 ms stddev 66.414 2023-10-14T08:55:01.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:01 smithi178 ceph-mon[103612]: pgmap v372: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 931 op/s 2023-10-14T08:55:01.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:01 smithi057 ceph-mon[103313]: pgmap v372: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 931 op/s 2023-10-14T08:55:01.744 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:01 smithi006 ceph-mon[99452]: pgmap v372: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 MiB/s wr, 931 op/s 2023-10-14T08:55:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:03 smithi178 ceph-mon[103612]: pgmap v373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 40 MiB/s wr, 1.60k op/s 2023-10-14T08:55:03.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:03 smithi057 ceph-mon[103313]: pgmap v373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 40 MiB/s wr, 1.60k op/s 2023-10-14T08:55:03.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:03 smithi006 ceph-mon[99452]: pgmap v373: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 40 MiB/s wr, 1.60k op/s 2023-10-14T08:55:04.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:04 smithi178 ceph-mon[103612]: pgmap v374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 40 MiB/s wr, 1.55k op/s 2023-10-14T08:55:04.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:04 smithi057 ceph-mon[103313]: pgmap v374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 40 MiB/s wr, 1.55k op/s 2023-10-14T08:55:04.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:04 smithi006 ceph-mon[99452]: pgmap v374: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 40 MiB/s wr, 1.55k op/s 2023-10-14T08:55:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 125.0 s, 3514.9 tps, lat 28.745 ms stddev 30.449 2023-10-14T08:55:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:07 smithi006 ceph-mon[99452]: pgmap v375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 MiB/s wr, 2.14k op/s 2023-10-14T08:55:07.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:07 smithi178 ceph-mon[103612]: pgmap v375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 MiB/s wr, 2.14k op/s 2023-10-14T08:55:07.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:07 smithi057 ceph-mon[103313]: pgmap v375: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 MiB/s wr, 2.14k op/s 2023-10-14T08:55:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:09 smithi006 ceph-mon[99452]: pgmap v376: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 2.01k op/s 2023-10-14T08:55:09.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:09 smithi178 ceph-mon[103612]: pgmap v376: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 2.01k op/s 2023-10-14T08:55:09.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:09 smithi057 ceph-mon[103313]: pgmap v376: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 2.01k op/s 2023-10-14T08:55:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 130.0 s, 3588.0 tps, lat 27.949 ms stddev 28.937 2023-10-14T08:55:11.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:11 smithi178 ceph-mon[103612]: pgmap v377: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 MiB/s wr, 1.95k op/s 2023-10-14T08:55:11.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:11 smithi057 ceph-mon[103313]: pgmap v377: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 MiB/s wr, 1.95k op/s 2023-10-14T08:55:11.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:11 smithi006 ceph-mon[99452]: pgmap v377: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 MiB/s wr, 1.95k op/s 2023-10-14T08:55:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.583+0000 7f35c3058700 1 -- 172.21.15.6:0/2793451271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc10f730 msgr2=0x7f35bc111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.583+0000 7f35c3058700 1 --2- 172.21.15.6:0/2793451271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc10f730 0x7f35bc111b20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f35b400b0a0 tx=0x7f35b400b3b0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 -- 172.21.15.6:0/2793451271 shutdown_connections 2023-10-14T08:55:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 --2- 172.21.15.6:0/2793451271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc10f730 0x7f35bc111b20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 --2- 172.21.15.6:0/2793451271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc107eb0 0x7f35bc1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 --2- 172.21.15.6:0/2793451271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35bc108810 0x7f35bc10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 -- 172.21.15.6:0/2793451271 >> 172.21.15.6:0/2793451271 conn(0x7f35bc06dcf0 msgr2=0x7f35bc070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 -- 172.21.15.6:0/2793451271 shutdown_connections 2023-10-14T08:55:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.586+0000 7f35c3058700 1 -- 172.21.15.6:0/2793451271 wait complete. 2023-10-14T08:55:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 Processor -- start 2023-10-14T08:55:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 -- start start 2023-10-14T08:55:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc107eb0 0x7f35bc1a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35bc108810 0x7f35bc1a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc10f730 0x7f35bc1ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1ad680 con 0x7f35bc107eb0 2023-10-14T08:55:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1ad7c0 con 0x7f35bc10f730 2023-10-14T08:55:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c3058700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc1ad950 con 0x7f35bc108810 2023-10-14T08:55:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c0df4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc107eb0 0x7f35bc1a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c0df4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc107eb0 0x7f35bc1a5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33998/0 (socket says 172.21.15.6:33998) 2023-10-14T08:55:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c0df4700 1 -- 172.21.15.6:0/271545334 learned_addr learned my addr 172.21.15.6:0/271545334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c15f5700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc10f730 0x7f35bc1ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35bbfff700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35bc108810 0x7f35bc1a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c15f5700 1 -- 172.21.15.6:0/271545334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35bc108810 msgr2=0x7f35bc1a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c15f5700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35bc108810 0x7f35bc1a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c15f5700 1 -- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc107eb0 msgr2=0x7f35bc1a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c15f5700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc107eb0 0x7f35bc1a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.587+0000 7f35c15f5700 1 -- 172.21.15.6:0/271545334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009d00 con 0x7f35bc10f730 2023-10-14T08:55:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.588+0000 7f35c15f5700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc10f730 0x7f35bc1ad0b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35b400b070 tx=0x7f35b400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.588+0000 7f35b9ffb700 1 -- 172.21.15.6:0/271545334 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400e040 con 0x7f35bc10f730 2023-10-14T08:55:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.588+0000 7f35b9ffb700 1 -- 172.21.15.6:0/271545334 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35b4003e10 con 0x7f35bc10f730 2023-10-14T08:55:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.588+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35bc1adbd0 con 0x7f35bc10f730 2023-10-14T08:55:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.588+0000 7f35b9ffb700 1 -- 172.21.15.6:0/271545334 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4005280 con 0x7f35bc10f730 2023-10-14T08:55:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.588+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc1adfa0 con 0x7f35bc10f730 2023-10-14T08:55:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.591+0000 7f35b9ffb700 1 -- 172.21.15.6:0/271545334 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f35b40053e0 con 0x7f35bc10f730 2023-10-14T08:55:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.591+0000 7f35b9ffb700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35ac0a1480 0x7f35ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.592+0000 7f35b9ffb700 1 -- 172.21.15.6:0/271545334 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f35b40ce100 con 0x7f35bc10f730 2023-10-14T08:55:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.592+0000 7f35c0df4700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35ac0a1480 0x7f35ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.592+0000 7f35c0df4700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35ac0a1480 0x7f35ac0a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35b0005950 tx=0x7f35b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 Processor -- start 2023-10-14T08:55:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 -- start start 2023-10-14T08:55:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e07834850 0x561e07834c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07835ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07836520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e077a9c10 con 0x561e078360a0 2023-10-14T08:55:13.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0778ec00 con 0x561e078351b0 2023-10-14T08:55:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.593+0000 7f35cf242b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0778c520 con 0x561e07834850 2023-10-14T08:55:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.594+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07835ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.594+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07835ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:60996/0 (socket says 172.21.15.6:60996) 2023-10-14T08:55:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.594+0000 7f35bbfff700 1 -- 172.21.15.6:0/2773508388 learned_addr learned my addr 172.21.15.6:0/2773508388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.594+0000 7f35c15f5700 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07836520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.595+0000 7f35c15f5700 1 -- 172.21.15.6:0/2773508388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e07834850 msgr2=0x561e07834c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.595+0000 7f35c15f5700 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e07834850 0x561e07834c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.595+0000 7f35c15f5700 1 -- 172.21.15.6:0/2773508388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 msgr2=0x561e07835ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.595+0000 7f35c15f5700 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07835ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.595+0000 7f35c15f5700 1 -- 172.21.15.6:0/2773508388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e07745390 con 0x561e078360a0 2023-10-14T08:55:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.595+0000 7f35c15f5700 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07836520 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009fd0 tx=0x7f35b401dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac0d18406f4d1e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.596+0000 7f35a6ffd700 1 -- 172.21.15.6:0/2773508388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b409b4b0 con 0x561e078360a0 2023-10-14T08:55:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.596+0000 7f35a6ffd700 1 -- 172.21.15.6:0/2773508388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35b409f600 con 0x561e078360a0 2023-10-14T08:55:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.596+0000 7f35a6ffd700 1 -- 172.21.15.6:0/2773508388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b409ac00 con 0x561e078360a0 2023-10-14T08:55:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 -- 172.21.15.6:0/2773508388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 msgr2=0x561e07836520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07836520 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009fd0 tx=0x7f35b401dce0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 -- 172.21.15.6:0/2773508388 shutdown_connections 2023-10-14T08:55:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07836520 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e07834850 0x561e07834c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 --2- 172.21.15.6:0/2773508388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07835ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.597+0000 7f35cf242b80 1 -- 172.21.15.6:0/2773508388 >> 172.21.15.6:0/2773508388 conn(0x561e07762d70 msgr2=0x561e0782fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.598+0000 7f35cf242b80 1 -- 172.21.15.6:0/2773508388 shutdown_connections 2023-10-14T08:55:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.598+0000 7f35cf242b80 1 -- 172.21.15.6:0/2773508388 wait complete. 2023-10-14T08:55:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.598+0000 7f35cf242b80 1 -- start start 2023-10-14T08:55:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.598+0000 7f35cf242b80 1 Processor -- start 2023-10-14T08:55:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e0783e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e0783eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07845b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e07787e10 con 0x561e07834850 2023-10-14T08:55:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e077246b0 con 0x561e078351b0 2023-10-14T08:55:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e07724350 con 0x561e078360a0 2023-10-14T08:55:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35cf242b80 10 client.0 _ll_register_callbacks cb 0x561e075817a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e0783eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e0783eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32768/0 (socket says 172.21.15.6:32768) 2023-10-14T08:55:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35c0df4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e0783e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 -- 172.21.15.6:0/3846760402 learned_addr learned my addr 172.21.15.6:0/3846760402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35c15f5700 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07845b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 -- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 msgr2=0x561e07845b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:13.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07845b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 -- 172.21.15.6:0/3846760402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 msgr2=0x561e0783e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e0783e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.599+0000 7f35bbfff700 1 -- 172.21.15.6:0/3846760402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc1adfa0 con 0x561e078351b0 2023-10-14T08:55:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35bbfff700 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e0783eb00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f35a800bfa0 tx=0x7f35a80116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed590cef2d68c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:13.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f359bfff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:55:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f359bfff700 1 -- 172.21.15.6:0/3846760402 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8012450 con 0x561e078351b0 2023-10-14T08:55:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f359bfff700 1 -- 172.21.15.6:0/3846760402 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f35a80125b0 con 0x561e078351b0 2023-10-14T08:55:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e0778ce90 con 0x561e078351b0 2023-10-14T08:55:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f359bfff700 1 -- 172.21.15.6:0/3846760402 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35a8012770 con 0x561e078351b0 2023-10-14T08:55:13.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 10 client.25463 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x561e075b2d80 con 0x561e078351b0 2023-10-14T08:55:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f359bfff700 1 -- 172.21.15.6:0/3846760402 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e0778ce90 con 0x561e078351b0 2023-10-14T08:55:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f359bfff700 1 -- 172.21.15.6:0/3846760402 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f35a801ba30 con 0x561e078351b0 2023-10-14T08:55:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 10 client.25463 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:13.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 20 client.25463 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:13.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e0784a580 0x561e0784c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 4 client.25463 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:55:13.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.600+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e07804bb0 con 0x561e0784a580 2023-10-14T08:55:13.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.601+0000 7f35c0df4700 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e0784a580 0x561e0784c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.605+0000 7f359bfff700 10 client.25463 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:13.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.605+0000 7f35c0df4700 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e0784a580 0x561e0784c9a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=428b8de325f37779 server_cookie=71f8267d6d6f15ed in_seq=0 out_seq=0 2023-10-14T08:55:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.605+0000 7f359bfff700 1 -- 172.21.15.6:0/3846760402 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e07804bb0 con 0x561e0784a580 2023-10-14T08:55:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.605+0000 7f359bfff700 10 client.25463 handle_command_reply: tid=0 2023-10-14T08:55:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.605+0000 7f35cf242b80 1 client.25463 shutdown 2023-10-14T08:55:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.605+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 msgr2=0x561e0783eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e0783eb00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f35a800bfa0 tx=0x7f35a80116c0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 shutdown_connections 2023-10-14T08:55:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e0784a580 0x561e0784c9a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07845b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e0783e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f359bfff700 0 client.25463 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 --2- 172.21.15.6:0/3846760402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e0783eb00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 >> 172.21.15.6:0/3846760402 conn(0x561e07762d70 msgr2=0x561e0782f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 shutdown_connections 2023-10-14T08:55:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 1 -- 172.21.15.6:0/3846760402 wait complete. 2023-10-14T08:55:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.606+0000 7f35cf242b80 20 client.25463 trim_cache size 0 max 16384 2023-10-14T08:55:13.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.632+0000 7f35cf242b80 1 Processor -- start 2023-10-14T08:55:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.633+0000 7f35cf242b80 1 -- start start 2023-10-14T08:55:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e07834850 0x561e07839080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078351b0 0x561e078395c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07845a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35cf242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e076088c0 con 0x561e078360a0 2023-10-14T08:55:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35cf242b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e07835950 con 0x561e07834850 2023-10-14T08:55:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35cf242b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e07835f20 con 0x561e078351b0 2023-10-14T08:55:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35c15f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07845a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35c15f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07845a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34018/0 (socket says 172.21.15.6:34018) 2023-10-14T08:55:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.634+0000 7f35c15f5700 1 -- 172.21.15.6:0/1344809470 learned_addr learned my addr 172.21.15.6:0/1344809470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.635+0000 7f35c15f5700 1 -- 172.21.15.6:0/1344809470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078351b0 msgr2=0x561e078395c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.635+0000 7f35c15f5700 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078351b0 0x561e078395c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.635+0000 7f35c15f5700 1 -- 172.21.15.6:0/1344809470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e07834850 msgr2=0x561e07839080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.635+0000 7f35c15f5700 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e07834850 0x561e07839080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.635+0000 7f35c15f5700 1 -- 172.21.15.6:0/1344809470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e0759bc00 con 0x561e078360a0 2023-10-14T08:55:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.635+0000 7f35c15f5700 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07845a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f35b409b3f0 tx=0x7f35b40860d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f971f67d6c2a44d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:13.644 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:13 smithi178 ceph-mon[103612]: pgmap v378: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 MiB/s wr, 2.03k op/s 2023-10-14T08:55:13.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.642+0000 7f35a77fe700 1 -- 172.21.15.6:0/1344809470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b409b4b0 con 0x561e078360a0 2023-10-14T08:55:13.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.642+0000 7f35a77fe700 1 -- 172.21.15.6:0/1344809470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35b40a37b0 con 0x561e078360a0 2023-10-14T08:55:13.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.642+0000 7f35a77fe700 1 -- 172.21.15.6:0/1344809470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40a3320 con 0x561e078360a0 2023-10-14T08:55:13.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.647+0000 7f35cf242b80 1 -- 172.21.15.6:0/1344809470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 msgr2=0x561e07845a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.647+0000 7f35cf242b80 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07845a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f35b409b3f0 tx=0x7f35b40860d0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 -- 172.21.15.6:0/1344809470 shutdown_connections 2023-10-14T08:55:13.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e078360a0 0x561e07845a60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e07834850 0x561e07839080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 --2- 172.21.15.6:0/1344809470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078351b0 0x561e078395c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 -- 172.21.15.6:0/1344809470 >> 172.21.15.6:0/1344809470 conn(0x561e07762d70 msgr2=0x561e0783d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:13.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 -- 172.21.15.6:0/1344809470 shutdown_connections 2023-10-14T08:55:13.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.649+0000 7f35cf242b80 1 -- 172.21.15.6:0/1344809470 wait complete. 2023-10-14T08:55:13.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.650+0000 7f35cf242b80 1 -- start start 2023-10-14T08:55:13.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.650+0000 7f35cf242b80 1 Processor -- start 2023-10-14T08:55:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e07841600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07841b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07844b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e078450a0 con 0x561e07834850 2023-10-14T08:55:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e07845210 con 0x561e078351b0 2023-10-14T08:55:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e078453d0 con 0x561e078360a0 2023-10-14T08:55:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.651+0000 7f35cf242b80 10 client.0 _ll_register_callbacks cb 0x7f35a800b9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.652+0000 7f35bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07841b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.652+0000 7f35c15f5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07844b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.652+0000 7f35c15f5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07844b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59656/0 (socket says 172.21.15.6:59656) 2023-10-14T08:55:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.652+0000 7f35c15f5700 1 -- 172.21.15.6:0/722950245 learned_addr learned my addr 172.21.15.6:0/722950245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35bbfff700 1 -- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 msgr2=0x561e07844b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35bbfff700 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07844b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35bbfff700 1 -- 172.21.15.6:0/722950245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 msgr2=0x561e07841600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35bbfff700 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e07841600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35bbfff700 1 -- 172.21.15.6:0/722950245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e07745390 con 0x561e078351b0 2023-10-14T08:55:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35bbfff700 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07841b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35a801bd90 tx=0x7f35a800b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6cc578f47e33b36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f359bfff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:55:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f359bfff700 1 -- 172.21.15.6:0/722950245 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a801b630 con 0x561e078351b0 2023-10-14T08:55:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35b409f600 con 0x561e078351b0 2023-10-14T08:55:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.653+0000 7f359bfff700 1 -- 172.21.15.6:0/722950245 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f35a8000e40 con 0x561e078351b0 2023-10-14T08:55:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.654+0000 7f359bfff700 1 -- 172.21.15.6:0/722950245 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35a801b790 con 0x561e078351b0 2023-10-14T08:55:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.657+0000 7f35cf242b80 10 client.25466 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.657+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x561e075d91f0 con 0x561e078351b0 2023-10-14T08:55:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f359bfff700 1 -- 172.21.15.6:0/722950245 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35b409f600 con 0x561e078351b0 2023-10-14T08:55:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f359bfff700 1 -- 172.21.15.6:0/722950245 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f35a8012450 con 0x561e078351b0 2023-10-14T08:55:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f35cf242b80 10 client.25466 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f35cf242b80 10 client.25466 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f35cf242b80 20 client.25466 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f35cf242b80 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e078b0280 0x561e078b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f35cf242b80 4 client.25466 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:55:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.658+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e07780df0 con 0x561e078b0280 2023-10-14T08:55:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.659+0000 7f35c0df4700 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e078b0280 0x561e078b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.660+0000 7f359bfff700 10 client.25466 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.660+0000 7f35c0df4700 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e078b0280 0x561e078b26a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d95bd7dcd40f27b server_cookie=30d44a0cbf42c425 in_seq=0 out_seq=0 2023-10-14T08:55:13.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.687+0000 7f359bfff700 1 -- 172.21.15.6:0/722950245 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e07780df0 con 0x561e078b0280 2023-10-14T08:55:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.687+0000 7f359bfff700 10 client.25466 handle_command_reply: tid=0 2023-10-14T08:55:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 client.25466 shutdown 2023-10-14T08:55:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 msgr2=0x561e07841b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07841b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35a801bd90 tx=0x7f35a800b3a0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 shutdown_connections 2023-10-14T08:55:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561e078b0280 0x561e078b26a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561e078360a0 0x561e07844b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e07834850 0x561e07841600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f359bfff700 0 client.25466 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 --2- 172.21.15.6:0/722950245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e078351b0 0x561e07841b40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 >> 172.21.15.6:0/722950245 conn(0x561e07762d70 msgr2=0x561e0783d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 shutdown_connections 2023-10-14T08:55:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 1 -- 172.21.15.6:0/722950245 wait complete. 2023-10-14T08:55:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.688+0000 7f35cf242b80 20 client.25466 trim_cache size 0 max 16384 2023-10-14T08:55:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:55:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:55:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:55:13.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:55:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35ac0a1480 msgr2=0x7f35ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35ac0a1480 0x7f35ac0a3940 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35b0005950 tx=0x7f35b0009260 comp rx=0 tx=0).stop 2023-10-14T08:55:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc10f730 msgr2=0x7f35bc1ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc10f730 0x7f35bc1ad0b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35b400b070 tx=0x7f35b400bc80 comp rx=0 tx=0).stop 2023-10-14T08:55:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 shutdown_connections 2023-10-14T08:55:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f35ac0a1480 0x7f35ac0a3940 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35bc10f730 0x7f35bc1ad0b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35bc107eb0 0x7f35bc1a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 --2- 172.21.15.6:0/271545334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35bc108810 0x7f35bc1a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.689+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 >> 172.21.15.6:0/271545334 conn(0x7f35bc06dcf0 msgr2=0x7f35bc06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.690+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 shutdown_connections 2023-10-14T08:55:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:13.690+0000 7f35c3058700 1 -- 172.21.15.6:0/271545334 wait complete. 2023-10-14T08:55:13.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:13 smithi057 ceph-mon[103313]: pgmap v378: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 MiB/s wr, 2.03k op/s 2023-10-14T08:55:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:13 smithi006 ceph-mon[99452]: pgmap v378: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 MiB/s wr, 2.03k op/s 2023-10-14T08:55:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:15 smithi178 ceph-mon[103612]: pgmap v379: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 1.32k op/s 2023-10-14T08:55:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:15 smithi057 ceph-mon[103313]: pgmap v379: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 1.32k op/s 2023-10-14T08:55:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:15 smithi006 ceph-mon[99452]: pgmap v379: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 1.32k op/s 2023-10-14T08:55:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 135.0 s, 3457.0 tps, lat 28.766 ms stddev 34.402 2023-10-14T08:55:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:17 smithi178 ceph-mon[103612]: pgmap v380: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 MiB/s wr, 1.33k op/s 2023-10-14T08:55:17.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:17 smithi057 ceph-mon[103313]: pgmap v380: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 MiB/s wr, 1.33k op/s 2023-10-14T08:55:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:17 smithi006 ceph-mon[99452]: pgmap v380: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 31 MiB/s wr, 1.33k op/s 2023-10-14T08:55:18.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:18 smithi178 ceph-mon[103612]: pgmap v381: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 886 op/s 2023-10-14T08:55:18.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:18 smithi057 ceph-mon[103313]: pgmap v381: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 886 op/s 2023-10-14T08:55:18.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:18 smithi006 ceph-mon[99452]: pgmap v381: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 886 op/s 2023-10-14T08:55:20.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:20 smithi178 ceph-mon[103612]: pgmap v382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 884 op/s 2023-10-14T08:55:20.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:20 smithi057 ceph-mon[103313]: pgmap v382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 884 op/s 2023-10-14T08:55:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 140.0 s, 2688.2 tps, lat 37.177 ms stddev 42.988 2023-10-14T08:55:20.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:20 smithi006 ceph-mon[99452]: pgmap v382: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 884 op/s 2023-10-14T08:55:23.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:23 smithi057 ceph-mon[103313]: pgmap v383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.09k op/s 2023-10-14T08:55:23.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:23 smithi006 ceph-mon[99452]: pgmap v383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.09k op/s 2023-10-14T08:55:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:23 smithi178 ceph-mon[103612]: pgmap v383: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.09k op/s 2023-10-14T08:55:25.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:25 smithi006 ceph-mon[99452]: pgmap v384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 967 op/s 2023-10-14T08:55:25.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:25 smithi178 ceph-mon[103612]: pgmap v384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 967 op/s 2023-10-14T08:55:25.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:25 smithi057 ceph-mon[103313]: pgmap v384: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 967 op/s 2023-10-14T08:55:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 145.0 s, 2309.4 tps, lat 43.441 ms stddev 70.929 2023-10-14T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/3443460775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 msgr2=0x7f5b58101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/3443460775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b58101ba0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098f0 tx=0x7f5b48009c00 comp rx=0 tx=0).stop 2023-10-14T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/3443460775 shutdown_connections 2023-10-14T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/3443460775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b58104ab0 0x7f5b58104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/3443460775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b58101ba0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/3443460775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b581020e0 0x7f5b58104570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/3443460775 >> 172.21.15.6:0/3443460775 conn(0x7f5b580fb390 msgr2=0x7f5b580fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/3443460775 shutdown_connections 2023-10-14T08:55:26.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.868+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/3443460775 wait complete. 2023-10-14T08:55:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.869+0000 7f5b5e7ae700 1 Processor -- start 2023-10-14T08:55:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.869+0000 7f5b5e7ae700 1 -- start start 2023-10-14T08:55:26.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5e7ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b581b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5e7ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 0x7f5b581bb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5e7ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b58104ab0 0x7f5b581bde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5e7ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581be5a0 con 0x7f5b580ff770 2023-10-14T08:55:26.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5e7ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581be710 con 0x7f5b58104ab0 2023-10-14T08:55:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5e7ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581be8d0 con 0x7f5b581020e0 2023-10-14T08:55:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 0x7f5b581bb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 0x7f5b581bb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59668/0 (socket says 172.21.15.6:59668) 2023-10-14T08:55:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 -- 172.21.15.6:0/55306274 learned_addr learned my addr 172.21.15.6:0/55306274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:26.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b58104ab0 0x7f5b581bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 -- 172.21.15.6:0/55306274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b58104ab0 msgr2=0x7f5b581bde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b58104ab0 0x7f5b581bde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 -- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 msgr2=0x7f5b581b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b57fff700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b581b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b581b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b577fe700 1 -- 172.21.15.6:0/55306274 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5001ad10 con 0x7f5b581020e0 2023-10-14T08:55:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.870+0000 7f5b57fff700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b581b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:55:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.871+0000 7f5b577fe700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 0x7f5b581bb830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e9a0 tx=0x7f5b4c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:26.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.871+0000 7f5b557fa700 1 -- 172.21.15.6:0/55306274 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c009790 con 0x7f5b581020e0 2023-10-14T08:55:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.871+0000 7f5b557fa700 1 -- 172.21.15.6:0/55306274 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b4c00cbd0 con 0x7f5b581020e0 2023-10-14T08:55:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.871+0000 7f5b557fa700 1 -- 172.21.15.6:0/55306274 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c018680 con 0x7f5b581020e0 2023-10-14T08:55:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.871+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b48009520 con 0x7f5b581020e0 2023-10-14T08:55:26.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.872+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b581bef30 con 0x7f5b581020e0 2023-10-14T08:55:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.874+0000 7f5b557fa700 1 -- 172.21.15.6:0/55306274 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5b4c00cd40 con 0x7f5b581020e0 2023-10-14T08:55:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.876+0000 7f5b6a998b80 1 Processor -- start 2023-10-14T08:55:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.876+0000 7f5b6a998b80 1 -- start start 2023-10-14T08:55:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.878+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfdcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.878+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.878+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfde520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.878+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcf51c10 con 0x55dbdcfde0a0 2023-10-14T08:55:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.878+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcf36c00 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.878+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcf34520 con 0x55dbdcfdc850 2023-10-14T08:55:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b5cd4b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfdcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfde520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfddac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32798/0 (socket says 172.21.15.6:32798) 2023-10-14T08:55:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 -- 172.21.15.6:0/828874268 learned_addr learned my addr 172.21.15.6:0/828874268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b557fa700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5b400a1600 0x7f5b400a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 -- 172.21.15.6:0/828874268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 msgr2=0x55dbdcfdcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfdcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 -- 172.21.15.6:0/828874268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfde0a0 msgr2=0x55dbdcfde520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfde520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 -- 172.21.15.6:0/828874268 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbdceed390 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfdcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:55:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5b400a1600 0x7f5b400a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b557fa700 1 -- 172.21.15.6:0/55306274 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5b4c014070 con 0x7f5b581020e0 2023-10-14T08:55:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b577fe700 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfde520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:55:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b57fff700 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfddac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5b48009230 tx=0x7f5b4800bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=680b1b91c2531f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5b400a1600 0x7f5b400a3ac0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5b5001ace0 tx=0x7f5b50009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.879+0000 7f5b3e7fc700 1 -- 172.21.15.6:0/828874268 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4801c070 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.880+0000 7f5b3e7fc700 1 -- 172.21.15.6:0/828874268 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b4800b560 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.880+0000 7f5b3e7fc700 1 -- 172.21.15.6:0/828874268 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48005310 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.880+0000 7f5b6a998b80 1 -- 172.21.15.6:0/828874268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 msgr2=0x55dbdcfddac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.880+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfddac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5b48009230 tx=0x7f5b4800bef0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.881+0000 7f5b6a998b80 1 -- 172.21.15.6:0/828874268 shutdown_connections 2023-10-14T08:55:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.881+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfde520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.881+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfdcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.881+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/828874268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfddac0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.881+0000 7f5b6a998b80 1 -- 172.21.15.6:0/828874268 >> 172.21.15.6:0/828874268 conn(0x55dbdcf0ad70 msgr2=0x55dbdcfd7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.882+0000 7f5b6a998b80 1 -- 172.21.15.6:0/828874268 shutdown_connections 2023-10-14T08:55:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.882+0000 7f5b6a998b80 1 -- 172.21.15.6:0/828874268 wait complete. 2023-10-14T08:55:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.882+0000 7f5b6a998b80 1 -- start start 2023-10-14T08:55:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 Processor -- start 2023-10-14T08:55:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcf2fe10 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcecc6b0 con 0x55dbdcfdc850 2023-10-14T08:55:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcecc350 con 0x55dbdcfde0a0 2023-10-14T08:55:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b6a998b80 10 client.0 _ll_register_callbacks cb 0x55dbdcd297a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.883+0000 7f5b5cd4b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59682/0 (socket says 172.21.15.6:59682) 2023-10-14T08:55:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 -- 172.21.15.6:0/1188172013 learned_addr learned my addr 172.21.15.6:0/1188172013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 -- 172.21.15.6:0/1188172013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdc850 msgr2=0x55dbdcfe6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 -- 172.21.15.6:0/1188172013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 msgr2=0x55dbdcfe6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 -- 172.21.15.6:0/1188172013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b581bef30 con 0x55dbdcfde0a0 2023-10-14T08:55:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedbf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b50007ae0 tx=0x7f5b50004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66310658a06cd026 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.884+0000 7f5b377fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:55:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b377fe700 1 -- 172.21.15.6:0/1188172013 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5001f040 con 0x55dbdcfde0a0 2023-10-14T08:55:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b377fe700 1 -- 172.21.15.6:0/1188172013 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5b500168e0 con 0x55dbdcfde0a0 2023-10-14T08:55:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbdcf34e90 con 0x55dbdcfde0a0 2023-10-14T08:55:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b377fe700 1 -- 172.21.15.6:0/1188172013 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b5001a200 con 0x55dbdcfde0a0 2023-10-14T08:55:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 10 client.25528 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:26.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f5b58105a60 con 0x55dbdcfde0a0 2023-10-14T08:55:26.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b377fe700 1 -- 172.21.15.6:0/1188172013 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dbdcf34e90 con 0x55dbdcfde0a0 2023-10-14T08:55:26.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b377fe700 1 -- 172.21.15.6:0/1188172013 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5b50014ab0 con 0x55dbdcfde0a0 2023-10-14T08:55:26.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 10 client.25528 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:26.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 10 client.25528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:26.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 20 client.25528 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:26.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdcff26b0 0x55dbdcff4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 4 client.25528 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:55:26.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.885+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbdcfacbb0 con 0x55dbdcff26b0 2023-10-14T08:55:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.886+0000 7f5b57fff700 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdcff26b0 0x55dbdcff4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.887+0000 7f5b377fe700 10 client.25528 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.887+0000 7f5b57fff700 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdcff26b0 0x55dbdcff4ad0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a69940049427d65 server_cookie=9a9b76d5bec245fe in_seq=0 out_seq=0 2023-10-14T08:55:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.887+0000 7f5b377fe700 1 -- 172.21.15.6:0/1188172013 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dbdcfacbb0 con 0x55dbdcff26b0 2023-10-14T08:55:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.887+0000 7f5b377fe700 10 client.25528 handle_command_reply: tid=0 2023-10-14T08:55:26.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.888+0000 7f5b6a998b80 1 client.25528 shutdown 2023-10-14T08:55:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 msgr2=0x55dbdcfedbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedbf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b50007ae0 tx=0x7f5b50004ad0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 shutdown_connections 2023-10-14T08:55:26.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdcff26b0 0x55dbdcff4ad0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedbf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/1188172013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 >> 172.21.15.6:0/1188172013 conn(0x55dbdcf0ad70 msgr2=0x55dbdcfd7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:26.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.889+0000 7f5b377fe700 0 client.25528 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:26.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.890+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 shutdown_connections 2023-10-14T08:55:26.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.890+0000 7f5b6a998b80 1 -- 172.21.15.6:0/1188172013 wait complete. 2023-10-14T08:55:26.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.890+0000 7f5b6a998b80 20 client.25528 trim_cache size 0 max 16384 2023-10-14T08:55:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.909+0000 7f5b6a998b80 1 Processor -- start 2023-10-14T08:55:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.909+0000 7f5b6a998b80 1 -- start start 2023-10-14T08:55:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.909+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 0x55dbdcfd7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.909+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfd7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.909+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcdb08c0 con 0x55dbdcfdc850 2023-10-14T08:55:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcfe5b20 con 0x55dbdcfde0a0 2023-10-14T08:55:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcfe61e0 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 0x55dbdcfd7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 0x55dbdcfd7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34056/0 (socket says 172.21.15.6:34056) 2023-10-14T08:55:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b577fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfd7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b57fff700 1 -- 172.21.15.6:0/2565760995 learned_addr learned my addr 172.21.15.6:0/2565760995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b5cd4b700 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b577fe700 1 -- 172.21.15.6:0/2565760995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 msgr2=0x55dbdcfedb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b577fe700 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b577fe700 1 -- 172.21.15.6:0/2565760995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 msgr2=0x55dbdcfd7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b577fe700 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 0x55dbdcfd7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b577fe700 1 -- 172.21.15.6:0/2565760995 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbdcd5ad80 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.910+0000 7f5b57fff700 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 0x55dbdcfd7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:55:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.912+0000 7f5b577fe700 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfd7c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55dbdcfdd880 tx=0x7f5b4c0d04b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93d3bede160e7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.912+0000 7f5b3effd700 1 -- 172.21.15.6:0/2565760995 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c09a030 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.912+0000 7f5b3effd700 1 -- 172.21.15.6:0/2565760995 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b4c099da0 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.912+0000 7f5b3effd700 1 -- 172.21.15.6:0/2565760995 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0a25f0 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 -- 172.21.15.6:0/2565760995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdd1b0 msgr2=0x55dbdcfd7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfd7c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55dbdcfdd880 tx=0x7f5b4c0d04b0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 -- 172.21.15.6:0/2565760995 shutdown_connections 2023-10-14T08:55:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfedb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdc850 0x55dbdcfd7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/2565760995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfd7c80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.913+0000 7f5b6a998b80 1 -- 172.21.15.6:0/2565760995 >> 172.21.15.6:0/2565760995 conn(0x55dbdcf0ad70 msgr2=0x55dbdcff46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.914+0000 7f5b6a998b80 1 -- 172.21.15.6:0/2565760995 shutdown_connections 2023-10-14T08:55:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.914+0000 7f5b6a998b80 1 -- 172.21.15.6:0/2565760995 wait complete. 2023-10-14T08:55:26.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.914+0000 7f5b6a998b80 1 -- start start 2023-10-14T08:55:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.914+0000 7f5b6a998b80 1 Processor -- start 2023-10-14T08:55:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcfecde0 con 0x55dbdcfdd1b0 2023-10-14T08:55:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcfecf50 con 0x55dbdcfde0a0 2023-10-14T08:55:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbdcfed110 con 0x55dbdcfdc850 2023-10-14T08:55:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b6a998b80 10 client.0 _ll_register_callbacks cb 0x55dbdcd297a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b5cd4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59694/0 (socket says 172.21.15.6:59694) 2023-10-14T08:55:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 -- 172.21.15.6:0/3750302779 learned_addr learned my addr 172.21.15.6:0/3750302779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b577fe700 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 -- 172.21.15.6:0/3750302779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 msgr2=0x55dbdcfec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfec8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 -- 172.21.15.6:0/3750302779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 msgr2=0x55dbdcfe9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.915+0000 7f5b57fff700 1 -- 172.21.15.6:0/3750302779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dbdceed390 con 0x55dbdcfdc850 2023-10-14T08:55:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.916+0000 7f5b57fff700 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe9340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800fa40 tx=0x7f5b4800f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a179124da16a295 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.918+0000 7f5b377fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:55:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.918+0000 7f5b377fe700 1 -- 172.21.15.6:0/3750302779 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4801c040 con 0x55dbdcfdc850 2023-10-14T08:55:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.918+0000 7f5b377fe700 1 -- 172.21.15.6:0/3750302779 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5b4800f700 con 0x55dbdcfdc850 2023-10-14T08:55:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.918+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b4800b560 con 0x55dbdcfdc850 2023-10-14T08:55:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.919+0000 7f5b377fe700 1 -- 172.21.15.6:0/3750302779 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b48005b00 con 0x55dbdcfdc850 2023-10-14T08:55:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.919+0000 7f5b6a998b80 10 client.25534 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.919+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f5b4c094e70 con 0x55dbdcfdc850 2023-10-14T08:55:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.919+0000 7f5b377fe700 1 -- 172.21.15.6:0/3750302779 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b4800b560 con 0x55dbdcfdc850 2023-10-14T08:55:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b377fe700 1 -- 172.21.15.6:0/3750302779 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5b48009c70 con 0x55dbdcfdc850 2023-10-14T08:55:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b6a998b80 10 client.25534 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b6a998b80 10 client.25534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b6a998b80 20 client.25534 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdd046c70 0x55dbdd049090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b6a998b80 4 client.25534 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:55:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dbdcf28df0 con 0x55dbdd046c70 2023-10-14T08:55:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.920+0000 7f5b577fe700 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdd046c70 0x55dbdd049090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.921+0000 7f5b577fe700 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdd046c70 0x55dbdd049090 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b179661e6c808f5 server_cookie=3beed48b09cd51f4 in_seq=0 out_seq=0 2023-10-14T08:55:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.922+0000 7f5b377fe700 10 client.25534 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b377fe700 1 -- 172.21.15.6:0/3750302779 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dbdcf28df0 con 0x55dbdd046c70 2023-10-14T08:55:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b377fe700 10 client.25534 handle_command_reply: tid=0 2023-10-14T08:55:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 client.25534 shutdown 2023-10-14T08:55:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 msgr2=0x55dbdcfe9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe9340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800fa40 tx=0x7f5b4800f460 comp rx=0 tx=0).stop 2023-10-14T08:55:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 shutdown_connections 2023-10-14T08:55:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55dbdd046c70 0x55dbdd049090 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dbdcfde0a0 0x55dbdcfec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b377fe700 0 client.25534 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dbdcfdc850 0x55dbdcfe9340 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 --2- 172.21.15.6:0/3750302779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dbdcfdd1b0 0x55dbdcfe9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 >> 172.21.15.6:0/3750302779 conn(0x55dbdcf0ad70 msgr2=0x55dbdcfe0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:26.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 shutdown_connections 2023-10-14T08:55:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.948+0000 7f5b6a998b80 1 -- 172.21.15.6:0/3750302779 wait complete. 2023-10-14T08:55:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b6a998b80 20 client.25534 trim_cache size 0 max 16384 2023-10-14T08:55:26.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:55:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:55:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:55:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:55:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5b400a1600 msgr2=0x7f5b400a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5b400a1600 0x7f5b400a3ac0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5b5001ace0 tx=0x7f5b50009040 comp rx=0 tx=0).stop 2023-10-14T08:55:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 msgr2=0x7f5b581bb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 0x7f5b581bb830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00e9a0 tx=0x7f5b4c00ed60 comp rx=0 tx=0).stop 2023-10-14T08:55:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 shutdown_connections 2023-10-14T08:55:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5b400a1600 0x7f5b400a3ac0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b58104ab0 0x7f5b581bde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b580ff770 0x7f5b581b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 --2- 172.21.15.6:0/55306274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b581020e0 0x7f5b581bb830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 >> 172.21.15.6:0/55306274 conn(0x7f5b580fb390 msgr2=0x7f5b580fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 shutdown_connections 2023-10-14T08:55:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:26.949+0000 7f5b5e7ae700 1 -- 172.21.15.6:0/55306274 wait complete. 2023-10-14T08:55:27.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:27 smithi178 ceph-mon[103612]: pgmap v385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 1.64k op/s 2023-10-14T08:55:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:27 smithi057 ceph-mon[103313]: pgmap v385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 1.64k op/s 2023-10-14T08:55:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:27 smithi006 ceph-mon[99452]: pgmap v385: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 1.64k op/s 2023-10-14T08:55:29.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:29 smithi178 ceph-mon[103612]: pgmap v386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 MiB/s wr, 2.08k op/s 2023-10-14T08:55:29.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:29 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:55:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:29 smithi057 ceph-mon[103313]: pgmap v386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 MiB/s wr, 2.08k op/s 2023-10-14T08:55:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:29 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:55:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:29 smithi006 ceph-mon[99452]: pgmap v386: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 MiB/s wr, 2.08k op/s 2023-10-14T08:55:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:29 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:55:30.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:30 smithi178 ceph-mon[103612]: pgmap v387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 MiB/s wr, 2.20k op/s 2023-10-14T08:55:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:30 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:30 smithi057 ceph-mon[103313]: pgmap v387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 MiB/s wr, 2.20k op/s 2023-10-14T08:55:30.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:30 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:30 smithi006 ceph-mon[99452]: pgmap v387: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 MiB/s wr, 2.20k op/s 2023-10-14T08:55:30.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:30 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 150.0 s, 3130.6 tps, lat 32.024 ms stddev 35.277 2023-10-14T08:55:31.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:55:31.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:55:31.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:55:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:55:31.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:55:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:55:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:55:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:32 smithi057 ceph-mon[103313]: pgmap v388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 MiB/s wr, 2.24k op/s 2023-10-14T08:55:32.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:32 smithi006 ceph-mon[99452]: pgmap v388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 MiB/s wr, 2.24k op/s 2023-10-14T08:55:32.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:32 smithi178 ceph-mon[103612]: pgmap v388: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 MiB/s wr, 2.24k op/s 2023-10-14T08:55:34.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:34 smithi178 ceph-mon[103612]: pgmap v389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2023-10-14T08:55:34.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:34 smithi057 ceph-mon[103313]: pgmap v389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2023-10-14T08:55:34.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:34 smithi006 ceph-mon[99452]: pgmap v389: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2023-10-14T08:55:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 155.0 s, 3425.4 tps, lat 29.183 ms stddev 30.807 2023-10-14T08:55:37.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:37 smithi057 ceph-mon[103313]: pgmap v390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 MiB/s wr, 2.22k op/s 2023-10-14T08:55:37.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:37 smithi006 ceph-mon[99452]: pgmap v390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 MiB/s wr, 2.22k op/s 2023-10-14T08:55:37.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:37 smithi178 ceph-mon[103612]: pgmap v390: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 MiB/s wr, 2.22k op/s 2023-10-14T08:55:39.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:39 smithi057 ceph-mon[103313]: pgmap v391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 1.69k op/s 2023-10-14T08:55:39.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:39 smithi006 ceph-mon[99452]: pgmap v391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 1.69k op/s 2023-10-14T08:55:39.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:39 smithi178 ceph-mon[103612]: pgmap v391: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 1.69k op/s 2023-10-14T08:55:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3287787005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 msgr2=0x7ff3f81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3287787005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f81013e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009990 tx=0x7ff3ec009ca0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3287787005 shutdown_connections 2023-10-14T08:55:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3287787005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f8101920 0x7ff3f8108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3287787005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f80ffe10 0x7ff3f8100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3287787005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f81013e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3287787005 >> 172.21.15.6:0/3287787005 conn(0x7ff3f80fb380 msgr2=0x7ff3f80fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:40.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3287787005 shutdown_connections 2023-10-14T08:55:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.108+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3287787005 wait complete. 2023-10-14T08:55:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 Processor -- start 2023-10-14T08:55:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 -- start start 2023-10-14T08:55:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f80ffe10 0x7ff3f81949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f8194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f8101920 0x7ff3f819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f819c530 con 0x7ff3f8100f60 2023-10-14T08:55:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f819c670 con 0x7ff3f8101920 2023-10-14T08:55:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.109+0000 7ff3fe17f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f819c800 con 0x7ff3f80ffe10 2023-10-14T08:55:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f8194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f8194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34076/0 (socket says 172.21.15.6:34076) 2023-10-14T08:55:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 -- 172.21.15.6:0/3625030543 learned_addr learned my addr 172.21.15.6:0/3625030543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f80ffe10 0x7ff3f81949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f8101920 0x7ff3f819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 -- 172.21.15.6:0/3625030543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f80ffe10 msgr2=0x7ff3f81949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f80ffe10 0x7ff3f81949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 -- 172.21.15.6:0/3625030543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f8101920 msgr2=0x7ff3f819bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f8101920 0x7ff3f819bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 -- 172.21.15.6:0/3625030543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0009c40 con 0x7ff3f8100f60 2023-10-14T08:55:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f8194ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0059d0 tx=0x7ff3ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.110+0000 7ff3f4ff9700 1 -- 172.21.15.6:0/3625030543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec020470 con 0x7ff3f8100f60 2023-10-14T08:55:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.111+0000 7ff3f4ff9700 1 -- 172.21.15.6:0/3625030543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3ec020a90 con 0x7ff3f8100f60 2023-10-14T08:55:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.111+0000 7ff3f4ff9700 1 -- 172.21.15.6:0/3625030543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec015ac0 con 0x7ff3f8100f60 2023-10-14T08:55:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.111+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec0095f0 con 0x7ff3f8100f60 2023-10-14T08:55:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.111+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f819cd10 con 0x7ff3f8100f60 2023-10-14T08:55:40.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.113+0000 7ff3f4ff9700 1 -- 172.21.15.6:0/3625030543 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff3ec01c070 con 0x7ff3f8100f60 2023-10-14T08:55:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.114+0000 7ff3f4ff9700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff3e00a1500 0x7ff3e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.114+0000 7ff3f4ff9700 1 -- 172.21.15.6:0/3625030543 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff3ec0cfed0 con 0x7ff3f8100f60 2023-10-14T08:55:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.114+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff3e00a1500 0x7ff3e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.115+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff3e00a1500 0x7ff3e00a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800ac50 tx=0x7ff3e800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.115+0000 7ff40a369b80 1 Processor -- start 2023-10-14T08:55:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 -- start start 2023-10-14T08:55:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69ce01080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce01ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 0x55a69ce02930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69cd71c10 con 0x55a69ce024b0 2023-10-14T08:55:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69cd56c00 con 0x55a69ce00c60 2023-10-14T08:55:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff40a369b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69cd54520 con 0x55a69ce015c0 2023-10-14T08:55:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 0x55a69ce02930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 0x55a69ce02930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34086/0 (socket says 172.21.15.6:34086) 2023-10-14T08:55:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 -- 172.21.15.6:0/1621636968 learned_addr learned my addr 172.21.15.6:0/1621636968 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce01ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69ce01080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 -- 172.21.15.6:0/1621636968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 msgr2=0x55a69ce01ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce01ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 -- 172.21.15.6:0/1621636968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 msgr2=0x55a69ce01080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69ce01080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.116+0000 7ff3f7fff700 1 -- 172.21.15.6:0/1621636968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69cd0d390 con 0x55a69ce024b0 2023-10-14T08:55:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.117+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 0x55a69ce02930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007600 tx=0x7ff3f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf78ab51188f0ba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.117+0000 7ff3ddffb700 1 -- 172.21.15.6:0/1621636968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000e070 con 0x55a69ce024b0 2023-10-14T08:55:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.117+0000 7ff3ddffb700 1 -- 172.21.15.6:0/1621636968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3f000f040 con 0x55a69ce024b0 2023-10-14T08:55:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.117+0000 7ff3ddffb700 1 -- 172.21.15.6:0/1621636968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0015b30 con 0x55a69ce024b0 2023-10-14T08:55:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 -- 172.21.15.6:0/1621636968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 msgr2=0x55a69ce02930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 0x55a69ce02930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007600 tx=0x7ff3f0009920 comp rx=0 tx=0).stop 2023-10-14T08:55:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 -- 172.21.15.6:0/1621636968 shutdown_connections 2023-10-14T08:55:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce024b0 0x55a69ce02930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69ce01080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 --2- 172.21.15.6:0/1621636968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce01ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 -- 172.21.15.6:0/1621636968 >> 172.21.15.6:0/1621636968 conn(0x55a69cd2ad70 msgr2=0x55a69cdf7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 -- 172.21.15.6:0/1621636968 shutdown_connections 2023-10-14T08:55:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.118+0000 7ff40a369b80 1 -- 172.21.15.6:0/1621636968 wait complete. 2023-10-14T08:55:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.119+0000 7ff40a369b80 1 -- start start 2023-10-14T08:55:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.119+0000 7ff40a369b80 1 Processor -- start 2023-10-14T08:55:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.119+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69cdffdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.119+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce015c0 0x55a69ce00300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdfc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff40a369b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69cd4fe10 con 0x55a69ce00c60 2023-10-14T08:55:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff40a369b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ccec6b0 con 0x55a69ce015c0 2023-10-14T08:55:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff40a369b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ccec350 con 0x55a69ce024b0 2023-10-14T08:55:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff40a369b80 10 client.0 _ll_register_callbacks cb 0x55a69cb497a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:40.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69cdffdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69cdffdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34088/0 (socket says 172.21.15.6:34088) 2023-10-14T08:55:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 -- 172.21.15.6:0/237387737 learned_addr learned my addr 172.21.15.6:0/237387737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdfc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 -- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 msgr2=0x55a69cdfc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:40.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdfc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 -- 172.21.15.6:0/237387737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce015c0 msgr2=0x55a69ce00300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:40.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce015c0 0x55a69ce00300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 -- 172.21.15.6:0/237387737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f00092e0 con 0x55a69ce00c60 2023-10-14T08:55:40.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69cdffdc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8003930 tx=0x7ff3e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415d308b14c872d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:55:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.120+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/237387737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80108c0 con 0x55a69ce00c60 2023-10-14T08:55:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/237387737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff3e8010a20 con 0x55a69ce00c60 2023-10-14T08:55:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a69cd54e90 con 0x55a69ce00c60 2023-10-14T08:55:40.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/237387737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3e8010c20 con 0x55a69ce00c60 2023-10-14T08:55:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff40a369b80 10 client.15849 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55a69cb7ad80 con 0x55a69ce00c60 2023-10-14T08:55:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/237387737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a69cd54e90 con 0x55a69ce00c60 2023-10-14T08:55:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.121+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/237387737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff3e801e410 con 0x55a69ce00c60 2023-10-14T08:55:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff40a369b80 10 client.15849 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff40a369b80 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff40a369b80 20 client.15849 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff40a369b80 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce1ae90 0x55a69ce1d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff40a369b80 4 client.15849 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:55:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a69cdccbb0 con 0x55a69ce1ae90 2023-10-14T08:55:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.122+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce1ae90 0x55a69ce1d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.124+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce1ae90 0x55a69ce1d2b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ada1ab55eb7fcd server_cookie=a7f22b56f830c59c in_seq=0 out_seq=0 2023-10-14T08:55:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.124+0000 7ff3d6ffd700 10 client.15849 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/237387737 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a69cdccbb0 con 0x55a69ce1ae90 2023-10-14T08:55:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff3d6ffd700 10 client.15849 handle_command_reply: tid=0 2023-10-14T08:55:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 client.15849 shutdown 2023-10-14T08:55:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 msgr2=0x55a69cdffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69cdffdc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8003930 tx=0x7ff3e80047c0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 shutdown_connections 2023-10-14T08:55:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce1ae90 0x55a69ce1d2b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdfc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff3d6ffd700 0 client.15849 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69cdffdc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 --2- 172.21.15.6:0/237387737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce015c0 0x55a69ce00300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 >> 172.21.15.6:0/237387737 conn(0x55a69cd2ad70 msgr2=0x55a69cdf7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 shutdown_connections 2023-10-14T08:55:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 1 -- 172.21.15.6:0/237387737 wait complete. 2023-10-14T08:55:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.131+0000 7ff40a369b80 20 client.15849 trim_cache size 0 max 16384 2023-10-14T08:55:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.154+0000 7ff40a369b80 1 Processor -- start 2023-10-14T08:55:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.154+0000 7ff40a369b80 1 -- start start 2023-10-14T08:55:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69cdfc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce015c0 0x55a69ce16f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdf6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff40a369b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69cbd08c0 con 0x55a69ce015c0 2023-10-14T08:55:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff40a369b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ce02330 con 0x55a69ce00c60 2023-10-14T08:55:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff40a369b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ce180f0 con 0x55a69ce024b0 2023-10-14T08:55:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdf6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdf6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59728/0 (socket says 172.21.15.6:59728) 2023-10-14T08:55:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.155+0000 7ff3f7fff700 1 -- 172.21.15.6:0/4224965517 learned_addr learned my addr 172.21.15.6:0/4224965517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3f7fff700 1 -- 172.21.15.6:0/4224965517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 msgr2=0x55a69cdfc910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:40.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69cdfc910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3f7fff700 1 -- 172.21.15.6:0/4224965517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce015c0 msgr2=0x55a69ce16f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce015c0 0x55a69ce16f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3f7fff700 1 -- 172.21.15.6:0/4224965517 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69cb63c00 con 0x55a69ce024b0 2023-10-14T08:55:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdf6e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007600 tx=0x7ff3f000afa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a77d53b7900466 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:40.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3de7fc700 1 -- 172.21.15.6:0/4224965517 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000e030 con 0x55a69ce024b0 2023-10-14T08:55:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3de7fc700 1 -- 172.21.15.6:0/4224965517 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3f0015500 con 0x55a69ce024b0 2023-10-14T08:55:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.156+0000 7ff3de7fc700 1 -- 172.21.15.6:0/4224965517 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0015db0 con 0x55a69ce024b0 2023-10-14T08:55:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 -- 172.21.15.6:0/4224965517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 msgr2=0x55a69cdf6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdf6e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007600 tx=0x7ff3f000afa0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 -- 172.21.15.6:0/4224965517 shutdown_connections 2023-10-14T08:55:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce024b0 0x55a69cdf6e30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce00c60 0x55a69cdfc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 --2- 172.21.15.6:0/4224965517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce015c0 0x55a69ce16f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 -- 172.21.15.6:0/4224965517 >> 172.21.15.6:0/4224965517 conn(0x55a69cd2ad70 msgr2=0x55a69ce21c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 -- 172.21.15.6:0/4224965517 shutdown_connections 2023-10-14T08:55:40.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.157+0000 7ff40a369b80 1 -- 172.21.15.6:0/4224965517 wait complete. 2023-10-14T08:55:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 -- start start 2023-10-14T08:55:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 Processor -- start 2023-10-14T08:55:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69ce2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce2a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce024b0 0x55a69ce6d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ce6def0 con 0x55a69ce00c60 2023-10-14T08:55:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ce6e030 con 0x55a69ce024b0 2023-10-14T08:55:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69ce6e1f0 con 0x55a69ce015c0 2023-10-14T08:55:40.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.158+0000 7ff40a369b80 10 client.0 _ll_register_callbacks cb 0x7ff3e80043d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69ce2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69ce2a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34098/0 (socket says 172.21.15.6:34098) 2023-10-14T08:55:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 -- 172.21.15.6:0/910600910 learned_addr learned my addr 172.21.15.6:0/910600910 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:40.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce024b0 0x55a69ce6d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce2a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 -- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 msgr2=0x55a69ce2a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce2a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 -- 172.21.15.6:0/910600910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce024b0 msgr2=0x55a69ce6d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce024b0 0x55a69ce6d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 -- 172.21.15.6:0/910600910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a69cd0d390 con 0x55a69ce00c60 2023-10-14T08:55:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f7fff700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce024b0 0x55a69ce6d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:55:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3f77fe700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69ce2a3a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff3e801e7f0 tx=0x7ff3e801ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c3e2d78fb7383e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:40.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:55:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/910600910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8010c10 con 0x55a69ce00c60 2023-10-14T08:55:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3f000f040 con 0x55a69ce00c60 2023-10-14T08:55:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.159+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/910600910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff3e8010d70 con 0x55a69ce00c60 2023-10-14T08:55:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/910600910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3e803b480 con 0x55a69ce00c60 2023-10-14T08:55:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 10 client.15852 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55a69cba11f0 con 0x55a69ce00c60 2023-10-14T08:55:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/910600910 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3f000f040 con 0x55a69ce00c60 2023-10-14T08:55:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/910600910 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7ff3e8027670 con 0x55a69ce00c60 2023-10-14T08:55:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 10 client.15852 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 20 client.15852 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce6fc90 0x55a69ce720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 4 client.15852 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:55:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a69cd48df0 con 0x55a69ce6fc90 2023-10-14T08:55:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.160+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce6fc90 0x55a69ce720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.161+0000 7ff3f6ffd700 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce6fc90 0x55a69ce720b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37aa661fc984a1a6 server_cookie=b0eb3b1b83412cd in_seq=0 out_seq=0 2023-10-14T08:55:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.161+0000 7ff3d6ffd700 10 client.15852 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.183+0000 7ff3d6ffd700 1 -- 172.21.15.6:0/910600910 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a69cd48df0 con 0x55a69ce6fc90 2023-10-14T08:55:40.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.183+0000 7ff3d6ffd700 10 client.15852 handle_command_reply: tid=0 2023-10-14T08:55:40.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.185+0000 7ff40a369b80 1 client.15852 shutdown 2023-10-14T08:55:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 msgr2=0x55a69ce2a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69ce2a3a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff3e801e7f0 tx=0x7ff3e801ea90 comp rx=0 tx=0).stop 2023-10-14T08:55:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 shutdown_connections 2023-10-14T08:55:40.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a69ce6fc90 0x55a69ce720b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a69ce024b0 0x55a69ce6d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a69ce00c60 0x55a69ce2a3a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff3d6ffd700 0 client.15852 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 --2- 172.21.15.6:0/910600910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a69ce015c0 0x55a69ce2a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 >> 172.21.15.6:0/910600910 conn(0x55a69cd2ad70 msgr2=0x55a69ce08840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 shutdown_connections 2023-10-14T08:55:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 1 -- 172.21.15.6:0/910600910 wait complete. 2023-10-14T08:55:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.186+0000 7ff40a369b80 20 client.15852 trim_cache size 0 max 16384 2023-10-14T08:55:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:55:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:55:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:55:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:55:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff3e00a1500 msgr2=0x7ff3e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff3e00a1500 0x7ff3e00a39c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800ac50 tx=0x7ff3e800a380 comp rx=0 tx=0).stop 2023-10-14T08:55:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 msgr2=0x7ff3f8194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f8194ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0059d0 tx=0x7ff3ec00ef60 comp rx=0 tx=0).stop 2023-10-14T08:55:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 shutdown_connections 2023-10-14T08:55:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff3e00a1500 0x7ff3e00a39c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3f8101920 0x7ff3f819bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f80ffe10 0x7ff3f81949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 --2- 172.21.15.6:0/3625030543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3f8100f60 0x7ff3f8194ef0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 >> 172.21.15.6:0/3625030543 conn(0x7ff3f80fb380 msgr2=0x7ff3f8104470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 shutdown_connections 2023-10-14T08:55:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:40.187+0000 7ff3fe17f700 1 -- 172.21.15.6:0/3625030543 wait complete. 2023-10-14T08:55:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 160.0 s, 2409.3 tps, lat 41.433 ms stddev 47.444 2023-10-14T08:55:41.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:41 smithi057 ceph-mon[103313]: pgmap v392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 25 MiB/s wr, 1.15k op/s 2023-10-14T08:55:41.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:41 smithi006 ceph-mon[99452]: pgmap v392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 25 MiB/s wr, 1.15k op/s 2023-10-14T08:55:41.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:41 smithi178 ceph-mon[103612]: pgmap v392: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 25 MiB/s wr, 1.15k op/s 2023-10-14T08:55:43.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:43 smithi006 ceph-mon[99452]: pgmap v393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 1.10k op/s 2023-10-14T08:55:43.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:43 smithi178 ceph-mon[103612]: pgmap v393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 1.10k op/s 2023-10-14T08:55:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:43 smithi057 ceph-mon[103313]: pgmap v393: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 MiB/s wr, 1.10k op/s 2023-10-14T08:55:45.485 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:45 smithi006 ceph-mon[99452]: pgmap v394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 977 op/s 2023-10-14T08:55:45.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:45 smithi178 ceph-mon[103612]: pgmap v394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 977 op/s 2023-10-14T08:55:45.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:45 smithi057 ceph-mon[103313]: pgmap v394: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 977 op/s 2023-10-14T08:55:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 165.0 s, 2297.9 tps, lat 43.104 ms stddev 44.914 2023-10-14T08:55:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:47 smithi006 ceph-mon[99452]: pgmap v395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 1.23k op/s 2023-10-14T08:55:47.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:47 smithi178 ceph-mon[103612]: pgmap v395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 1.23k op/s 2023-10-14T08:55:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:47 smithi057 ceph-mon[103313]: pgmap v395: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 28 MiB/s wr, 1.23k op/s 2023-10-14T08:55:49.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:49 smithi006 ceph-mon[99452]: pgmap v396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.17k op/s 2023-10-14T08:55:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:49 smithi178 ceph-mon[103612]: pgmap v396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.17k op/s 2023-10-14T08:55:49.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:49 smithi057 ceph-mon[103313]: pgmap v396: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.17k op/s 2023-10-14T08:55:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 170.0 s, 1966.4 tps, lat 51.229 ms stddev 90.860 2023-10-14T08:55:51.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:51 smithi178 ceph-mon[103612]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 1.24k op/s 2023-10-14T08:55:51.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:51 smithi057 ceph-mon[103313]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 1.24k op/s 2023-10-14T08:55:51.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:51 smithi006 ceph-mon[99452]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 1.24k op/s 2023-10-14T08:55:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 -- 172.21.15.6:0/3570734097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec0ffdd0 msgr2=0x7fcfec1001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/3570734097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec1001f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009990 tx=0x7fcfdc009ca0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 -- 172.21.15.6:0/3570734097 shutdown_connections 2023-10-14T08:55:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/3570734097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec101960 0x7fcfec108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/3570734097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec1001f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/3570734097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 -- 172.21.15.6:0/3570734097 >> 172.21.15.6:0/3570734097 conn(0x7fcfec0fb380 msgr2=0x7fcfec0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:53.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 -- 172.21.15.6:0/3570734097 shutdown_connections 2023-10-14T08:55:53.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.365+0000 7fcff0a3a700 1 -- 172.21.15.6:0/3570734097 wait complete. 2023-10-14T08:55:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.366+0000 7fcff0a3a700 1 Processor -- start 2023-10-14T08:55:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.366+0000 7fcff0a3a700 1 -- start start 2023-10-14T08:55:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.366+0000 7fcff0a3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec069370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcff0a3a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec0698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcff0a3a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec101960 0x7fcfec195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcff0a3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec06a0f0 con 0x7fcfec0ffdd0 2023-10-14T08:55:53.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcff0a3a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec196240 con 0x7fcfec100fc0 2023-10-14T08:55:53.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcff0a3a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec196380 con 0x7fcfec101960 2023-10-14T08:55:53.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec0698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec0698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32872/0 (socket says 172.21.15.6:32872) 2023-10-14T08:55:53.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec069370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34112/0 (socket says 172.21.15.6:34112) 2023-10-14T08:55:53.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1127036975 learned_addr learned my addr 172.21.15.6:0/1127036975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:53.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfead9d700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec101960 0x7fcfec195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1127036975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec101960 msgr2=0x7fcfec195d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec101960 0x7fcfec195d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0ffdd0 msgr2=0x7fcfec069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.367+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1127036975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0095f0 con 0x7fcfec100fc0 2023-10-14T08:55:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.369+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec0698b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000d950 tx=0x7fcfe000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.369+0000 7fcfdb7fe700 1 -- 172.21.15.6:0/1127036975 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0009940 con 0x7fcfec100fc0 2023-10-14T08:55:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.369+0000 7fcfdb7fe700 1 -- 172.21.15.6:0/1127036975 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfe0010460 con 0x7fcfec100fc0 2023-10-14T08:55:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.369+0000 7fcfdb7fe700 1 -- 172.21.15.6:0/1127036975 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000f620 con 0x7fcfec100fc0 2023-10-14T08:55:53.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.369+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec18db20 con 0x7fcfec100fc0 2023-10-14T08:55:53.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.370+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec18e060 con 0x7fcfec100fc0 2023-10-14T08:55:53.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.374+0000 7fcfdb7fe700 1 -- 172.21.15.6:0/1127036975 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fcfe00108d0 con 0x7fcfec100fc0 2023-10-14T08:55:53.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.375+0000 7fcfdb7fe700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcfd40b69a0 0x7fcfd40b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.375+0000 7fcffcc24b80 1 Processor -- start 2023-10-14T08:55:53.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.375+0000 7fcfdb7fe700 1 -- 172.21.15.6:0/1127036975 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcfe00ccb10 con 0x7fcfec100fc0 2023-10-14T08:55:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.375+0000 7fcffcc24b80 1 -- start start 2023-10-14T08:55:53.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ea850 0x55d8c25eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 0x55d8c25ebac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25ec520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c255fc10 con 0x55d8c25ea850 2023-10-14T08:55:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2544c00 con 0x55d8c25eb1b0 2023-10-14T08:55:53.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2542520 con 0x55d8c25ec0a0 2023-10-14T08:55:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 0x55d8c25ebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 0x55d8c25ebac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32876/0 (socket says 172.21.15.6:32876) 2023-10-14T08:55:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1861882224 learned_addr learned my addr 172.21.15.6:0/1861882224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:53.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.376+0000 7fcfead9d700 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25ec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1861882224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 msgr2=0x55d8c25ec520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:53.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25ec520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1861882224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ea850 msgr2=0x55d8c25eac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:53.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ea850 0x55d8c25eac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1861882224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8c24fb390 con 0x55d8c25eb1b0 2023-10-14T08:55:53.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 0x55d8c25ebac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0099d80 tx=0x7fcfe0099850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e7aab16750455b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:53.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfea59c700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcfd40b69a0 0x7fcfd40b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfd8ff9700 1 -- 172.21.15.6:0/1861882224 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe009df40 con 0x55d8c25eb1b0 2023-10-14T08:55:53.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfd8ff9700 1 -- 172.21.15.6:0/1861882224 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfe00a2180 con 0x55d8c25eb1b0 2023-10-14T08:55:53.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.377+0000 7fcfd8ff9700 1 -- 172.21.15.6:0/1861882224 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0099540 con 0x55d8c25eb1b0 2023-10-14T08:55:53.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1861882224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 msgr2=0x55d8c25ebac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 0x55d8c25ebac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0099d80 tx=0x7fcfe0099850 comp rx=0 tx=0).stop 2023-10-14T08:55:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1861882224 shutdown_connections 2023-10-14T08:55:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25ec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ea850 0x55d8c25eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1861882224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25eb1b0 0x55d8c25ebac0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0099d80 tx=0x7fcfe0099850 comp rx=0 tx=0).stop 2023-10-14T08:55:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1861882224 >> 172.21.15.6:0/1861882224 conn(0x55d8c2518d70 msgr2=0x55d8c25e5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.378+0000 7fcfea59c700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcfd40b69a0 0x7fcfd40b8e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc003790 tx=0x7fcfdc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.380+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1861882224 shutdown_connections 2023-10-14T08:55:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.381+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1861882224 wait complete. 2023-10-14T08:55:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 -- start start 2023-10-14T08:55:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 Processor -- start 2023-10-14T08:55:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 0x55d8c25f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c25fc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c253de10 con 0x55d8c25f9f80 2023-10-14T08:55:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c24da6b0 con 0x55d8c25ea850 2023-10-14T08:55:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c24da350 con 0x55d8c25ec0a0 2023-10-14T08:55:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.382+0000 7fcffcc24b80 10 client.0 _ll_register_callbacks cb 0x55d8c23377a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfead9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c25fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 0x55d8c25f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 0x55d8c25f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32882/0 (socket says 172.21.15.6:32882) 2023-10-14T08:55:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 -- 172.21.15.6:0/522943168 learned_addr learned my addr 172.21.15.6:0/522943168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 -- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 msgr2=0x55d8c25f4f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:55:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25f4f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 -- 172.21.15.6:0/522943168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 msgr2=0x55d8c25fc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:53.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c25fc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 -- 172.21.15.6:0/522943168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec18e060 con 0x55d8c25ea850 2023-10-14T08:55:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfea59c700 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 0x55d8c25f4a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcfec100e20 tx=0x7fcfdc009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea01510a510ecb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.383+0000 7fcfd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:55:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.384+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/522943168 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc02a070 con 0x55d8c25ea850 2023-10-14T08:55:53.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.384+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/522943168 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcfdc023460 con 0x55d8c25ea850 2023-10-14T08:55:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.384+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8c2542e90 con 0x55d8c25ea850 2023-10-14T08:55:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.384+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/522943168 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfdc0056e0 con 0x55d8c25ea850 2023-10-14T08:55:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.384+0000 7fcffcc24b80 10 client.25508 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.384+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d8c2368d80 con 0x55d8c25ea850 2023-10-14T08:55:53.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/522943168 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d8c2542e90 con 0x55d8c25ea850 2023-10-14T08:55:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/522943168 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fcfdc039880 con 0x55d8c25ea850 2023-10-14T08:55:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcffcc24b80 10 client.25508 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcffcc24b80 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:53.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcffcc24b80 20 client.25508 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26094f0 0x55d8c260b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcffcc24b80 4 client.25508 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:55:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.386+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8c25babb0 con 0x55d8c26094f0 2023-10-14T08:55:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.388+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26094f0 0x55d8c260b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.390+0000 7fcfd1ffb700 10 client.25508 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.390+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26094f0 0x55d8c260b910 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec2ef51e4d04f912 server_cookie=7ccace975a59068b in_seq=0 out_seq=0 2023-10-14T08:55:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/522943168 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8c25babb0 con 0x55d8c26094f0 2023-10-14T08:55:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcfd1ffb700 10 client.25508 handle_command_reply: tid=0 2023-10-14T08:55:53.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 client.25508 shutdown 2023-10-14T08:55:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 msgr2=0x55d8c25f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 0x55d8c25f4a10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcfec100e20 tx=0x7fcfdc009ca0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 shutdown_connections 2023-10-14T08:55:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26094f0 0x55d8c260b910 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c25fc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ea850 0x55d8c25f4a10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/522943168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ec0a0 0x55d8c25f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 >> 172.21.15.6:0/522943168 conn(0x55d8c2518d70 msgr2=0x55d8c25e57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcfd1ffb700 0 client.25508 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 shutdown_connections 2023-10-14T08:55:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.391+0000 7fcffcc24b80 1 -- 172.21.15.6:0/522943168 wait complete. 2023-10-14T08:55:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.392+0000 7fcffcc24b80 20 client.25508 trim_cache size 0 max 16384 2023-10-14T08:55:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 Processor -- start 2023-10-14T08:55:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 -- start start 2023-10-14T08:55:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c25e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ec0a0 0x55d8c2619110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c2605440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c23be8c0 con 0x55d8c25f9f80 2023-10-14T08:55:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2606800 con 0x55d8c25ec0a0 2023-10-14T08:55:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c25e2450 con 0x55d8c25ea850 2023-10-14T08:55:53.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c25e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c25e4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59766/0 (socket says 172.21.15.6:59766) 2023-10-14T08:55:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.417+0000 7fcfea59c700 1 -- 172.21.15.6:0/789966642 learned_addr learned my addr 172.21.15.6:0/789966642 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.418+0000 7fcfea59c700 1 -- 172.21.15.6:0/789966642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ec0a0 msgr2=0x55d8c2619110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:55:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.418+0000 7fcfea59c700 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ec0a0 0x55d8c2619110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.418+0000 7fcfea59c700 1 -- 172.21.15.6:0/789966642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 msgr2=0x55d8c2605440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.418+0000 7fcfea59c700 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c2605440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.418+0000 7fcfea59c700 1 -- 172.21.15.6:0/789966642 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8c2351c00 con 0x55d8c25ea850 2023-10-14T08:55:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.418+0000 7fcfea59c700 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c25e4e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc000c00 tx=0x7fcfdc005cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c3dd151abfed9c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.419+0000 7fcfd97fa700 1 -- 172.21.15.6:0/789966642 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc05f020 con 0x55d8c25ea850 2023-10-14T08:55:53.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.419+0000 7fcfd97fa700 1 -- 172.21.15.6:0/789966642 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfdc01e040 con 0x55d8c25ea850 2023-10-14T08:55:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.419+0000 7fcfd97fa700 1 -- 172.21.15.6:0/789966642 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc02a070 con 0x55d8c25ea850 2023-10-14T08:55:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 -- 172.21.15.6:0/789966642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 msgr2=0x55d8c25e4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c25e4e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc000c00 tx=0x7fcfdc005cc0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 -- 172.21.15.6:0/789966642 shutdown_connections 2023-10-14T08:55:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25f9f80 0x55d8c2605440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c25e4e30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/789966642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25ec0a0 0x55d8c2619110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 -- 172.21.15.6:0/789966642 >> 172.21.15.6:0/789966642 conn(0x55d8c2518d70 msgr2=0x55d8c25eb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 -- 172.21.15.6:0/789966642 shutdown_connections 2023-10-14T08:55:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.420+0000 7fcffcc24b80 1 -- 172.21.15.6:0/789966642 wait complete. 2023-10-14T08:55:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 -- start start 2023-10-14T08:55:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 Processor -- start 2023-10-14T08:55:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c2616390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ec0a0 0x55d8c26168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25f9f80 0x55d8c2600950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2616fb0 con 0x55d8c25ec0a0 2023-10-14T08:55:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2600e90 con 0x55d8c25f9f80 2023-10-14T08:55:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8c2601020 con 0x55d8c25ea850 2023-10-14T08:55:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcffcc24b80 10 client.0 _ll_register_callbacks cb 0x7fcfdc00bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:55:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ec0a0 0x55d8c26168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcfea59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c2616390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcfe9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ec0a0 0x55d8c26168d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34136/0 (socket says 172.21.15.6:34136) 2023-10-14T08:55:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcfe9d9b700 1 -- 172.21.15.6:0/1064475969 learned_addr learned my addr 172.21.15.6:0/1064475969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:55:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.421+0000 7fcfead9d700 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25f9f80 0x55d8c2600950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.422+0000 7fcfea59c700 1 -- 172.21.15.6:0/1064475969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25f9f80 msgr2=0x55d8c2600950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.422+0000 7fcfea59c700 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25f9f80 0x55d8c2600950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.422+0000 7fcfea59c700 1 -- 172.21.15.6:0/1064475969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ec0a0 msgr2=0x55d8c26168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:55:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.422+0000 7fcfea59c700 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ec0a0 0x55d8c26168d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.422+0000 7fcfea59c700 1 -- 172.21.15.6:0/1064475969 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8c2368d80 con 0x55d8c25ea850 2023-10-14T08:55:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.423+0000 7fcfea59c700 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c2616390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0108b0 tx=0x7fcfdc010e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2318081cf1199508 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:55:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.423+0000 7fcfd1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:55:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.423+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/1064475969 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc05f070 con 0x55d8c25ea850 2023-10-14T08:55:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.423+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/1064475969 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fcfdc039670 con 0x55d8c25ea850 2023-10-14T08:55:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.423+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfe00a2180 con 0x55d8c25ea850 2023-10-14T08:55:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/1064475969 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfdc02a040 con 0x55d8c25ea850 2023-10-14T08:55:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 10 client.25564 fetch_fsmap learned FSMap version 33 2023-10-14T08:55:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55d8c238f1f0 con 0x55d8c25ea850 2023-10-14T08:55:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/1064475969 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfdc06c030 con 0x55d8c25ea850 2023-10-14T08:55:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/1064475969 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 33) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fcfdc065d10 con 0x55d8c25ea850 2023-10-14T08:55:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 10 client.25564 fetch_fsmap finished waiting for FSMap version 33 2023-10-14T08:55:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 10 client.25564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:55:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 20 client.25564 populate_metadata read hostname 'smithi006' 2023-10-14T08:55:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26025c0 0x55d8c26049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:55:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 4 client.25564 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:55:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.424+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8c2536df0 con 0x55d8c26025c0 2023-10-14T08:55:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.425+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26025c0 0x55d8c26049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:55:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.425+0000 7fcfd1ffb700 10 client.25564 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.425+0000 7fcfe9d9b700 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26025c0 0x55d8c26049e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf495a8714c426d server_cookie=5919c5f2f1bff33c in_seq=0 out_seq=0 2023-10-14T08:55:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcfd1ffb700 1 -- 172.21.15.6:0/1064475969 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8c2536df0 con 0x55d8c26025c0 2023-10-14T08:55:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcfd1ffb700 10 client.25564 handle_command_reply: tid=0 2023-10-14T08:55:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 client.25564 shutdown 2023-10-14T08:55:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 msgr2=0x55d8c2616390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c2616390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0108b0 tx=0x7fcfdc010e40 comp rx=0 tx=0).stop 2023-10-14T08:55:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 shutdown_connections 2023-10-14T08:55:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d8c26025c0 0x55d8c26049e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d8c25f9f80 0x55d8c2600950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8c25ea850 0x55d8c2616390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 --2- 172.21.15.6:0/1064475969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8c25ec0a0 0x55d8c26168d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 >> 172.21.15.6:0/1064475969 conn(0x55d8c2518d70 msgr2=0x55d8c25e4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcfd1ffb700 0 client.25564 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:55:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 shutdown_connections 2023-10-14T08:55:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 1 -- 172.21.15.6:0/1064475969 wait complete. 2023-10-14T08:55:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.497+0000 7fcffcc24b80 20 client.25564 trim_cache size 0 max 16384 2023-10-14T08:55:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:55:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:55:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:55:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:55:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcfd40b69a0 msgr2=0x7fcfd40b8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcfd40b69a0 0x7fcfd40b8e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc003790 tx=0x7fcfdc005fb0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 msgr2=0x7fcfec0698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:55:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec0698b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000d950 tx=0x7fcfe000dc60 comp rx=0 tx=0).stop 2023-10-14T08:55:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 shutdown_connections 2023-10-14T08:55:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfec101960 0x7fcfec195d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfec0ffdd0 0x7fcfec069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fcfd40b69a0 0x7fcfd40b8e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 --2- 172.21.15.6:0/1127036975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec100fc0 0x7fcfec0698b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:55:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 >> 172.21.15.6:0/1127036975 conn(0x7fcfec0fb380 msgr2=0x7fcfec06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:55:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 shutdown_connections 2023-10-14T08:55:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:55:53.498+0000 7fcff0a3a700 1 -- 172.21.15.6:0/1127036975 wait complete. 2023-10-14T08:55:53.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:53 smithi178 ceph-mon[103612]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 48 MiB/s wr, 2.08k op/s 2023-10-14T08:55:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:53 smithi057 ceph-mon[103313]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 48 MiB/s wr, 2.08k op/s 2023-10-14T08:55:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:53 smithi006 ceph-mon[99452]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 48 MiB/s wr, 2.08k op/s 2023-10-14T08:55:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:55 smithi178 ceph-mon[103612]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2023-10-14T08:55:55.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:55 smithi057 ceph-mon[103313]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2023-10-14T08:55:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:55 smithi006 ceph-mon[99452]: pgmap v399: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2023-10-14T08:55:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 175.0 s, 2673.0 tps, lat 37.536 ms stddev 41.170 2023-10-14T08:55:57.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:57 smithi178 ceph-mon[103612]: pgmap v400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 2.31k op/s 2023-10-14T08:55:57.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:57 smithi057 ceph-mon[103313]: pgmap v400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 2.31k op/s 2023-10-14T08:55:57.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:57 smithi006 ceph-mon[99452]: pgmap v400: 97 pgs: 97 active+clean; 1.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 2.31k op/s 2023-10-14T08:55:59.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:55:59 smithi178 ceph-mon[103612]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 47 MiB/s wr, 2.12k op/s 2023-10-14T08:55:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:55:59 smithi057 ceph-mon[103313]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 47 MiB/s wr, 2.12k op/s 2023-10-14T08:55:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:55:59 smithi006 ceph-mon[99452]: pgmap v401: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 47 MiB/s wr, 2.12k op/s 2023-10-14T08:56:00.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:00 smithi178 ceph-mon[103612]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 MiB/s wr, 2.00k op/s 2023-10-14T08:56:00.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:00 smithi057 ceph-mon[103313]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 MiB/s wr, 2.00k op/s 2023-10-14T08:56:00.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:00 smithi006 ceph-mon[99452]: pgmap v402: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 MiB/s wr, 2.00k op/s 2023-10-14T08:56:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 180.0 s, 2721.6 tps, lat 36.681 ms stddev 40.549 2023-10-14T08:56:03.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:03 smithi057 ceph-mon[103313]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 MiB/s wr, 1.93k op/s 2023-10-14T08:56:03.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:03 smithi006 ceph-mon[99452]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 MiB/s wr, 1.93k op/s 2023-10-14T08:56:03.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:03 smithi178 ceph-mon[103612]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 MiB/s wr, 1.93k op/s 2023-10-14T08:56:05.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:05 smithi006 ceph-mon[99452]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 23 MiB/s wr, 1.01k op/s 2023-10-14T08:56:05.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:05 smithi178 ceph-mon[103612]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 23 MiB/s wr, 1.01k op/s 2023-10-14T08:56:05.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:05 smithi057 ceph-mon[103313]: pgmap v404: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 23 MiB/s wr, 1.01k op/s 2023-10-14T08:56:05.969 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 185.0 s, 2986.6 tps, lat 33.352 ms stddev 37.031 2023-10-14T08:56:06.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:06 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:06.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:06 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 -- 172.21.15.6:0/777415009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 msgr2=0x7f70801082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 --2- 172.21.15.6:0/777415009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f70801082d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7070009990 tx=0x7f7070009ca0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 -- 172.21.15.6:0/777415009 shutdown_connections 2023-10-14T08:56:06.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 --2- 172.21.15.6:0/777415009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f708010f730 0x7f7080111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 --2- 172.21.15.6:0/777415009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f70801082d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 --2- 172.21.15.6:0/777415009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7080108810 0x7f708010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 -- 172.21.15.6:0/777415009 >> 172.21.15.6:0/777415009 conn(0x7f708006dcf0 msgr2=0x7f7080070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 -- 172.21.15.6:0/777415009 shutdown_connections 2023-10-14T08:56:06.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.656+0000 7f7084bc2700 1 -- 172.21.15.6:0/777415009 wait complete. 2023-10-14T08:56:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.657+0000 7f7084bc2700 1 Processor -- start 2023-10-14T08:56:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.657+0000 7f7084bc2700 1 -- start start 2023-10-14T08:56:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f7084bc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f708010ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f7084bc2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7080108810 0x7f7080109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f7084bc2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f708010f730 0x7f70801096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f7084bc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080109e60 con 0x7f7080107eb0 2023-10-14T08:56:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f7084bc2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080109fd0 con 0x7f708010f730 2023-10-14T08:56:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f7084bc2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70801a9480 con 0x7f7080108810 2023-10-14T08:56:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f708010ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7080108810 0x7f7080109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f708010f730 0x7f70801096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f708010ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34152/0 (socket says 172.21.15.6:34152) 2023-10-14T08:56:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 -- 172.21.15.6:0/1763229515 learned_addr learned my addr 172.21.15.6:0/1763229515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 -- 172.21.15.6:0/1763229515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7080108810 msgr2=0x7f7080109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7080108810 0x7f7080109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 -- 172.21.15.6:0/1763229515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f708010f730 msgr2=0x7f70801096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f708010f730 0x7f70801096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.658+0000 7f707e59c700 1 -- 172.21.15.6:0/1763229515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009c40 con 0x7f7080107eb0 2023-10-14T08:56:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.659+0000 7f707e59c700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f708010ab40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f707000b2e0 tx=0x7f7070004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.659+0000 7f706f7fe700 1 -- 172.21.15.6:0/1763229515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707001d070 con 0x7f7080107eb0 2023-10-14T08:56:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.659+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70700095f0 con 0x7f7080107eb0 2023-10-14T08:56:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.659+0000 7f706f7fe700 1 -- 172.21.15.6:0/1763229515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f707000bed0 con 0x7f7080107eb0 2023-10-14T08:56:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.659+0000 7f706f7fe700 1 -- 172.21.15.6:0/1763229515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070005390 con 0x7f7080107eb0 2023-10-14T08:56:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.659+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70801a9990 con 0x7f7080107eb0 2023-10-14T08:56:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.661+0000 7f706f7fe700 1 -- 172.21.15.6:0/1763229515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f70700049c0 con 0x7f7080107eb0 2023-10-14T08:56:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.662+0000 7f706f7fe700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f70680a1480 0x7f70680a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.662+0000 7f707dd9b700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f70680a1480 0x7f70680a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.662+0000 7f706f7fe700 1 -- 172.21.15.6:0/1763229515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f70700cdf30 con 0x7f7080107eb0 2023-10-14T08:56:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.662+0000 7f707dd9b700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f70680a1480 0x7f70680a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7074005950 tx=0x7f707400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 Processor -- start 2023-10-14T08:56:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 -- start start 2023-10-14T08:56:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084b00a0 0x5639084b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563908423c10 con 0x5639084ae850 2023-10-14T08:56:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563908408c00 con 0x5639084af1b0 2023-10-14T08:56:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.663+0000 7f7090dacb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563908406520 con 0x5639084b00a0 2023-10-14T08:56:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34156/0 (socket says 172.21.15.6:34156) 2023-10-14T08:56:06.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084b00a0 0x5639084b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 -- 172.21.15.6:0/1450681643 learned_addr learned my addr 172.21.15.6:0/1450681643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:06.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 -- 172.21.15.6:0/1450681643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084b00a0 msgr2=0x5639084b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084b00a0 0x5639084b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 -- 172.21.15.6:0/1450681643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 msgr2=0x5639084afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 -- 172.21.15.6:0/1450681643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639083bf390 con 0x5639084ae850 2023-10-14T08:56:06.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f707e59c700 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084aec70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f707009afe0 tx=0x7f7070005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2f7ca41c83492d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:06.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f706cff9700 1 -- 172.21.15.6:0/1450681643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707009b9e0 con 0x5639084ae850 2023-10-14T08:56:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f706cff9700 1 -- 172.21.15.6:0/1450681643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f707009b2e0 con 0x5639084ae850 2023-10-14T08:56:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.664+0000 7f706cff9700 1 -- 172.21.15.6:0/1450681643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707009a7d0 con 0x5639084ae850 2023-10-14T08:56:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 -- 172.21.15.6:0/1450681643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 msgr2=0x5639084aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084aec70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f707009afe0 tx=0x7f7070005b00 comp rx=0 tx=0).stop 2023-10-14T08:56:06.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 -- 172.21.15.6:0/1450681643 shutdown_connections 2023-10-14T08:56:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084b00a0 0x5639084b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084aec70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 --2- 172.21.15.6:0/1450681643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 -- 172.21.15.6:0/1450681643 >> 172.21.15.6:0/1450681643 conn(0x5639083dcd70 msgr2=0x5639084a9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 -- 172.21.15.6:0/1450681643 shutdown_connections 2023-10-14T08:56:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.665+0000 7f7090dacb80 1 -- 172.21.15.6:0/1450681643 wait complete. 2023-10-14T08:56:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 -- start start 2023-10-14T08:56:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 Processor -- start 2023-10-14T08:56:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 0x5639084b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084b8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563908401e10 con 0x5639084b00a0 2023-10-14T08:56:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390839e6b0 con 0x5639084af1b0 2023-10-14T08:56:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390839e350 con 0x5639084ae850 2023-10-14T08:56:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.666+0000 7f7090dacb80 10 client.0 _ll_register_callbacks cb 0x5639081fb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 0x5639084b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 0x5639084b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59796/0 (socket says 172.21.15.6:59796) 2023-10-14T08:56:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 -- 172.21.15.6:0/2135928473 learned_addr learned my addr 172.21.15.6:0/2135928473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707ed9d700 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084b8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32922/0 (socket says 172.21.15.6:32922) 2023-10-14T08:56:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 -- 172.21.15.6:0/2135928473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 msgr2=0x5639084b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 -- 172.21.15.6:0/2135928473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 msgr2=0x5639084bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 -- 172.21.15.6:0/2135928473 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70801a9990 con 0x5639084ae850 2023-10-14T08:56:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.667+0000 7f707e59c700 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 0x5639084b8420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70700998d0 tx=0x7f7070009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2209431a94049b5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.668+0000 7f7065ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:56:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.668+0000 7f7065ffb700 1 -- 172.21.15.6:0/2135928473 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70700b2070 con 0x5639084ae850 2023-10-14T08:56:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.668+0000 7f7065ffb700 1 -- 172.21.15.6:0/2135928473 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f707009f430 con 0x5639084ae850 2023-10-14T08:56:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.669+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563908406e90 con 0x5639084ae850 2023-10-14T08:56:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.669+0000 7f7065ffb700 1 -- 172.21.15.6:0/2135928473 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f707009a7d0 con 0x5639084ae850 2023-10-14T08:56:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.669+0000 7f7090dacb80 10 client.25576 fetch_fsmap learned FSMap version 34 2023-10-14T08:56:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.669+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56390822cd80 con 0x5639084ae850 2023-10-14T08:56:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.669+0000 7f7065ffb700 1 -- 172.21.15.6:0/2135928473 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7070066080 con 0x5639084ae850 2023-10-14T08:56:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7065ffb700 1 -- 172.21.15.6:0/2135928473 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 34) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f70700a3150 con 0x5639084ae850 2023-10-14T08:56:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7090dacb80 10 client.25576 fetch_fsmap finished waiting for FSMap version 34 2023-10-14T08:56:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7090dacb80 10 client.25576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7090dacb80 20 client.25576 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x5639084c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7090dacb80 4 client.25576 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:56:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56390847ebb0 con 0x5639084c3d70 2023-10-14T08:56:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.671+0000 7f707dd9b700 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x5639084c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7065ffb700 10 client.25576 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f707dd9b700 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x5639084c6190 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d24ef4fb3232a9c4 server_cookie=7d4f984c73f2f465 in_seq=0 out_seq=0 2023-10-14T08:56:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7065ffb700 1 -- 172.21.15.6:0/2135928473 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56390847ebb0 con 0x5639084c3d70 2023-10-14T08:56:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7065ffb700 10 client.25576 handle_command_reply: tid=0 2023-10-14T08:56:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7090dacb80 1 client.25576 shutdown 2023-10-14T08:56:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 msgr2=0x5639084b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 0x5639084b8420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f70700998d0 tx=0x7f7070009ca0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 shutdown_connections 2023-10-14T08:56:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x5639084c6190 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7065ffb700 0 client.25576 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.672+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084ae850 0x5639084b8420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2135928473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084af1b0 0x5639084b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 >> 172.21.15.6:0/2135928473 conn(0x5639083dcd70 msgr2=0x5639084a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 shutdown_connections 2023-10-14T08:56:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7090dacb80 1 -- 172.21.15.6:0/2135928473 wait complete. 2023-10-14T08:56:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.673+0000 7f7090dacb80 20 client.25576 trim_cache size 0 max 16384 2023-10-14T08:56:06.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:06 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.697+0000 7f7090dacb80 1 Processor -- start 2023-10-14T08:56:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.697+0000 7f7090dacb80 1 -- start start 2023-10-14T08:56:06.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.698+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.698+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.698+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084b00a0 0x5639084b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.698+0000 7f7090dacb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639082828c0 con 0x5639084ae850 2023-10-14T08:56:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.698+0000 7f7090dacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639084b6f30 con 0x5639084b00a0 2023-10-14T08:56:06.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.698+0000 7f7090dacb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639084a9580 con 0x5639084af1b0 2023-10-14T08:56:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.699+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.699+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59806/0 (socket says 172.21.15.6:59806) 2023-10-14T08:56:06.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.699+0000 7f707dd9b700 1 -- 172.21.15.6:0/3254510806 learned_addr learned my addr 172.21.15.6:0/3254510806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f707dd9b700 1 -- 172.21.15.6:0/3254510806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084b00a0 msgr2=0x5639084b69c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:56:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f707dd9b700 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084b00a0 0x5639084b69c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f707dd9b700 1 -- 172.21.15.6:0/3254510806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 msgr2=0x5639084b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f707dd9b700 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f707dd9b700 1 -- 172.21.15.6:0/3254510806 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563908215c00 con 0x5639084af1b0 2023-10-14T08:56:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f707dd9b700 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bf960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7074011750 tx=0x7f7074013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765df0bf495b5784 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:06.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f706d7fa700 1 -- 172.21.15.6:0/3254510806 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074024040 con 0x5639084af1b0 2023-10-14T08:56:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f706d7fa700 1 -- 172.21.15.6:0/3254510806 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7074015070 con 0x5639084af1b0 2023-10-14T08:56:06.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.700+0000 7f706d7fa700 1 -- 172.21.15.6:0/3254510806 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074004a70 con 0x5639084af1b0 2023-10-14T08:56:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.701+0000 7f7090dacb80 1 -- 172.21.15.6:0/3254510806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 msgr2=0x5639084bf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.701+0000 7f7090dacb80 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bf960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7074011750 tx=0x7f7074013000 comp rx=0 tx=0).stop 2023-10-14T08:56:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 -- 172.21.15.6:0/3254510806 shutdown_connections 2023-10-14T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084b00a0 0x5639084b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084ae850 0x5639084b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 --2- 172.21.15.6:0/3254510806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bf960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 -- 172.21.15.6:0/3254510806 >> 172.21.15.6:0/3254510806 conn(0x5639083dcd70 msgr2=0x5639084b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 -- 172.21.15.6:0/3254510806 shutdown_connections 2023-10-14T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 -- 172.21.15.6:0/3254510806 wait complete. 2023-10-14T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 -- start start 2023-10-14T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 Processor -- start 2023-10-14T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084ae850 0x5639084bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.702+0000 7f7090dacb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f7090dacb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639084bf130 con 0x5639084b00a0 2023-10-14T08:56:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f7090dacb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639084bf2a0 con 0x5639084ae850 2023-10-14T08:56:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f7090dacb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639084bf460 con 0x5639084af1b0 2023-10-14T08:56:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f7090dacb80 10 client.0 _ll_register_callbacks cb 0x7f707400b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084ae850 0x5639084bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707dd9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59810/0 (socket says 172.21.15.6:59810) 2023-10-14T08:56:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084ae850 0x5639084bb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32934/0 (socket says 172.21.15.6:32934) 2023-10-14T08:56:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707dd9b700 1 -- 172.21.15.6:0/2287418253 learned_addr learned my addr 172.21.15.6:0/2287418253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34180/0 (socket says 172.21.15.6:34180) 2023-10-14T08:56:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 -- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 msgr2=0x5639084bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 -- 172.21.15.6:0/2287418253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084ae850 msgr2=0x5639084bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084ae850 0x5639084bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 -- 172.21.15.6:0/2287418253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70740114c0 con 0x5639084b00a0 2023-10-14T08:56:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707dd9b700 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:56:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f707ed9d700 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bebf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7078009f80 tx=0x7f707801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2661b75799117076 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.703+0000 7f7065ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:56:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7065ffb700 1 -- 172.21.15.6:0/2287418253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707801f050 con 0x5639084b00a0 2023-10-14T08:56:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7065ffb700 1 -- 172.21.15.6:0/2287418253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7078003a00 con 0x5639084b00a0 2023-10-14T08:56:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f707009b2e0 con 0x5639084b00a0 2023-10-14T08:56:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7065ffb700 1 -- 172.21.15.6:0/2287418253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f707800e040 con 0x5639084b00a0 2023-10-14T08:56:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 10 client.15876 fetch_fsmap learned FSMap version 34 2023-10-14T08:56:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5639082531f0 con 0x5639084b00a0 2023-10-14T08:56:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7065ffb700 1 -- 172.21.15.6:0/2287418253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7078033080 con 0x5639084b00a0 2023-10-14T08:56:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7065ffb700 1 -- 172.21.15.6:0/2287418253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f7078004020 con 0x5639084b00a0 2023-10-14T08:56:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 10 client.15876 fetch_fsmap finished waiting for FSMap version 34 2023-10-14T08:56:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 20 client.15876 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x56390851ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 4 client.15876 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:56:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.704+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5639083fadf0 con 0x5639084c3d70 2023-10-14T08:56:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.705+0000 7f707e59c700 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x56390851ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.705+0000 7f7065ffb700 10 client.15876 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.705+0000 7f707e59c700 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x56390851ac80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74412d1674eb4b7f server_cookie=51f5b2336b37380e in_seq=0 out_seq=0 2023-10-14T08:56:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7065ffb700 1 -- 172.21.15.6:0/2287418253 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5639083fadf0 con 0x5639084c3d70 2023-10-14T08:56:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7065ffb700 10 client.15876 handle_command_reply: tid=0 2023-10-14T08:56:06.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 client.15876 shutdown 2023-10-14T08:56:06.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 msgr2=0x5639084bebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bebf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7078009f80 tx=0x7f707801ad00 comp rx=0 tx=0).stop 2023-10-14T08:56:06.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 shutdown_connections 2023-10-14T08:56:06.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639084c3d70 0x56390851ac80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.738 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639084b00a0 0x5639084bebf0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639084ae850 0x5639084bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7065ffb700 0 client.15876 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:06.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 --2- 172.21.15.6:0/2287418253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639084af1b0 0x5639084bbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 >> 172.21.15.6:0/2287418253 conn(0x5639083dcd70 msgr2=0x5639084b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:06.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.735+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 shutdown_connections 2023-10-14T08:56:06.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.736+0000 7f7090dacb80 1 -- 172.21.15.6:0/2287418253 wait complete. 2023-10-14T08:56:06.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.736+0000 7f7090dacb80 20 client.15876 trim_cache size 0 max 16384 2023-10-14T08:56:06.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:56:06.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:56:06.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:56:06.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:56:06.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.736+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f70680a1480 msgr2=0x7f70680a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.736+0000 7f7084bc2700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f70680a1480 0x7f70680a3940 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7074005950 tx=0x7f707400b410 comp rx=0 tx=0).stop 2023-10-14T08:56:06.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.736+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 msgr2=0x7f708010ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.736+0000 7f7084bc2700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f708010ab40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f707000b2e0 tx=0x7f7070004730 comp rx=0 tx=0).stop 2023-10-14T08:56:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 shutdown_connections 2023-10-14T08:56:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f70680a1480 0x7f70680a3940 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f708010f730 0x7f70801096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7080107eb0 0x7f708010ab40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 --2- 172.21.15.6:0/1763229515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7080108810 0x7f7080109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 >> 172.21.15.6:0/1763229515 conn(0x7f708006dcf0 msgr2=0x7f708006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 shutdown_connections 2023-10-14T08:56:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:06.738+0000 7f7084bc2700 1 -- 172.21.15.6:0/1763229515 wait complete. 2023-10-14T08:56:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:07 smithi006 ceph-mon[99452]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 1.02k op/s 2023-10-14T08:56:07.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:07 smithi178 ceph-mon[103612]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 1.02k op/s 2023-10-14T08:56:07.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:07 smithi057 ceph-mon[103313]: pgmap v405: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 1.02k op/s 2023-10-14T08:56:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:08 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:08 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:08.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:08 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:09.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:09 smithi178 ceph-mon[103612]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 829 op/s 2023-10-14T08:56:09.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:09 smithi057 ceph-mon[103313]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 829 op/s 2023-10-14T08:56:09.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:09 smithi006 ceph-mon[99452]: pgmap v406: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 829 op/s 2023-10-14T08:56:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 190.0 s, 1786.7 tps, lat 56.147 ms stddev 69.403 2023-10-14T08:56:11.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:11 smithi178 ceph-mon[103612]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 826 op/s 2023-10-14T08:56:11.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:11 smithi057 ceph-mon[103313]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 826 op/s 2023-10-14T08:56:11.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:11 smithi006 ceph-mon[99452]: pgmap v407: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 826 op/s 2023-10-14T08:56:13.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:13 smithi178 ceph-mon[103612]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 1.02k op/s 2023-10-14T08:56:13.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:13 smithi057 ceph-mon[103313]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 1.02k op/s 2023-10-14T08:56:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:13 smithi006 ceph-mon[99452]: pgmap v408: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 1.02k op/s 2023-10-14T08:56:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:15 smithi178 ceph-mon[103612]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 932 op/s 2023-10-14T08:56:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:15 smithi057 ceph-mon[103313]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 932 op/s 2023-10-14T08:56:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:15 smithi006 ceph-mon[99452]: pgmap v409: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 932 op/s 2023-10-14T08:56:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 195.0 s, 2020.0 tps, lat 49.168 ms stddev 54.645 2023-10-14T08:56:17.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:17 smithi178 ceph-mon[103612]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 1.17k op/s 2023-10-14T08:56:17.693 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:17 smithi057 ceph-mon[103313]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 1.17k op/s 2023-10-14T08:56:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:17 smithi006 ceph-mon[99452]: pgmap v410: 97 pgs: 97 active+clean; 1.5 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 31 MiB/s wr, 1.17k op/s 2023-10-14T08:56:19.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:19 smithi178 ceph-mon[103612]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 1.22k op/s 2023-10-14T08:56:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:19 smithi057 ceph-mon[103313]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 1.22k op/s 2023-10-14T08:56:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:19 smithi006 ceph-mon[99452]: pgmap v411: 97 pgs: 97 active+clean; 1.5 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 32 MiB/s wr, 1.22k op/s 2023-10-14T08:56:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.954+0000 7fe672265700 1 -- 172.21.15.6:0/2221784792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c108810 msgr2=0x7fe66c10f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.954+0000 7fe672265700 1 --2- 172.21.15.6:0/2221784792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c108810 0x7fe66c10f1f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009990 tx=0x7fe65c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.956+0000 7fe672265700 1 -- 172.21.15.6:0/2221784792 shutdown_connections 2023-10-14T08:56:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.956+0000 7fe672265700 1 --2- 172.21.15.6:0/2221784792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe66c10f730 0x7fe66c111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.956+0000 7fe672265700 1 --2- 172.21.15.6:0/2221784792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe66c107eb0 0x7fe66c1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.956+0000 7fe672265700 1 --2- 172.21.15.6:0/2221784792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c108810 0x7fe66c10f1f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.956+0000 7fe672265700 1 -- 172.21.15.6:0/2221784792 >> 172.21.15.6:0/2221784792 conn(0x7fe66c06dcf0 msgr2=0x7fe66c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.957+0000 7fe672265700 1 -- 172.21.15.6:0/2221784792 shutdown_connections 2023-10-14T08:56:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.957+0000 7fe672265700 1 -- 172.21.15.6:0/2221784792 wait complete. 2023-10-14T08:56:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 Processor -- start 2023-10-14T08:56:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 -- start start 2023-10-14T08:56:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 0x7fe66c19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe66c108810 0x7fe66c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe66c10f730 0x7fe66c1b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1a08b0 con 0x7fe66c107eb0 2023-10-14T08:56:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1a0a20 con 0x7fe66c10f730 2023-10-14T08:56:19.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.958+0000 7fe672265700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1b6220 con 0x7fe66c108810 2023-10-14T08:56:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 0x7fe66c19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 0x7fe66c19d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34190/0 (socket says 172.21.15.6:34190) 2023-10-14T08:56:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 -- 172.21.15.6:0/682787339 learned_addr learned my addr 172.21.15.6:0/682787339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:19.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe670802700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe66c10f730 0x7fe66c1b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 -- 172.21.15.6:0/682787339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe66c108810 msgr2=0x7fe66c19d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:19.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe66c108810 0x7fe66c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 -- 172.21.15.6:0/682787339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe66c10f730 msgr2=0x7fe66c1b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe66c10f730 0x7fe66c1b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.959+0000 7fe66bfff700 1 -- 172.21.15.6:0/682787339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0095f0 con 0x7fe66c107eb0 2023-10-14T08:56:19.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.960+0000 7fe66bfff700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 0x7fe66c19d290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe66400b9c0 tx=0x7fe66400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.962+0000 7fe6697fa700 1 -- 172.21.15.6:0/682787339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400c9d0 con 0x7fe66c107eb0 2023-10-14T08:56:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.963+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c1b6420 con 0x7fe66c107eb0 2023-10-14T08:56:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.963+0000 7fe6697fa700 1 -- 172.21.15.6:0/682787339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe664014440 con 0x7fe66c107eb0 2023-10-14T08:56:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.963+0000 7fe6697fa700 1 -- 172.21.15.6:0/682787339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640125a0 con 0x7fe66c107eb0 2023-10-14T08:56:19.966 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.963+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c1b6980 con 0x7fe66c107eb0 2023-10-14T08:56:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.968+0000 7fe67e44fb80 1 Processor -- start 2023-10-14T08:56:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 -- start start 2023-10-14T08:56:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3d9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3daac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3db520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc34ec10 con 0x55d7bc3d9850 2023-10-14T08:56:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc333c00 con 0x55d7bc3da1b0 2023-10-14T08:56:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc331520 con 0x55d7bc3db0a0 2023-10-14T08:56:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3db520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3db520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59830/0 (socket says 172.21.15.6:59830) 2023-10-14T08:56:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.969+0000 7fe66b7fe700 1 -- 172.21.15.6:0/1726325447 learned_addr learned my addr 172.21.15.6:0/1726325447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.970+0000 7fe6697fa700 1 -- 172.21.15.6:0/682787339 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe6640145b0 con 0x7fe66c107eb0 2023-10-14T08:56:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.970+0000 7fe670802700 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3d9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.970+0000 7fe66bfff700 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3daac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe670802700 1 -- 172.21.15.6:0/1726325447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3db0a0 msgr2=0x55d7bc3db520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe670802700 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3db520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe670802700 1 -- 172.21.15.6:0/1726325447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 msgr2=0x55d7bc3daac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe670802700 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3daac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe670802700 1 -- 172.21.15.6:0/1726325447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7bc2ea390 con 0x55d7bc3d9850 2023-10-14T08:56:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe6697fa700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6540a15b0 0x7fe6540a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe670802700 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3d9c70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe66000bbf0 tx=0x7fe66000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cec14c30adf1ede server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe66bfff700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6540a15b0 0x7fe6540a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe6527fc700 1 -- 172.21.15.6:0/1726325447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66000fb10 con 0x55d7bc3d9850 2023-10-14T08:56:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe6697fa700 1 -- 172.21.15.6:0/682787339 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe664006e40 con 0x7fe66c107eb0 2023-10-14T08:56:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.971+0000 7fe6527fc700 1 -- 172.21.15.6:0/1726325447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe660004cf0 con 0x55d7bc3d9850 2023-10-14T08:56:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.972+0000 7fe6527fc700 1 -- 172.21.15.6:0/1726325447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660005650 con 0x55d7bc3d9850 2023-10-14T08:56:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 -- 172.21.15.6:0/1726325447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 msgr2=0x55d7bc3d9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3d9c70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe66000bbf0 tx=0x7fe66000bf00 comp rx=0 tx=0).stop 2023-10-14T08:56:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 -- 172.21.15.6:0/1726325447 shutdown_connections 2023-10-14T08:56:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3db520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3d9c70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/1726325447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3daac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.973+0000 7fe67e44fb80 1 -- 172.21.15.6:0/1726325447 >> 172.21.15.6:0/1726325447 conn(0x55d7bc307d70 msgr2=0x55d7bc3d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.974+0000 7fe67e44fb80 1 -- 172.21.15.6:0/1726325447 shutdown_connections 2023-10-14T08:56:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.974+0000 7fe67e44fb80 1 -- 172.21.15.6:0/1726325447 wait complete. 2023-10-14T08:56:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.974+0000 7fe66bfff700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6540a15b0 0x7fe6540a3a70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe66400bea0 tx=0x7fe6640cfb80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.974+0000 7fe67e44fb80 1 -- start start 2023-10-14T08:56:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.974+0000 7fe67e44fb80 1 Processor -- start 2023-10-14T08:56:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3ead10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc32ce10 con 0x55d7bc3db0a0 2023-10-14T08:56:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc2c96b0 con 0x55d7bc3da1b0 2023-10-14T08:56:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc2c9350 con 0x55d7bc3d9850 2023-10-14T08:56:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe67e44fb80 10 client.0 _ll_register_callbacks cb 0x55d7bc1267a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe670802700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe670802700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59838/0 (socket says 172.21.15.6:59838) 2023-10-14T08:56:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe670802700 1 -- 172.21.15.6:0/2180652063 learned_addr learned my addr 172.21.15.6:0/2180652063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe670802700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe670802700 1 -- 172.21.15.6:0/2180652063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 msgr2=0x55d7bc3e3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.975+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe670802700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe670802700 1 -- 172.21.15.6:0/2180652063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 msgr2=0x55d7bc3ead10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe670802700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3ead10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe670802700 1 -- 172.21.15.6:0/2180652063 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66000b820 con 0x55d7bc3d9850 2023-10-14T08:56:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:56:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe670802700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e3790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe66000f640 tx=0x7fe66000b2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d95d17ad794adf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe64b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:56:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe64b7fe700 1 -- 172.21.15.6:0/2180652063 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66001d030 con 0x55d7bc3d9850 2023-10-14T08:56:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7bc331e90 con 0x55d7bc3d9850 2023-10-14T08:56:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe64b7fe700 1 -- 172.21.15.6:0/2180652063 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe66001e070 con 0x55d7bc3d9850 2023-10-14T08:56:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe64b7fe700 1 -- 172.21.15.6:0/2180652063 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe66000f910 con 0x55d7bc3d9850 2023-10-14T08:56:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe67e44fb80 10 client.25588 fetch_fsmap learned FSMap version 35 2023-10-14T08:56:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.976+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d7bc157d80 con 0x55d7bc3d9850 2023-10-14T08:56:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe64b7fe700 1 -- 172.21.15.6:0/2180652063 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d7bc331e90 con 0x55d7bc3d9850 2023-10-14T08:56:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe64b7fe700 1 -- 172.21.15.6:0/2180652063 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 35) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe660011900 con 0x55d7bc3d9850 2023-10-14T08:56:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe67e44fb80 10 client.25588 fetch_fsmap finished waiting for FSMap version 35 2023-10-14T08:56:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe67e44fb80 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe67e44fb80 20 client.25588 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc3ef530 0x55d7bc3f1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe67e44fb80 4 client.25588 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:56:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7bc3a9bb0 con 0x55d7bc3ef530 2023-10-14T08:56:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.977+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc3ef530 0x55d7bc3f1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.978+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc3ef530 0x55d7bc3f1950 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ae2dbe3bc32270 server_cookie=ff2c62ec797775be in_seq=0 out_seq=0 2023-10-14T08:56:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.978+0000 7fe64b7fe700 10 client.25588 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.979+0000 7fe64b7fe700 1 -- 172.21.15.6:0/2180652063 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d7bc3a9bb0 con 0x55d7bc3ef530 2023-10-14T08:56:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.979+0000 7fe64b7fe700 10 client.25588 handle_command_reply: tid=0 2023-10-14T08:56:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.979+0000 7fe67e44fb80 1 client.25588 shutdown 2023-10-14T08:56:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 msgr2=0x55d7bc3e3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e3790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe66000f640 tx=0x7fe66000b2c0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 shutdown_connections 2023-10-14T08:56:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc3ef530 0x55d7bc3f1950 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3ead10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e3790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2180652063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 >> 172.21.15.6:0/2180652063 conn(0x55d7bc307d70 msgr2=0x55d7bc3d4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.980+0000 7fe64b7fe700 0 client.25588 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.981+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 shutdown_connections 2023-10-14T08:56:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.981+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2180652063 wait complete. 2023-10-14T08:56:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:19.981+0000 7fe67e44fb80 20 client.25588 trim_cache size 0 max 16384 2023-10-14T08:56:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 Processor -- start 2023-10-14T08:56:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 -- start start 2023-10-14T08:56:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3f1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3de000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc1ad8c0 con 0x55d7bc3db0a0 2023-10-14T08:56:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc3daf20 con 0x55d7bc3da1b0 2023-10-14T08:56:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc3e2c40 con 0x55d7bc3d9850 2023-10-14T08:56:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3eacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32970/0 (socket says 172.21.15.6:32970) 2023-10-14T08:56:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe66b7fe700 1 -- 172.21.15.6:0/2463525065 learned_addr learned my addr 172.21.15.6:0/2463525065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 -- 172.21.15.6:0/2463525065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 msgr2=0x55d7bc3f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 -- 172.21.15.6:0/2463525065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 msgr2=0x55d7bc3eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe670802700 1 -- 172.21.15.6:0/2463525065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7bc140c00 con 0x55d7bc3db0a0 2023-10-14T08:56:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.011+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:56:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.012+0000 7fe670802700 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3de000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe660011d30 tx=0x7fe66000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cd40e40d8bbe98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.012+0000 7fe652ffd700 1 -- 172.21.15.6:0/2463525065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660011ea0 con 0x55d7bc3db0a0 2023-10-14T08:56:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.012+0000 7fe652ffd700 1 -- 172.21.15.6:0/2463525065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe66000fdd0 con 0x55d7bc3db0a0 2023-10-14T08:56:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.012+0000 7fe652ffd700 1 -- 172.21.15.6:0/2463525065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66001d040 con 0x55d7bc3db0a0 2023-10-14T08:56:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2463525065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 msgr2=0x55d7bc3de000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3de000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe660011d30 tx=0x7fe66000bf00 comp rx=0 tx=0).stop 2023-10-14T08:56:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2463525065 shutdown_connections 2023-10-14T08:56:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3de000 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3d9850 0x55d7bc3f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/2463525065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2463525065 >> 172.21.15.6:0/2463525065 conn(0x55d7bc307d70 msgr2=0x55d7bc3e14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2463525065 shutdown_connections 2023-10-14T08:56:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.013+0000 7fe67e44fb80 1 -- 172.21.15.6:0/2463525065 wait complete. 2023-10-14T08:56:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.014+0000 7fe67e44fb80 1 -- start start 2023-10-14T08:56:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 Processor -- start 2023-10-14T08:56:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3e9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc3e9d80 con 0x55d7bc3d9850 2023-10-14T08:56:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc3e9ef0 con 0x55d7bc3db0a0 2023-10-14T08:56:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7bc3ea0b0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe67e44fb80 10 client.0 _ll_register_callbacks cb 0x7fe66000ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe66b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59850/0 (socket says 172.21.15.6:59850) 2023-10-14T08:56:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe66b7fe700 1 -- 172.21.15.6:0/4250044500 learned_addr learned my addr 172.21.15.6:0/4250044500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.015+0000 7fe670802700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe670802700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe66b7fe700 1 -- 172.21.15.6:0/4250044500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3db0a0 msgr2=0x55d7bc3e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe66b7fe700 1 -- 172.21.15.6:0/4250044500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 msgr2=0x55d7bc3e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe66b7fe700 1 -- 172.21.15.6:0/4250044500 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c112450 con 0x55d7bc3da1b0 2023-10-14T08:56:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe670802700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:56:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe66b7fe700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e8860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe65c003680 tx=0x7fe65c0254a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=785c4bc5057579a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.016+0000 7fe64b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:56:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe64b7fe700 1 -- 172.21.15.6:0/4250044500 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c025da0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe64b7fe700 1 -- 172.21.15.6:0/4250044500 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe65c00b8f0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe660004cf0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe64b7fe700 1 -- 172.21.15.6:0/4250044500 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe65c00bab0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe67e44fb80 10 client.25594 fetch_fsmap learned FSMap version 35 2023-10-14T08:56:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55d7bc157d80 con 0x55d7bc3da1b0 2023-10-14T08:56:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe64b7fe700 1 -- 172.21.15.6:0/4250044500 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe660004cf0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.018+0000 7fe64b7fe700 1 -- 172.21.15.6:0/4250044500 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 35) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe65c0099c0 con 0x55d7bc3da1b0 2023-10-14T08:56:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe67e44fb80 10 client.25594 fetch_fsmap finished waiting for FSMap version 35 2023-10-14T08:56:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe67e44fb80 10 client.25594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe67e44fb80 20 client.25594 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc443d00 0x55d7bc446120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe67e44fb80 4 client.25594 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:56:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d7bc325df0 con 0x55d7bc443d00 2023-10-14T08:56:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe670802700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc443d00 0x55d7bc446120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe64b7fe700 10 client.25594 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:20.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.019+0000 7fe670802700 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc443d00 0x55d7bc446120 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96cfee397f04af5c server_cookie=cf89ee4192cdc8ce in_seq=0 out_seq=0 2023-10-14T08:56:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe64b7fe700 1 -- 172.21.15.6:0/4250044500 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d7bc325df0 con 0x55d7bc443d00 2023-10-14T08:56:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe64b7fe700 10 client.25594 handle_command_reply: tid=0 2023-10-14T08:56:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 client.25594 shutdown 2023-10-14T08:56:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 msgr2=0x55d7bc3e8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e8860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe65c003680 tx=0x7fe65c0254a0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 shutdown_connections 2023-10-14T08:56:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d7bc443d00 0x55d7bc446120 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d7bc3db0a0 0x55d7bc3e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7bc3d9850 0x55d7bc3e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 --2- 172.21.15.6:0/4250044500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d7bc3da1b0 0x55d7bc3e8860 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe64b7fe700 0 client.25594 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 >> 172.21.15.6:0/4250044500 conn(0x55d7bc307d70 msgr2=0x55d7bc3e14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 shutdown_connections 2023-10-14T08:56:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 1 -- 172.21.15.6:0/4250044500 wait complete. 2023-10-14T08:56:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.049+0000 7fe67e44fb80 20 client.25594 trim_cache size 0 max 16384 2023-10-14T08:56:20.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:56:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:56:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:56:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:56:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6540a15b0 msgr2=0x7fe6540a3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6540a15b0 0x7fe6540a3a70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe66400bea0 tx=0x7fe6640cfb80 comp rx=0 tx=0).stop 2023-10-14T08:56:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 msgr2=0x7fe66c19d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 0x7fe66c19d290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe66400b9c0 tx=0x7fe66400bd80 comp rx=0 tx=0).stop 2023-10-14T08:56:20.056 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 shutdown_connections 2023-10-14T08:56:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6540a15b0 0x7fe6540a3a70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe66c10f730 0x7fe66c1b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe66c107eb0 0x7fe66c19d290 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 --2- 172.21.15.6:0/682787339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe66c108810 0x7fe66c19d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 >> 172.21.15.6:0/682787339 conn(0x7fe66c06dcf0 msgr2=0x7fe66c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 shutdown_connections 2023-10-14T08:56:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:20.050+0000 7fe672265700 1 -- 172.21.15.6:0/682787339 wait complete. 2023-10-14T08:56:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 200.0 s, 1969.8 tps, lat 51.131 ms stddev 90.417 2023-10-14T08:56:21.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:21 smithi178 ceph-mon[103612]: pgmap v412: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.47k op/s 2023-10-14T08:56:21.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:21 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:21 smithi057 ceph-mon[103313]: pgmap v412: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.47k op/s 2023-10-14T08:56:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:21 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:21.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:21 smithi006 ceph-mon[99452]: pgmap v412: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.47k op/s 2023-10-14T08:56:21.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:21 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:23.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:23 smithi178 ceph-mon[103612]: pgmap v413: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 52 MiB/s wr, 2.25k op/s 2023-10-14T08:56:23.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:23 smithi057 ceph-mon[103313]: pgmap v413: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 52 MiB/s wr, 2.25k op/s 2023-10-14T08:56:23.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:23 smithi006 ceph-mon[99452]: pgmap v413: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 52 MiB/s wr, 2.25k op/s 2023-10-14T08:56:24.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:24 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:24.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:24 smithi178 ceph-mon[103612]: pgmap v414: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 2.05k op/s 2023-10-14T08:56:24.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:24 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:24.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:24 smithi057 ceph-mon[103313]: pgmap v414: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 2.05k op/s 2023-10-14T08:56:24.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:24 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:24.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:24 smithi006 ceph-mon[99452]: pgmap v414: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 2.05k op/s 2023-10-14T08:56:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 205.0 s, 2879.9 tps, lat 34.796 ms stddev 38.733 2023-10-14T08:56:27.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:27 smithi006 ceph-mon[99452]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 47 MiB/s wr, 2.13k op/s 2023-10-14T08:56:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:27 smithi178 ceph-mon[103612]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 47 MiB/s wr, 2.13k op/s 2023-10-14T08:56:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:27 smithi057 ceph-mon[103313]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 47 MiB/s wr, 2.13k op/s 2023-10-14T08:56:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:29 smithi178 ceph-mon[103612]: pgmap v416: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 MiB/s wr, 2.00k op/s 2023-10-14T08:56:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:29 smithi057 ceph-mon[103313]: pgmap v416: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 MiB/s wr, 2.00k op/s 2023-10-14T08:56:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:29 smithi006 ceph-mon[99452]: pgmap v416: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 MiB/s wr, 2.00k op/s 2023-10-14T08:56:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 210.0 s, 2630.1 tps, lat 37.793 ms stddev 40.068 2023-10-14T08:56:31.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:31 smithi178 ceph-mon[103612]: pgmap v417: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.82k op/s 2023-10-14T08:56:31.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:56:31.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:31.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:31 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:31 smithi057 ceph-mon[103313]: pgmap v417: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.82k op/s 2023-10-14T08:56:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:56:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:31.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:31 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:31.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:31 smithi006 ceph-mon[99452]: pgmap v417: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.82k op/s 2023-10-14T08:56:31.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:56:31.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:31.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:31 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:32.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:56:32.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:56:32.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:56:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:56:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:32.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:56:32.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:56:32.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:56:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 -- 172.21.15.6:0/4102079741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 msgr2=0x7f24f0108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 --2- 172.21.15.6:0/4102079741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 0x7f24f0108670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f24e800b0a0 tx=0x7f24e800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 -- 172.21.15.6:0/4102079741 shutdown_connections 2023-10-14T08:56:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 --2- 172.21.15.6:0/4102079741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0109920 0x7f24f01101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 --2- 172.21.15.6:0/4102079741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 0x7f24f0108670 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 --2- 172.21.15.6:0/4102079741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f0108f60 0x7f24f01093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.252+0000 7f24f841d700 1 -- 172.21.15.6:0/4102079741 >> 172.21.15.6:0/4102079741 conn(0x7f24f006dcf0 msgr2=0x7f24f0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.253+0000 7f24f841d700 1 -- 172.21.15.6:0/4102079741 shutdown_connections 2023-10-14T08:56:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.253+0000 7f24f841d700 1 -- 172.21.15.6:0/4102079741 wait complete. 2023-10-14T08:56:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.254+0000 7f24f841d700 1 Processor -- start 2023-10-14T08:56:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.254+0000 7f24f841d700 1 -- start start 2023-10-14T08:56:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f841d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 0x7f24f01186b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f841d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 0x7f24f0118bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f841d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f0109920 0x7f24f011fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f841d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0120230 con 0x7f24f0108250 2023-10-14T08:56:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f841d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f01203a0 con 0x7f24f0108f60 2023-10-14T08:56:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f841d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0120560 con 0x7f24f0109920 2023-10-14T08:56:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 0x7f24f0118bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 0x7f24f0118bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:32990/0 (socket says 172.21.15.6:32990) 2023-10-14T08:56:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.255+0000 7f24f59b8700 1 -- 172.21.15.6:0/2364825073 learned_addr learned my addr 172.21.15.6:0/2364825073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 0x7f24f01186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f69ba700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f0109920 0x7f24f011fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f59b8700 1 -- 172.21.15.6:0/2364825073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f0109920 msgr2=0x7f24f011fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f0109920 0x7f24f011fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f59b8700 1 -- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 msgr2=0x7f24f01186b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 0x7f24f01186b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f59b8700 1 -- 172.21.15.6:0/2364825073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8009d00 con 0x7f24f0108f60 2023-10-14T08:56:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.256+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 0x7f24f0118bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b550 tx=0x7f24e000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.257+0000 7f24e77fe700 1 -- 172.21.15.6:0/2364825073 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0011830 con 0x7f24f0108f60 2023-10-14T08:56:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.257+0000 7f24e77fe700 1 -- 172.21.15.6:0/2364825073 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24e0011e50 con 0x7f24f0108f60 2023-10-14T08:56:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.257+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f01b6550 con 0x7f24f0108f60 2023-10-14T08:56:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.257+0000 7f24e77fe700 1 -- 172.21.15.6:0/2364825073 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e000f2e0 con 0x7f24f0108f60 2023-10-14T08:56:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.257+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f01b6ab0 con 0x7f24f0108f60 2023-10-14T08:56:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.260+0000 7f24e77fe700 1 -- 172.21.15.6:0/2364825073 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f24e0010580 con 0x7f24f0108f60 2023-10-14T08:56:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.260+0000 7f24e77fe700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24dc0a1600 0x7f24dc0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.261+0000 7f24e77fe700 1 -- 172.21.15.6:0/2364825073 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24e00cc710 con 0x7f24f0108f60 2023-10-14T08:56:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.261+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24dc0a1600 0x7f24dc0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.261+0000 7f2504607b80 1 Processor -- start 2023-10-14T08:56:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.261+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24dc0a1600 0x7f24dc0a3ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f24e8000f80 tx=0x7f24e800b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.261+0000 7f2504607b80 1 -- start start 2023-10-14T08:56:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f2504607b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a84306850 0x560a84306c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f2504607b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84307ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f2504607b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a84308520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f2504607b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8427bc10 con 0x560a843071b0 2023-10-14T08:56:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f2504607b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84260c00 con 0x560a843080a0 2023-10-14T08:56:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f2504607b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8425e520 con 0x560a84306850 2023-10-14T08:56:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84307ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84307ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34240/0 (socket says 172.21.15.6:34240) 2023-10-14T08:56:33.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 -- 172.21.15.6:0/270616233 learned_addr learned my addr 172.21.15.6:0/270616233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:33.270 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f61b9700 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a84306850 0x560a84306c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 -- 172.21.15.6:0/270616233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a84306850 msgr2=0x560a84306c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a84306850 0x560a84306c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 -- 172.21.15.6:0/270616233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 msgr2=0x560a84308520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a84308520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 -- 172.21.15.6:0/270616233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a84217390 con 0x560a843071b0 2023-10-14T08:56:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f61b9700 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a84306850 0x560a84306c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:56:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.262+0000 7f24f59b8700 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84307ac0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f24e0095f30 tx=0x7f24e0099670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686cd58ce0be951e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f24e4d82700 1 -- 172.21.15.6:0/270616233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e009a130 con 0x560a843071b0 2023-10-14T08:56:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f24e4d82700 1 -- 172.21.15.6:0/270616233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24e0099a30 con 0x560a843071b0 2023-10-14T08:56:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f24e4d82700 1 -- 172.21.15.6:0/270616233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0099e90 con 0x560a843071b0 2023-10-14T08:56:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 -- 172.21.15.6:0/270616233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 msgr2=0x560a84307ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84307ac0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f24e0095f30 tx=0x7f24e0099670 comp rx=0 tx=0).stop 2023-10-14T08:56:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 -- 172.21.15.6:0/270616233 shutdown_connections 2023-10-14T08:56:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a84308520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a84306850 0x560a84306c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 --2- 172.21.15.6:0/270616233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84307ac0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.263+0000 7f2504607b80 1 -- 172.21.15.6:0/270616233 >> 172.21.15.6:0/270616233 conn(0x560a84234d70 msgr2=0x560a84301c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 -- 172.21.15.6:0/270616233 shutdown_connections 2023-10-14T08:56:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 -- 172.21.15.6:0/270616233 wait complete. 2023-10-14T08:56:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 -- start start 2023-10-14T08:56:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 Processor -- start 2023-10-14T08:56:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84310840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84310d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84317dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84259e10 con 0x560a843071b0 2023-10-14T08:56:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a841f66b0 con 0x560a84306850 2023-10-14T08:56:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.264+0000 7f2504607b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a841f6350 con 0x560a843080a0 2023-10-14T08:56:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f2504607b80 10 client.0 _ll_register_callbacks cb 0x560a840537a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84310d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f61b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84310840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84310d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34246/0 (socket says 172.21.15.6:34246) 2023-10-14T08:56:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 -- 172.21.15.6:0/2275028652 learned_addr learned my addr 172.21.15.6:0/2275028652 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f69ba700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84317dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 -- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 msgr2=0x560a84317dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84317dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 -- 172.21.15.6:0/2275028652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 msgr2=0x560a84310840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84310840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f59b8700 1 -- 172.21.15.6:0/2275028652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f01b6ab0 con 0x560a843071b0 2023-10-14T08:56:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.265+0000 7f24f69ba700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84317dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:56:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84310d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b520 tx=0x7f24e000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d71695b8c141a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f24d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:56:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2275028652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e0099120 con 0x560a843071b0 2023-10-14T08:56:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a8425ee90 con 0x560a843071b0 2023-10-14T08:56:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2275028652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24e00a1dc0 con 0x560a843071b0 2023-10-14T08:56:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2275028652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24e0099c90 con 0x560a843071b0 2023-10-14T08:56:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f2504607b80 10 client.15906 fetch_fsmap learned FSMap version 37 2023-10-14T08:56:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.268+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560a84084d80 con 0x560a843071b0 2023-10-14T08:56:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.271+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2275028652 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560a8425ee90 con 0x560a843071b0 2023-10-14T08:56:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.271+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2275028652 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f24e00b90b0 con 0x560a843071b0 2023-10-14T08:56:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.271+0000 7f2504607b80 10 client.15906 fetch_fsmap finished waiting for FSMap version 37 2023-10-14T08:56:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.271+0000 7f2504607b80 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.272+0000 7f2504607b80 20 client.15906 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.272+0000 7f2504607b80 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a8431c340 0x560a8431e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.272+0000 7f2504607b80 4 client.15906 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:56:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.272+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a842d6bb0 con 0x560a8431c340 2023-10-14T08:56:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.272+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a8431c340 0x560a8431e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.273+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a8431c340 0x560a8431e730 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4658ea45d5cd368 server_cookie=793919e8c2c57cf1 in_seq=0 out_seq=0 2023-10-14T08:56:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f24d9ffb700 10 client.15906 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2275028652 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560a842d6bb0 con 0x560a8431c340 2023-10-14T08:56:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f24d9ffb700 10 client.15906 handle_command_reply: tid=0 2023-10-14T08:56:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 client.15906 shutdown 2023-10-14T08:56:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 msgr2=0x560a84310d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84310d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b520 tx=0x7f24e000be80 comp rx=0 tx=0).stop 2023-10-14T08:56:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 shutdown_connections 2023-10-14T08:56:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a8431c340 0x560a8431e730 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84317dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84310840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 --2- 172.21.15.6:0/2275028652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84310d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.274+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 >> 172.21.15.6:0/2275028652 conn(0x560a84234d70 msgr2=0x560a84301830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.275+0000 7f24d9ffb700 0 client.15906 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.275+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 shutdown_connections 2023-10-14T08:56:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.275+0000 7f2504607b80 1 -- 172.21.15.6:0/2275028652 wait complete. 2023-10-14T08:56:33.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.275+0000 7f2504607b80 20 client.15906 trim_cache size 0 max 16384 2023-10-14T08:56:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.297+0000 7f2504607b80 1 Processor -- start 2023-10-14T08:56:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 -- start start 2023-10-14T08:56:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 0x560a843185f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843071b0 0x560a84317d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a8430f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a840da8c0 con 0x560a84306850 2023-10-14T08:56:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84308940 con 0x560a843080a0 2023-10-14T08:56:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f2504607b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84307600 con 0x560a843071b0 2023-10-14T08:56:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 0x560a843185f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 0x560a843185f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34252/0 (socket says 172.21.15.6:34252) 2023-10-14T08:56:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 -- 172.21.15.6:0/613608205 learned_addr learned my addr 172.21.15.6:0/613608205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f69ba700 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a8430f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f59b8700 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843071b0 0x560a84317d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 -- 172.21.15.6:0/613608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843071b0 msgr2=0x560a84317d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843071b0 0x560a84317d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 -- 172.21.15.6:0/613608205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 msgr2=0x560a8430f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.299+0000 7f24f61b9700 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a8430f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.300+0000 7f24f61b9700 1 -- 172.21.15.6:0/613608205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a8406dc00 con 0x560a84306850 2023-10-14T08:56:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.300+0000 7f24f61b9700 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 0x560a843185f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f24e800b070 tx=0x7f24e801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d974bca998640b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.300+0000 7f24e5583700 1 -- 172.21.15.6:0/613608205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e80077a0 con 0x560a84306850 2023-10-14T08:56:33.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.300+0000 7f24e5583700 1 -- 172.21.15.6:0/613608205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24e802f070 con 0x560a84306850 2023-10-14T08:56:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.300+0000 7f24e5583700 1 -- 172.21.15.6:0/613608205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e80052a0 con 0x560a84306850 2023-10-14T08:56:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 -- 172.21.15.6:0/613608205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 msgr2=0x560a843185f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 0x560a843185f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f24e800b070 tx=0x7f24e801b000 comp rx=0 tx=0).stop 2023-10-14T08:56:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 -- 172.21.15.6:0/613608205 shutdown_connections 2023-10-14T08:56:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a843080a0 0x560a8430f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a84306850 0x560a843185f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 --2- 172.21.15.6:0/613608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843071b0 0x560a84317d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.301+0000 7f2504607b80 1 -- 172.21.15.6:0/613608205 >> 172.21.15.6:0/613608205 conn(0x560a84234d70 msgr2=0x560a8431e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.302+0000 7f2504607b80 1 -- 172.21.15.6:0/613608205 shutdown_connections 2023-10-14T08:56:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.302+0000 7f2504607b80 1 -- 172.21.15.6:0/613608205 wait complete. 2023-10-14T08:56:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.302+0000 7f2504607b80 1 -- start start 2023-10-14T08:56:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.302+0000 7f2504607b80 1 Processor -- start 2023-10-14T08:56:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84315570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84315ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84316ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84317000 con 0x560a843071b0 2023-10-14T08:56:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84317170 con 0x560a84306850 2023-10-14T08:56:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a84317330 con 0x560a843080a0 2023-10-14T08:56:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f2504607b80 10 client.0 _ll_register_callbacks cb 0x7f24e0099840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84315ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84315ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34262/0 (socket says 172.21.15.6:34262) 2023-10-14T08:56:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f61b9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84315570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 -- 172.21.15.6:0/2376107274 learned_addr learned my addr 172.21.15.6:0/2376107274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f69ba700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84316ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 -- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 msgr2=0x560a84316ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84316ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 -- 172.21.15.6:0/2376107274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 msgr2=0x560a84315570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84315570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 -- 172.21.15.6:0/2376107274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f0072790 con 0x560a843071b0 2023-10-14T08:56:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84315570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:56:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24f59b8700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84315ab0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f24e0095e40 tx=0x7f24e0010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f5dd07cb2f5e9a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:56:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.303+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2376107274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e00ad570 con 0x560a843071b0 2023-10-14T08:56:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.304+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24e0099a30 con 0x560a843071b0 2023-10-14T08:56:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.304+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2376107274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f24e00a1dc0 con 0x560a843071b0 2023-10-14T08:56:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.304+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2376107274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24e000d040 con 0x560a843071b0 2023-10-14T08:56:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.304+0000 7f2504607b80 10 client.15912 fetch_fsmap learned FSMap version 37 2023-10-14T08:56:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.304+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x560a840ab1f0 con 0x560a843071b0 2023-10-14T08:56:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.308+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2376107274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24e0099a30 con 0x560a843071b0 2023-10-14T08:56:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.308+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2376107274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f24e0099c90 con 0x560a843071b0 2023-10-14T08:56:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f2504607b80 10 client.15912 fetch_fsmap finished waiting for FSMap version 37 2023-10-14T08:56:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f2504607b80 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f2504607b80 20 client.15912 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f2504607b80 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a843705d0 0x560a843729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f2504607b80 4 client.15912 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:56:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a84252df0 con 0x560a843705d0 2023-10-14T08:56:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.310+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a843705d0 0x560a843729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.311+0000 7f24d9ffb700 10 client.15912 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.311+0000 7f24f61b9700 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a843705d0 0x560a843729f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c48e2a8990e0025a server_cookie=11c27965a6565bb5 in_seq=0 out_seq=0 2023-10-14T08:56:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f24d9ffb700 1 -- 172.21.15.6:0/2376107274 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a84252df0 con 0x560a843705d0 2023-10-14T08:56:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f24d9ffb700 10 client.15912 handle_command_reply: tid=0 2023-10-14T08:56:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 client.15912 shutdown 2023-10-14T08:56:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 msgr2=0x560a84315ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84315ab0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f24e0095e40 tx=0x7f24e0010fd0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 shutdown_connections 2023-10-14T08:56:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a843705d0 0x560a843729f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a843080a0 0x560a84316ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a84306850 0x560a84315570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 --2- 172.21.15.6:0/2376107274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a843071b0 0x560a84315ab0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 >> 172.21.15.6:0/2376107274 conn(0x560a84234d70 msgr2=0x560a8430f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f24d9ffb700 0 client.15912 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 shutdown_connections 2023-10-14T08:56:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 1 -- 172.21.15.6:0/2376107274 wait complete. 2023-10-14T08:56:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.326+0000 7f2504607b80 20 client.15912 trim_cache size 0 max 16384 2023-10-14T08:56:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:56:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:56:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:56:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:56:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24dc0a1600 msgr2=0x7f24dc0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24dc0a1600 0x7f24dc0a3ac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f24e8000f80 tx=0x7f24e800b7b0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 msgr2=0x7f24f0118bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 0x7f24f0118bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24e000b550 tx=0x7f24e000b910 comp rx=0 tx=0).stop 2023-10-14T08:56:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 shutdown_connections 2023-10-14T08:56:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f0109920 0x7f24f011fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24f0108250 0x7f24f01186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f24dc0a1600 0x7f24dc0a3ac0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 --2- 172.21.15.6:0/2364825073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24f0108f60 0x7f24f0118bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 >> 172.21.15.6:0/2364825073 conn(0x7f24f006dcf0 msgr2=0x7f24f006ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 shutdown_connections 2023-10-14T08:56:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:33.328+0000 7f24f841d700 1 -- 172.21.15.6:0/2364825073 wait complete. 2023-10-14T08:56:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:33 smithi178 ceph-mon[103612]: pgmap v418: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 1.57k op/s 2023-10-14T08:56:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:33 smithi057 ceph-mon[103313]: pgmap v418: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 1.57k op/s 2023-10-14T08:56:33.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:33 smithi006 ceph-mon[99452]: pgmap v418: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 MiB/s wr, 1.57k op/s 2023-10-14T08:56:35.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:35 smithi178 ceph-mon[103612]: pgmap v419: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 696 op/s 2023-10-14T08:56:35.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:35 smithi057 ceph-mon[103313]: pgmap v419: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 696 op/s 2023-10-14T08:56:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:35 smithi006 ceph-mon[99452]: pgmap v419: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 696 op/s 2023-10-14T08:56:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 215.0 s, 2044.0 tps, lat 48.755 ms stddev 56.834 2023-10-14T08:56:37.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:37 smithi178 ceph-mon[103612]: pgmap v420: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 833 op/s 2023-10-14T08:56:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:37 smithi057 ceph-mon[103313]: pgmap v420: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 833 op/s 2023-10-14T08:56:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:37 smithi006 ceph-mon[99452]: pgmap v420: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 833 op/s 2023-10-14T08:56:39.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:39 smithi178 ceph-mon[103612]: pgmap v421: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 849 op/s 2023-10-14T08:56:39.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:39 smithi057 ceph-mon[103313]: pgmap v421: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 849 op/s 2023-10-14T08:56:39.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:39 smithi006 ceph-mon[99452]: pgmap v421: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 18 MiB/s wr, 849 op/s 2023-10-14T08:56:40.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:40 smithi178 ceph-mon[103612]: pgmap v422: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 863 op/s 2023-10-14T08:56:40.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:40 smithi057 ceph-mon[103313]: pgmap v422: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 863 op/s 2023-10-14T08:56:40.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:40 smithi006 ceph-mon[99452]: pgmap v422: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 863 op/s 2023-10-14T08:56:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 220.0 s, 1843.2 tps, lat 54.193 ms stddev 59.623 2023-10-14T08:56:43.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:43 smithi006 ceph-mon[99452]: pgmap v423: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 1.07k op/s 2023-10-14T08:56:43.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:43 smithi178 ceph-mon[103612]: pgmap v423: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 1.07k op/s 2023-10-14T08:56:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:43 smithi057 ceph-mon[103313]: pgmap v423: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 MiB/s wr, 1.07k op/s 2023-10-14T08:56:44.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:44 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:44.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:44 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:44.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:44 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:45 smithi006 ceph-mon[99452]: pgmap v424: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 976 op/s 2023-10-14T08:56:45.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:45 smithi178 ceph-mon[103612]: pgmap v424: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 976 op/s 2023-10-14T08:56:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:45 smithi057 ceph-mon[103313]: pgmap v424: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 MiB/s wr, 976 op/s 2023-10-14T08:56:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 225.0 s, 2662.0 tps, lat 37.673 ms stddev 41.322 2023-10-14T08:56:46.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.556+0000 7f72c17e9700 1 -- 172.21.15.6:0/903247808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 msgr2=0x7f72bc10b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.556+0000 7f72c17e9700 1 --2- 172.21.15.6:0/903247808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc10b3b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f72b00098f0 tx=0x7f72b0009c00 comp rx=0 tx=0).stop 2023-10-14T08:56:46.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.557+0000 7f72c17e9700 1 -- 172.21.15.6:0/903247808 shutdown_connections 2023-10-14T08:56:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.557+0000 7f72c17e9700 1 --2- 172.21.15.6:0/903247808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 0x7f72bc110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.557+0000 7f72c17e9700 1 --2- 172.21.15.6:0/903247808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc10b3b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.557+0000 7f72c17e9700 1 --2- 172.21.15.6:0/903247808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72bc10b8f0 0x7f72bc10dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.557+0000 7f72c17e9700 1 -- 172.21.15.6:0/903247808 >> 172.21.15.6:0/903247808 conn(0x7f72bc06dcf0 msgr2=0x7f72bc070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.563+0000 7f72c17e9700 1 -- 172.21.15.6:0/903247808 shutdown_connections 2023-10-14T08:56:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.563+0000 7f72c17e9700 1 -- 172.21.15.6:0/903247808 wait complete. 2023-10-14T08:56:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.564+0000 7f72c17e9700 1 Processor -- start 2023-10-14T08:56:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 -- start start 2023-10-14T08:56:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc19d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72bc10b8f0 0x7f72bc19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 0x7f72bc1a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc1a4eb0 con 0x7f72bc108fc0 2023-10-14T08:56:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc1a4ff0 con 0x7f72bc10e270 2023-10-14T08:56:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.565+0000 7f72c17e9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc1a5180 con 0x7f72bc10b8f0 2023-10-14T08:56:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.566+0000 7f72baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc19d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.566+0000 7f72baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc19d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34272/0 (socket says 172.21.15.6:34272) 2023-10-14T08:56:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.566+0000 7f72baffd700 1 -- 172.21.15.6:0/3547036715 learned_addr learned my addr 172.21.15.6:0/3547036715 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.566+0000 7f72bb7fe700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 0x7f72bc1a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.567+0000 7f72bb7fe700 1 -- 172.21.15.6:0/3547036715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72bc10b8f0 msgr2=0x7f72bc19d870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:56:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.567+0000 7f72bb7fe700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72bc10b8f0 0x7f72bc19d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.567+0000 7f72bb7fe700 1 -- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 msgr2=0x7f72bc19d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.567+0000 7f72bb7fe700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc19d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.567+0000 7f72bb7fe700 1 -- 172.21.15.6:0/3547036715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009520 con 0x7f72bc10e270 2023-10-14T08:56:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.578+0000 7f72bb7fe700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 0x7f72bc1a48e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00d720 tx=0x7f72ac00da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.579+0000 7f72a3fff700 1 -- 172.21.15.6:0/3547036715 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac004a30 con 0x7f72bc10e270 2023-10-14T08:56:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.579+0000 7f72a3fff700 1 -- 172.21.15.6:0/3547036715 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72ac0054e0 con 0x7f72bc10e270 2023-10-14T08:56:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.579+0000 7f72a3fff700 1 -- 172.21.15.6:0/3547036715 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00fb70 con 0x7f72bc10e270 2023-10-14T08:56:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.580+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc1a5460 con 0x7f72bc10e270 2023-10-14T08:56:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.580+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc1a5970 con 0x7f72bc10e270 2023-10-14T08:56:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.587+0000 7f72cd9d3b80 1 Processor -- start 2023-10-14T08:56:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.587+0000 7f72cd9d3b80 1 -- start start 2023-10-14T08:56:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.588+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a934540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.588+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a934a80 0x56072a935340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.588+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a935920 0x56072a935da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.588+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a8a0c10 con 0x56072a934120 2023-10-14T08:56:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.588+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a885c00 con 0x56072a935920 2023-10-14T08:56:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.588+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a883520 con 0x56072a934a80 2023-10-14T08:56:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a934540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a934540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34278/0 (socket says 172.21.15.6:34278) 2023-10-14T08:56:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 -- 172.21.15.6:0/1887516504 learned_addr learned my addr 172.21.15.6:0/1887516504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a935920 0x56072a935da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 -- 172.21.15.6:0/1887516504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a934a80 msgr2=0x56072a935340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:56:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a934a80 0x56072a935340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 -- 172.21.15.6:0/1887516504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a935920 msgr2=0x56072a935da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.589+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a935920 0x56072a935da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.590+0000 7f72ba7fc700 1 -- 172.21.15.6:0/1887516504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56072a83c390 con 0x56072a934120 2023-10-14T08:56:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.590+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a934540 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f72b400f140 tx=0x7f72b40095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551b9536b755a4cc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.595+0000 7f72a3fff700 1 -- 172.21.15.6:0/3547036715 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f72ac004b90 con 0x7f72bc10e270 2023-10-14T08:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.596+0000 7f72a3fff700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72a40a15c0 0x7f72a40a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.596+0000 7f72a3fff700 1 -- 172.21.15.6:0/3547036715 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72ac0ccaa0 con 0x7f72bc10e270 2023-10-14T08:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.596+0000 7f72a17fa700 1 -- 172.21.15.6:0/1887516504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4003a00 con 0x56072a934120 2023-10-14T08:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.596+0000 7f72a17fa700 1 -- 172.21.15.6:0/1887516504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72b4003b60 con 0x56072a934120 2023-10-14T08:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.596+0000 7f72a17fa700 1 -- 172.21.15.6:0/1887516504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4015650 con 0x56072a934120 2023-10-14T08:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.597+0000 7f72baffd700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72a40a15c0 0x7f72a40a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.597+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1887516504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 msgr2=0x56072a934540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.597+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a934540 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f72b400f140 tx=0x7f72b40095e0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.598+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1887516504 shutdown_connections 2023-10-14T08:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.598+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a935920 0x56072a935da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.598+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a934540 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.598+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1887516504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a934a80 0x56072a935340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.598+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1887516504 >> 172.21.15.6:0/1887516504 conn(0x56072a859d70 msgr2=0x56072a926ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.598+0000 7f72baffd700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72a40a15c0 0x7f72a40a3a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72b00098c0 tx=0x7f72b0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.599+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1887516504 shutdown_connections 2023-10-14T08:56:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.599+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1887516504 wait complete. 2023-10-14T08:56:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 -- start start 2023-10-14T08:56:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 Processor -- start 2023-10-14T08:56:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a93df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934a80 0x56072a93e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 0x56072a9454f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a87ee10 con 0x56072a934120 2023-10-14T08:56:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a81b6b0 con 0x56072a934a80 2023-10-14T08:56:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a81b350 con 0x56072a935920 2023-10-14T08:56:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.600+0000 7f72cd9d3b80 10 client.0 _ll_register_callbacks cb 0x56072a6787a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.603+0000 7f72ba7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934a80 0x56072a93e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.603+0000 7f72ba7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934a80 0x56072a93e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33042/0 (socket says 172.21.15.6:33042) 2023-10-14T08:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.603+0000 7f72ba7fc700 1 -- 172.21.15.6:0/1855695313 learned_addr learned my addr 172.21.15.6:0/1855695313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.610+0000 7f72baffd700 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a93df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72baffd700 1 -- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 msgr2=0x56072a9454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72baffd700 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 0x56072a9454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72baffd700 1 -- 172.21.15.6:0/1855695313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934a80 msgr2=0x56072a93e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72baffd700 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934a80 0x56072a93e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72baffd700 1 -- 172.21.15.6:0/1855695313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b4009d30 con 0x56072a934120 2023-10-14T08:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72baffd700 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a93df70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f72b000fbd0 tx=0x7f72b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ef98bd926dd6ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f729eff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f729eff5700 1 -- 172.21.15.6:0/1855695313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b002a070 con 0x56072a934120 2023-10-14T08:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f729eff5700 1 -- 172.21.15.6:0/1855695313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72b000b9f0 con 0x56072a934120 2023-10-14T08:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56072a883e90 con 0x56072a934120 2023-10-14T08:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f729eff5700 1 -- 172.21.15.6:0/1855695313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b000bbb0 con 0x56072a934120 2023-10-14T08:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72cd9d3b80 10 client.15924 fetch_fsmap learned FSMap version 38 2023-10-14T08:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.611+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x56072a6a9d80 con 0x56072a934120 2023-10-14T08:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f729eff5700 1 -- 172.21.15.6:0/1855695313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56072a883e90 con 0x56072a934120 2023-10-14T08:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f729eff5700 1 -- 172.21.15.6:0/1855695313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f72b0024760 con 0x56072a934120 2023-10-14T08:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f72cd9d3b80 10 client.15924 fetch_fsmap finished waiting for FSMap version 38 2023-10-14T08:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f72cd9d3b80 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f72cd9d3b80 20 client.15924 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a92bba0 0x56072a92dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f72cd9d3b80 4 client.15924 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:56:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.612+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56072a8fbbb0 con 0x56072a92bba0 2023-10-14T08:56:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.625+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a92bba0 0x56072a92dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.625+0000 7f729eff5700 10 client.15924 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.625+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a92bba0 0x56072a92dfc0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50ee3bc8cd767cb7 server_cookie=8cbec682cebcc6c8 in_seq=0 out_seq=0 2023-10-14T08:56:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.626+0000 7f729eff5700 1 -- 172.21.15.6:0/1855695313 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56072a8fbbb0 con 0x56072a92bba0 2023-10-14T08:56:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.626+0000 7f729eff5700 10 client.15924 handle_command_reply: tid=0 2023-10-14T08:56:46.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.626+0000 7f72cd9d3b80 1 client.15924 shutdown 2023-10-14T08:56:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.628+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 msgr2=0x56072a93df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.628+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a93df70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f72b000fbd0 tx=0x7f72b0009260 comp rx=0 tx=0).stop 2023-10-14T08:56:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 shutdown_connections 2023-10-14T08:56:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a92bba0 0x56072a92dfc0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 0x56072a9454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934120 0x56072a93df70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/1855695313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934a80 0x56072a93e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f729eff5700 0 client.15924 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.632+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 >> 172.21.15.6:0/1855695313 conn(0x56072a859d70 msgr2=0x56072a926670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.635+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 shutdown_connections 2023-10-14T08:56:46.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.642+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/1855695313 wait complete. 2023-10-14T08:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.646+0000 7f72cd9d3b80 20 client.15924 trim_cache size 0 max 16384 2023-10-14T08:56:46.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.681+0000 7f72cd9d3b80 1 Processor -- start 2023-10-14T08:56:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.681+0000 7f72cd9d3b80 1 -- start start 2023-10-14T08:56:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 0x56072a935d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934a80 0x56072a94b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 0x56072a938900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a6ff8c0 con 0x56072a934a80 2023-10-14T08:56:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a93efc0 con 0x56072a934120 2023-10-14T08:56:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a9278a0 con 0x56072a935920 2023-10-14T08:56:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 0x56072a935d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 0x56072a935d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33050/0 (socket says 172.21.15.6:33050) 2023-10-14T08:56:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 -- 172.21.15.6:0/2929097662 learned_addr learned my addr 172.21.15.6:0/2929097662 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 -- 172.21.15.6:0/2929097662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 msgr2=0x56072a938900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 0x56072a938900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 -- 172.21.15.6:0/2929097662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934a80 msgr2=0x56072a94b1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:56:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934a80 0x56072a94b1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.682+0000 7f72baffd700 1 -- 172.21.15.6:0/2929097662 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56072a692c00 con 0x56072a934120 2023-10-14T08:56:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.683+0000 7f72baffd700 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 0x56072a935d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b2e0 tx=0x7f72b000f460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e226a70b26aa62b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.686+0000 7f72a1ffb700 1 -- 172.21.15.6:0/2929097662 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b002a070 con 0x56072a934120 2023-10-14T08:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.686+0000 7f72a1ffb700 1 -- 172.21.15.6:0/2929097662 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72b002b040 con 0x56072a934120 2023-10-14T08:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.686+0000 7f72a1ffb700 1 -- 172.21.15.6:0/2929097662 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0004a80 con 0x56072a934120 2023-10-14T08:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2929097662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 msgr2=0x56072a935d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 0x56072a935d00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b2e0 tx=0x7f72b000f460 comp rx=0 tx=0).stop 2023-10-14T08:56:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2929097662 shutdown_connections 2023-10-14T08:56:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a935920 0x56072a938900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a934120 0x56072a935d00 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b2e0 tx=0x7f72b000f460 comp rx=0 tx=0).stop 2023-10-14T08:56:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2929097662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a934a80 0x56072a94b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.691+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2929097662 >> 172.21.15.6:0/2929097662 conn(0x56072a859d70 msgr2=0x56072a93bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.696+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2929097662 shutdown_connections 2023-10-14T08:56:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.696+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2929097662 wait complete. 2023-10-14T08:56:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 -- start start 2023-10-14T08:56:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 Processor -- start 2023-10-14T08:56:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 0x56072a949fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a94a510 0x56072a94a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a992330 0x56072a994720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a994da0 con 0x56072a935920 2023-10-14T08:56:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a994f10 con 0x56072a992330 2023-10-14T08:56:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.697+0000 7f72cd9d3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56072a9950d0 con 0x56072a94a510 2023-10-14T08:56:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72cd9d3b80 10 client.0 _ll_register_callbacks cb 0x7f72b000fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:56:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 0x56072a949fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 0x56072a949fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34296/0 (socket says 172.21.15.6:34296) 2023-10-14T08:56:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 -- 172.21.15.6:0/2940791109 learned_addr learned my addr 172.21.15.6:0/2940791109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:56:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 -- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a94a510 msgr2=0x56072a94a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a94a510 0x56072a94a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 -- 172.21.15.6:0/2940791109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a992330 msgr2=0x56072a994720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:56:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a992330 0x56072a994720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.698+0000 7f72baffd700 1 -- 172.21.15.6:0/2940791109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56072a6a9d80 con 0x56072a935920 2023-10-14T08:56:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.699+0000 7f72baffd700 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 0x56072a949fd0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b4c0 tx=0x7f72b000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f745ab4f20d0c19c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:56:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.699+0000 7f729eff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:56:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.699+0000 7f729eff5700 1 -- 172.21.15.6:0/2940791109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b002a070 con 0x56072a935920 2023-10-14T08:56:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.699+0000 7f729eff5700 1 -- 172.21.15.6:0/2940791109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72b003e070 con 0x56072a935920 2023-10-14T08:56:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.702+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72b4003b60 con 0x56072a935920 2023-10-14T08:56:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.703+0000 7f729eff5700 1 -- 172.21.15.6:0/2940791109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72b0046040 con 0x56072a935920 2023-10-14T08:56:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.703+0000 7f72cd9d3b80 10 client.15927 fetch_fsmap learned FSMap version 38 2023-10-14T08:56:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.703+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x56072a6d01f0 con 0x56072a935920 2023-10-14T08:56:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.703+0000 7f729eff5700 1 -- 172.21.15.6:0/2940791109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72b4003b60 con 0x56072a935920 2023-10-14T08:56:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.703+0000 7f729eff5700 1 -- 172.21.15.6:0/2940791109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f72b0052050 con 0x56072a935920 2023-10-14T08:56:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.703+0000 7f72cd9d3b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 38 2023-10-14T08:56:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72cd9d3b80 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:56:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72cd9d3b80 20 client.15927 populate_metadata read hostname 'smithi006' 2023-10-14T08:56:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a996540 0x56072a998960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:56:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72cd9d3b80 4 client.15927 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:56:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56072a877df0 con 0x56072a996540 2023-10-14T08:56:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a996540 0x56072a998960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:56:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.704+0000 7f72ba7fc700 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a996540 0x56072a998960 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8560e1ca218df6bf server_cookie=ff9731af4025038a in_seq=0 out_seq=0 2023-10-14T08:56:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.705+0000 7f729eff5700 10 client.15927 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:46.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f729eff5700 1 -- 172.21.15.6:0/2940791109 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56072a877df0 con 0x56072a996540 2023-10-14T08:56:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f729eff5700 10 client.15927 handle_command_reply: tid=0 2023-10-14T08:56:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 client.15927 shutdown 2023-10-14T08:56:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 msgr2=0x56072a949fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 0x56072a949fd0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f72b000b4c0 tx=0x7f72b000bbd0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 shutdown_connections 2023-10-14T08:56:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56072a996540 0x56072a998960 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56072a992330 0x56072a994720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56072a935920 0x56072a949fd0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 --2- 172.21.15.6:0/2940791109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56072a94a510 0x56072a94a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 >> 172.21.15.6:0/2940791109 conn(0x56072a859d70 msgr2=0x56072a938900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f729eff5700 0 client.15927 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:56:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 shutdown_connections 2023-10-14T08:56:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 1 -- 172.21.15.6:0/2940791109 wait complete. 2023-10-14T08:56:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.914+0000 7f72cd9d3b80 20 client.15927 trim_cache size 0 max 16384 2023-10-14T08:56:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:56:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:56:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:56:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:56:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72a40a15c0 msgr2=0x7f72a40a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72a40a15c0 0x7f72a40a3a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72b00098c0 tx=0x7f72b0019040 comp rx=0 tx=0).stop 2023-10-14T08:56:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 msgr2=0x7f72bc1a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:56:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 0x7f72bc1a48e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00d720 tx=0x7f72ac00da30 comp rx=0 tx=0).stop 2023-10-14T08:56:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 shutdown_connections 2023-10-14T08:56:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72a40a15c0 0x7f72a40a3a80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72bc10e270 0x7f72bc1a48e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc108fc0 0x7f72bc19d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 --2- 172.21.15.6:0/3547036715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72bc10b8f0 0x7f72bc19d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:56:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 >> 172.21.15.6:0/3547036715 conn(0x7f72bc06dcf0 msgr2=0x7f72bc109c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:56:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 shutdown_connections 2023-10-14T08:56:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:56:46.915+0000 7f72c17e9700 1 -- 172.21.15.6:0/3547036715 wait complete. 2023-10-14T08:56:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:47 smithi178 ceph-mon[103612]: pgmap v425: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.16k op/s 2023-10-14T08:56:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:47 smithi057 ceph-mon[103313]: pgmap v425: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.16k op/s 2023-10-14T08:56:47.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:47 smithi006 ceph-mon[99452]: pgmap v425: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 28 MiB/s wr, 1.16k op/s 2023-10-14T08:56:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:49 smithi178 ceph-mon[103612]: pgmap v426: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 35 MiB/s wr, 1.48k op/s 2023-10-14T08:56:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:49 smithi057 ceph-mon[103313]: pgmap v426: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 35 MiB/s wr, 1.48k op/s 2023-10-14T08:56:49.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:49 smithi006 ceph-mon[99452]: pgmap v426: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 35 MiB/s wr, 1.48k op/s 2023-10-14T08:56:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 230.0 s, 2023.6 tps, lat 49.869 ms stddev 90.216 2023-10-14T08:56:51.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:51 smithi178 ceph-mon[103612]: pgmap v427: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 1.73k op/s 2023-10-14T08:56:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:51 smithi057 ceph-mon[103313]: pgmap v427: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 1.73k op/s 2023-10-14T08:56:51.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:51 smithi006 ceph-mon[99452]: pgmap v427: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 1.73k op/s 2023-10-14T08:56:53.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:53 smithi178 ceph-mon[103612]: pgmap v428: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 48 MiB/s wr, 2.13k op/s 2023-10-14T08:56:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:53 smithi057 ceph-mon[103313]: pgmap v428: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 48 MiB/s wr, 2.13k op/s 2023-10-14T08:56:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:53 smithi006 ceph-mon[99452]: pgmap v428: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 48 MiB/s wr, 2.13k op/s 2023-10-14T08:56:55.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:55 smithi178 ceph-mon[103612]: pgmap v429: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 MiB/s wr, 2.00k op/s 2023-10-14T08:56:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:55 smithi057 ceph-mon[103313]: pgmap v429: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 MiB/s wr, 2.00k op/s 2023-10-14T08:56:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:55 smithi006 ceph-mon[99452]: pgmap v429: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 MiB/s wr, 2.00k op/s 2023-10-14T08:56:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 235.0 s, 2719.2 tps, lat 36.601 ms stddev 41.049 2023-10-14T08:56:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:57 smithi178 ceph-mon[103612]: pgmap v430: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 45 MiB/s wr, 2.08k op/s 2023-10-14T08:56:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:57 smithi057 ceph-mon[103313]: pgmap v430: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 45 MiB/s wr, 2.08k op/s 2023-10-14T08:56:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:57 smithi006 ceph-mon[99452]: pgmap v430: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 45 MiB/s wr, 2.08k op/s 2023-10-14T08:56:58.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:58 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:58.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:58 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:58.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:58 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:56:59.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:56:59 smithi178 ceph-mon[103612]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 44 MiB/s wr, 2.01k op/s 2023-10-14T08:56:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:56:59 smithi057 ceph-mon[103313]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 44 MiB/s wr, 2.01k op/s 2023-10-14T08:56:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:56:59 smithi006 ceph-mon[99452]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 44 MiB/s wr, 2.01k op/s 2023-10-14T08:57:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 -- 172.21.15.6:0/775195188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c0ffeb0 msgr2=0x7fd73c100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 --2- 172.21.15.6:0/775195188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c100330 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0098f0 tx=0x7fd72c009c00 comp rx=0 tx=0).stop 2023-10-14T08:57:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 -- 172.21.15.6:0/775195188 shutdown_connections 2023-10-14T08:57:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 --2- 172.21.15.6:0/775195188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c100870 0x7fd73c105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 --2- 172.21.15.6:0/775195188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c0fed80 0x7fd73c0ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 --2- 172.21.15.6:0/775195188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c100330 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 -- 172.21.15.6:0/775195188 >> 172.21.15.6:0/775195188 conn(0x7fd73c0fa6c0 msgr2=0x7fd73c0fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.085+0000 7fd742f76700 1 -- 172.21.15.6:0/775195188 shutdown_connections 2023-10-14T08:57:00.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.086+0000 7fd742f76700 1 -- 172.21.15.6:0/775195188 wait complete. 2023-10-14T08:57:00.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.086+0000 7fd742f76700 1 Processor -- start 2023-10-14T08:57:00.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.086+0000 7fd742f76700 1 -- start start 2023-10-14T08:57:00.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd742f76700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c0fed80 0x7fd73c194a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd742f76700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd742f76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c100870 0x7fd73c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd742f76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19c610 con 0x7fd73c100870 2023-10-14T08:57:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd742f76700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19c750 con 0x7fd73c0fed80 2023-10-14T08:57:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd742f76700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c19c8e0 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c194fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59946/0 (socket says 172.21.15.6:59946) 2023-10-14T08:57:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd73bfff700 1 -- 172.21.15.6:0/4230349881 learned_addr learned my addr 172.21.15.6:0/4230349881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd73bfff700 1 -- 172.21.15.6:0/4230349881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c0fed80 msgr2=0x7fd73c194a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.087+0000 7fd73bfff700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c0fed80 0x7fd73c194a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.088+0000 7fd73bfff700 1 -- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c100870 msgr2=0x7fd73c19c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.088+0000 7fd73bfff700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c100870 0x7fd73c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.088+0000 7fd73bfff700 1 -- 172.21.15.6:0/4230349881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009520 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.096+0000 7fd73bfff700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c194fd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009230 tx=0x7fd72c00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:00.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.096+0000 7fd739ffb700 1 -- 172.21.15.6:0/4230349881 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c01c070 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.096+0000 7fd739ffb700 1 -- 172.21.15.6:0/4230349881 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd72c00f860 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.096+0000 7fd739ffb700 1 -- 172.21.15.6:0/4230349881 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c004c30 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.099+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c19cb60 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.100+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c19cfb0 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.102+0000 7fd739ffb700 1 -- 172.21.15.6:0/4230349881 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd72c020070 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.103+0000 7fd739ffb700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7240b2510 0x7fd7240b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.103+0000 7fd740d12700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7240b2510 0x7fd7240b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.103+0000 7fd739ffb700 1 -- 172.21.15.6:0/4230349881 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd72c0cdc10 con 0x7fd73c0ffeb0 2023-10-14T08:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd740d12700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7240b2510 0x7fd7240b49d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ab90 tx=0x7fd734009250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 Processor -- start 2023-10-14T08:57:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 -- start start 2023-10-14T08:57:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c959eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959f0a0 0x5588c959f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c9512c10 con 0x5588c959d850 2023-10-14T08:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c94f7c00 con 0x5588c959e1b0 2023-10-14T08:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd74f160b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c94f5520 con 0x5588c959f0a0 2023-10-14T08:57:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd740d12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd740d12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34318/0 (socket says 172.21.15.6:34318) 2023-10-14T08:57:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.104+0000 7fd740d12700 1 -- 172.21.15.6:0/3801380642 learned_addr learned my addr 172.21.15.6:0/3801380642 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd741513700 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959f0a0 0x5588c959f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd740d12700 1 -- 172.21.15.6:0/3801380642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959f0a0 msgr2=0x5588c959f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd740d12700 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959f0a0 0x5588c959f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd740d12700 1 -- 172.21.15.6:0/3801380642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 msgr2=0x5588c959eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd740d12700 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c959eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd740d12700 1 -- 172.21.15.6:0/3801380642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c94ae390 con 0x5588c959d850 2023-10-14T08:57:00.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd740d12700 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ce00 tx=0x7fd73400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b6eb33e33da902 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd722ffd700 1 -- 172.21.15.6:0/3801380642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734019420 con 0x5588c959d850 2023-10-14T08:57:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd722ffd700 1 -- 172.21.15.6:0/3801380642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd734019a40 con 0x5588c959d850 2023-10-14T08:57:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.105+0000 7fd722ffd700 1 -- 172.21.15.6:0/3801380642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734021960 con 0x5588c959d850 2023-10-14T08:57:00.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 -- 172.21.15.6:0/3801380642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 msgr2=0x5588c959dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ce00 tx=0x7fd73400f000 comp rx=0 tx=0).stop 2023-10-14T08:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 -- 172.21.15.6:0/3801380642 shutdown_connections 2023-10-14T08:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959f0a0 0x5588c959f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3801380642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c959eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 -- 172.21.15.6:0/3801380642 >> 172.21.15.6:0/3801380642 conn(0x5588c94cbd70 msgr2=0x5588c9598c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 -- 172.21.15.6:0/3801380642 shutdown_connections 2023-10-14T08:57:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 -- 172.21.15.6:0/3801380642 wait complete. 2023-10-14T08:57:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.106+0000 7fd74f160b80 1 -- start start 2023-10-14T08:57:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 Processor -- start 2023-10-14T08:57:00.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959d850 0x5588c95a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c95a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 0x5588c95aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c94f0e10 con 0x5588c959f0a0 2023-10-14T08:57:00.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c948d6b0 con 0x5588c959e1b0 2023-10-14T08:57:00.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c948d350 con 0x5588c959d850 2023-10-14T08:57:00.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd74f160b80 10 client.0 _ll_register_callbacks cb 0x5588c92ea7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:00.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 0x5588c95aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 0x5588c95aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34328/0 (socket says 172.21.15.6:34328) 2023-10-14T08:57:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 -- 172.21.15.6:0/966995635 learned_addr learned my addr 172.21.15.6:0/966995635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd740d12700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959d850 0x5588c95a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd73bfff700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c95a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 -- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959d850 msgr2=0x5588c95a78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959d850 0x5588c95a78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 -- 172.21.15.6:0/966995635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 msgr2=0x5588c95a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c95a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd741513700 1 -- 172.21.15.6:0/966995635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd734012070 con 0x5588c959f0a0 2023-10-14T08:57:00.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.107+0000 7fd73bfff700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c95a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:57:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd741513700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 0x5588c95aee40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd730011690 tx=0x7fd7300119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f48a33d3a2546 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd71bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:57:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd71bfff700 1 -- 172.21.15.6:0/966995635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730009700 con 0x5588c959f0a0 2023-10-14T08:57:00.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd71bfff700 1 -- 172.21.15.6:0/966995635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd730012860 con 0x5588c959f0a0 2023-10-14T08:57:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588c94f5e90 con 0x5588c959f0a0 2023-10-14T08:57:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd71bfff700 1 -- 172.21.15.6:0/966995635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd730012a20 con 0x5588c959f0a0 2023-10-14T08:57:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd74f160b80 10 client.15936 fetch_fsmap learned FSMap version 39 2023-10-14T08:57:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.108+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5588c931bd80 con 0x5588c959f0a0 2023-10-14T08:57:00.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd71bfff700 1 -- 172.21.15.6:0/966995635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5588c94f5e90 con 0x5588c959f0a0 2023-10-14T08:57:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd71bfff700 1 -- 172.21.15.6:0/966995635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fd73001a3f0 con 0x5588c959f0a0 2023-10-14T08:57:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd74f160b80 10 client.15936 fetch_fsmap finished waiting for FSMap version 39 2023-10-14T08:57:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd74f160b80 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd74f160b80 20 client.15936 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:00.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd74f160b80 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c95b3840 0x5588c95b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd74f160b80 4 client.15936 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588c956dbb0 con 0x5588c95b3840 2023-10-14T08:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.109+0000 7fd740d12700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c95b3840 0x5588c95b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.110+0000 7fd740d12700 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c95b3840 0x5588c95b5c60 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71d9c6ab599ff3c server_cookie=a611e6feaa63b89a in_seq=0 out_seq=0 2023-10-14T08:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.110+0000 7fd71bfff700 10 client.15936 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd71bfff700 1 -- 172.21.15.6:0/966995635 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588c956dbb0 con 0x5588c95b3840 2023-10-14T08:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd71bfff700 10 client.15936 handle_command_reply: tid=0 2023-10-14T08:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 client.15936 shutdown 2023-10-14T08:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 msgr2=0x5588c95aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 0x5588c95aee40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd730011690 tx=0x7fd7300119a0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 shutdown_connections 2023-10-14T08:57:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c95b3840 0x5588c95b5c60 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959f0a0 0x5588c95aee40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd71bfff700 0 client.15936 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959d850 0x5588c95a78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 --2- 172.21.15.6:0/966995635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959e1b0 0x5588c95a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 >> 172.21.15.6:0/966995635 conn(0x5588c94cbd70 msgr2=0x5588c9598830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.111+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 shutdown_connections 2023-10-14T08:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.112+0000 7fd74f160b80 1 -- 172.21.15.6:0/966995635 wait complete. 2023-10-14T08:57:00.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.112+0000 7fd74f160b80 20 client.15936 trim_cache size 0 max 16384 2023-10-14T08:57:00.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.135+0000 7fd74f160b80 1 Processor -- start 2023-10-14T08:57:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 -- start start 2023-10-14T08:57:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c93718c0 con 0x5588c959d850 2023-10-14T08:57:00.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c959d4c0 con 0x5588c959f0a0 2023-10-14T08:57:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd74f160b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c9595430 con 0x5588c959e1b0 2023-10-14T08:57:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34332/0 (socket says 172.21.15.6:34332) 2023-10-14T08:57:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 -- 172.21.15.6:0/2171719975 learned_addr learned my addr 172.21.15.6:0/2171719975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd73bfff700 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd741513700 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 -- 172.21.15.6:0/2171719975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 msgr2=0x5588c95aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 -- 172.21.15.6:0/2171719975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 msgr2=0x5588c95a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.136+0000 7fd740d12700 1 -- 172.21.15.6:0/2171719975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588c9304c00 con 0x5588c959d850 2023-10-14T08:57:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.137+0000 7fd740d12700 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd734000f80 tx=0x7fd734009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6662d5562bf5809 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.137+0000 7fd7237fe700 1 -- 172.21.15.6:0/2171719975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734009dd0 con 0x5588c959d850 2023-10-14T08:57:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.137+0000 7fd7237fe700 1 -- 172.21.15.6:0/2171719975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd73402fc30 con 0x5588c959d850 2023-10-14T08:57:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.137+0000 7fd7237fe700 1 -- 172.21.15.6:0/2171719975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340215e0 con 0x5588c959d850 2023-10-14T08:57:00.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.137+0000 7fd74f160b80 1 -- 172.21.15.6:0/2171719975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 msgr2=0x5588c959dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.137+0000 7fd74f160b80 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd734000f80 tx=0x7fd734009ac0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 -- 172.21.15.6:0/2171719975 shutdown_connections 2023-10-14T08:57:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c959dc30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 --2- 172.21.15.6:0/2171719975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 -- 172.21.15.6:0/2171719975 >> 172.21.15.6:0/2171719975 conn(0x5588c94cbd70 msgr2=0x5588c95a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 -- 172.21.15.6:0/2171719975 shutdown_connections 2023-10-14T08:57:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.138+0000 7fd74f160b80 1 -- 172.21.15.6:0/2171719975 wait complete. 2023-10-14T08:57:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 -- start start 2023-10-14T08:57:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 Processor -- start 2023-10-14T08:57:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c95aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c95ae510 con 0x5588c959d850 2023-10-14T08:57:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c95ae680 con 0x5588c959f0a0 2023-10-14T08:57:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c95ae840 con 0x5588c959e1b0 2023-10-14T08:57:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.139+0000 7fd74f160b80 10 client.0 _ll_register_callbacks cb 0x5588c92ea7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:59972/0 (socket says 172.21.15.6:59972) 2023-10-14T08:57:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd73bfff700 1 -- 172.21.15.6:0/3831550093 learned_addr learned my addr 172.21.15.6:0/3831550093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd740d12700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c95aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 -- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 msgr2=0x5588c95ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 -- 172.21.15.6:0/3831550093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 msgr2=0x5588c95aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c95aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 -- 172.21.15.6:0/3831550093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588c94ae390 con 0x5588c959f0a0 2023-10-14T08:57:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd73bfff700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:57:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd741513700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95adfd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c00 tx=0x7fd73001acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41cc66429d93a6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.140+0000 7fd71bfff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:57:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd71bfff700 1 -- 172.21.15.6:0/3831550093 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730005a00 con 0x5588c959f0a0 2023-10-14T08:57:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd71bfff700 1 -- 172.21.15.6:0/3831550093 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd730004830 con 0x5588c959f0a0 2023-10-14T08:57:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd734019a40 con 0x5588c959f0a0 2023-10-14T08:57:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd71bfff700 1 -- 172.21.15.6:0/3831550093 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7300049f0 con 0x5588c959f0a0 2023-10-14T08:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 10 client.25574 fetch_fsmap learned FSMap version 39 2023-10-14T08:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5588c93421f0 con 0x5588c959f0a0 2023-10-14T08:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd71bfff700 1 -- 172.21.15.6:0/3831550093 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd73003d020 con 0x5588c959f0a0 2023-10-14T08:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd71bfff700 1 -- 172.21.15.6:0/3831550093 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 39) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fd730012660 con 0x5588c959f0a0 2023-10-14T08:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 10 client.25574 fetch_fsmap finished waiting for FSMap version 39 2023-10-14T08:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 10 client.25574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 20 client.25574 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c9608440 0x5588c960a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 4 client.25574 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.141+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5588c94e9df0 con 0x5588c9608440 2023-10-14T08:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.142+0000 7fd740d12700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c9608440 0x5588c960a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.142+0000 7fd71bfff700 10 client.25574 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.142+0000 7fd740d12700 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c9608440 0x5588c960a860 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d60fef7e084648a server_cookie=1b2e9c6eb586629f in_seq=0 out_seq=0 2023-10-14T08:57:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd71bfff700 1 -- 172.21.15.6:0/3831550093 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5588c94e9df0 con 0x5588c9608440 2023-10-14T08:57:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd71bfff700 10 client.25574 handle_command_reply: tid=0 2023-10-14T08:57:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 client.25574 shutdown 2023-10-14T08:57:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 msgr2=0x5588c95adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95adfd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c00 tx=0x7fd73001acd0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 shutdown_connections 2023-10-14T08:57:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5588c9608440 0x5588c960a860 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5588c959f0a0 0x5588c95adfd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5588c959d850 0x5588c95aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 --2- 172.21.15.6:0/3831550093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c959e1b0 0x5588c95ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd71bfff700 0 client.25574 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:00.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.171+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 >> 172.21.15.6:0/3831550093 conn(0x5588c94cbd70 msgr2=0x5588c95a15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.172+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 shutdown_connections 2023-10-14T08:57:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.172+0000 7fd74f160b80 1 -- 172.21.15.6:0/3831550093 wait complete. 2023-10-14T08:57:00.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd74f160b80 20 client.25574 trim_cache size 0 max 16384 2023-10-14T08:57:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:57:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:57:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:57:00.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:57:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7240b2510 msgr2=0x7fd7240b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7240b2510 0x7fd7240b49d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ab90 tx=0x7fd734009250 comp rx=0 tx=0).stop 2023-10-14T08:57:00.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 msgr2=0x7fd73c194fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c194fd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009230 tx=0x7fd72c00b840 comp rx=0 tx=0).stop 2023-10-14T08:57:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 shutdown_connections 2023-10-14T08:57:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd73c100870 0x7fd73c19c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd7240b2510 0x7fd7240b49d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd73c0fed80 0x7fd73c194a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 --2- 172.21.15.6:0/4230349881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd73c0ffeb0 0x7fd73c194fd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 >> 172.21.15.6:0/4230349881 conn(0x7fd73c0fa6c0 msgr2=0x7fd73c0fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 shutdown_connections 2023-10-14T08:57:00.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:00.173+0000 7fd742f76700 1 -- 172.21.15.6:0/4230349881 wait complete. 2023-10-14T08:57:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 240.0 s, 3022.4 tps, lat 33.140 ms stddev 37.626 2023-10-14T08:57:01.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:01 smithi178 ceph-mon[103612]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 1.54k op/s 2023-10-14T08:57:01.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:01 smithi057 ceph-mon[103313]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 1.54k op/s 2023-10-14T08:57:01.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:01 smithi006 ceph-mon[99452]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 33 MiB/s wr, 1.54k op/s 2023-10-14T08:57:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:03 smithi178 ceph-mon[103612]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 MiB/s wr, 1.22k op/s 2023-10-14T08:57:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:03 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:57:03.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:03 smithi057 ceph-mon[103313]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 MiB/s wr, 1.22k op/s 2023-10-14T08:57:03.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:03 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:57:03.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:03 smithi006 ceph-mon[99452]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 26 MiB/s wr, 1.22k op/s 2023-10-14T08:57:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:03 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:57:04.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:04 smithi057 ceph-mon[103313]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 19 MiB/s wr, 793 op/s 2023-10-14T08:57:04.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:04 smithi006 ceph-mon[99452]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 19 MiB/s wr, 793 op/s 2023-10-14T08:57:04.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:04 smithi178 ceph-mon[103612]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 19 MiB/s wr, 793 op/s 2023-10-14T08:57:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 245.0 s, 2886.7 tps, lat 34.736 ms stddev 38.730 2023-10-14T08:57:07.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:07 smithi006 ceph-mon[99452]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 18 MiB/s wr, 852 op/s 2023-10-14T08:57:07.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:07 smithi178 ceph-mon[103612]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 18 MiB/s wr, 852 op/s 2023-10-14T08:57:07.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:07 smithi057 ceph-mon[103313]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 18 MiB/s wr, 852 op/s 2023-10-14T08:57:09.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:09 smithi006 ceph-mon[99452]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 834 op/s 2023-10-14T08:57:09.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:09 smithi178 ceph-mon[103612]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 834 op/s 2023-10-14T08:57:09.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:09 smithi057 ceph-mon[103313]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 834 op/s 2023-10-14T08:57:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 250.0 s, 2278.1 tps, lat 43.793 ms stddev 52.681 2023-10-14T08:57:11.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:11 smithi178 ceph-mon[103612]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 809 op/s 2023-10-14T08:57:11.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:11 smithi057 ceph-mon[103313]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 809 op/s 2023-10-14T08:57:11.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:11 smithi006 ceph-mon[99452]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 809 op/s 2023-10-14T08:57:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 -- 172.21.15.6:0/1618475826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8640fff10 msgr2=0x7fc864100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 --2- 172.21.15.6:0/1618475826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8640fff10 0x7fc864100390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc854009f90 tx=0x7fc85400b330 comp rx=0 tx=0).stop 2023-10-14T08:57:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 -- 172.21.15.6:0/1618475826 shutdown_connections 2023-10-14T08:57:13.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 --2- 172.21.15.6:0/1618475826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8641008d0 0x7fc864105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 --2- 172.21.15.6:0/1618475826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ff1b0 0x7fc8640ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 --2- 172.21.15.6:0/1618475826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8640fff10 0x7fc864100390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.325+0000 7fc86c512700 1 -- 172.21.15.6:0/1618475826 >> 172.21.15.6:0/1618475826 conn(0x7fc8640faac0 msgr2=0x7fc8640fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.326+0000 7fc86c512700 1 -- 172.21.15.6:0/1618475826 shutdown_connections 2023-10-14T08:57:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.326+0000 7fc86c512700 1 -- 172.21.15.6:0/1618475826 wait complete. 2023-10-14T08:57:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 Processor -- start 2023-10-14T08:57:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 -- start start 2023-10-14T08:57:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ff1b0 0x7fc86406f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 0x7fc86406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8641008d0 0x7fc8641ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864072da0 con 0x7fc8640fff10 2023-10-14T08:57:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864072f10 con 0x7fc8641008d0 2023-10-14T08:57:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86c512700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641ad900 con 0x7fc8640ff1b0 2023-10-14T08:57:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc869aad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 0x7fc86406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ff1b0 0x7fc86406f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc869aad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 0x7fc86406fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34354/0 (socket says 172.21.15.6:34354) 2023-10-14T08:57:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc869aad700 1 -- 172.21.15.6:0/984389092 learned_addr learned my addr 172.21.15.6:0/984389092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.327+0000 7fc86aaaf700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8641008d0 0x7fc8641ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.328+0000 7fc869aad700 1 -- 172.21.15.6:0/984389092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ff1b0 msgr2=0x7fc86406f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.328+0000 7fc869aad700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ff1b0 0x7fc86406f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.328+0000 7fc869aad700 1 -- 172.21.15.6:0/984389092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8641008d0 msgr2=0x7fc8641ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.328+0000 7fc869aad700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8641008d0 0x7fc8641ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.328+0000 7fc869aad700 1 -- 172.21.15.6:0/984389092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009c40 con 0x7fc8640fff10 2023-10-14T08:57:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.328+0000 7fc869aad700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 0x7fc86406fcc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc854009740 tx=0x7fc85400ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.329+0000 7fc8637fe700 1 -- 172.21.15.6:0/984389092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400e070 con 0x7fc8640fff10 2023-10-14T08:57:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.329+0000 7fc8637fe700 1 -- 172.21.15.6:0/984389092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc854005770 con 0x7fc8640fff10 2023-10-14T08:57:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.329+0000 7fc8637fe700 1 -- 172.21.15.6:0/984389092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85401a9f0 con 0x7fc8640fff10 2023-10-14T08:57:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.330+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8641adb30 con 0x7fc8640fff10 2023-10-14T08:57:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.330+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8641adea0 con 0x7fc8640fff10 2023-10-14T08:57:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.333+0000 7fc8637fe700 1 -- 172.21.15.6:0/984389092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc8540058e0 con 0x7fc8640fff10 2023-10-14T08:57:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.334+0000 7fc8637fe700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc84c0a15d0 0x7fc84c0a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.334+0000 7fc8637fe700 1 -- 172.21.15.6:0/984389092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8540cd760 con 0x7fc8640fff10 2023-10-14T08:57:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.334+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc84c0a15d0 0x7fc84c0a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.334+0000 7fc8786fcb80 1 Processor -- start 2023-10-14T08:57:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 -- start start 2023-10-14T08:57:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 0x5608b85d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d31c0 0x5608b85d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85d4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b8536c10 con 0x5608b85d31c0 2023-10-14T08:57:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b851bc00 con 0x5608b85d2860 2023-10-14T08:57:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b8519520 con 0x5608b85d40b0 2023-10-14T08:57:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc84c0a15d0 0x7fc84c0a3a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc858009c60 tx=0x7fc858009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 0x5608b85d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86aaaf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 0x5608b85d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33118/0 (socket says 172.21.15.6:33118) 2023-10-14T08:57:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86a2ae700 1 -- 172.21.15.6:0/4009444568 learned_addr learned my addr 172.21.15.6:0/4009444568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc869aad700 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d31c0 0x5608b85d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86a2ae700 1 -- 172.21.15.6:0/4009444568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 msgr2=0x5608b85d4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.335+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85d4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.336+0000 7fc86a2ae700 1 -- 172.21.15.6:0/4009444568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d31c0 msgr2=0x5608b85d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.336+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d31c0 0x5608b85d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.336+0000 7fc86a2ae700 1 -- 172.21.15.6:0/4009444568 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608b84d2390 con 0x5608b85d2860 2023-10-14T08:57:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.336+0000 7fc869aad700 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d31c0 0x5608b85d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:57:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.336+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 0x5608b85d2c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc85800e430 tx=0x7fc858014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c53b330e4e42d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.336+0000 7fc860ff9700 1 -- 172.21.15.6:0/4009444568 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858026430 con 0x5608b85d2860 2023-10-14T08:57:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.337+0000 7fc860ff9700 1 -- 172.21.15.6:0/4009444568 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc858021070 con 0x5608b85d2860 2023-10-14T08:57:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.337+0000 7fc860ff9700 1 -- 172.21.15.6:0/4009444568 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8580256c0 con 0x5608b85d2860 2023-10-14T08:57:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.337+0000 7fc8786fcb80 1 -- 172.21.15.6:0/4009444568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 msgr2=0x5608b85d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.337+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 0x5608b85d2c80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc85800e430 tx=0x7fc858014000 comp rx=0 tx=0).stop 2023-10-14T08:57:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 -- 172.21.15.6:0/4009444568 shutdown_connections 2023-10-14T08:57:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85d4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d2860 0x5608b85d2c80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/4009444568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d31c0 0x5608b85d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 -- 172.21.15.6:0/4009444568 >> 172.21.15.6:0/4009444568 conn(0x5608b84efd70 msgr2=0x5608b85bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 -- 172.21.15.6:0/4009444568 shutdown_connections 2023-10-14T08:57:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.338+0000 7fc8786fcb80 1 -- 172.21.15.6:0/4009444568 wait complete. 2023-10-14T08:57:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 -- start start 2023-10-14T08:57:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 Processor -- start 2023-10-14T08:57:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85dcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b8514e10 con 0x5608b85d2860 2023-10-14T08:57:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b84b16b0 con 0x5608b85d31c0 2023-10-14T08:57:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b84b1350 con 0x5608b85d40b0 2023-10-14T08:57:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc8786fcb80 10 client.0 _ll_register_callbacks cb 0x5608b830e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85dc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34366/0 (socket says 172.21.15.6:34366) 2023-10-14T08:57:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc86a2ae700 1 -- 172.21.15.6:0/103704780 learned_addr learned my addr 172.21.15.6:0/103704780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.339+0000 7fc86aaaf700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.340+0000 7fc869aad700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85dcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.340+0000 7fc86a2ae700 1 -- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 msgr2=0x5608b85e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.340+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.340+0000 7fc86a2ae700 1 -- 172.21.15.6:0/103704780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 msgr2=0x5608b85dcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.340+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85dcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.340+0000 7fc86a2ae700 1 -- 172.21.15.6:0/103704780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc858017070 con 0x5608b85d2860 2023-10-14T08:57:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.341+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85dc700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc858011ab0 tx=0x7fc85800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db548205a50e19d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.341+0000 7fc849ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:57:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.341+0000 7fc86aaaf700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc849ffb700 1 -- 172.21.15.6:0/103704780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858005250 con 0x5608b85d2860 2023-10-14T08:57:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc849ffb700 1 -- 172.21.15.6:0/103704780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8580053b0 con 0x5608b85d2860 2023-10-14T08:57:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608b8519e90 con 0x5608b85d2860 2023-10-14T08:57:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc849ffb700 1 -- 172.21.15.6:0/103704780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc858005570 con 0x5608b85d2860 2023-10-14T08:57:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc8786fcb80 10 client.15954 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5608b833fd80 con 0x5608b85d2860 2023-10-14T08:57:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.342+0000 7fc849ffb700 1 -- 172.21.15.6:0/103704780 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5608b8519e90 con 0x5608b85d2860 2023-10-14T08:57:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc849ffb700 1 -- 172.21.15.6:0/103704780 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc85801d960 con 0x5608b85d2860 2023-10-14T08:57:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc8786fcb80 10 client.15954 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc8786fcb80 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc8786fcb80 20 client.15954 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b85e8450 0x5608b85ea870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc8786fcb80 4 client.15954 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:57:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608b8591bb0 con 0x5608b85e8450 2023-10-14T08:57:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.343+0000 7fc869aad700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b85e8450 0x5608b85ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc849ffb700 10 client.15954 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc869aad700 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b85e8450 0x5608b85ea870 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722ec4e170460b0d server_cookie=d3dbfb28cf1ffea8 in_seq=0 out_seq=0 2023-10-14T08:57:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc849ffb700 1 -- 172.21.15.6:0/103704780 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5608b8591bb0 con 0x5608b85e8450 2023-10-14T08:57:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc849ffb700 10 client.15954 handle_command_reply: tid=0 2023-10-14T08:57:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc8786fcb80 1 client.15954 shutdown 2023-10-14T08:57:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 msgr2=0x5608b85dc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.344+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85dc700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc858011ab0 tx=0x7fc85800ed30 comp rx=0 tx=0).stop 2023-10-14T08:57:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 shutdown_connections 2023-10-14T08:57:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b85e8450 0x5608b85ea870 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85dc700 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/103704780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85dcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc849ffb700 0 client.15954 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 >> 172.21.15.6:0/103704780 conn(0x5608b84efd70 msgr2=0x5608b85bc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 shutdown_connections 2023-10-14T08:57:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 1 -- 172.21.15.6:0/103704780 wait complete. 2023-10-14T08:57:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.345+0000 7fc8786fcb80 20 client.15954 trim_cache size 0 max 16384 2023-10-14T08:57:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.367+0000 7fc8786fcb80 1 Processor -- start 2023-10-14T08:57:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.367+0000 7fc8786fcb80 1 -- start start 2023-10-14T08:57:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d2860 0x5608b85d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d40b0 0x5608b85d7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b83958c0 con 0x5608b85d40b0 2023-10-14T08:57:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b85dd8f0 con 0x5608b85d31c0 2023-10-14T08:57:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b85d3f30 con 0x5608b85d2860 2023-10-14T08:57:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc86aaaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d40b0 0x5608b85d7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc86aaaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d40b0 0x5608b85d7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34378/0 (socket says 172.21.15.6:34378) 2023-10-14T08:57:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.368+0000 7fc86aaaf700 1 -- 172.21.15.6:0/2515633451 learned_addr learned my addr 172.21.15.6:0/2515633451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d2860 0x5608b85d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 -- 172.21.15.6:0/2515633451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d2860 msgr2=0x5608b85d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d2860 0x5608b85d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 -- 172.21.15.6:0/2515633451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d40b0 msgr2=0x5608b85d7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d40b0 0x5608b85d7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 -- 172.21.15.6:0/2515633451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608b8328c00 con 0x5608b85d31c0 2023-10-14T08:57:13.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d2860 0x5608b85d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:57:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.369+0000 7fc869aad700 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85e3c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8540cb260 tx=0x7fc85401a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bee936228626047 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.370+0000 7fc8617fa700 1 -- 172.21.15.6:0/2515633451 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540a2e10 con 0x5608b85d31c0 2023-10-14T08:57:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.370+0000 7fc8617fa700 1 -- 172.21.15.6:0/2515633451 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8540cb370 con 0x5608b85d31c0 2023-10-14T08:57:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.370+0000 7fc8617fa700 1 -- 172.21.15.6:0/2515633451 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85409ad70 con 0x5608b85d31c0 2023-10-14T08:57:13.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 -- 172.21.15.6:0/2515633451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 msgr2=0x5608b85e3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85e3c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8540cb260 tx=0x7fc85401a3f0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 -- 172.21.15.6:0/2515633451 shutdown_connections 2023-10-14T08:57:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d40b0 0x5608b85d7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d2860 0x5608b85d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/2515633451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85d31c0 0x5608b85e3c40 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8540cb260 tx=0x7fc85401a3f0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 -- 172.21.15.6:0/2515633451 >> 172.21.15.6:0/2515633451 conn(0x5608b84efd70 msgr2=0x5608b85da490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 -- 172.21.15.6:0/2515633451 shutdown_connections 2023-10-14T08:57:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 -- 172.21.15.6:0/2515633451 wait complete. 2023-10-14T08:57:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.371+0000 7fc8786fcb80 1 -- start start 2023-10-14T08:57:13.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 Processor -- start 2023-10-14T08:57:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85e2c10 0x5608b85e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b85e35d0 con 0x5608b85d2860 2023-10-14T08:57:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b85e3740 con 0x5608b85e2c10 2023-10-14T08:57:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608b85e3900 con 0x5608b85d40b0 2023-10-14T08:57:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc8786fcb80 10 client.0 _ll_register_callbacks cb 0x7fc85800e460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc86a2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85df6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34380/0 (socket says 172.21.15.6:34380) 2023-10-14T08:57:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc86a2ae700 1 -- 172.21.15.6:0/84617309 learned_addr learned my addr 172.21.15.6:0/84617309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc869aad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.372+0000 7fc86aaaf700 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85e2c10 0x5608b85e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc86a2ae700 1 -- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 msgr2=0x5608b85dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85dfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc86a2ae700 1 -- 172.21.15.6:0/84617309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85e2c10 msgr2=0x5608b85e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85e2c10 0x5608b85e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc86a2ae700 1 -- 172.21.15.6:0/84617309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8641adea0 con 0x5608b85d2860 2023-10-14T08:57:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc86a2ae700 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85df6b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc85800eda0 tx=0x7fc85800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60616863349480b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc849ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:57:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc849ffb700 1 -- 172.21.15.6:0/84617309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858005250 con 0x5608b85d2860 2023-10-14T08:57:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc849ffb700 1 -- 172.21.15.6:0/84617309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc8580053b0 con 0x5608b85d2860 2023-10-14T08:57:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc858021070 con 0x5608b85d2860 2023-10-14T08:57:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc849ffb700 1 -- 172.21.15.6:0/84617309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc858005570 con 0x5608b85d2860 2023-10-14T08:57:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc8786fcb80 10 client.15960 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5608b83661f0 con 0x5608b85d2860 2023-10-14T08:57:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.373+0000 7fc849ffb700 1 -- 172.21.15.6:0/84617309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc858021070 con 0x5608b85d2860 2023-10-14T08:57:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc849ffb700 1 -- 172.21.15.6:0/84617309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc858003a00 con 0x5608b85d2860 2023-10-14T08:57:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc8786fcb80 10 client.15960 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc8786fcb80 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:13.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc8786fcb80 20 client.15960 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b863d040 0x5608b863f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc8786fcb80 4 client.15960 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:57:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5608b850ddf0 con 0x5608b863d040 2023-10-14T08:57:13.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc869aad700 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b863d040 0x5608b863f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc869aad700 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b863d040 0x5608b863f460 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5522820d44cbd4 server_cookie=ccccf59514ed9ea2 in_seq=0 out_seq=0 2023-10-14T08:57:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.374+0000 7fc849ffb700 10 client.15960 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc849ffb700 1 -- 172.21.15.6:0/84617309 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5608b850ddf0 con 0x5608b863d040 2023-10-14T08:57:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc849ffb700 10 client.15960 handle_command_reply: tid=0 2023-10-14T08:57:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 client.15960 shutdown 2023-10-14T08:57:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 msgr2=0x5608b85df6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85df6b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc85800eda0 tx=0x7fc85800eec0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 shutdown_connections 2023-10-14T08:57:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5608b863d040 0x5608b863f460 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5608b85e2c10 0x5608b85e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc849ffb700 0 client.15960 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5608b85d2860 0x5608b85df6b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 --2- 172.21.15.6:0/84617309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608b85d40b0 0x5608b85dfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 >> 172.21.15.6:0/84617309 conn(0x5608b84efd70 msgr2=0x5608b85d6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 shutdown_connections 2023-10-14T08:57:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 1 -- 172.21.15.6:0/84617309 wait complete. 2023-10-14T08:57:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.391+0000 7fc8786fcb80 20 client.15960 trim_cache size 0 max 16384 2023-10-14T08:57:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:57:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:57:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:57:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:57:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.392+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc84c0a15d0 msgr2=0x7fc84c0a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.392+0000 7fc86c512700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc84c0a15d0 0x7fc84c0a3a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc858009c60 tx=0x7fc858009260 comp rx=0 tx=0).stop 2023-10-14T08:57:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.392+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 msgr2=0x7fc86406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.392+0000 7fc86c512700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 0x7fc86406fcc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc854009740 tx=0x7fc85400ca00 comp rx=0 tx=0).stop 2023-10-14T08:57:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 shutdown_connections 2023-10-14T08:57:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc84c0a15d0 0x7fc84c0a3a90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8641008d0 0x7fc8641ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ff1b0 0x7fc86406f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 --2- 172.21.15.6:0/984389092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8640fff10 0x7fc86406fcc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 >> 172.21.15.6:0/984389092 conn(0x7fc8640faac0 msgr2=0x7fc8640fb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.393+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 shutdown_connections 2023-10-14T08:57:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:13.394+0000 7fc86c512700 1 -- 172.21.15.6:0/984389092 wait complete. 2023-10-14T08:57:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:13 smithi178 ceph-mon[103612]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 16 MiB/s wr, 900 op/s 2023-10-14T08:57:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:13 smithi057 ceph-mon[103313]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 16 MiB/s wr, 900 op/s 2023-10-14T08:57:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:13 smithi006 ceph-mon[99452]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 16 MiB/s wr, 900 op/s 2023-10-14T08:57:15.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:15 smithi178 ceph-mon[103612]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 990 op/s 2023-10-14T08:57:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:15 smithi057 ceph-mon[103313]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 990 op/s 2023-10-14T08:57:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:15 smithi006 ceph-mon[99452]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 990 op/s 2023-10-14T08:57:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 255.0 s, 2325.6 tps, lat 42.780 ms stddev 47.649 2023-10-14T08:57:17.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:17 smithi178 ceph-mon[103612]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 20 MiB/s wr, 1.08k op/s 2023-10-14T08:57:17.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:17 smithi057 ceph-mon[103313]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 20 MiB/s wr, 1.08k op/s 2023-10-14T08:57:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:17 smithi006 ceph-mon[99452]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 20 MiB/s wr, 1.08k op/s 2023-10-14T08:57:19.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:19 smithi178 ceph-mon[103612]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-10-14T08:57:19.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:19 smithi057 ceph-mon[103313]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-10-14T08:57:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:19 smithi006 ceph-mon[99452]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-10-14T08:57:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 260.0 s, 2235.6 tps, lat 44.569 ms stddev 52.975 2023-10-14T08:57:21.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:21 smithi178 ceph-mon[103612]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 947 op/s 2023-10-14T08:57:21.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:21 smithi057 ceph-mon[103313]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 947 op/s 2023-10-14T08:57:21.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:21 smithi006 ceph-mon[99452]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 22 MiB/s wr, 947 op/s 2023-10-14T08:57:22.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:22 smithi057 ceph-mon[103313]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 927 op/s 2023-10-14T08:57:22.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:22 smithi006 ceph-mon[99452]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 927 op/s 2023-10-14T08:57:22.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:22 smithi178 ceph-mon[103612]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 927 op/s 2023-10-14T08:57:24.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:24 smithi057 ceph-mon[103313]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 921 op/s 2023-10-14T08:57:24.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:24 smithi006 ceph-mon[99452]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 921 op/s 2023-10-14T08:57:25.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:24 smithi178 ceph-mon[103612]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 921 op/s 2023-10-14T08:57:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 265.0 s, 2070.0 tps, lat 48.742 ms stddev 91.196 2023-10-14T08:57:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 -- 172.21.15.6:0/639503762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8100f70 msgr2=0x7f93e81013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 --2- 172.21.15.6:0/639503762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8100f70 0x7f93e81013f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f93e000b0a0 tx=0x7f93e000b3b0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 -- 172.21.15.6:0/639503762 shutdown_connections 2023-10-14T08:57:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 --2- 172.21.15.6:0/639503762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e8101930 0x7f93e8108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 --2- 172.21.15.6:0/639503762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e80ffe20 0x7f93e8100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 --2- 172.21.15.6:0/639503762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8100f70 0x7f93e81013f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 -- 172.21.15.6:0/639503762 >> 172.21.15.6:0/639503762 conn(0x7f93e80fb370 msgr2=0x7f93e80fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 -- 172.21.15.6:0/639503762 shutdown_connections 2023-10-14T08:57:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.547+0000 7f93edb99700 1 -- 172.21.15.6:0/639503762 wait complete. 2023-10-14T08:57:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 Processor -- start 2023-10-14T08:57:26.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 -- start start 2023-10-14T08:57:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e80ffe20 0x7f93e8069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8100f70 0x7f93e819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 0x7f93e819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819e900 con 0x7f93e80ffe20 2023-10-14T08:57:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819ea70 con 0x7f93e8101930 2023-10-14T08:57:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93edb99700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819ec30 con 0x7f93e8100f70 2023-10-14T08:57:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e80ffe20 0x7f93e8069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8100f70 0x7f93e819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 0x7f93e819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e80ffe20 0x7f93e8069950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34392/0 (socket says 172.21.15.6:34392) 2023-10-14T08:57:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8100f70 0x7f93e819bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60028/0 (socket says 172.21.15.6:60028) 2023-10-14T08:57:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e77fe700 1 -- 172.21.15.6:0/806037652 learned_addr learned my addr 172.21.15.6:0/806037652 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.548+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 0x7f93e819e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33154/0 (socket says 172.21.15.6:33154) 2023-10-14T08:57:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e7fff700 1 -- 172.21.15.6:0/806037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8100f70 msgr2=0x7f93e819bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e7fff700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8100f70 0x7f93e819bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e7fff700 1 -- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e80ffe20 msgr2=0x7f93e8069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e7fff700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e80ffe20 0x7f93e8069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e7fff700 1 -- 172.21.15.6:0/806037652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009520 con 0x7f93e8101930 2023-10-14T08:57:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e7fff700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 0x7f93e819e130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00e970 tx=0x7f93dc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e4ff9700 1 -- 172.21.15.6:0/806037652 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc004220 con 0x7f93e8101930 2023-10-14T08:57:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e4ff9700 1 -- 172.21.15.6:0/806037652 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93dc004cf0 con 0x7f93e8101930 2023-10-14T08:57:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.549+0000 7f93e4ff9700 1 -- 172.21.15.6:0/806037652 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc005660 con 0x7f93e8101930 2023-10-14T08:57:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.550+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e0009d00 con 0x7f93e8101930 2023-10-14T08:57:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.550+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e8195c10 con 0x7f93e8101930 2023-10-14T08:57:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.554+0000 7f93e4ff9700 1 -- 172.21.15.6:0/806037652 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f93dc004750 con 0x7f93e8101930 2023-10-14T08:57:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.554+0000 7f93e4ff9700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93d00a5990 0x7f93d00a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e4ff9700 1 -- 172.21.15.6:0/806037652 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f93dc014070 con 0x7f93e8101930 2023-10-14T08:57:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e77fe700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93d00a5990 0x7f93d00a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 Processor -- start 2023-10-14T08:57:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 -- start start 2023-10-14T08:57:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fa0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1f14c10 con 0x55d9e1f9f850 2023-10-14T08:57:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1ef9c00 con 0x55d9e1fa10a0 2023-10-14T08:57:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1ef7520 con 0x55d9e1fa01b0 2023-10-14T08:57:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34400/0 (socket says 172.21.15.6:34400) 2023-10-14T08:57:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e77fe700 1 -- 172.21.15.6:0/4244043804 learned_addr learned my addr 172.21.15.6:0/4244043804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e7fff700 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.555+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fa0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 -- 172.21.15.6:0/4244043804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 msgr2=0x55d9e1fa0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fa0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 -- 172.21.15.6:0/4244043804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 msgr2=0x55d9e1fa1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 -- 172.21.15.6:0/4244043804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9e1eb0390 con 0x55d9e1f9f850 2023-10-14T08:57:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e7fff700 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9fc70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93d8013e50 tx=0x7f93d800f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90450fb58b02ca7e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93e77fe700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93d00a5990 0x7f93d00a7e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f93d800f9f0 tx=0x7f93d8011000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93cdffb700 1 -- 172.21.15.6:0/4244043804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8005ce0 con 0x55d9e1f9f850 2023-10-14T08:57:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93cdffb700 1 -- 172.21.15.6:0/4244043804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93d8013930 con 0x55d9e1f9f850 2023-10-14T08:57:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.556+0000 7f93cdffb700 1 -- 172.21.15.6:0/4244043804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d801f660 con 0x55d9e1f9f850 2023-10-14T08:57:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 -- 172.21.15.6:0/4244043804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 msgr2=0x55d9e1f9fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9fc70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f93d8013e50 tx=0x7f93d800f6a0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 -- 172.21.15.6:0/4244043804 shutdown_connections 2023-10-14T08:57:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9fc70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/4244043804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fa0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 -- 172.21.15.6:0/4244043804 >> 172.21.15.6:0/4244043804 conn(0x55d9e1ecdd70 msgr2=0x55d9e1f9ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.557+0000 7f93f9d83b80 1 -- 172.21.15.6:0/4244043804 shutdown_connections 2023-10-14T08:57:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.558+0000 7f93f9d83b80 1 -- 172.21.15.6:0/4244043804 wait complete. 2023-10-14T08:57:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.558+0000 7f93f9d83b80 1 -- start start 2023-10-14T08:57:26.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 Processor -- start 2023-10-14T08:57:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1fba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1ef2e10 con 0x55d9e1f9f850 2023-10-14T08:57:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1e8f6b0 con 0x55d9e1fa01b0 2023-10-14T08:57:26.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1e8f350 con 0x55d9e1fa10a0 2023-10-14T08:57:26.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93f9d83b80 10 client.0 _ll_register_callbacks cb 0x55d9e1cec7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:26.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1fba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1fba710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34406/0 (socket says 172.21.15.6:34406) 2023-10-14T08:57:26.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93e77fe700 1 -- 172.21.15.6:0/1903554998 learned_addr learned my addr 172.21.15.6:0/1903554998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:26.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93e7fff700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.559+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93e77fe700 1 -- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa10a0 msgr2=0x55d9e1fc1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93e77fe700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93e77fe700 1 -- 172.21.15.6:0/1903554998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 msgr2=0x55d9e1fbac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93e77fe700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93e77fe700 1 -- 172.21.15.6:0/1903554998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e8195c10 con 0x55d9e1f9f850 2023-10-14T08:57:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93e77fe700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1fba710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f93d8013ae0 tx=0x7f93d80109a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9161b094839b6918 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:57:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1903554998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8009bc0 con 0x55d9e1f9f850 2023-10-14T08:57:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9e1ef7e90 con 0x55d9e1f9f850 2023-10-14T08:57:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1903554998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f93d8005c80 con 0x55d9e1f9f850 2023-10-14T08:57:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1903554998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93d8013330 con 0x55d9e1f9f850 2023-10-14T08:57:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93f9d83b80 10 client.15972 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.560+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7f93d801b040 con 0x55d9e1f9f850 2023-10-14T08:57:26.575 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1903554998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d9e1ef7e90 con 0x55d9e1f9f850 2023-10-14T08:57:26.576 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1903554998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f93d8004c20 con 0x55d9e1f9f850 2023-10-14T08:57:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93f9d83b80 10 client.15972 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93f9d83b80 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93f9d83b80 20 client.15972 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e1fc6510 0x55d9e1fc8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93f9d83b80 4 client.15972 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:57:26.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9e1f6fbb0 con 0x55d9e1fc6510 2023-10-14T08:57:26.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e1fc6510 0x55d9e1fc8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93c6ffd700 10 client.15972 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:26.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.561+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e1fc6510 0x55d9e1fc8930 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ff6bbf43fa9bb9 server_cookie=3a954152cf931a62 in_seq=0 out_seq=0 2023-10-14T08:57:26.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.562+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1903554998 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d9e1f6fbb0 con 0x55d9e1fc6510 2023-10-14T08:57:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.562+0000 7f93c6ffd700 10 client.15972 handle_command_reply: tid=0 2023-10-14T08:57:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.562+0000 7f93f9d83b80 1 client.15972 shutdown 2023-10-14T08:57:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 msgr2=0x55d9e1fba710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1fba710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f93d8013ae0 tx=0x7f93d80109a0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 shutdown_connections 2023-10-14T08:57:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e1fc6510 0x55d9e1fc8930 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1fba710 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/1903554998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 >> 172.21.15.6:0/1903554998 conn(0x55d9e1ecdd70 msgr2=0x55d9e1f9a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.563+0000 7f93c6ffd700 0 client.15972 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.564+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 shutdown_connections 2023-10-14T08:57:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.564+0000 7f93f9d83b80 1 -- 172.21.15.6:0/1903554998 wait complete. 2023-10-14T08:57:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.564+0000 7f93f9d83b80 20 client.15972 trim_cache size 0 max 16384 2023-10-14T08:57:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 Processor -- start 2023-10-14T08:57:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 -- start start 2023-10-14T08:57:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fc1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1d738c0 con 0x55d9e1f9f850 2023-10-14T08:57:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.583+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1fa0f20 con 0x55d9e1fa10a0 2023-10-14T08:57:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1fb9a00 con 0x55d9e1fa01b0 2023-10-14T08:57:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34414/0 (socket says 172.21.15.6:34414) 2023-10-14T08:57:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 -- 172.21.15.6:0/2819516898 learned_addr learned my addr 172.21.15.6:0/2819516898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fc1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 -- 172.21.15.6:0/2819516898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 msgr2=0x55d9e1fc1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fc1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 -- 172.21.15.6:0/2819516898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 msgr2=0x55d9e1fa4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 -- 172.21.15.6:0/2819516898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9e1d1dd80 con 0x55d9e1f9f850 2023-10-14T08:57:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e7fff700 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93e77fe700 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9c780 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93d800f6e0 tx=0x7f93d8009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8188e6e27fe2f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93ce7fc700 1 -- 172.21.15.6:0/2819516898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8005c80 con 0x55d9e1f9f850 2023-10-14T08:57:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93ce7fc700 1 -- 172.21.15.6:0/2819516898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93d80132d0 con 0x55d9e1f9f850 2023-10-14T08:57:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.584+0000 7f93ce7fc700 1 -- 172.21.15.6:0/2819516898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8010c70 con 0x55d9e1f9f850 2023-10-14T08:57:26.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 -- 172.21.15.6:0/2819516898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 msgr2=0x55d9e1f9c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9c780 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93d800f6e0 tx=0x7f93d8009930 comp rx=0 tx=0).stop 2023-10-14T08:57:26.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 -- 172.21.15.6:0/2819516898 shutdown_connections 2023-10-14T08:57:26.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fa4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1f9f850 0x55d9e1f9c780 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/2819516898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fc1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.585+0000 7f93f9d83b80 1 -- 172.21.15.6:0/2819516898 >> 172.21.15.6:0/2819516898 conn(0x55d9e1ecdd70 msgr2=0x55d9e1fa74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.586+0000 7f93f9d83b80 1 -- 172.21.15.6:0/2819516898 shutdown_connections 2023-10-14T08:57:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.586+0000 7f93f9d83b80 1 -- 172.21.15.6:0/2819516898 wait complete. 2023-10-14T08:57:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.586+0000 7f93f9d83b80 1 -- start start 2023-10-14T08:57:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.586+0000 7f93f9d83b80 1 Processor -- start 2023-10-14T08:57:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1f9f850 0x55d9e1fbf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1fc13b0 con 0x55d9e1fa10a0 2023-10-14T08:57:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1fc1520 con 0x55d9e1fa01b0 2023-10-14T08:57:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9e1fc16e0 con 0x55d9e1f9f850 2023-10-14T08:57:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93f9d83b80 10 client.0 _ll_register_callbacks cb 0x7f93dc0965b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34422/0 (socket says 172.21.15.6:34422) 2023-10-14T08:57:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e7fff700 1 -- 172.21.15.6:0/3942720058 learned_addr learned my addr 172.21.15.6:0/3942720058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e77fe700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1f9f850 0x55d9e1fbf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 -- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1f9f850 msgr2=0x55d9e1fbf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1f9f850 0x55d9e1fbf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 -- 172.21.15.6:0/3942720058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 msgr2=0x55d9e1fc0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 -- 172.21.15.6:0/3942720058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e0009d00 con 0x55d9e1fa01b0 2023-10-14T08:57:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e7fff700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93e6ffd700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbfe60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d010 tx=0x7f93e000b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad9ca5e35833803 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.587+0000 7f93c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:57:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93c6ffd700 1 -- 172.21.15.6:0/3942720058 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0023040 con 0x55d9e1fa01b0 2023-10-14T08:57:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93d8013930 con 0x55d9e1fa01b0 2023-10-14T08:57:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93c6ffd700 1 -- 172.21.15.6:0/3942720058 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f93e0006000 con 0x55d9e1fa01b0 2023-10-14T08:57:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93c6ffd700 1 -- 172.21.15.6:0/3942720058 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e000e040 con 0x55d9e1fa01b0 2023-10-14T08:57:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 10 client.25610 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7f93d801b040 con 0x55d9e1fa01b0 2023-10-14T08:57:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93c6ffd700 1 -- 172.21.15.6:0/3942720058 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93d8013930 con 0x55d9e1fa01b0 2023-10-14T08:57:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93c6ffd700 1 -- 172.21.15.6:0/3942720058 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f93e000b0d0 con 0x55d9e1fa01b0 2023-10-14T08:57:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 10 client.25610 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:26.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 20 client.25610 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e2023af0 0x55d9e2025f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 4 client.25610 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:57:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.588+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d9e1eebdf0 con 0x55d9e2023af0 2023-10-14T08:57:26.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.589+0000 7f93e77fe700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e2023af0 0x55d9e2025f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.589+0000 7f93c6ffd700 10 client.25610 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.589+0000 7f93e77fe700 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e2023af0 0x55d9e2025f10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff6bcad1fe0cc19 server_cookie=8fb8d1ae1ebb0543 in_seq=0 out_seq=0 2023-10-14T08:57:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.657+0000 7f93c6ffd700 1 -- 172.21.15.6:0/3942720058 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d9e1eebdf0 con 0x55d9e2023af0 2023-10-14T08:57:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.657+0000 7f93c6ffd700 10 client.25610 handle_command_reply: tid=0 2023-10-14T08:57:26.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.657+0000 7f93f9d83b80 1 client.25610 shutdown 2023-10-14T08:57:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.657+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 msgr2=0x55d9e1fbfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.657+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbfe60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d010 tx=0x7f93e000b740 comp rx=0 tx=0).stop 2023-10-14T08:57:26.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 shutdown_connections 2023-10-14T08:57:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d9e2023af0 0x55d9e2025f10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d9e1fa10a0 0x55d9e1fc0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e1f9f850 0x55d9e1fbf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 --2- 172.21.15.6:0/3942720058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d9e1fa01b0 0x55d9e1fbfe60 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d010 tx=0x7f93e000b740 comp rx=0 tx=0).stop 2023-10-14T08:57:26.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 >> 172.21.15.6:0/3942720058 conn(0x55d9e1ecdd70 msgr2=0x55d9e1fa4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93c6ffd700 0 client.25610 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 shutdown_connections 2023-10-14T08:57:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.658+0000 7f93f9d83b80 1 -- 172.21.15.6:0/3942720058 wait complete. 2023-10-14T08:57:26.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.659+0000 7f93f9d83b80 20 client.25610 trim_cache size 0 max 16384 2023-10-14T08:57:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:57:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:57:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:57:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:57:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.659+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93d00a5990 msgr2=0x7f93d00a7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.659+0000 7f93edb99700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93d00a5990 0x7f93d00a7e50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f93d800f9f0 tx=0x7f93d8011000 comp rx=0 tx=0).stop 2023-10-14T08:57:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.659+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 msgr2=0x7f93e819e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.659+0000 7f93edb99700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 0x7f93e819e130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00e970 tx=0x7f93dc00ec80 comp rx=0 tx=0).stop 2023-10-14T08:57:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 shutdown_connections 2023-10-14T08:57:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f93d00a5990 0x7f93d00a7e50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e8101930 0x7f93e819e130 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e80ffe20 0x7f93e8069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 --2- 172.21.15.6:0/806037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8100f70 0x7f93e819bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 >> 172.21.15.6:0/806037652 conn(0x7f93e80fb370 msgr2=0x7f93e8104530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 shutdown_connections 2023-10-14T08:57:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:26.660+0000 7f93edb99700 1 -- 172.21.15.6:0/806037652 wait complete. 2023-10-14T08:57:27.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:27 smithi178 ceph-mon[103612]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 1.60k op/s 2023-10-14T08:57:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:27 smithi057 ceph-mon[103313]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 1.60k op/s 2023-10-14T08:57:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:27 smithi006 ceph-mon[99452]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 1.60k op/s 2023-10-14T08:57:29.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:29 smithi178 ceph-mon[103612]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 MiB/s wr, 1.96k op/s 2023-10-14T08:57:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:29 smithi057 ceph-mon[103313]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 MiB/s wr, 1.96k op/s 2023-10-14T08:57:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:29 smithi006 ceph-mon[99452]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 MiB/s wr, 1.96k op/s 2023-10-14T08:57:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 270.0 s, 2769.9 tps, lat 36.221 ms stddev 40.782 2023-10-14T08:57:31.643 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:31 smithi178 ceph-mon[103612]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 1.91k op/s 2023-10-14T08:57:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:31 smithi057 ceph-mon[103313]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 1.91k op/s 2023-10-14T08:57:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:31 smithi006 ceph-mon[99452]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 1.91k op/s 2023-10-14T08:57:32.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:32 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:57:32.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:32 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:57:32.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:32 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:57:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:33 smithi178 ceph-mon[103612]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.93k op/s 2023-10-14T08:57:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:57:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:57:33.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:57:33.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:33 smithi057 ceph-mon[103313]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.93k op/s 2023-10-14T08:57:33.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:57:33.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:57:33.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:57:33.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:33 smithi006 ceph-mon[99452]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.93k op/s 2023-10-14T08:57:33.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:57:33.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:57:33.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:57:35.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:35 smithi178 ceph-mon[103612]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 1.93k op/s 2023-10-14T08:57:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:35 smithi057 ceph-mon[103313]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 1.93k op/s 2023-10-14T08:57:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:35 smithi006 ceph-mon[99452]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 39 MiB/s wr, 1.93k op/s 2023-10-14T08:57:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 275.0 s, 2518.6 tps, lat 39.431 ms stddev 45.826 2023-10-14T08:57:37.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:37 smithi178 ceph-mon[103612]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.99k op/s 2023-10-14T08:57:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:37 smithi057 ceph-mon[103313]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.99k op/s 2023-10-14T08:57:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:37 smithi006 ceph-mon[99452]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.99k op/s 2023-10-14T08:57:39.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:39 smithi178 ceph-mon[103612]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2023-10-14T08:57:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:39 smithi057 ceph-mon[103313]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2023-10-14T08:57:39.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:39 smithi006 ceph-mon[99452]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 MiB/s wr, 1.25k op/s 2023-10-14T08:57:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 -- 172.21.15.6:0/4024156445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70101990 msgr2=0x7fdb70108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 --2- 172.21.15.6:0/4024156445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70101990 0x7fdb70108240 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800b0d0 tx=0x7fdb6800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 -- 172.21.15.6:0/4024156445 shutdown_connections 2023-10-14T08:57:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 --2- 172.21.15.6:0/4024156445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70101990 0x7fdb70108240 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 --2- 172.21.15.6:0/4024156445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb700ffe00 0x7fdb70100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 --2- 172.21.15.6:0/4024156445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70100ff0 0x7fdb70101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 -- 172.21.15.6:0/4024156445 >> 172.21.15.6:0/4024156445 conn(0x7fdb700fb390 msgr2=0x7fdb700fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 -- 172.21.15.6:0/4024156445 shutdown_connections 2023-10-14T08:57:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 -- 172.21.15.6:0/4024156445 wait complete. 2023-10-14T08:57:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 Processor -- start 2023-10-14T08:57:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.819+0000 7fdb779dd700 1 -- start start 2023-10-14T08:57:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.820+0000 7fdb779dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb700ffe00 0x7fdb70068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.820+0000 7fdb779dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70100ff0 0x7fdb7019de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.820+0000 7fdb779dd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb70101990 0x7fdb701a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.820+0000 7fdb779dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb701a0a20 con 0x7fdb70100ff0 2023-10-14T08:57:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.820+0000 7fdb779dd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb701a0b90 con 0x7fdb700ffe00 2023-10-14T08:57:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.820+0000 7fdb779dd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb701a0d50 con 0x7fdb70101990 2023-10-14T08:57:39.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.821+0000 7fdb74f78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70100ff0 0x7fdb7019de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.821+0000 7fdb74f78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70100ff0 0x7fdb7019de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34434/0 (socket says 172.21.15.6:34434) 2023-10-14T08:57:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.821+0000 7fdb74f78700 1 -- 172.21.15.6:0/1977034748 learned_addr learned my addr 172.21.15.6:0/1977034748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.822+0000 7fdb75779700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb700ffe00 0x7fdb70068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.823+0000 7fdb75779700 1 -- 172.21.15.6:0/1977034748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb70101990 msgr2=0x7fdb701a0370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:57:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.823+0000 7fdb75779700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb70101990 0x7fdb701a0370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.823+0000 7fdb75779700 1 -- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70100ff0 msgr2=0x7fdb7019de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.823+0000 7fdb75779700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70100ff0 0x7fdb7019de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.823+0000 7fdb75779700 1 -- 172.21.15.6:0/1977034748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68009d00 con 0x7fdb700ffe00 2023-10-14T08:57:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.823+0000 7fdb75779700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb700ffe00 0x7fdb70068fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e9c0 tx=0x7fdb6c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.824+0000 7fdb667fc700 1 -- 172.21.15.6:0/1977034748 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00cbd0 con 0x7fdb700ffe00 2023-10-14T08:57:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.824+0000 7fdb667fc700 1 -- 172.21.15.6:0/1977034748 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb6c00eeb0 con 0x7fdb700ffe00 2023-10-14T08:57:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.824+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb701a0fd0 con 0x7fdb700ffe00 2023-10-14T08:57:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.824+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb701a14a0 con 0x7fdb700ffe00 2023-10-14T08:57:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.824+0000 7fdb667fc700 1 -- 172.21.15.6:0/1977034748 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c003ce0 con 0x7fdb700ffe00 2023-10-14T08:57:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.826+0000 7fdb667fc700 1 -- 172.21.15.6:0/1977034748 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fdb6c004020 con 0x7fdb700ffe00 2023-10-14T08:57:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.827+0000 7fdb667fc700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdb5c0a1500 0x7fdb5c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.827+0000 7fdb74f78700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdb5c0a1500 0x7fdb5c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.827+0000 7fdb667fc700 1 -- 172.21.15.6:0/1977034748 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdb6c014070 con 0x7fdb700ffe00 2023-10-14T08:57:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.827+0000 7fdb74f78700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdb5c0a1500 0x7fdb5c0a39c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009d20 tx=0x7fdb60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 Processor -- start 2023-10-14T08:57:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 -- start start 2023-10-14T08:57:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef97959c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9795aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795b0a0 0x55ef9795b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef978cec10 con 0x55ef9795a1b0 2023-10-14T08:57:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef978b3c00 con 0x55ef97959850 2023-10-14T08:57:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef978b1520 con 0x55ef9795b0a0 2023-10-14T08:57:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb74f78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9795aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb74f78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9795aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34438/0 (socket says 172.21.15.6:34438) 2023-10-14T08:57:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.829+0000 7fdb74f78700 1 -- 172.21.15.6:0/2778318015 learned_addr learned my addr 172.21.15.6:0/2778318015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.830+0000 7fdb74f78700 1 -- 172.21.15.6:0/2778318015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795b0a0 msgr2=0x55ef9795b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.830+0000 7fdb74f78700 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795b0a0 0x55ef9795b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.830+0000 7fdb74f78700 1 -- 172.21.15.6:0/2778318015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 msgr2=0x55ef97959c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:57:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.830+0000 7fdb74f78700 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef97959c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.830+0000 7fdb74f78700 1 -- 172.21.15.6:0/2778318015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef9786a390 con 0x55ef9795a1b0 2023-10-14T08:57:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.830+0000 7fdb74f78700 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9795aac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000e540 tx=0x7fdb60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c5a34a99b10b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.831+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2778318015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60037430 con 0x55ef9795a1b0 2023-10-14T08:57:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.831+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2778318015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb60032070 con 0x55ef9795a1b0 2023-10-14T08:57:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.831+0000 7fdb5b7fe700 1 -- 172.21.15.6:0/2778318015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6001c7d0 con 0x55ef9795a1b0 2023-10-14T08:57:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2778318015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 msgr2=0x55ef9795aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9795aac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000e540 tx=0x7fdb60014000 comp rx=0 tx=0).stop 2023-10-14T08:57:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2778318015 shutdown_connections 2023-10-14T08:57:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795b0a0 0x55ef9795b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef97959c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2778318015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9795aac0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2778318015 >> 172.21.15.6:0/2778318015 conn(0x55ef97887d70 msgr2=0x55ef97954c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2778318015 shutdown_connections 2023-10-14T08:57:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.832+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2778318015 wait complete. 2023-10-14T08:57:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 -- start start 2023-10-14T08:57:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 Processor -- start 2023-10-14T08:57:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef979637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef97963d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795b0a0 0x55ef9796ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef978ace10 con 0x55ef9795b0a0 2023-10-14T08:57:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef978496b0 con 0x55ef97959850 2023-10-14T08:57:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.833+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef97849350 con 0x55ef9795a1b0 2023-10-14T08:57:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb83bc7b80 10 client.0 _ll_register_callbacks cb 0x55ef976a67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef979637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef979637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33200/0 (socket says 172.21.15.6:33200) 2023-10-14T08:57:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 -- 172.21.15.6:0/3902141635 learned_addr learned my addr 172.21.15.6:0/3902141635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795b0a0 0x55ef9796ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb74f78700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef97963d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 -- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 msgr2=0x55ef97963d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef97963d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 -- 172.21.15.6:0/3902141635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795b0a0 msgr2=0x55ef9796ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795b0a0 0x55ef9796ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 -- 172.21.15.6:0/3902141635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb60017070 con 0x55ef97959850 2023-10-14T08:57:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb75779700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef979637c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0a2070 tx=0x7fdb6c099b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8c74ae0a4f036e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:57:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3902141635 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c09a910 con 0x55ef97959850 2023-10-14T08:57:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3902141635 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdb6c09a210 con 0x55ef97959850 2023-10-14T08:57:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.834+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef978b1e90 con 0x55ef97959850 2023-10-14T08:57:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3902141635 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb6c09e360 con 0x55ef97959850 2023-10-14T08:57:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 10 client.25619 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55ef976d7d80 con 0x55ef97959850 2023-10-14T08:57:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3902141635 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ef978b1e90 con 0x55ef97959850 2023-10-14T08:57:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3902141635 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdb6c09a500 con 0x55ef97959850 2023-10-14T08:57:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 10 client.25619 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 10 client.25619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 20 client.25619 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef9796f670 0x55ef97971a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 4 client.25619 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:57:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef97929bb0 con 0x55ef9796f670 2023-10-14T08:57:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.835+0000 7fdb74f78700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef9796f670 0x55ef97971a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb74f78700 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef9796f670 0x55ef97971a90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238499bf9f021796 server_cookie=a3085b0667011627 in_seq=0 out_seq=0 2023-10-14T08:57:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb58ff9700 10 client.25619 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3902141635 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ef97929bb0 con 0x55ef9796f670 2023-10-14T08:57:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb58ff9700 10 client.25619 handle_command_reply: tid=0 2023-10-14T08:57:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 client.25619 shutdown 2023-10-14T08:57:39.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 msgr2=0x55ef979637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef979637c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0a2070 tx=0x7fdb6c099b70 comp rx=0 tx=0).stop 2023-10-14T08:57:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 shutdown_connections 2023-10-14T08:57:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef9796f670 0x55ef97971a90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795b0a0 0x55ef9796ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb58ff9700 0 client.25619 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef97959850 0x55ef979637c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3902141635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef97963d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.836+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 >> 172.21.15.6:0/3902141635 conn(0x55ef97887d70 msgr2=0x55ef97954830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.837+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 shutdown_connections 2023-10-14T08:57:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.837+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3902141635 wait complete. 2023-10-14T08:57:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.837+0000 7fdb83bc7b80 20 client.25619 trim_cache size 0 max 16384 2023-10-14T08:57:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 Processor -- start 2023-10-14T08:57:39.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 -- start start 2023-10-14T08:57:39.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef97959850 0x55ef979614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9796ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97962430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef9772d8c0 con 0x55ef9795a1b0 2023-10-14T08:57:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef979621f0 con 0x55ef9795b0a0 2023-10-14T08:57:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef97959490 con 0x55ef97959850 2023-10-14T08:57:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb75f7a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97962430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb75f7a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97962430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33210/0 (socket says 172.21.15.6:33210) 2023-10-14T08:57:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.860+0000 7fdb75f7a700 1 -- 172.21.15.6:0/2786499367 learned_addr learned my addr 172.21.15.6:0/2786499367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb74f78700 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9796ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75779700 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef97959850 0x55ef979614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75f7a700 1 -- 172.21.15.6:0/2786499367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef97959850 msgr2=0x55ef979614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef97959850 0x55ef979614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75f7a700 1 -- 172.21.15.6:0/2786499367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 msgr2=0x55ef9796ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9796ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75f7a700 1 -- 172.21.15.6:0/2786499367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef976c0c00 con 0x55ef9795b0a0 2023-10-14T08:57:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb74f78700 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9796ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:57:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97962430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009ba0 tx=0x7fdb6800b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df15a5070fb7fffd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb5bfff700 1 -- 172.21.15.6:0/2786499367 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800e040 con 0x55ef9795b0a0 2023-10-14T08:57:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb5bfff700 1 -- 172.21.15.6:0/2786499367 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb6800baa0 con 0x55ef9795b0a0 2023-10-14T08:57:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.861+0000 7fdb5bfff700 1 -- 172.21.15.6:0/2786499367 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680052a0 con 0x55ef9795b0a0 2023-10-14T08:57:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2786499367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 msgr2=0x55ef97962430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97962430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009ba0 tx=0x7fdb6800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2786499367 shutdown_connections 2023-10-14T08:57:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97962430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef97959850 0x55ef979614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/2786499367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef9795a1b0 0x55ef9796ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2786499367 >> 172.21.15.6:0/2786499367 conn(0x55ef97887d70 msgr2=0x55ef979763b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2786499367 shutdown_connections 2023-10-14T08:57:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.862+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/2786499367 wait complete. 2023-10-14T08:57:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 -- start start 2023-10-14T08:57:39.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 Processor -- start 2023-10-14T08:57:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 0x55ef9796a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef9796ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97968c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef97969230 con 0x55ef97959850 2023-10-14T08:57:39.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef979693a0 con 0x55ef9795b0a0 2023-10-14T08:57:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef97969560 con 0x55ef9795a1b0 2023-10-14T08:57:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb83bc7b80 10 client.0 _ll_register_callbacks cb 0x7fdb6c096640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb75779700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 0x55ef9796a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.863+0000 7fdb75f7a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97968c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97968c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33216/0 (socket says 172.21.15.6:33216) 2023-10-14T08:57:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 -- 172.21.15.6:0/3670165276 learned_addr learned my addr 172.21.15.6:0/3670165276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75779700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 0x55ef9796a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34456/0 (socket says 172.21.15.6:34456) 2023-10-14T08:57:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb74f78700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef9796ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 -- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 msgr2=0x55ef9796ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef9796ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 -- 172.21.15.6:0/3670165276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 msgr2=0x55ef9796a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 0x55ef9796a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 -- 172.21.15.6:0/3670165276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb70108b90 con 0x55ef9795b0a0 2023-10-14T08:57:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb74f78700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef9796ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75779700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 0x55ef9796a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb75f7a700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97968c10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006200 tx=0x7fdb680076d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a499452b02b5b575 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:57:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3670165276 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680054e0 con 0x55ef9795b0a0 2023-10-14T08:57:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb60032070 con 0x55ef9795b0a0 2023-10-14T08:57:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3670165276 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fdb68009450 con 0x55ef9795b0a0 2023-10-14T08:57:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3670165276 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb68005640 con 0x55ef9795b0a0 2023-10-14T08:57:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb83bc7b80 10 client.25625 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.864+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55ef976fe1f0 con 0x55ef9795b0a0 2023-10-14T08:57:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3670165276 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb60032070 con 0x55ef9795b0a0 2023-10-14T08:57:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3670165276 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdb6800b100 con 0x55ef9795b0a0 2023-10-14T08:57:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb83bc7b80 10 client.25625 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb83bc7b80 10 client.25625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb83bc7b80 20 client.25625 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef979c4260 0x55ef979c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb83bc7b80 4 client.25625 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:57:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef978a5df0 con 0x55ef979c4260 2023-10-14T08:57:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.865+0000 7fdb75779700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef979c4260 0x55ef979c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.867+0000 7fdb75779700 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef979c4260 0x55ef979c6680 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5593e90770bedb server_cookie=de9619d5269f2d06 in_seq=0 out_seq=0 2023-10-14T08:57:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.868+0000 7fdb58ff9700 10 client.25625 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.884+0000 7fdb58ff9700 1 -- 172.21.15.6:0/3670165276 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef978a5df0 con 0x55ef979c4260 2023-10-14T08:57:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.884+0000 7fdb58ff9700 10 client.25625 handle_command_reply: tid=0 2023-10-14T08:57:39.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 client.25625 shutdown 2023-10-14T08:57:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 msgr2=0x55ef97968c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97968c10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdb68006200 tx=0x7fdb680076d0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 shutdown_connections 2023-10-14T08:57:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ef979c4260 0x55ef979c6680 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ef9795b0a0 0x55ef97968c10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ef97959850 0x55ef9796a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb58ff9700 0 client.25625 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 --2- 172.21.15.6:0/3670165276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ef9795a1b0 0x55ef9796ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 >> 172.21.15.6:0/3670165276 conn(0x55ef97887d70 msgr2=0x55ef979614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 shutdown_connections 2023-10-14T08:57:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.885+0000 7fdb83bc7b80 1 -- 172.21.15.6:0/3670165276 wait complete. 2023-10-14T08:57:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.886+0000 7fdb83bc7b80 20 client.25625 trim_cache size 0 max 16384 2023-10-14T08:57:39.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:57:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:57:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:57:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:57:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdb5c0a1500 msgr2=0x7fdb5c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdb5c0a1500 0x7fdb5c0a39c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009d20 tx=0x7fdb60009260 comp rx=0 tx=0).stop 2023-10-14T08:57:39.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb700ffe00 msgr2=0x7fdb70068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb700ffe00 0x7fdb70068fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00e9c0 tx=0x7fdb6c00ecd0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 shutdown_connections 2023-10-14T08:57:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb70101990 0x7fdb701a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fdb5c0a1500 0x7fdb5c0a39c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb700ffe00 0x7fdb70068fb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 --2- 172.21.15.6:0/1977034748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb70100ff0 0x7fdb7019de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 >> 172.21.15.6:0/1977034748 conn(0x7fdb700fb390 msgr2=0x7fdb700fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 shutdown_connections 2023-10-14T08:57:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:39.887+0000 7fdb779dd700 1 -- 172.21.15.6:0/1977034748 wait complete. 2023-10-14T08:57:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 280.0 s, 2601.8 tps, lat 38.345 ms stddev 42.640 2023-10-14T08:57:41.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:41 smithi178 ceph-mon[103612]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 781 op/s 2023-10-14T08:57:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:41 smithi057 ceph-mon[103313]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 781 op/s 2023-10-14T08:57:41.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:41 smithi006 ceph-mon[99452]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 781 op/s 2023-10-14T08:57:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:43 smithi178 ceph-mon[103612]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 805 op/s 2023-10-14T08:57:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:43 smithi057 ceph-mon[103313]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 805 op/s 2023-10-14T08:57:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:43 smithi006 ceph-mon[99452]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 805 op/s 2023-10-14T08:57:44.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:44 smithi178 ceph-mon[103612]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 830 op/s 2023-10-14T08:57:44.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:44 smithi057 ceph-mon[103313]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 830 op/s 2023-10-14T08:57:44.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:44 smithi006 ceph-mon[99452]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 830 op/s 2023-10-14T08:57:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 285.0 s, 2926.0 tps, lat 34.278 ms stddev 41.663 2023-10-14T08:57:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:47 smithi006 ceph-mon[99452]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 935 op/s 2023-10-14T08:57:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:47 smithi178 ceph-mon[103612]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 935 op/s 2023-10-14T08:57:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:47 smithi057 ceph-mon[103313]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 935 op/s 2023-10-14T08:57:49.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:49 smithi178 ceph-mon[103612]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-14T08:57:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:49 smithi057 ceph-mon[103313]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-14T08:57:49.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:49 smithi006 ceph-mon[99452]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-14T08:57:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 290.0 s, 2458.6 tps, lat 40.524 ms stddev 49.922 2023-10-14T08:57:51.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:51 smithi178 ceph-mon[103612]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 759 op/s 2023-10-14T08:57:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:51 smithi057 ceph-mon[103313]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 759 op/s 2023-10-14T08:57:51.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:51 smithi006 ceph-mon[99452]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 759 op/s 2023-10-14T08:57:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/1736643160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc101990 msgr2=0x7fc7dc108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/1736643160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc101990 0x7fc7dc108240 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400d360 tx=0x7fc7d400d670 comp rx=0 tx=0).stop 2023-10-14T08:57:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/1736643160 shutdown_connections 2023-10-14T08:57:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/1736643160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc101990 0x7fc7dc108240 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/1736643160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7dc0ffe00 0x7fc7dc100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/1736643160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/1736643160 >> 172.21.15.6:0/1736643160 conn(0x7fc7dc0fb390 msgr2=0x7fc7dc0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/1736643160 shutdown_connections 2023-10-14T08:57:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.057+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/1736643160 wait complete. 2023-10-14T08:57:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.058+0000 7fc7e0d3c700 1 Processor -- start 2023-10-14T08:57:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.058+0000 7fc7e0d3c700 1 -- start start 2023-10-14T08:57:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.058+0000 7fc7e0d3c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7dc0ffe00 0x7fc7dc194b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7e0d3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc195060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7e0d3c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7dc101990 0x7fc7dc19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7e0d3c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19c6a0 con 0x7fc7dc100ff0 2023-10-14T08:57:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7e0d3c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19c7e0 con 0x7fc7dc101990 2023-10-14T08:57:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7e0d3c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19c970 con 0x7fc7dc0ffe00 2023-10-14T08:57:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc195060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc195060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34470/0 (socket says 172.21.15.6:34470) 2023-10-14T08:57:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2491861408 learned_addr learned my addr 172.21.15.6:0/2491861408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7dc101990 0x7fc7dc19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2491861408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7dc0ffe00 msgr2=0x7fc7dc194b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7dc0ffe00 0x7fc7dc194b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2491861408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7dc101990 msgr2=0x7fc7dc19c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7dc101990 0x7fc7dc19c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2491861408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4009d00 con 0x7fc7dc100ff0 2023-10-14T08:57:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc195060 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d950 tx=0x7fc7d000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7cb7fe700 1 -- 172.21.15.6:0/2491861408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0009940 con 0x7fc7dc100ff0 2023-10-14T08:57:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7cb7fe700 1 -- 172.21.15.6:0/2491861408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0010460 con 0x7fc7dc100ff0 2023-10-14T08:57:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.059+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7dc19cc50 con 0x7fc7dc100ff0 2023-10-14T08:57:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.060+0000 7fc7cb7fe700 1 -- 172.21.15.6:0/2491861408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000f620 con 0x7fc7dc100ff0 2023-10-14T08:57:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.060+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc19d160 con 0x7fc7dc100ff0 2023-10-14T08:57:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.062+0000 7fc7cb7fe700 1 -- 172.21.15.6:0/2491861408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc7d00108d0 con 0x7fc7dc100ff0 2023-10-14T08:57:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.063+0000 7fc7cb7fe700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7c40a1500 0x7fc7c40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.063+0000 7fc7cb7fe700 1 -- 172.21.15.6:0/2491861408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc7d00ccb80 con 0x7fc7dc100ff0 2023-10-14T08:57:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.064+0000 7fc7ecf26b80 1 Processor -- start 2023-10-14T08:57:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 -- start start 2023-10-14T08:57:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7da59c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7c40a1500 0x7fc7c40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b847530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b847ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b855ed0 0x55e77b8582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b7bcc10 con 0x55e77b847a70 2023-10-14T08:57:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b7a1c00 con 0x55e77b848d40 2023-10-14T08:57:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b79f520 con 0x55e77b855ed0 2023-10-14T08:57:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b847530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7d9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b847ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b847530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33234/0 (socket says 172.21.15.6:33234) 2023-10-14T08:57:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7da59c700 1 -- 172.21.15.6:0/2567286030 learned_addr learned my addr 172.21.15.6:0/2567286030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.065+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b855ed0 0x55e77b8582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7da59c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7c40a1500 0x7fc7c40a39c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009d70 tx=0x7fc7cc0124f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2567286030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b855ed0 msgr2=0x55e77b8582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b855ed0 0x55e77b8582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2567286030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 msgr2=0x55e77b847530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b847530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7d9d9b700 1 -- 172.21.15.6:0/2567286030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e77b758390 con 0x55e77b847a70 2023-10-14T08:57:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b855ed0 0x55e77b8582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7da59c700 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b847530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:57:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b847ef0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00ca640 tx=0x7fc7d0010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0280801e7af1f0e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7c8ff9700 1 -- 172.21.15.6:0/2567286030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d009dfb0 con 0x55e77b847a70 2023-10-14T08:57:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7c8ff9700 1 -- 172.21.15.6:0/2567286030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d00a21f0 con 0x55e77b847a70 2023-10-14T08:57:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.066+0000 7fc7c8ff9700 1 -- 172.21.15.6:0/2567286030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0099550 con 0x55e77b847a70 2023-10-14T08:57:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/2567286030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 msgr2=0x55e77b847ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b847ef0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00ca640 tx=0x7fc7d0010cd0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/2567286030 shutdown_connections 2023-10-14T08:57:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b855ed0 0x55e77b8582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b847530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/2567286030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b847ef0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/2567286030 >> 172.21.15.6:0/2567286030 conn(0x55e77b775d70 msgr2=0x55e77b842a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/2567286030 shutdown_connections 2023-10-14T08:57:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/2567286030 wait complete. 2023-10-14T08:57:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.067+0000 7fc7ecf26b80 1 -- start start 2023-10-14T08:57:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 Processor -- start 2023-10-14T08:57:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b859f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 0x55e77b85a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b8614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b79ae10 con 0x55e77b847a70 2023-10-14T08:57:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b7376b0 con 0x55e77b855ed0 2023-10-14T08:57:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b737350 con 0x55e77b848d40 2023-10-14T08:57:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7ecf26b80 10 client.0 _ll_register_callbacks cb 0x55e77b5947a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7da59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b859f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7da59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b859f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34482/0 (socket says 172.21.15.6:34482) 2023-10-14T08:57:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7da59c700 1 -- 172.21.15.6:0/759666108 learned_addr learned my addr 172.21.15.6:0/759666108 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.068+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b8614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7da59c700 1 -- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 msgr2=0x55e77b85a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7da59c700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 0x55e77b85a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7da59c700 1 -- 172.21.15.6:0/759666108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 msgr2=0x55e77b8614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7da59c700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b8614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7da59c700 1 -- 172.21.15.6:0/759666108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc108b90 con 0x55e77b847a70 2023-10-14T08:57:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b8614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:57:53.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7da59c700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b859f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc006b60 tx=0x7fc7cc0048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d1441c0259c844 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:57:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/759666108 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc016960 con 0x55e77b847a70 2023-10-14T08:57:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/759666108 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc7cc01d040 con 0x55e77b847a70 2023-10-14T08:57:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e77b79fe90 con 0x55e77b847a70 2023-10-14T08:57:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/759666108 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7cc016ac0 con 0x55e77b847a70 2023-10-14T08:57:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7ecf26b80 10 client.16005 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7fc7dc19d160 con 0x55e77b847a70 2023-10-14T08:57:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.069+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/759666108 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7cc030020 con 0x55e77b847a70 2023-10-14T08:57:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/759666108 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc7cc02a400 con 0x55e77b847a70 2023-10-14T08:57:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7ecf26b80 10 client.16005 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7ecf26b80 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7ecf26b80 20 client.16005 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b865e40 0x55e77b868260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7ecf26b80 4 client.16005 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:57:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e77b817bb0 con 0x55e77b865e40 2023-10-14T08:57:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b865e40 0x55e77b868260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b865e40 0x55e77b868260 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59737c3173f09d29 server_cookie=d9fc32c110e2dee0 in_seq=0 out_seq=0 2023-10-14T08:57:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.070+0000 7fc7c1ffb700 10 client.16005 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/759666108 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e77b817bb0 con 0x55e77b865e40 2023-10-14T08:57:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7c1ffb700 10 client.16005 handle_command_reply: tid=0 2023-10-14T08:57:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 client.16005 shutdown 2023-10-14T08:57:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 msgr2=0x55e77b859f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b859f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc006b60 tx=0x7fc7cc0048d0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 shutdown_connections 2023-10-14T08:57:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b865e40 0x55e77b868260 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b8614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b859f20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/759666108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 0x55e77b85a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7c1ffb700 0 client.16005 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 >> 172.21.15.6:0/759666108 conn(0x55e77b775d70 msgr2=0x55e77b842630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 shutdown_connections 2023-10-14T08:57:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.077+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/759666108 wait complete. 2023-10-14T08:57:53.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.078+0000 7fc7ecf26b80 20 client.16005 trim_cache size 0 max 16384 2023-10-14T08:57:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 Processor -- start 2023-10-14T08:57:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 -- start start 2023-10-14T08:57:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b847a70 0x55e77b847470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b861460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 0x55e77b855520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b61b8c0 con 0x55e77b855ed0 2023-10-14T08:57:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b859a90 con 0x55e77b848d40 2023-10-14T08:57:53.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b83dee0 con 0x55e77b847a70 2023-10-14T08:57:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 0x55e77b855520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 0x55e77b855520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34494/0 (socket says 172.21.15.6:34494) 2023-10-14T08:57:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 -- 172.21.15.6:0/1637144854 learned_addr learned my addr 172.21.15.6:0/1637144854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 -- 172.21.15.6:0/1637144854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b847a70 msgr2=0x55e77b847470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b847a70 0x55e77b847470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 -- 172.21.15.6:0/1637144854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 msgr2=0x55e77b861460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.097+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b861460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.098+0000 7fc7dad9d700 1 -- 172.21.15.6:0/1637144854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e77b5c5d80 con 0x55e77b855ed0 2023-10-14T08:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.098+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 0x55e77b855520 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400b010 tx=0x7fc7d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b182d23d43ea5d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.098+0000 7fc7c97fa700 1 -- 172.21.15.6:0/1637144854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d401f070 con 0x55e77b855ed0 2023-10-14T08:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.098+0000 7fc7c97fa700 1 -- 172.21.15.6:0/1637144854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d4020040 con 0x55e77b855ed0 2023-10-14T08:57:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.098+0000 7fc7c97fa700 1 -- 172.21.15.6:0/1637144854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40078a0 con 0x55e77b855ed0 2023-10-14T08:57:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/1637144854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 msgr2=0x55e77b855520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 0x55e77b855520 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400b010 tx=0x7fc7d400b040 comp rx=0 tx=0).stop 2023-10-14T08:57:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/1637144854 shutdown_connections 2023-10-14T08:57:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b855ed0 0x55e77b855520 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b847a70 0x55e77b847470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/1637144854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b848d40 0x55e77b861460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/1637144854 >> 172.21.15.6:0/1637144854 conn(0x55e77b775d70 msgr2=0x55e77b858c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/1637144854 shutdown_connections 2023-10-14T08:57:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/1637144854 wait complete. 2023-10-14T08:57:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 -- start start 2023-10-14T08:57:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.099+0000 7fc7ecf26b80 1 Processor -- start 2023-10-14T08:57:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b860e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 0x55e77b861350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b85f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b85fab0 con 0x55e77b847a70 2023-10-14T08:57:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b85fc20 con 0x55e77b855ed0 2023-10-14T08:57:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77b85fde0 con 0x55e77b848d40 2023-10-14T08:57:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 10 client.0 _ll_register_callbacks cb 0x55e77b5947a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:57:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b860e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b860e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34496/0 (socket says 172.21.15.6:34496) 2023-10-14T08:57:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 -- 172.21.15.6:0/3382183865 learned_addr learned my addr 172.21.15.6:0/3382183865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:57:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7dad9d700 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b85f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 -- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 msgr2=0x55e77b861350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 0x55e77b861350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 -- 172.21.15.6:0/3382183865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 msgr2=0x55e77b85f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:57:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b85f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 -- 172.21.15.6:0/3382183865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d40091b0 con 0x55e77b847a70 2023-10-14T08:57:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7da59c700 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b860e10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009200 tx=0x7fc7cc009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aa7008289a25b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:57:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:57:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/3382183865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0168e0 con 0x55e77b847a70 2023-10-14T08:57:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7d00a21f0 con 0x55e77b847a70 2023-10-14T08:57:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.100+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/3382183865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc7cc01d040 con 0x55e77b847a70 2023-10-14T08:57:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.101+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/3382183865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7cc02ae50 con 0x55e77b847a70 2023-10-14T08:57:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.102+0000 7fc7ecf26b80 10 client.16011 fetch_fsmap learned FSMap version 40 2023-10-14T08:57:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.102+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55e77b5aec00 con 0x55e77b847a70 2023-10-14T08:57:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.102+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/3382183865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7cc043020 con 0x55e77b847a70 2023-10-14T08:57:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.102+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/3382183865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc7cc034420 con 0x55e77b847a70 2023-10-14T08:57:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7ecf26b80 10 client.16011 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:57:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7ecf26b80 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:57:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7ecf26b80 20 client.16011 populate_metadata read hostname 'smithi006' 2023-10-14T08:57:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b8bb0a0 0x55e77b8bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:57:53.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7ecf26b80 4 client.16011 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:57:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e77b793df0 con 0x55e77b8bb0a0 2023-10-14T08:57:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.103+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b8bb0a0 0x55e77b8bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:57:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.104+0000 7fc7d9d9b700 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b8bb0a0 0x55e77b8bd4c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e8c28992d4bc0dd server_cookie=292404d7d2e45a4a in_seq=0 out_seq=0 2023-10-14T08:57:53.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.104+0000 7fc7c1ffb700 10 client.16011 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.134+0000 7fc7c1ffb700 1 -- 172.21.15.6:0/3382183865 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e77b793df0 con 0x55e77b8bb0a0 2023-10-14T08:57:53.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.134+0000 7fc7c1ffb700 10 client.16011 handle_command_reply: tid=0 2023-10-14T08:57:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.134+0000 7fc7ecf26b80 1 client.16011 shutdown 2023-10-14T08:57:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 msgr2=0x55e77b860e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b860e10 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009200 tx=0x7fc7cc009b10 comp rx=0 tx=0).stop 2023-10-14T08:57:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 shutdown_connections 2023-10-14T08:57:53.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55e77b8bb0a0 0x55e77b8bd4c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55e77b855ed0 0x55e77b85f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e77b847a70 0x55e77b860e10 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 --2- 172.21.15.6:0/3382183865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e77b848d40 0x55e77b861350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7c1ffb700 0 client.16011 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:57:53.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 >> 172.21.15.6:0/3382183865 conn(0x55e77b775d70 msgr2=0x55e77b855520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:53.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 shutdown_connections 2023-10-14T08:57:53.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.135+0000 7fc7ecf26b80 1 -- 172.21.15.6:0/3382183865 wait complete. 2023-10-14T08:57:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7ecf26b80 20 client.16011 trim_cache size 0 max 16384 2023-10-14T08:57:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:57:53.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:57:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:57:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:57:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7c40a1500 msgr2=0x7fc7c40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7c40a1500 0x7fc7c40a39c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009d70 tx=0x7fc7cc0124f0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 msgr2=0x7fc7dc195060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:57:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc195060 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d950 tx=0x7fc7d000dc60 comp rx=0 tx=0).stop 2023-10-14T08:57:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 shutdown_connections 2023-10-14T08:57:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7c40a1500 0x7fc7c40a39c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7dc101990 0x7fc7dc19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7dc0ffe00 0x7fc7dc194b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 --2- 172.21.15.6:0/2491861408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7dc100ff0 0x7fc7dc195060 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:57:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 >> 172.21.15.6:0/2491861408 conn(0x7fc7dc0fb390 msgr2=0x7fc7dc0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:57:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 shutdown_connections 2023-10-14T08:57:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:57:53.136+0000 7fc7e0d3c700 1 -- 172.21.15.6:0/2491861408 wait complete. 2023-10-14T08:57:53.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:53 smithi178 ceph-mon[103612]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 787 op/s 2023-10-14T08:57:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:53 smithi057 ceph-mon[103313]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 787 op/s 2023-10-14T08:57:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:53 smithi006 ceph-mon[99452]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 787 op/s 2023-10-14T08:57:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:55 smithi178 ceph-mon[103612]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 800 op/s 2023-10-14T08:57:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:55 smithi057 ceph-mon[103313]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 800 op/s 2023-10-14T08:57:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:55 smithi006 ceph-mon[99452]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 800 op/s 2023-10-14T08:57:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 295.0 s, 1894.2 tps, lat 53.224 ms stddev 60.587 2023-10-14T08:57:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:57 smithi178 ceph-mon[103612]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 915 op/s 2023-10-14T08:57:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:57 smithi057 ceph-mon[103313]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 915 op/s 2023-10-14T08:57:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:57 smithi006 ceph-mon[99452]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 915 op/s 2023-10-14T08:57:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:57:59 smithi178 ceph-mon[103612]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 851 op/s 2023-10-14T08:57:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:57:59 smithi057 ceph-mon[103313]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 851 op/s 2023-10-14T08:57:59.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:57:59 smithi006 ceph-mon[99452]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 851 op/s 2023-10-14T08:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 300.0 s, 2324.3 tps, lat 42.722 ms stddev 48.902 2023-10-14T08:58:01.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:01 smithi178 ceph-mon[103612]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 822 op/s 2023-10-14T08:58:01.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:01 smithi057 ceph-mon[103313]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 822 op/s 2023-10-14T08:58:01.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:01 smithi006 ceph-mon[99452]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 822 op/s 2023-10-14T08:58:03.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:03 smithi178 ceph-mon[103612]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 866 op/s 2023-10-14T08:58:03.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:03 smithi057 ceph-mon[103313]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 866 op/s 2023-10-14T08:58:03.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:03 smithi006 ceph-mon[99452]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 866 op/s 2023-10-14T08:58:05.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:05 smithi178 ceph-mon[103612]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 822 op/s 2023-10-14T08:58:05.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:05 smithi057 ceph-mon[103313]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 822 op/s 2023-10-14T08:58:05.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:05 smithi006 ceph-mon[99452]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 822 op/s 2023-10-14T08:58:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 305.0 s, 1795.6 tps, lat 49.794 ms stddev 58.270 2023-10-14T08:58:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 -- 172.21.15.6:0/3823946274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50101930 msgr2=0x7efd50108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 --2- 172.21.15.6:0/3823946274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50101930 0x7efd50108250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efd4800b0a0 tx=0x7efd4800b3b0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 -- 172.21.15.6:0/3823946274 shutdown_connections 2023-10-14T08:58:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 --2- 172.21.15.6:0/3823946274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50101930 0x7efd50108250 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 --2- 172.21.15.6:0/3823946274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd500ffe20 0x7efd50100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 --2- 172.21.15.6:0/3823946274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd50100f70 0x7efd501013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 -- 172.21.15.6:0/3823946274 >> 172.21.15.6:0/3823946274 conn(0x7efd500fb370 msgr2=0x7efd500fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 -- 172.21.15.6:0/3823946274 shutdown_connections 2023-10-14T08:58:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.279+0000 7efd56bb7700 1 -- 172.21.15.6:0/3823946274 wait complete. 2023-10-14T08:58:06.284 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 Processor -- start 2023-10-14T08:58:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 -- start start 2023-10-14T08:58:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd500ffe20 0x7efd50196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 0x7efd50197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd50101930 0x7efd5019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.285 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5019e830 con 0x7efd50100f70 2023-10-14T08:58:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5019e9a0 con 0x7efd50101930 2023-10-14T08:58:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.280+0000 7efd56bb7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5019eb60 con 0x7efd500ffe20 2023-10-14T08:58:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 0x7efd50197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 0x7efd50197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34512/0 (socket says 172.21.15.6:34512) 2023-10-14T08:58:06.286 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd54953700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd500ffe20 0x7efd50196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 -- 172.21.15.6:0/1746411410 learned_addr learned my addr 172.21.15.6:0/1746411410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd55154700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd50101930 0x7efd5019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 -- 172.21.15.6:0/1746411410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd500ffe20 msgr2=0x7efd50196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd500ffe20 0x7efd50196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 -- 172.21.15.6:0/1746411410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd50101930 msgr2=0x7efd5019e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd50101930 0x7efd5019e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 -- 172.21.15.6:0/1746411410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48009d00 con 0x7efd50100f70 2023-10-14T08:58:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.281+0000 7efd4ffff700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 0x7efd50197230 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e9a0 tx=0x7efd3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.282+0000 7efd4dffb700 1 -- 172.21.15.6:0/1746411410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c009790 con 0x7efd50100f70 2023-10-14T08:58:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.282+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5019ee40 con 0x7efd50100f70 2023-10-14T08:58:06.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.282+0000 7efd4dffb700 1 -- 172.21.15.6:0/1746411410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd3c010430 con 0x7efd50100f70 2023-10-14T08:58:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.282+0000 7efd4dffb700 1 -- 172.21.15.6:0/1746411410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c018680 con 0x7efd50100f70 2023-10-14T08:58:06.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.282+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5019f2c0 con 0x7efd50100f70 2023-10-14T08:58:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.292+0000 7efd4dffb700 1 -- 172.21.15.6:0/1746411410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7efd3c0105a0 con 0x7efd50100f70 2023-10-14T08:58:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.292+0000 7efd4dffb700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd400a1480 0x7efd400a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.292+0000 7efd4dffb700 1 -- 172.21.15.6:0/1746411410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7efd3c014070 con 0x7efd50100f70 2023-10-14T08:58:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.293+0000 7efd54953700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd400a1480 0x7efd400a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.293+0000 7efd54953700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd400a1480 0x7efd400a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd501981c0 tx=0x7efd44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 Processor -- start 2023-10-14T08:58:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 -- start start 2023-10-14T08:58:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aab8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aab9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aaba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aa2dc10 con 0x555b6aaba0a0 2023-10-14T08:58:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aa12c00 con 0x555b6aab91b0 2023-10-14T08:58:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd62da1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aa10520 con 0x555b6aab8850 2023-10-14T08:58:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd55154700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aaba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd54953700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aab8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd55154700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aaba520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34522/0 (socket says 172.21.15.6:34522) 2023-10-14T08:58:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.294+0000 7efd55154700 1 -- 172.21.15.6:0/3608012007 learned_addr learned my addr 172.21.15.6:0/3608012007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd55154700 1 -- 172.21.15.6:0/3608012007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 msgr2=0x555b6aab8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd55154700 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aab8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd55154700 1 -- 172.21.15.6:0/3608012007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 msgr2=0x555b6aab9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd55154700 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aab9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd55154700 1 -- 172.21.15.6:0/3608012007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b6a9c9390 con 0x555b6aaba0a0 2023-10-14T08:58:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd55154700 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aaba520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efd48009c60 tx=0x7efd48009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2054d62f42209b0c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd3affd700 1 -- 172.21.15.6:0/3608012007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4800e040 con 0x555b6aaba0a0 2023-10-14T08:58:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd3affd700 1 -- 172.21.15.6:0/3608012007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd48006000 con 0x555b6aaba0a0 2023-10-14T08:58:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.295+0000 7efd3affd700 1 -- 172.21.15.6:0/3608012007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48003c60 con 0x555b6aaba0a0 2023-10-14T08:58:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 -- 172.21.15.6:0/3608012007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 msgr2=0x555b6aaba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aaba520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efd48009c60 tx=0x7efd48009c90 comp rx=0 tx=0).stop 2023-10-14T08:58:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 -- 172.21.15.6:0/3608012007 shutdown_connections 2023-10-14T08:58:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aaba520 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aab8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3608012007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aab9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 -- 172.21.15.6:0/3608012007 >> 172.21.15.6:0/3608012007 conn(0x555b6a9e6d70 msgr2=0x555b6aab3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 -- 172.21.15.6:0/3608012007 shutdown_connections 2023-10-14T08:58:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 -- 172.21.15.6:0/3608012007 wait complete. 2023-10-14T08:58:06.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.296+0000 7efd62da1b80 1 -- start start 2023-10-14T08:58:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 Processor -- start 2023-10-14T08:58:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab91b0 0x555b6aac2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aaba0a0 0x555b6aac9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aa0be10 con 0x555b6aab8850 2023-10-14T08:58:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6a9a86b0 con 0x555b6aaba0a0 2023-10-14T08:58:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6a9a8350 con 0x555b6aab91b0 2023-10-14T08:58:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd62da1b80 10 client.0 _ll_register_callbacks cb 0x555b6a8057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd54953700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd54953700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34524/0 (socket says 172.21.15.6:34524) 2023-10-14T08:58:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab91b0 0x555b6aac2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.297+0000 7efd54953700 1 -- 172.21.15.6:0/3792386359 learned_addr learned my addr 172.21.15.6:0/3792386359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd54953700 1 -- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab91b0 msgr2=0x555b6aac2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd54953700 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab91b0 0x555b6aac2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd54953700 1 -- 172.21.15.6:0/3792386359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aaba0a0 msgr2=0x555b6aac9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd54953700 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aaba0a0 0x555b6aac9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd54953700 1 -- 172.21.15.6:0/3792386359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd50108b80 con 0x555b6aab8850 2023-10-14T08:58:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd54953700 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac2730 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efd4401ea80 tx=0x7efd440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5d9a23651e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:58:06.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd2ffff700 1 -- 172.21.15.6:0/3792386359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4402c070 con 0x555b6aab8850 2023-10-14T08:58:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd2ffff700 1 -- 172.21.15.6:0/3792386359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7efd4401ee40 con 0x555b6aab8850 2023-10-14T08:58:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b6aa10e90 con 0x555b6aab8850 2023-10-14T08:58:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd2ffff700 1 -- 172.21.15.6:0/3792386359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd4400e9d0 con 0x555b6aab8850 2023-10-14T08:58:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd62da1b80 10 client.16023 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.298+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x555b6a836d80 con 0x555b6aab8850 2023-10-14T08:58:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd2ffff700 1 -- 172.21.15.6:0/3792386359 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd44036080 con 0x555b6aab8850 2023-10-14T08:58:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd2ffff700 1 -- 172.21.15.6:0/3792386359 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7efd4402f030 con 0x555b6aab8850 2023-10-14T08:58:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd62da1b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd62da1b80 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd62da1b80 20 client.16023 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6aace6b0 0x555b6aad0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd62da1b80 4 client.16023 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:58:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b6aa88bb0 con 0x555b6aace6b0 2023-10-14T08:58:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.299+0000 7efd4ffff700 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6aace6b0 0x555b6aad0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.300+0000 7efd4ffff700 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6aace6b0 0x555b6aad0ad0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62cce659691bce50 server_cookie=9e3e27328c08db9b in_seq=0 out_seq=0 2023-10-14T08:58:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.300+0000 7efd2ffff700 10 client.16023 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd2ffff700 1 -- 172.21.15.6:0/3792386359 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555b6aa88bb0 con 0x555b6aace6b0 2023-10-14T08:58:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd2ffff700 10 client.16023 handle_command_reply: tid=0 2023-10-14T08:58:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 client.16023 shutdown 2023-10-14T08:58:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 msgr2=0x555b6aac2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac2730 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efd4401ea80 tx=0x7efd440047c0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 shutdown_connections 2023-10-14T08:58:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6aace6b0 0x555b6aad0ad0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aaba0a0 0x555b6aac9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac2730 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3792386359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab91b0 0x555b6aac2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd2ffff700 0 client.16023 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 >> 172.21.15.6:0/3792386359 conn(0x555b6a9e6d70 msgr2=0x555b6aab3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 shutdown_connections 2023-10-14T08:58:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 1 -- 172.21.15.6:0/3792386359 wait complete. 2023-10-14T08:58:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.301+0000 7efd62da1b80 20 client.16023 trim_cache size 0 max 16384 2023-10-14T08:58:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.318+0000 7efd62da1b80 1 Processor -- start 2023-10-14T08:58:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.318+0000 7efd62da1b80 1 -- start start 2023-10-14T08:58:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.318+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.318+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aaba0a0 0x555b6aac1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd62da1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6a88c8c0 con 0x555b6aab8850 2023-10-14T08:58:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd62da1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aac22a0 con 0x555b6aab91b0 2023-10-14T08:58:06.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd62da1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aab8490 con 0x555b6aaba0a0 2023-10-14T08:58:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd54953700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd54953700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34532/0 (socket says 172.21.15.6:34532) 2023-10-14T08:58:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd54953700 1 -- 172.21.15.6:0/3560147053 learned_addr learned my addr 172.21.15.6:0/3560147053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:06.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd55154700 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aaba0a0 0x555b6aac1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 -- 172.21.15.6:0/3560147053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aaba0a0 msgr2=0x555b6aac1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aaba0a0 0x555b6aac1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 -- 172.21.15.6:0/3560147053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 msgr2=0x555b6aac04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 -- 172.21.15.6:0/3560147053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b6a81fc00 con 0x555b6aab91b0 2023-10-14T08:58:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd54953700 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd4ffff700 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac9c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00c2d0 tx=0x7efd3c010c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb51bb53187f0009 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.319+0000 7efd3b7fe700 1 -- 172.21.15.6:0/3560147053 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c099ca0 con 0x555b6aab91b0 2023-10-14T08:58:06.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd3b7fe700 1 -- 172.21.15.6:0/3560147053 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd3c09e2b0 con 0x555b6aab91b0 2023-10-14T08:58:06.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd3b7fe700 1 -- 172.21.15.6:0/3560147053 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c099650 con 0x555b6aab91b0 2023-10-14T08:58:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 -- 172.21.15.6:0/3560147053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 msgr2=0x555b6aac9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac9c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00c2d0 tx=0x7efd3c010c80 comp rx=0 tx=0).stop 2023-10-14T08:58:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 -- 172.21.15.6:0/3560147053 shutdown_connections 2023-10-14T08:58:06.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aaba0a0 0x555b6aac1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aab8850 0x555b6aac04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3560147053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac9c70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 -- 172.21.15.6:0/3560147053 >> 172.21.15.6:0/3560147053 conn(0x555b6a9e6d70 msgr2=0x555b6aab2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:06.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 -- 172.21.15.6:0/3560147053 shutdown_connections 2023-10-14T08:58:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.320+0000 7efd62da1b80 1 -- 172.21.15.6:0/3560147053 wait complete. 2023-10-14T08:58:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 -- start start 2023-10-14T08:58:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 Processor -- start 2023-10-14T08:58:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aac7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aac90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aac9620 con 0x555b6aaba0a0 2023-10-14T08:58:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aac9790 con 0x555b6aab91b0 2023-10-14T08:58:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6aac9950 con 0x555b6aab8850 2023-10-14T08:58:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd62da1b80 10 client.0 _ll_register_callbacks cb 0x7efd44011f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:06.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd55154700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aac90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd55154700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aac90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34542/0 (socket says 172.21.15.6:34542) 2023-10-14T08:58:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd55154700 1 -- 172.21.15.6:0/3291131213 learned_addr learned my addr 172.21.15.6:0/3291131213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd4ffff700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.321+0000 7efd54953700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aac7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd55154700 1 -- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 msgr2=0x555b6aac7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd55154700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aac7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd55154700 1 -- 172.21.15.6:0/3291131213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 msgr2=0x555b6aac80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd55154700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd55154700 1 -- 172.21.15.6:0/3291131213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b6a836d80 con 0x555b6aaba0a0 2023-10-14T08:58:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd55154700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aac90e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efd48009c60 tx=0x7efd48007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f611db96c48b8d31 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:58:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd2ffff700 1 -- 172.21.15.6:0/3291131213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4800e040 con 0x555b6aaba0a0 2023-10-14T08:58:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd48006000 con 0x555b6aaba0a0 2023-10-14T08:58:06.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd2ffff700 1 -- 172.21.15.6:0/3291131213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7efd4800bc60 con 0x555b6aaba0a0 2023-10-14T08:58:06.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd2ffff700 1 -- 172.21.15.6:0/3291131213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd4800be20 con 0x555b6aaba0a0 2023-10-14T08:58:06.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd62da1b80 10 client.16029 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:06.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7efd5019f2c0 con 0x555b6aaba0a0 2023-10-14T08:58:06.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.322+0000 7efd2ffff700 1 -- 172.21.15.6:0/3291131213 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd48006000 con 0x555b6aaba0a0 2023-10-14T08:58:06.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd2ffff700 1 -- 172.21.15.6:0/3291131213 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7efd48019070 con 0x555b6aaba0a0 2023-10-14T08:58:06.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd62da1b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:06.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd62da1b80 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:06.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd62da1b80 20 client.16029 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:06.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6ab232d0 0x555b6ab256f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:06.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd62da1b80 4 client.16029 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:58:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555b6aa04df0 con 0x555b6ab232d0 2023-10-14T08:58:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd54953700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6ab232d0 0x555b6ab256f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd2ffff700 10 client.16029 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:06.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.323+0000 7efd54953700 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6ab232d0 0x555b6ab256f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7fe11aa328a323 server_cookie=548f0b25a40ec6ac in_seq=0 out_seq=0 2023-10-14T08:58:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.398+0000 7efd2ffff700 1 -- 172.21.15.6:0/3291131213 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555b6aa04df0 con 0x555b6ab232d0 2023-10-14T08:58:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.398+0000 7efd2ffff700 10 client.16029 handle_command_reply: tid=0 2023-10-14T08:58:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.398+0000 7efd62da1b80 1 client.16029 shutdown 2023-10-14T08:58:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 msgr2=0x555b6aac90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aac90e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efd48009c60 tx=0x7efd48007810 comp rx=0 tx=0).stop 2023-10-14T08:58:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 shutdown_connections 2023-10-14T08:58:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b6ab232d0 0x555b6ab256f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b6aaba0a0 0x555b6aac90e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd2ffff700 0 client.16029 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b6aab8850 0x555b6aac7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 --2- 172.21.15.6:0/3291131213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b6aab91b0 0x555b6aac80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 >> 172.21.15.6:0/3291131213 conn(0x555b6a9e6d70 msgr2=0x555b6aac04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 shutdown_connections 2023-10-14T08:58:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 1 -- 172.21.15.6:0/3291131213 wait complete. 2023-10-14T08:58:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.399+0000 7efd62da1b80 20 client.16029 trim_cache size 0 max 16384 2023-10-14T08:58:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:58:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:58:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:58:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:58:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd400a1480 msgr2=0x7efd400a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd400a1480 0x7efd400a3940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd501981c0 tx=0x7efd44009260 comp rx=0 tx=0).stop 2023-10-14T08:58:06.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 msgr2=0x7efd50197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 0x7efd50197230 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e9a0 tx=0x7efd3c00ecb0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 shutdown_connections 2023-10-14T08:58:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7efd400a1480 0x7efd400a3940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd50101930 0x7efd5019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd500ffe20 0x7efd50196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 --2- 172.21.15.6:0/1746411410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd50100f70 0x7efd50197230 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 >> 172.21.15.6:0/1746411410 conn(0x7efd500fb370 msgr2=0x7efd50068ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 shutdown_connections 2023-10-14T08:58:06.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:06.400+0000 7efd56bb7700 1 -- 172.21.15.6:0/1746411410 wait complete. 2023-10-14T08:58:07.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:07 smithi178 ceph-mon[103612]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 879 op/s 2023-10-14T08:58:07.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:07 smithi057 ceph-mon[103313]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 879 op/s 2023-10-14T08:58:07.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:07 smithi006 ceph-mon[99452]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 879 op/s 2023-10-14T08:58:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:08 smithi178 ceph-mon[103612]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 1.32k op/s 2023-10-14T08:58:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:08 smithi057 ceph-mon[103313]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 1.32k op/s 2023-10-14T08:58:08.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:08 smithi006 ceph-mon[99452]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 1.32k op/s 2023-10-14T08:58:10.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:10 smithi057 ceph-mon[103313]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 1.60k op/s 2023-10-14T08:58:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 310.0 s, 2147.8 tps, lat 51.512 ms stddev 102.064 2023-10-14T08:58:10.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:10 smithi006 ceph-mon[99452]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 1.60k op/s 2023-10-14T08:58:11.139 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:10 smithi178 ceph-mon[103612]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 1.60k op/s 2023-10-14T08:58:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:13 smithi178 ceph-mon[103612]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 MiB/s wr, 1.95k op/s 2023-10-14T08:58:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:13 smithi057 ceph-mon[103313]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 MiB/s wr, 1.95k op/s 2023-10-14T08:58:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:13 smithi006 ceph-mon[99452]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 MiB/s wr, 1.95k op/s 2023-10-14T08:58:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:15 smithi178 ceph-mon[103612]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 MiB/s wr, 1.95k op/s 2023-10-14T08:58:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:15 smithi057 ceph-mon[103313]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 MiB/s wr, 1.95k op/s 2023-10-14T08:58:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:15 smithi006 ceph-mon[99452]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 MiB/s wr, 1.95k op/s 2023-10-14T08:58:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 315.0 s, 2607.9 tps, lat 38.421 ms stddev 43.158 2023-10-14T08:58:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:17 smithi178 ceph-mon[103612]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.98k op/s 2023-10-14T08:58:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:17 smithi057 ceph-mon[103313]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.98k op/s 2023-10-14T08:58:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:17 smithi006 ceph-mon[99452]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.98k op/s 2023-10-14T08:58:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.537+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1281462338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 msgr2=0x7f1e341094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.537+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1281462338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e341094a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b0a0 tx=0x7f1e2c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1281462338 shutdown_connections 2023-10-14T08:58:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1281462338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e341094a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1281462338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e340ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1281462338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e34102250 0x7f1e341026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1281462338 >> 172.21.15.6:0/1281462338 conn(0x7f1e340faaf0 msgr2=0x7f1e340fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1281462338 shutdown_connections 2023-10-14T08:58:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1281462338 wait complete. 2023-10-14T08:58:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 Processor -- start 2023-10-14T08:58:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.538+0000 7f1e3c3d4700 1 -- start start 2023-10-14T08:58:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3c3d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e34196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3c3d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e34102250 0x7f1e34197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3c3d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e3419e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3c3d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3419e840 con 0x7f1e34102bf0 2023-10-14T08:58:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3c3d4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3419e9b0 con 0x7f1e34102250 2023-10-14T08:58:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3c3d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3419eb70 con 0x7f1e340ff1e0 2023-10-14T08:58:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e3419e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a170700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e34196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e3419e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34556/0 (socket says 172.21.15.6:34556) 2023-10-14T08:58:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 -- 172.21.15.6:0/1113415744 learned_addr learned my addr 172.21.15.6:0/1113415744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a170700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e34196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60186/0 (socket says 172.21.15.6:60186) 2023-10-14T08:58:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3996f700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e34102250 0x7f1e34197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 -- 172.21.15.6:0/1113415744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 msgr2=0x7f1e34196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e34196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 -- 172.21.15.6:0/1113415744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e34102250 msgr2=0x7f1e34197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e34102250 0x7f1e34197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 -- 172.21.15.6:0/1113415744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009d00 con 0x7f1e34102bf0 2023-10-14T08:58:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a170700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e34196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.539+0000 7f1e3a971700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e3419e270 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b780 tx=0x7f1e2c00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.540+0000 7f1e2b7fe700 1 -- 172.21.15.6:0/1113415744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00e040 con 0x7f1e34102bf0 2023-10-14T08:58:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.540+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3419edf0 con 0x7f1e34102bf0 2023-10-14T08:58:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.540+0000 7f1e2b7fe700 1 -- 172.21.15.6:0/1113415744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e2c004c50 con 0x7f1e34102bf0 2023-10-14T08:58:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.540+0000 7f1e2b7fe700 1 -- 172.21.15.6:0/1113415744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c005280 con 0x7f1e34102bf0 2023-10-14T08:58:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.540+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3419f200 con 0x7f1e34102bf0 2023-10-14T08:58:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.542+0000 7f1e2b7fe700 1 -- 172.21.15.6:0/1113415744 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1e2c01d470 con 0x7f1e34102bf0 2023-10-14T08:58:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.542+0000 7f1e2b7fe700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1e200a1480 0x7f1e200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.543+0000 7f1e2b7fe700 1 -- 172.21.15.6:0/1113415744 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1e2c0ce1d0 con 0x7f1e34102bf0 2023-10-14T08:58:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.543+0000 7f1e3a170700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1e200a1480 0x7f1e200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.543+0000 7f1e3a170700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1e200a1480 0x7f1e200a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e341981d0 tx=0x7f1e30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.543+0000 7f1e485beb80 1 Processor -- start 2023-10-14T08:58:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 -- start start 2023-10-14T08:58:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87056f60 0x560a87055790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a87056150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87063cc0 0x560a870660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86fcac10 con 0x560a87055cd0 2023-10-14T08:58:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86fafc00 con 0x560a87056f60 2023-10-14T08:58:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e485beb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86fad520 con 0x560a87063cc0 2023-10-14T08:58:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e3996f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a87056150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e3996f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a87056150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34560/0 (socket says 172.21.15.6:34560) 2023-10-14T08:58:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.546+0000 7f1e3996f700 1 -- 172.21.15.6:0/2265206075 learned_addr learned my addr 172.21.15.6:0/2265206075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3996f700 1 -- 172.21.15.6:0/2265206075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87063cc0 msgr2=0x560a870660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3996f700 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87063cc0 0x560a870660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3996f700 1 -- 172.21.15.6:0/2265206075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87056f60 msgr2=0x560a87055790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87056f60 0x560a87055790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3996f700 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87056f60 0x560a87055790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3996f700 1 -- 172.21.15.6:0/2265206075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a86f66390 con 0x560a87055cd0 2023-10-14T08:58:19.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87056f60 0x560a87055790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e3996f700 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a87056150 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009d80 tx=0x7f1e24011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209c584aee6049c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e28d82700 1 -- 172.21.15.6:0/2265206075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24004230 con 0x560a87055cd0 2023-10-14T08:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e28d82700 1 -- 172.21.15.6:0/2265206075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e24004390 con 0x560a87055cd0 2023-10-14T08:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.547+0000 7f1e28d82700 1 -- 172.21.15.6:0/2265206075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24019860 con 0x560a87055cd0 2023-10-14T08:58:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 -- 172.21.15.6:0/2265206075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 msgr2=0x560a87056150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a87056150 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009d80 tx=0x7f1e24011720 comp rx=0 tx=0).stop 2023-10-14T08:58:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 -- 172.21.15.6:0/2265206075 shutdown_connections 2023-10-14T08:58:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87063cc0 0x560a870660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87056f60 0x560a87055790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2265206075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a87056150 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 -- 172.21.15.6:0/2265206075 >> 172.21.15.6:0/2265206075 conn(0x560a86f83d70 msgr2=0x560a870509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 -- 172.21.15.6:0/2265206075 shutdown_connections 2023-10-14T08:58:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.548+0000 7f1e485beb80 1 -- 172.21.15.6:0/2265206075 wait complete. 2023-10-14T08:58:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 -- start start 2023-10-14T08:58:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 Processor -- start 2023-10-14T08:58:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87078f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87079480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a870804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86fa8e10 con 0x560a87063cc0 2023-10-14T08:58:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86f456b0 con 0x560a87055cd0 2023-10-14T08:58:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86f45350 con 0x560a87056f60 2023-10-14T08:58:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e485beb80 10 client.0 _ll_register_callbacks cb 0x560a86da27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e3a170700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87078f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e3996f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87079480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e3a971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a870804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e3a170700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87078f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33324/0 (socket says 172.21.15.6:33324) 2023-10-14T08:58:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e3996f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87079480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60202/0 (socket says 172.21.15.6:60202) 2023-10-14T08:58:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.549+0000 7f1e3a170700 1 -- 172.21.15.6:0/2252359122 learned_addr learned my addr 172.21.15.6:0/2252359122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e3a971700 1 -- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 msgr2=0x560a87079480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e3a971700 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87079480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e3a971700 1 -- 172.21.15.6:0/2252359122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 msgr2=0x560a87078f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e3a971700 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87078f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e3a971700 1 -- 172.21.15.6:0/2252359122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e240099e0 con 0x560a87063cc0 2023-10-14T08:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e3a971700 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a870804c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c007a60 tx=0x7f1e2c09b0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac97d52d15fc643c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.550+0000 7f1e1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2252359122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c09aee0 con 0x560a87063cc0 2023-10-14T08:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2252359122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1e2c0cd070 con 0x560a87063cc0 2023-10-14T08:58:19.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a86fade90 con 0x560a87063cc0 2023-10-14T08:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2252359122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e2c09bc80 con 0x560a87063cc0 2023-10-14T08:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 10 client.16041 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x560a86dd3d80 con 0x560a87063cc0 2023-10-14T08:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2252359122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560a86fade90 con 0x560a87063cc0 2023-10-14T08:58:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2252359122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1e2c0a33f0 con 0x560a87063cc0 2023-10-14T08:58:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 10 client.16041 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 20 client.16041 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a87084a00 0x560a87086e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 4 client.16041 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:58:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a87025bb0 con 0x560a87084a00 2023-10-14T08:58:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.551+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a87084a00 0x560a87086e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.552+0000 7f1e1dffb700 10 client.16041 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.552+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a87084a00 0x560a87086e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d9963f0ec7c8cdc server_cookie=51e01d8859e6bd8a in_seq=0 out_seq=0 2023-10-14T08:58:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2252359122 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560a87025bb0 con 0x560a87084a00 2023-10-14T08:58:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e1dffb700 10 client.16041 handle_command_reply: tid=0 2023-10-14T08:58:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 client.16041 shutdown 2023-10-14T08:58:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 msgr2=0x560a870804c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a870804c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c007a60 tx=0x7f1e2c09b0c0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 shutdown_connections 2023-10-14T08:58:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a87084a00 0x560a87086e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a870804c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87078f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2252359122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87079480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 >> 172.21.15.6:0/2252359122 conn(0x560a86f83d70 msgr2=0x560a87050620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e1dffb700 0 client.16041 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 shutdown_connections 2023-10-14T08:58:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 1 -- 172.21.15.6:0/2252359122 wait complete. 2023-10-14T08:58:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.553+0000 7f1e485beb80 20 client.16041 trim_cache size 0 max 16384 2023-10-14T08:58:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 Processor -- start 2023-10-14T08:58:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 -- start start 2023-10-14T08:58:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87063300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87080480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a8705ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a86e298c0 con 0x560a87063cc0 2023-10-14T08:58:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a87084820 con 0x560a87055cd0 2023-10-14T08:58:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e485beb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a87078ae0 con 0x560a87056f60 2023-10-14T08:58:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a8705ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a8705ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34578/0 (socket says 172.21.15.6:34578) 2023-10-14T08:58:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 -- 172.21.15.6:0/1168446338 learned_addr learned my addr 172.21.15.6:0/1168446338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3996f700 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87080480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a170700 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87063300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 -- 172.21.15.6:0/1168446338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 msgr2=0x560a87080480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87080480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 -- 172.21.15.6:0/1168446338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 msgr2=0x560a87063300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87063300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.574+0000 7f1e3a971700 1 -- 172.21.15.6:0/1168446338 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a86dbcc00 con 0x560a87063cc0 2023-10-14T08:58:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.575+0000 7f1e3a971700 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a8705ffa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0062a0 tx=0x7f1e2c0861a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52417f0d4b30c41 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.575+0000 7f1e29583700 1 -- 172.21.15.6:0/1168446338 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c09aee0 con 0x560a87063cc0 2023-10-14T08:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.575+0000 7f1e29583700 1 -- 172.21.15.6:0/1168446338 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e2c09bc80 con 0x560a87063cc0 2023-10-14T08:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.575+0000 7f1e29583700 1 -- 172.21.15.6:0/1168446338 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c09ab00 con 0x560a87063cc0 2023-10-14T08:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- 172.21.15.6:0/1168446338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 msgr2=0x560a8705ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a8705ffa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0062a0 tx=0x7f1e2c0861a0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- 172.21.15.6:0/1168446338 shutdown_connections 2023-10-14T08:58:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87063cc0 0x560a8705ffa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87055cd0 0x560a87063300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- 172.21.15.6:0/1168446338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a87080480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- 172.21.15.6:0/1168446338 >> 172.21.15.6:0/1168446338 conn(0x560a86f83d70 msgr2=0x560a87086a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- 172.21.15.6:0/1168446338 shutdown_connections 2023-10-14T08:58:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- 172.21.15.6:0/1168446338 wait complete. 2023-10-14T08:58:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- start start 2023-10-14T08:58:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 Processor -- start 2023-10-14T08:58:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a8707da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a8707dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87063cc0 0x560a8707efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8707f510 con 0x560a87055cd0 2023-10-14T08:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8707f680 con 0x560a87063cc0 2023-10-14T08:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.576+0000 7f1e485beb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8707f840 con 0x560a87056f60 2023-10-14T08:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.577+0000 7f1e485beb80 10 client.0 _ll_register_callbacks cb 0x560a86da27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.577+0000 7f1e3a170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a8707da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.577+0000 7f1e3a170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a8707da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34582/0 (socket says 172.21.15.6:34582) 2023-10-14T08:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.577+0000 7f1e3a170700 1 -- 172.21.15.6:0/2916319021 learned_addr learned my addr 172.21.15.6:0/2916319021 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.578+0000 7f1e3a170700 1 -- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 msgr2=0x560a8707dfc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.578+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a8707dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.578+0000 7f1e3a170700 1 -- 172.21.15.6:0/2916319021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87063cc0 msgr2=0x560a8707efd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:58:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.578+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87063cc0 0x560a8707efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.578+0000 7f1e3a170700 1 -- 172.21.15.6:0/2916319021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a86dd3d80 con 0x560a87055cd0 2023-10-14T08:58:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.595+0000 7f1e3a170700 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a8707da80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x560a87087730 tx=0x7f1e300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aede4295c854c1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.595+0000 7f1e1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:58:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.599+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2916319021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30023040 con 0x560a87055cd0 2023-10-14T08:58:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.599+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2916319021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1e30029e10 con 0x560a87055cd0 2023-10-14T08:58:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.599+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e24004390 con 0x560a87055cd0 2023-10-14T08:58:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.600+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2916319021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e30003ae0 con 0x560a87055cd0 2023-10-14T08:58:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.602+0000 7f1e485beb80 10 client.16047 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.602+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x560a86dfa1f0 con 0x560a87055cd0 2023-10-14T08:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.602+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2916319021 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e24004390 con 0x560a87055cd0 2023-10-14T08:58:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.602+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2916319021 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1e30032cf0 con 0x560a87055cd0 2023-10-14T08:58:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.603+0000 7f1e485beb80 10 client.16047 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.603+0000 7f1e485beb80 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.603+0000 7f1e485beb80 20 client.16047 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.603+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a870d90a0 0x560a870db4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.603+0000 7f1e485beb80 4 client.16047 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:58:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.603+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a86fa1df0 con 0x560a870d90a0 2023-10-14T08:58:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.606+0000 7f1e3996f700 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a870d90a0 0x560a870db4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.607+0000 7f1e3996f700 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a870d90a0 0x560a870db4c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff2786d8fb7deb1 server_cookie=a60e5eaeda9d6176 in_seq=0 out_seq=0 2023-10-14T08:58:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.607+0000 7f1e1dffb700 10 client.16047 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:19 smithi178 ceph-mon[103612]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.97k op/s 2023-10-14T08:58:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.644+0000 7f1e1dffb700 1 -- 172.21.15.6:0/2916319021 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a86fa1df0 con 0x560a870d90a0 2023-10-14T08:58:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.644+0000 7f1e1dffb700 10 client.16047 handle_command_reply: tid=0 2023-10-14T08:58:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 client.16047 shutdown 2023-10-14T08:58:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 msgr2=0x560a8707da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a8707da80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x560a87087730 tx=0x7f1e300047c0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 shutdown_connections 2023-10-14T08:58:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560a870d90a0 0x560a870db4c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560a87063cc0 0x560a8707efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a87055cd0 0x560a8707da80 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 --2- 172.21.15.6:0/2916319021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a87056f60 0x560a8707dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e1dffb700 0 client.16047 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.645+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 >> 172.21.15.6:0/2916319021 conn(0x560a86f83d70 msgr2=0x560a87063300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:19.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 shutdown_connections 2023-10-14T08:58:19.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e485beb80 1 -- 172.21.15.6:0/2916319021 wait complete. 2023-10-14T08:58:19.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e485beb80 20 client.16047 trim_cache size 0 max 16384 2023-10-14T08:58:19.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:58:19.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:58:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:58:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:58:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1e200a1480 msgr2=0x7f1e200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1e200a1480 0x7f1e200a3940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e341981d0 tx=0x7f1e30009260 comp rx=0 tx=0).stop 2023-10-14T08:58:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 msgr2=0x7f1e3419e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e3419e270 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b780 tx=0x7f1e2c00bab0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 shutdown_connections 2023-10-14T08:58:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e34102bf0 0x7f1e3419e270 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e340ff1e0 0x7f1e34196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1e200a1480 0x7f1e200a3940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 --2- 172.21.15.6:0/1113415744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e34102250 0x7f1e34197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 >> 172.21.15.6:0/1113415744 conn(0x7f1e340faaf0 msgr2=0x7f1e341056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 shutdown_connections 2023-10-14T08:58:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:19.646+0000 7f1e3c3d4700 1 -- 172.21.15.6:0/1113415744 wait complete. 2023-10-14T08:58:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:19 smithi057 ceph-mon[103313]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.97k op/s 2023-10-14T08:58:19.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:19 smithi006 ceph-mon[99452]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.97k op/s 2023-10-14T08:58:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 320.0 s, 2359.9 tps, lat 42.551 ms stddev 47.608 2023-10-14T08:58:21.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:21 smithi178 ceph-mon[103612]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 1.32k op/s 2023-10-14T08:58:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:21 smithi057 ceph-mon[103313]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 1.32k op/s 2023-10-14T08:58:21.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:21 smithi006 ceph-mon[99452]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 27 MiB/s wr, 1.32k op/s 2023-10-14T08:58:23.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:23 smithi178 ceph-mon[103612]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 1.03k op/s 2023-10-14T08:58:23.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:23 smithi057 ceph-mon[103313]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 1.03k op/s 2023-10-14T08:58:23.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:23 smithi006 ceph-mon[99452]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 1.03k op/s 2023-10-14T08:58:25.644 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:25 smithi178 ceph-mon[103612]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 710 op/s 2023-10-14T08:58:25.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:25 smithi057 ceph-mon[103313]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 710 op/s 2023-10-14T08:58:25.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:25 smithi006 ceph-mon[99452]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 710 op/s 2023-10-14T08:58:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 325.0 s, 2690.8 tps, lat 37.223 ms stddev 44.064 2023-10-14T08:58:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:27 smithi178 ceph-mon[103612]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-14T08:58:27.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:27 smithi057 ceph-mon[103313]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-14T08:58:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:27 smithi006 ceph-mon[99452]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-14T08:58:29.633 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:29 smithi178 ceph-mon[103612]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 765 op/s 2023-10-14T08:58:29.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:29 smithi057 ceph-mon[103313]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 765 op/s 2023-10-14T08:58:29.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:29 smithi006 ceph-mon[99452]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 765 op/s 2023-10-14T08:58:30.965 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 330.0 s, 2721.8 tps, lat 36.740 ms stddev 44.096 2023-10-14T08:58:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:31 smithi178 ceph-mon[103612]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 664 op/s 2023-10-14T08:58:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:31 smithi057 ceph-mon[103313]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 664 op/s 2023-10-14T08:58:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:31 smithi006 ceph-mon[99452]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 664 op/s 2023-10-14T08:58:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.809+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/4136934339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100060 msgr2=0x7fb3e81004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.809+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/4136934339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100060 0x7fb3e81004e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0098f0 tx=0x7fb3dc009c00 comp rx=0 tx=0).stop 2023-10-14T08:58:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/4136934339 shutdown_connections 2023-10-14T08:58:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/4136934339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100a20 0x7fb3e81082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/4136934339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 0x7fb3e81018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/4136934339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100060 0x7fb3e81004e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/4136934339 >> 172.21.15.6:0/4136934339 conn(0x7fb3e80fab10 msgr2=0x7fb3e80fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/4136934339 shutdown_connections 2023-10-14T08:58:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/4136934339 wait complete. 2023-10-14T08:58:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.810+0000 7fb3ee8aa700 1 Processor -- start 2023-10-14T08:58:32.815 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 -- start start 2023-10-14T08:58:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100060 0x7fb3e80ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100a20 0x7fb3e819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 0x7fb3e819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8195710 con 0x7fb3e8100060 2023-10-14T08:58:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8195880 con 0x7fb3e81014a0 2023-10-14T08:58:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ee8aa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8195a40 con 0x7fb3e8100a20 2023-10-14T08:58:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100060 0x7fb3e80ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100060 0x7fb3e80ffae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34592/0 (socket says 172.21.15.6:34592) 2023-10-14T08:58:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3e7fff700 1 -- 172.21.15.6:0/64653569 learned_addr learned my addr 172.21.15.6:0/64653569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100a20 0x7fb3e819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.811+0000 7fb3ece47700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 0x7fb3e819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e77fe700 1 -- 172.21.15.6:0/64653569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 msgr2=0x7fb3e819df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 0x7fb3e819df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e77fe700 1 -- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100060 msgr2=0x7fb3e80ffae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100060 0x7fb3e80ffae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e77fe700 1 -- 172.21.15.6:0/64653569 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc009520 con 0x7fb3e8100a20 2023-10-14T08:58:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3ece47700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 0x7fb3e819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100a20 0x7fb3e819b910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009230 tx=0x7fb3dc00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e57fa700 1 -- 172.21.15.6:0/64653569 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc01c070 con 0x7fb3e8100a20 2023-10-14T08:58:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e57fa700 1 -- 172.21.15.6:0/64653569 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3dc00f860 con 0x7fb3e8100a20 2023-10-14T08:58:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e8195cc0 con 0x7fb3e8100a20 2023-10-14T08:58:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3e57fa700 1 -- 172.21.15.6:0/64653569 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc003a80 con 0x7fb3e8100a20 2023-10-14T08:58:32.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.812+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e81961c0 con 0x7fb3e8100a20 2023-10-14T08:58:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.815+0000 7fb3e57fa700 1 -- 172.21.15.6:0/64653569 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb3dc020070 con 0x7fb3e8100a20 2023-10-14T08:58:32.825 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.815+0000 7fb3e57fa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb3d00a1500 0x7fb3d00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.815+0000 7fb3e57fa700 1 -- 172.21.15.6:0/64653569 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb3dc0cd7d0 con 0x7fb3e8100a20 2023-10-14T08:58:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.815+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb3d00a1500 0x7fb3d00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb3d00a1500 0x7fb3d00a39c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bd90 tx=0x7fb3d800b4e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:32.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 Processor -- start 2023-10-14T08:58:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 -- start start 2023-10-14T08:58:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e236ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e236bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e236c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e22dfc10 con 0x55d2e236c0a0 2023-10-14T08:58:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e22c4c00 con 0x55d2e236a850 2023-10-14T08:58:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e22c2520 con 0x55d2e236b1b0 2023-10-14T08:58:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e236ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e236ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33358/0 (socket says 172.21.15.6:33358) 2023-10-14T08:58:32.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.817+0000 7fb3e7fff700 1 -- 172.21.15.6:0/3052044893 learned_addr learned my addr 172.21.15.6:0/3052044893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3ece47700 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e236c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3e7fff700 1 -- 172.21.15.6:0/3052044893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 msgr2=0x55d2e236bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:58:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e236bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3e7fff700 1 -- 172.21.15.6:0/3052044893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 msgr2=0x55d2e236c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:32.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e236c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3e7fff700 1 -- 172.21.15.6:0/3052044893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e227b390 con 0x55d2e236a850 2023-10-14T08:58:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3ece47700 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e236c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:58:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e236ac70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8010f70 tx=0x7fb3d8013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626eab4b95a6d389 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:32.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3ce7fc700 1 -- 172.21.15.6:0/3052044893 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d801e620 con 0x55d2e236a850 2023-10-14T08:58:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3ce7fc700 1 -- 172.21.15.6:0/3052044893 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3d8015070 con 0x55d2e236a850 2023-10-14T08:58:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.818+0000 7fb3ce7fc700 1 -- 172.21.15.6:0/3052044893 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d801cae0 con 0x55d2e236a850 2023-10-14T08:58:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.819+0000 7fb3faa94b80 1 -- 172.21.15.6:0/3052044893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 msgr2=0x55d2e236ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.819+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e236ac70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8010f70 tx=0x7fb3d8013000 comp rx=0 tx=0).stop 2023-10-14T08:58:32.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.819+0000 7fb3faa94b80 1 -- 172.21.15.6:0/3052044893 shutdown_connections 2023-10-14T08:58:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.819+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e236c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.819+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e236ac70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.820+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/3052044893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e236bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.820+0000 7fb3faa94b80 1 -- 172.21.15.6:0/3052044893 >> 172.21.15.6:0/3052044893 conn(0x55d2e2298d70 msgr2=0x55d2e2365c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.820+0000 7fb3faa94b80 1 -- 172.21.15.6:0/3052044893 shutdown_connections 2023-10-14T08:58:32.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.820+0000 7fb3faa94b80 1 -- 172.21.15.6:0/3052044893 wait complete. 2023-10-14T08:58:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.820+0000 7fb3faa94b80 1 -- start start 2023-10-14T08:58:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.820+0000 7fb3faa94b80 1 Processor -- start 2023-10-14T08:58:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e23857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236b1b0 0x55d2e2385ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236c0a0 0x55d2e238cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e22bde10 con 0x55d2e236a850 2023-10-14T08:58:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e225a6b0 con 0x55d2e236b1b0 2023-10-14T08:58:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e225a350 con 0x55d2e236c0a0 2023-10-14T08:58:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3faa94b80 10 client.0 _ll_register_callbacks cb 0x55d2e20b77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e23857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e23857a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34606/0 (socket says 172.21.15.6:34606) 2023-10-14T08:58:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3e7fff700 1 -- 172.21.15.6:0/1421004634 learned_addr learned my addr 172.21.15.6:0/1421004634 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.822+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236b1b0 0x55d2e2385ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e77fe700 1 -- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236c0a0 msgr2=0x55d2e238cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T08:58:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236c0a0 0x55d2e238cd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e77fe700 1 -- 172.21.15.6:0/1421004634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 msgr2=0x55d2e23857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e23857a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e77fe700 1 -- 172.21.15.6:0/1421004634 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d8010c50 con 0x55d2e236b1b0 2023-10-14T08:58:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e23857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236b1b0 0x55d2e2385ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009810 tx=0x7fb3dc09a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e8ebf3941221e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:58:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3c77fe700 1 -- 172.21.15.6:0/1421004634 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b2070 con 0x55d2e236b1b0 2023-10-14T08:58:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3c77fe700 1 -- 172.21.15.6:0/1421004634 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb3dc09ecd0 con 0x55d2e236b1b0 2023-10-14T08:58:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2e22c2e90 con 0x55d2e236b1b0 2023-10-14T08:58:32.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3c77fe700 1 -- 172.21.15.6:0/1421004634 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3dc0a2e80 con 0x55d2e236b1b0 2023-10-14T08:58:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3faa94b80 10 client.25673 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55d2e20e8d80 con 0x55d2e236b1b0 2023-10-14T08:58:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3c77fe700 1 -- 172.21.15.6:0/1421004634 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3dc07d020 con 0x55d2e236b1b0 2023-10-14T08:58:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3c77fe700 1 -- 172.21.15.6:0/1421004634 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb3dc09ae70 con 0x55d2e236b1b0 2023-10-14T08:58:32.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3faa94b80 10 client.25673 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3faa94b80 10 client.25673 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.823+0000 7fb3faa94b80 20 client.25673 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.824+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e2391210 0x55d2e2393600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.824+0000 7fb3faa94b80 4 client.25673 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:58:32.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.824+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2e233abb0 con 0x55d2e2391210 2023-10-14T08:58:32.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.824+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e2391210 0x55d2e2393600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.824+0000 7fb3c77fe700 10 client.25673 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.824+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e2391210 0x55d2e2393600 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b7bbd52c3b98ae server_cookie=bba052004650c34b in_seq=0 out_seq=0 2023-10-14T08:58:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.825+0000 7fb3c77fe700 1 -- 172.21.15.6:0/1421004634 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d2e233abb0 con 0x55d2e2391210 2023-10-14T08:58:32.841 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.825+0000 7fb3c77fe700 10 client.25673 handle_command_reply: tid=0 2023-10-14T08:58:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.825+0000 7fb3faa94b80 1 client.25673 shutdown 2023-10-14T08:58:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.825+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236b1b0 msgr2=0x55d2e2385ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.825+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236b1b0 0x55d2e2385ce0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009810 tx=0x7fb3dc09a560 comp rx=0 tx=0).stop 2023-10-14T08:58:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 shutdown_connections 2023-10-14T08:58:32.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e2391210 0x55d2e2393600 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236c0a0 0x55d2e238cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3c77fe700 0 client.25673 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e23857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1421004634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236b1b0 0x55d2e2385ce0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.843 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 >> 172.21.15.6:0/1421004634 conn(0x55d2e2298d70 msgr2=0x55d2e2365830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.826+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 shutdown_connections 2023-10-14T08:58:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.829+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1421004634 wait complete. 2023-10-14T08:58:32.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.829+0000 7fb3faa94b80 20 client.25673 trim_cache size 0 max 16384 2023-10-14T08:58:32.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 Processor -- start 2023-10-14T08:58:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 -- start start 2023-10-14T08:58:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e2384410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e23724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e213e8c0 con 0x55d2e236c0a0 2023-10-14T08:58:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e236bf20 con 0x55d2e236a850 2023-10-14T08:58:32.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e2384c50 con 0x55d2e236b1b0 2023-10-14T08:58:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3ece47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e23724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e2384410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3e77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e2384410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33372/0 (socket says 172.21.15.6:33372) 2023-10-14T08:58:32.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3e7fff700 1 -- 172.21.15.6:0/1676268481 learned_addr learned my addr 172.21.15.6:0/1676268481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3e77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60248/0 (socket says 172.21.15.6:60248) 2023-10-14T08:58:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.851+0000 7fb3ece47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e23724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34618/0 (socket says 172.21.15.6:34618) 2023-10-14T08:58:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e7fff700 1 -- 172.21.15.6:0/1676268481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 msgr2=0x55d2e238cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e7fff700 1 -- 172.21.15.6:0/1676268481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 msgr2=0x55d2e23724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e23724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e7fff700 1 -- 172.21.15.6:0/1676268481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2e20d1c00 con 0x55d2e236a850 2023-10-14T08:58:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:32.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e2384410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8011010 tx=0x7fb3d800b570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df190206c947a05b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:32.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3ceffd700 1 -- 172.21.15.6:0/1676268481 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d802c040 con 0x55d2e236a850 2023-10-14T08:58:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3ceffd700 1 -- 172.21.15.6:0/1676268481 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3d802d040 con 0x55d2e236a850 2023-10-14T08:58:32.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.852+0000 7fb3ceffd700 1 -- 172.21.15.6:0/1676268481 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8033380 con 0x55d2e236a850 2023-10-14T08:58:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1676268481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 msgr2=0x55d2e2384410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e2384410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8011010 tx=0x7fb3d800b570 comp rx=0 tx=0).stop 2023-10-14T08:58:32.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1676268481 shutdown_connections 2023-10-14T08:58:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236c0a0 0x55d2e23724b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236a850 0x55d2e2384410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/1676268481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1676268481 >> 172.21.15.6:0/1676268481 conn(0x55d2e2298d70 msgr2=0x55d2e2397f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1676268481 shutdown_connections 2023-10-14T08:58:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 -- 172.21.15.6:0/1676268481 wait complete. 2023-10-14T08:58:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.853+0000 7fb3faa94b80 1 -- start start 2023-10-14T08:58:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 Processor -- start 2023-10-14T08:58:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e238ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236c0a0 0x55d2e238c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e238c710 con 0x55d2e236a850 2023-10-14T08:58:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e238c880 con 0x55d2e236c0a0 2023-10-14T08:58:32.866 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2e238ca40 con 0x55d2e236b1b0 2023-10-14T08:58:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3faa94b80 10 client.0 _ll_register_callbacks cb 0x55d2e20b77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e238ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e238ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34620/0 (socket says 172.21.15.6:34620) 2023-10-14T08:58:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e7fff700 1 -- 172.21.15.6:0/4060115203 learned_addr learned my addr 172.21.15.6:0/4060115203 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3ece47700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236c0a0 0x55d2e238c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e77fe700 1 -- 172.21.15.6:0/4060115203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236c0a0 msgr2=0x55d2e238c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236c0a0 0x55d2e238c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e77fe700 1 -- 172.21.15.6:0/4060115203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 msgr2=0x55d2e238ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:32.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e238ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e77fe700 1 -- 172.21.15.6:0/4060115203 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2e20e8d80 con 0x55d2e236b1b0 2023-10-14T08:58:32.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.854+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e238ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:32.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3e77fe700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238b1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc097080 tx=0x7fb3dc09a790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c602bd10a394e3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:32.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:58:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3c77fe700 1 -- 172.21.15.6:0/4060115203 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0b2070 con 0x55d2e236b1b0 2023-10-14T08:58:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3d8015070 con 0x55d2e236b1b0 2023-10-14T08:58:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3c77fe700 1 -- 172.21.15.6:0/4060115203 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb3dc07e080 con 0x55d2e236b1b0 2023-10-14T08:58:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3c77fe700 1 -- 172.21.15.6:0/4060115203 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3dc0a2e80 con 0x55d2e236b1b0 2023-10-14T08:58:32.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3faa94b80 10 client.25714 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55d2e227b390 con 0x55d2e236b1b0 2023-10-14T08:58:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3c77fe700 1 -- 172.21.15.6:0/4060115203 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3dc0a9020 con 0x55d2e236b1b0 2023-10-14T08:58:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.855+0000 7fb3c77fe700 1 -- 172.21.15.6:0/4060115203 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb3dc099ae0 con 0x55d2e236b1b0 2023-10-14T08:58:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3faa94b80 10 client.25714 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3faa94b80 10 client.25714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3faa94b80 20 client.25714 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e23e5d90 0x55d2e23e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3faa94b80 4 client.25714 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:58:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d2e22b6df0 con 0x55d2e23e5d90 2023-10-14T08:58:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.856+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e23e5d90 0x55d2e23e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.857+0000 7fb3e7fff700 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e23e5d90 0x55d2e23e81b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c4ed0cf23ae422 server_cookie=a0fd85e2c4ce4d4c in_seq=0 out_seq=0 2023-10-14T08:58:32.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.857+0000 7fb3c77fe700 10 client.25714 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3c77fe700 1 -- 172.21.15.6:0/4060115203 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d2e22b6df0 con 0x55d2e23e5d90 2023-10-14T08:58:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3c77fe700 10 client.25714 handle_command_reply: tid=0 2023-10-14T08:58:32.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 client.25714 shutdown 2023-10-14T08:58:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 msgr2=0x55d2e238b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238b1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc097080 tx=0x7fb3dc09a790 comp rx=0 tx=0).stop 2023-10-14T08:58:32.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 shutdown_connections 2023-10-14T08:58:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d2e23e5d90 0x55d2e23e81b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d2e236c0a0 0x55d2e238c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3c77fe700 0 client.25714 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2e236a850 0x55d2e238ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 --2- 172.21.15.6:0/4060115203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2e236b1b0 0x55d2e238b1c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 >> 172.21.15.6:0/4060115203 conn(0x55d2e2298d70 msgr2=0x55d2e2384410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 shutdown_connections 2023-10-14T08:58:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 1 -- 172.21.15.6:0/4060115203 wait complete. 2023-10-14T08:58:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.874+0000 7fb3faa94b80 20 client.25714 trim_cache size 0 max 16384 2023-10-14T08:58:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:58:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:58:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:58:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:58:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.876+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb3d00a1500 msgr2=0x7fb3d00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.876+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb3d00a1500 0x7fb3d00a39c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb3d800bd90 tx=0x7fb3d800b4e0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.876+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100a20 msgr2=0x7fb3e819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.876+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100a20 0x7fb3e819b910 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009230 tx=0x7fb3dc00b790 comp rx=0 tx=0).stop 2023-10-14T08:58:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 shutdown_connections 2023-10-14T08:58:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb3d00a1500 0x7fb3d00a39c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3e81014a0 0x7fb3e819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8100060 0x7fb3e80ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 --2- 172.21.15.6:0/64653569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8100a20 0x7fb3e819b910 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 >> 172.21.15.6:0/64653569 conn(0x7fb3e80fab10 msgr2=0x7fb3e81045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 shutdown_connections 2023-10-14T08:58:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:32.879+0000 7fb3ee8aa700 1 -- 172.21.15.6:0/64653569 wait complete. 2023-10-14T08:58:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:33 smithi178 ceph-mon[103612]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 732 op/s 2023-10-14T08:58:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:33 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:58:33.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:33 smithi057 ceph-mon[103313]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 732 op/s 2023-10-14T08:58:33.701 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:33 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:58:33.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:33 smithi006 ceph-mon[99452]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 732 op/s 2023-10-14T08:58:33.921 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:33 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:58:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:58:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:58:34.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:58:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:58:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:58:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:58:34.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:58:34.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:58:34.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:58:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:35 smithi178 ceph-mon[103612]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 731 op/s 2023-10-14T08:58:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:35 smithi057 ceph-mon[103313]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 731 op/s 2023-10-14T08:58:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:35 smithi006 ceph-mon[99452]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 731 op/s 2023-10-14T08:58:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 335.0 s, 2208.2 tps, lat 44.466 ms stddev 50.267 2023-10-14T08:58:37.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:37 smithi178 ceph-mon[103612]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 760 op/s 2023-10-14T08:58:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:37 smithi057 ceph-mon[103313]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 760 op/s 2023-10-14T08:58:37.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:37 smithi006 ceph-mon[99452]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 760 op/s 2023-10-14T08:58:39.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:39 smithi178 ceph-mon[103612]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 834 op/s 2023-10-14T08:58:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:39 smithi057 ceph-mon[103313]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 834 op/s 2023-10-14T08:58:39.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:39 smithi006 ceph-mon[99452]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 834 op/s 2023-10-14T08:58:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 340.0 s, 1677.0 tps, lat 60.246 ms stddev 73.379 2023-10-14T08:58:41.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:41 smithi178 ceph-mon[103612]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 734 op/s 2023-10-14T08:58:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:41 smithi057 ceph-mon[103313]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 734 op/s 2023-10-14T08:58:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:41 smithi006 ceph-mon[99452]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 734 op/s 2023-10-14T08:58:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:43 smithi178 ceph-mon[103612]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 864 op/s 2023-10-14T08:58:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:43 smithi057 ceph-mon[103313]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 864 op/s 2023-10-14T08:58:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:43 smithi006 ceph-mon[99452]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 864 op/s 2023-10-14T08:58:45.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:45 smithi178 ceph-mon[103612]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 918 op/s 2023-10-14T08:58:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:45 smithi057 ceph-mon[103313]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 918 op/s 2023-10-14T08:58:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:45 smithi006 ceph-mon[99452]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 918 op/s 2023-10-14T08:58:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 345.0 s, 2177.4 tps, lat 46.218 ms stddev 53.525 2023-10-14T08:58:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 -- 172.21.15.6:0/403249656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8108250 msgr2=0x7fd9d8108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/403249656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8108250 0x7fd9d8108670 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009990 tx=0x7fd9d4009ca0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 -- 172.21.15.6:0/403249656 shutdown_connections 2023-10-14T08:58:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/403249656 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9d8072890 0x7fd9d81094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/403249656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8108250 0x7fd9d8108670 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/403249656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8072410 0x7fd9d8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 -- 172.21.15.6:0/403249656 >> 172.21.15.6:0/403249656 conn(0x7fd9d806dcf0 msgr2=0x7fd9d8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 -- 172.21.15.6:0/403249656 shutdown_connections 2023-10-14T08:58:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.057+0000 7fd9dfe26700 1 -- 172.21.15.6:0/403249656 wait complete. 2023-10-14T08:58:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 Processor -- start 2023-10-14T08:58:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 -- start start 2023-10-14T08:58:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9d8072410 0x7fd9d81a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8072890 0x7fd9d81a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 0x7fd9d81a8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81a9170 con 0x7fd9d8108250 2023-10-14T08:58:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81a92b0 con 0x7fd9d8072410 2023-10-14T08:58:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dfe26700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81a9440 con 0x7fd9d8072890 2023-10-14T08:58:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9de3c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 0x7fd9d81a8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9de3c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 0x7fd9d81a8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34638/0 (socket says 172.21.15.6:34638) 2023-10-14T08:58:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9de3c3700 1 -- 172.21.15.6:0/1579915897 learned_addr learned my addr 172.21.15.6:0/1579915897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.058+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8072890 0x7fd9d81a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9d8072410 0x7fd9d81a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9de3c3700 1 -- 172.21.15.6:0/1579915897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8072890 msgr2=0x7fd9d81a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9de3c3700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8072890 0x7fd9d81a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9de3c3700 1 -- 172.21.15.6:0/1579915897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9d8072410 msgr2=0x7fd9d81a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9de3c3700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9d8072410 0x7fd9d81a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9de3c3700 1 -- 172.21.15.6:0/1579915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40095f0 con 0x7fd9d8108250 2023-10-14T08:58:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9de3c3700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 0x7fd9d81a8ba0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00094f0 tx=0x7fd9d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9ceffd700 1 -- 172.21.15.6:0/1579915897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0004db0 con 0x7fd9d8108250 2023-10-14T08:58:46.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d81a9720 con 0x7fd9d8108250 2023-10-14T08:58:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d81a9c80 con 0x7fd9d8108250 2023-10-14T08:58:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9ceffd700 1 -- 172.21.15.6:0/1579915897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9d000f040 con 0x7fd9d8108250 2023-10-14T08:58:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.059+0000 7fd9ceffd700 1 -- 172.21.15.6:0/1579915897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00058b0 con 0x7fd9d8108250 2023-10-14T08:58:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ceffd700 1 -- 172.21.15.6:0/1579915897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd9d0005000 con 0x7fd9d8108250 2023-10-14T08:58:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 Processor -- start 2023-10-14T08:58:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 -- start start 2023-10-14T08:58:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f3372850 0x55a5f3372c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33731b0 0x55a5f3373ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f3374520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f32e7c10 con 0x55a5f3372850 2023-10-14T08:58:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f32ccc00 con 0x55a5f33731b0 2023-10-14T08:58:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.064+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f32ca520 con 0x55a5f33740a0 2023-10-14T08:58:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9dd3c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f3372850 0x55a5f3372c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ceffd700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd9c40a1480 0x7fd9c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9dd3c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f3372850 0x55a5f3372c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34640/0 (socket says 172.21.15.6:34640) 2023-10-14T08:58:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9dd3c1700 1 -- 172.21.15.6:0/3255980943 learned_addr learned my addr 172.21.15.6:0/3255980943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33731b0 0x55a5f3373ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f3374520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ceffd700 1 -- 172.21.15.6:0/1579915897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd9d00cc630 con 0x7fd9d8108250 2023-10-14T08:58:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9de3c3700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd9c40a1480 0x7fd9c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/3255980943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 msgr2=0x55a5f3374520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f3374520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/3255980943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f3372850 msgr2=0x55a5f3372c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f3372850 0x55a5f3372c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.065+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/3255980943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5f3283390 con 0x55a5f33731b0 2023-10-14T08:58:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.066+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33731b0 0x55a5f3373ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b2e0 tx=0x7fd9d4005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28eed7960d5d440 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.066+0000 7fd9de3c3700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd9c40a1480 0x7fd9c40a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00963c0 tx=0x7fd9d0084040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.066+0000 7fd9c3fff700 1 -- 172.21.15.6:0/3255980943 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401d070 con 0x55a5f33731b0 2023-10-14T08:58:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.066+0000 7fd9c3fff700 1 -- 172.21.15.6:0/3255980943 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9d401e040 con 0x55a5f33731b0 2023-10-14T08:58:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.066+0000 7fd9c3fff700 1 -- 172.21.15.6:0/3255980943 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4004920 con 0x55a5f33731b0 2023-10-14T08:58:46.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 -- 172.21.15.6:0/3255980943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33731b0 msgr2=0x55a5f3373ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33731b0 0x55a5f3373ac0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b2e0 tx=0x7fd9d4005bc0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 -- 172.21.15.6:0/3255980943 shutdown_connections 2023-10-14T08:58:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f3374520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f3372850 0x55a5f3372c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/3255980943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33731b0 0x55a5f3373ac0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 -- 172.21.15.6:0/3255980943 >> 172.21.15.6:0/3255980943 conn(0x55a5f32a0d70 msgr2=0x55a5f336dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 -- 172.21.15.6:0/3255980943 shutdown_connections 2023-10-14T08:58:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.067+0000 7fd9ec010b80 1 -- 172.21.15.6:0/3255980943 wait complete. 2023-10-14T08:58:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 -- start start 2023-10-14T08:58:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 Processor -- start 2023-10-14T08:58:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33731b0 0x55a5f337cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33740a0 0x55a5f3383c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f32c5e10 con 0x55a5f33740a0 2023-10-14T08:58:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f32626b0 con 0x55a5f3372850 2023-10-14T08:58:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f3262350 con 0x55a5f33731b0 2023-10-14T08:58:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.068+0000 7fd9ec010b80 10 client.0 _ll_register_callbacks cb 0x55a5f30bf7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9dd3c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33731b0 0x55a5f337cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9dd3c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33406/0 (socket says 172.21.15.6:33406) 2023-10-14T08:58:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9dd3c1700 1 -- 172.21.15.6:0/396735951 learned_addr learned my addr 172.21.15.6:0/396735951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33740a0 0x55a5f3383c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/396735951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 msgr2=0x55a5f337c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/396735951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33740a0 msgr2=0x55a5f3383c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33740a0 0x55a5f3383c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/396735951 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d810c210 con 0x55a5f33731b0 2023-10-14T08:58:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33731b0 0x55a5f337cbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4004570 tx=0x7fd9d400f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d094ff7c09d1b449 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:58:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9c17fa700 1 -- 172.21.15.6:0/396735951 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401d040 con 0x55a5f33731b0 2023-10-14T08:58:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9c17fa700 1 -- 172.21.15.6:0/396735951 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd9d400fe40 con 0x55a5f33731b0 2023-10-14T08:58:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.069+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5f32cae90 con 0x55a5f33731b0 2023-10-14T08:58:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9c17fa700 1 -- 172.21.15.6:0/396735951 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9d40059a0 con 0x55a5f33731b0 2023-10-14T08:58:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 10 client.25726 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55a5f30f0d80 con 0x55a5f33731b0 2023-10-14T08:58:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9c17fa700 1 -- 172.21.15.6:0/396735951 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a5f32cae90 con 0x55a5f33731b0 2023-10-14T08:58:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9c17fa700 1 -- 172.21.15.6:0/396735951 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd9d4004ab0 con 0x55a5f33731b0 2023-10-14T08:58:46.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 10 client.25726 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 20 client.25726 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33880c0 0x55a5f338a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 4 client.25726 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:58:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.071+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5f3342bb0 con 0x55a5f33880c0 2023-10-14T08:58:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.072+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33880c0 0x55a5f338a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.072+0000 7fd9c17fa700 10 client.25726 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.072+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33880c0 0x55a5f338a4e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b57c35c0056b90d9 server_cookie=ee4806a43c3b9df5 in_seq=0 out_seq=0 2023-10-14T08:58:46.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9c17fa700 1 -- 172.21.15.6:0/396735951 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5f3342bb0 con 0x55a5f33880c0 2023-10-14T08:58:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9c17fa700 10 client.25726 handle_command_reply: tid=0 2023-10-14T08:58:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 client.25726 shutdown 2023-10-14T08:58:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33731b0 msgr2=0x55a5f337cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33731b0 0x55a5f337cbe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4004570 tx=0x7fd9d400f710 comp rx=0 tx=0).stop 2023-10-14T08:58:46.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 shutdown_connections 2023-10-14T08:58:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33880c0 0x55a5f338a4e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33740a0 0x55a5f3383c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9c17fa700 0 client.25726 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/396735951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33731b0 0x55a5f337cbe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 >> 172.21.15.6:0/396735951 conn(0x55a5f32a0d70 msgr2=0x55a5f336d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 shutdown_connections 2023-10-14T08:58:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 1 -- 172.21.15.6:0/396735951 wait complete. 2023-10-14T08:58:46.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.073+0000 7fd9ec010b80 20 client.25726 trim_cache size 0 max 16384 2023-10-14T08:58:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 Processor -- start 2023-10-14T08:58:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 -- start start 2023-10-14T08:58:46.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f3383be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f337c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f31468c0 con 0x55a5f33731b0 2023-10-14T08:58:46.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f3373f50 con 0x55a5f3372850 2023-10-14T08:58:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.093+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f337bb50 con 0x55a5f33740a0 2023-10-14T08:58:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f3383be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f3383be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34658/0 (socket says 172.21.15.6:34658) 2023-10-14T08:58:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/1225133561 learned_addr learned my addr 172.21.15.6:0/1225133561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:46.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f337c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/1225133561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 msgr2=0x55a5f337c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f337c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/1225133561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 msgr2=0x55a5f337a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/1225133561 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5f30d9c00 con 0x55a5f33731b0 2023-10-14T08:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f3383be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd9d403a040 tx=0x7fd9d4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cad3a2b6ed77224 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ccff9700 1 -- 172.21.15.6:0/1225133561 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40224a0 con 0x55a5f33731b0 2023-10-14T08:58:46.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ccff9700 1 -- 172.21.15.6:0/1225133561 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9d4022600 con 0x55a5f33731b0 2023-10-14T08:58:46.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.094+0000 7fd9ccff9700 1 -- 172.21.15.6:0/1225133561 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4004c80 con 0x55a5f33731b0 2023-10-14T08:58:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.095+0000 7fd9ec010b80 1 -- 172.21.15.6:0/1225133561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 msgr2=0x55a5f3383be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.095+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f3383be0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd9d403a040 tx=0x7fd9d4005a20 comp rx=0 tx=0).stop 2023-10-14T08:58:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.097+0000 7fd9ec010b80 1 -- 172.21.15.6:0/1225133561 shutdown_connections 2023-10-14T08:58:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.097+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f33740a0 0x55a5f337c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.097+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f3372850 0x55a5f337a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.097+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/1225133561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f3383be0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.097+0000 7fd9ec010b80 1 -- 172.21.15.6:0/1225133561 >> 172.21.15.6:0/1225133561 conn(0x55a5f32a0d70 msgr2=0x55a5f336c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.099+0000 7fd9ec010b80 1 -- 172.21.15.6:0/1225133561 shutdown_connections 2023-10-14T08:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.099+0000 7fd9ec010b80 1 -- 172.21.15.6:0/1225133561 wait complete. 2023-10-14T08:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.099+0000 7fd9ec010b80 1 -- start start 2023-10-14T08:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 Processor -- start 2023-10-14T08:58:46.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f3372850 0x55a5f3381470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f33819b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33740a0 0x55a5f33829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f3382f00 con 0x55a5f33731b0 2023-10-14T08:58:46.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f3383070 con 0x55a5f33740a0 2023-10-14T08:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f3383230 con 0x55a5f3372850 2023-10-14T08:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9ec010b80 10 client.0 _ll_register_callbacks cb 0x7fd9c8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9dd3c1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f3372850 0x55a5f3381470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9dd3c1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f3372850 0x55a5f3381470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60296/0 (socket says 172.21.15.6:60296) 2023-10-14T08:58:46.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9dd3c1700 1 -- 172.21.15.6:0/2350726864 learned_addr learned my addr 172.21.15.6:0/2350726864 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.100+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33740a0 0x55a5f33829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.101+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f33819b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.101+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f3372850 msgr2=0x55a5f3381470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.101+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f3372850 0x55a5f3381470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.101+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/2350726864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33740a0 msgr2=0x55a5f33829c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.101+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33740a0 0x55a5f33829c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.101+0000 7fd9ddbc2700 1 -- 172.21.15.6:0/2350726864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5f30f0d80 con 0x55a5f33731b0 2023-10-14T08:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ddbc2700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f33819b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b680 tx=0x7fd9d40224a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2e583b708c544f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9c17fa700 1 -- 172.21.15.6:0/2350726864 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401d030 con 0x55a5f33731b0 2023-10-14T08:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9c17fa700 1 -- 172.21.15.6:0/2350726864 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd9d4000e40 con 0x55a5f33731b0 2023-10-14T08:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd9d401e040 con 0x55a5f33731b0 2023-10-14T08:58:46.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9c17fa700 1 -- 172.21.15.6:0/2350726864 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9d4022cc0 con 0x55a5f33731b0 2023-10-14T08:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 10 client.16080 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55a5f31171f0 con 0x55a5f33731b0 2023-10-14T08:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9c17fa700 1 -- 172.21.15.6:0/2350726864 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9d4052020 con 0x55a5f33731b0 2023-10-14T08:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9c17fa700 1 -- 172.21.15.6:0/2350726864 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd9d4041540 con 0x55a5f33731b0 2023-10-14T08:58:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 10 client.16080 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 20 client.16080 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33e4c40 0x55a5f33e7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 4 client.16080 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:58:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.102+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a5f32bedf0 con 0x55a5f33e4c40 2023-10-14T08:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.103+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33e4c40 0x55a5f33e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.103+0000 7fd9dd3c1700 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33e4c40 0x55a5f33e7060 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d00bfba5c54015e1 server_cookie=e6bdf964e98c8504 in_seq=0 out_seq=0 2023-10-14T08:58:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.103+0000 7fd9c17fa700 10 client.16080 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9c17fa700 1 -- 172.21.15.6:0/2350726864 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a5f32bedf0 con 0x55a5f33e4c40 2023-10-14T08:58:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9c17fa700 10 client.16080 handle_command_reply: tid=0 2023-10-14T08:58:46.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 client.16080 shutdown 2023-10-14T08:58:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 msgr2=0x55a5f33819b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f33819b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b680 tx=0x7fd9d40224a0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 shutdown_connections 2023-10-14T08:58:46.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a5f33e4c40 0x55a5f33e7060 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a5f33740a0 0x55a5f33829c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a5f3372850 0x55a5f3381470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 --2- 172.21.15.6:0/2350726864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5f33731b0 0x55a5f33819b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 >> 172.21.15.6:0/2350726864 conn(0x55a5f32a0d70 msgr2=0x55a5f3377000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:46.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9c17fa700 0 client.16080 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 shutdown_connections 2023-10-14T08:58:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 1 -- 172.21.15.6:0/2350726864 wait complete. 2023-10-14T08:58:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.119+0000 7fd9ec010b80 20 client.16080 trim_cache size 0 max 16384 2023-10-14T08:58:46.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:58:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd9c40a1480 msgr2=0x7fd9c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd9c40a1480 0x7fd9c40a3940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00963c0 tx=0x7fd9d0084040 comp rx=0 tx=0).stop 2023-10-14T08:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 msgr2=0x7fd9d81a8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 0x7fd9d81a8ba0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00094f0 tx=0x7fd9d000d3b0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 shutdown_connections 2023-10-14T08:58:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9d8108250 0x7fd9d81a8ba0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd9c40a1480 0x7fd9c40a3940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9d8072410 0x7fd9d81a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 --2- 172.21.15.6:0/1579915897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9d8072890 0x7fd9d81a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 >> 172.21.15.6:0/1579915897 conn(0x7fd9d806dcf0 msgr2=0x7fd9d80700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 shutdown_connections 2023-10-14T08:58:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:46.120+0000 7fd9dfe26700 1 -- 172.21.15.6:0/1579915897 wait complete. 2023-10-14T08:58:47.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:47 smithi178 ceph-mon[103612]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 979 op/s 2023-10-14T08:58:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:47 smithi057 ceph-mon[103313]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 979 op/s 2023-10-14T08:58:47.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:47 smithi006 ceph-mon[99452]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 979 op/s 2023-10-14T08:58:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:49 smithi178 ceph-mon[103612]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 991 op/s 2023-10-14T08:58:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:49 smithi057 ceph-mon[103313]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 991 op/s 2023-10-14T08:58:49.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:49 smithi006 ceph-mon[99452]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 991 op/s 2023-10-14T08:58:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 350.0 s, 2044.8 tps, lat 48.881 ms stddev 53.937 2023-10-14T08:58:51.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:51 smithi178 ceph-mon[103612]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 851 op/s 2023-10-14T08:58:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:51 smithi057 ceph-mon[103313]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 851 op/s 2023-10-14T08:58:51.743 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:51 smithi006 ceph-mon[99452]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 851 op/s 2023-10-14T08:58:53.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:53 smithi178 ceph-mon[103612]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 906 op/s 2023-10-14T08:58:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:53 smithi057 ceph-mon[103313]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 906 op/s 2023-10-14T08:58:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:53 smithi006 ceph-mon[99452]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 906 op/s 2023-10-14T08:58:55.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:55 smithi178 ceph-mon[103612]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 1.17k op/s 2023-10-14T08:58:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:55 smithi057 ceph-mon[103313]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 1.17k op/s 2023-10-14T08:58:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:55 smithi006 ceph-mon[99452]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 MiB/s wr, 1.17k op/s 2023-10-14T08:58:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 355.0 s, 1522.6 tps, lat 65.232 ms stddev 124.860 2023-10-14T08:58:57.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:57 smithi178 ceph-mon[103612]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 MiB/s wr, 1.71k op/s 2023-10-14T08:58:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:57 smithi057 ceph-mon[103313]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 MiB/s wr, 1.71k op/s 2023-10-14T08:58:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:57 smithi006 ceph-mon[99452]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 MiB/s wr, 1.71k op/s 2023-10-14T08:58:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 -- 172.21.15.6:0/4179790822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 msgr2=0x7fb444107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 --2- 172.21.15.6:0/4179790822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 0x7fb444107f30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00b0a0 tx=0x7fb43c00b3b0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 -- 172.21.15.6:0/4179790822 shutdown_connections 2023-10-14T08:58:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 --2- 172.21.15.6:0/4179790822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 0x7fb444107f30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 --2- 172.21.15.6:0/4179790822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4441005f0 0x7fb4441029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 --2- 172.21.15.6:0/4179790822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb444102fb0 0x7fb4441053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 -- 172.21.15.6:0/4179790822 >> 172.21.15.6:0/4179790822 conn(0x7fb4440fa6c0 msgr2=0x7fb4440fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 -- 172.21.15.6:0/4179790822 shutdown_connections 2023-10-14T08:58:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.272+0000 7fb44933c700 1 -- 172.21.15.6:0/4179790822 wait complete. 2023-10-14T08:58:59.277 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.273+0000 7fb44933c700 1 Processor -- start 2023-10-14T08:58:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.273+0000 7fb44933c700 1 -- start start 2023-10-14T08:58:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.273+0000 7fb44933c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 0x7fb44410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb44933c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb444102fb0 0x7fb444110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb44933c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 0x7fb4441ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb44933c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb444117400 con 0x7fb444105a70 2023-10-14T08:58:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb44933c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb444117570 con 0x7fb444102fb0 2023-10-14T08:58:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb44933c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4441ad9f0 con 0x7fb4441005f0 2023-10-14T08:58:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 0x7fb44410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 0x7fb44410fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60310/0 (socket says 172.21.15.6:60310) 2023-10-14T08:58:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 -- 172.21.15.6:0/1450555678 learned_addr learned my addr 172.21.15.6:0/1450555678 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb4437fe700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 0x7fb4441ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb444102fb0 0x7fb444110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 -- 172.21.15.6:0/1450555678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb444102fb0 msgr2=0x7fb444110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb444102fb0 0x7fb444110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 -- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 msgr2=0x7fb4441ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 0x7fb4441ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb442ffd700 1 -- 172.21.15.6:0/1450555678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009d00 con 0x7fb4441005f0 2023-10-14T08:58:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.274+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb444102fb0 0x7fb444110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:58:59.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.275+0000 7fb442ffd700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 0x7fb44410fdc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d950 tx=0x7fb43400dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.275+0000 7fb42bfff700 1 -- 172.21.15.6:0/1450555678 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb434009b40 con 0x7fb4441005f0 2023-10-14T08:58:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.275+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4441adbf0 con 0x7fb4441005f0 2023-10-14T08:58:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.275+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4441ae0c0 con 0x7fb4441005f0 2023-10-14T08:58:59.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.275+0000 7fb42bfff700 1 -- 172.21.15.6:0/1450555678 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb434009ca0 con 0x7fb4441005f0 2023-10-14T08:58:59.283 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.275+0000 7fb42bfff700 1 -- 172.21.15.6:0/1450555678 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43400f620 con 0x7fb4441005f0 2023-10-14T08:58:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.278+0000 7fb42bfff700 1 -- 172.21.15.6:0/1450555678 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb434010460 con 0x7fb4441005f0 2023-10-14T08:58:59.287 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.279+0000 7fb42bfff700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb42c0a1580 0x7fb42c0a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.279+0000 7fb42bfff700 1 -- 172.21.15.6:0/1450555678 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb4340cd010 con 0x7fb4441005f0 2023-10-14T08:58:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.279+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb42c0a1580 0x7fb42c0a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb42c0a1580 0x7fb42c0a3a40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb4440ff240 tx=0x7fb438009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 Processor -- start 2023-10-14T08:58:59.288 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 -- start start 2023-10-14T08:58:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 0x56500cfefc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cff0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff10a0 0x56500cff1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cf64c10 con 0x56500cff01b0 2023-10-14T08:58:59.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cf49c00 con 0x56500cfef850 2023-10-14T08:58:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb455526b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cf47520 con 0x56500cff10a0 2023-10-14T08:58:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 0x56500cfefc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb4437fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff10a0 0x56500cff1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 0x56500cfefc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33440/0 (socket says 172.21.15.6:33440) 2023-10-14T08:58:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.280+0000 7fb442ffd700 1 -- 172.21.15.6:0/968406281 learned_addr learned my addr 172.21.15.6:0/968406281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4427fc700 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cff0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4437fe700 1 -- 172.21.15.6:0/968406281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 msgr2=0x56500cfefc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.291 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4437fe700 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 0x56500cfefc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4437fe700 1 -- 172.21.15.6:0/968406281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 msgr2=0x56500cff0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4437fe700 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cff0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4437fe700 1 -- 172.21.15.6:0/968406281 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56500cf00390 con 0x56500cff10a0 2023-10-14T08:58:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4427fc700 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cff0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:58:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb442ffd700 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 0x56500cfefc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:59.292 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.281+0000 7fb4437fe700 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff10a0 0x56500cff1520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009fd0 tx=0x7fb43c009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f831289fe6036ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb4297fa700 1 -- 172.21.15.6:0/968406281 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00e050 con 0x56500cff10a0 2023-10-14T08:58:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb4297fa700 1 -- 172.21.15.6:0/968406281 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb43c009460 con 0x56500cff10a0 2023-10-14T08:58:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb4297fa700 1 -- 172.21.15.6:0/968406281 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c03d6a0 con 0x56500cff10a0 2023-10-14T08:58:59.293 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 -- 172.21.15.6:0/968406281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff10a0 msgr2=0x56500cff1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff10a0 0x56500cff1520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009fd0 tx=0x7fb43c009c60 comp rx=0 tx=0).stop 2023-10-14T08:58:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 -- 172.21.15.6:0/968406281 shutdown_connections 2023-10-14T08:58:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff10a0 0x56500cff1520 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cfef850 0x56500cfefc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 --2- 172.21.15.6:0/968406281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cff0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 -- 172.21.15.6:0/968406281 >> 172.21.15.6:0/968406281 conn(0x56500cf1dd70 msgr2=0x56500cfeac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.282+0000 7fb455526b80 1 -- 172.21.15.6:0/968406281 shutdown_connections 2023-10-14T08:58:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.283+0000 7fb455526b80 1 -- 172.21.15.6:0/968406281 wait complete. 2023-10-14T08:58:59.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.283+0000 7fb455526b80 1 -- start start 2023-10-14T08:58:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.283+0000 7fb455526b80 1 Processor -- start 2023-10-14T08:58:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.283+0000 7fb455526b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 0x56500cff9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.283+0000 7fb455526b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff01b0 0x56500cff9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 0x56500cff9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 0x56500cff9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34688/0 (socket says 172.21.15.6:34688) 2023-10-14T08:58:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.283+0000 7fb455526b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d000ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb455526b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cf42e10 con 0x56500cfef850 2023-10-14T08:58:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb455526b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cedf6b0 con 0x56500cff10a0 2023-10-14T08:58:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb455526b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cedf350 con 0x56500cff01b0 2023-10-14T08:58:59.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb442ffd700 1 -- 172.21.15.6:0/2561244209 learned_addr learned my addr 172.21.15.6:0/2561244209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4427fc700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff01b0 0x56500cff9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb455526b80 10 client.0 _ll_register_callbacks cb 0x56500cd3c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4437fe700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d000ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4427fc700 1 -- 172.21.15.6:0/2561244209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 msgr2=0x56500d000ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4427fc700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d000ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4427fc700 1 -- 172.21.15.6:0/2561244209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 msgr2=0x56500cff9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4427fc700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 0x56500cff9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4427fc700 1 -- 172.21.15.6:0/2561244209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4441ae0c0 con 0x56500cff01b0 2023-10-14T08:58:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb4437fe700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d000ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:58:59.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.284+0000 7fb442ffd700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 0x56500cff9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:58:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb4427fc700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff01b0 0x56500cff9a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb438010700 tx=0x7fb438004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710d9bb2a49e9f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb426ff5700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T08:58:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb426ff5700 1 -- 172.21.15.6:0/2561244209 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438020630 con 0x56500cff01b0 2023-10-14T08:58:59.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb426ff5700 1 -- 172.21.15.6:0/2561244209 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb438020790 con 0x56500cff01b0 2023-10-14T08:58:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56500cf47e90 con 0x56500cff01b0 2023-10-14T08:58:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb426ff5700 1 -- 172.21.15.6:0/2561244209 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb438012e80 con 0x56500cff01b0 2023-10-14T08:58:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb455526b80 10 client.25744 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7fb4440ff430 con 0x56500cff01b0 2023-10-14T08:58:59.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb426ff5700 1 -- 172.21.15.6:0/2561244209 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56500cf47e90 con 0x56500cff01b0 2023-10-14T08:58:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.285+0000 7fb426ff5700 1 -- 172.21.15.6:0/2561244209 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb438026020 con 0x56500cff01b0 2023-10-14T08:58:59.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb455526b80 10 client.25744 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb455526b80 10 client.25744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb455526b80 20 client.25744 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb455526b80 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d005410 0x56500d007830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb455526b80 4 client.25744 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:58:59.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56500cfbfbb0 con 0x56500d005410 2023-10-14T08:58:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.286+0000 7fb442ffd700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d005410 0x56500d007830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.287+0000 7fb442ffd700 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d005410 0x56500d007830 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27133c5f2374bbd7 server_cookie=24170f87bb9d7bfc in_seq=0 out_seq=0 2023-10-14T08:58:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.287+0000 7fb426ff5700 10 client.25744 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb426ff5700 1 -- 172.21.15.6:0/2561244209 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56500cfbfbb0 con 0x56500d005410 2023-10-14T08:58:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb426ff5700 10 client.25744 handle_command_reply: tid=0 2023-10-14T08:58:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 client.25744 shutdown 2023-10-14T08:58:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff01b0 msgr2=0x56500cff9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff01b0 0x56500cff9a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb438010700 tx=0x7fb438004750 comp rx=0 tx=0).stop 2023-10-14T08:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 shutdown_connections 2023-10-14T08:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d005410 0x56500d007830 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d000ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cfef850 0x56500cff9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 --2- 172.21.15.6:0/2561244209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cff01b0 0x56500cff9a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb426ff5700 0 client.25744 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 >> 172.21.15.6:0/2561244209 conn(0x56500cf1dd70 msgr2=0x56500cfea830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 shutdown_connections 2023-10-14T08:58:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.288+0000 7fb455526b80 1 -- 172.21.15.6:0/2561244209 wait complete. 2023-10-14T08:58:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.289+0000 7fb455526b80 20 client.25744 trim_cache size 0 max 16384 2023-10-14T08:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 Processor -- start 2023-10-14T08:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 -- start start 2023-10-14T08:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cfea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500cfeac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cdc38c0 con 0x56500cff01b0 2023-10-14T08:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cfe6ea0 con 0x56500cff10a0 2023-10-14T08:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb455526b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500cfe7400 con 0x56500cfef850 2023-10-14T08:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb4427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cfea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb4427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cfea6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34696/0 (socket says 172.21.15.6:34696) 2023-10-14T08:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb4427fc700 1 -- 172.21.15.6:0/795091087 learned_addr learned my addr 172.21.15.6:0/795091087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.309+0000 7fb442ffd700 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4437fe700 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500cfeac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4427fc700 1 -- 172.21.15.6:0/795091087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 msgr2=0x56500d00cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4427fc700 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4427fc700 1 -- 172.21.15.6:0/795091087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 msgr2=0x56500cfeac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4427fc700 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500cfeac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4427fc700 1 -- 172.21.15.6:0/795091087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56500cd6dd80 con 0x56500cff01b0 2023-10-14T08:58:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.310+0000 7fb4427fc700 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cfea6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb438009430 tx=0x7fb438005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb123a0e4720d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.311+0000 7fb429ffb700 1 -- 172.21.15.6:0/795091087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438028dd0 con 0x56500cff01b0 2023-10-14T08:58:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.311+0000 7fb429ffb700 1 -- 172.21.15.6:0/795091087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb438012ac0 con 0x56500cff01b0 2023-10-14T08:58:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.311+0000 7fb429ffb700 1 -- 172.21.15.6:0/795091087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438003900 con 0x56500cff01b0 2023-10-14T08:58:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- 172.21.15.6:0/795091087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 msgr2=0x56500cfea6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cfea6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb438009430 tx=0x7fb438005ba0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- 172.21.15.6:0/795091087 shutdown_connections 2023-10-14T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500cfeac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- 172.21.15.6:0/795091087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500cfea6e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- 172.21.15.6:0/795091087 >> 172.21.15.6:0/795091087 conn(0x56500cf1dd70 msgr2=0x56500cff4400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- 172.21.15.6:0/795091087 shutdown_connections 2023-10-14T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- 172.21.15.6:0/795091087 wait complete. 2023-10-14T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- start start 2023-10-14T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 Processor -- start 2023-10-14T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500d00c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d058200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d058740 con 0x56500cff01b0 2023-10-14T08:58:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d058880 con 0x56500cff10a0 2023-10-14T08:58:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d058a40 con 0x56500cfef850 2023-10-14T08:58:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.312+0000 7fb455526b80 10 client.0 _ll_register_callbacks cb 0x7fb438010a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500d00c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb442ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500d00c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34704/0 (socket says 172.21.15.6:34704) 2023-10-14T08:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 -- 172.21.15.6:0/1503707196 learned_addr learned my addr 172.21.15.6:0/1503707196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:58:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4437fe700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d058200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 -- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 msgr2=0x56500d00c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 -- 172.21.15.6:0/1503707196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 msgr2=0x56500d058200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:58:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d058200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.313+0000 7fb4427fc700 1 -- 172.21.15.6:0/1503707196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4440ff430 con 0x56500cff01b0 2023-10-14T08:58:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.314+0000 7fb4437fe700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d058200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:58:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.314+0000 7fb4427fc700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500d00c8b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb438009990 tx=0x7fb4380286e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d7517c5ef35d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:58:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.314+0000 7fb426ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.315+0000 7fb426ff5700 1 -- 172.21.15.6:0/1503707196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb438005240 con 0x56500cff01b0 2023-10-14T08:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.315+0000 7fb426ff5700 1 -- 172.21.15.6:0/1503707196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb4380053a0 con 0x56500cff01b0 2023-10-14T08:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.315+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb43c009460 con 0x56500cff01b0 2023-10-14T08:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.315+0000 7fb426ff5700 1 -- 172.21.15.6:0/1503707196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb438005560 con 0x56500cff01b0 2023-10-14T08:58:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.315+0000 7fb455526b80 10 client.16098 fetch_fsmap learned FSMap version 40 2023-10-14T08:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.315+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x56500cd56c00 con 0x56500cff01b0 2023-10-14T08:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb426ff5700 1 -- 172.21.15.6:0/1503707196 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb43c009460 con 0x56500cff01b0 2023-10-14T08:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb426ff5700 1 -- 172.21.15.6:0/1503707196 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 40) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb438026070 con 0x56500cff01b0 2023-10-14T08:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb455526b80 10 client.16098 fetch_fsmap finished waiting for FSMap version 40 2023-10-14T08:58:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb455526b80 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb455526b80 20 client.16098 populate_metadata read hostname 'smithi006' 2023-10-14T08:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb455526b80 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d059f90 0x56500d05c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb455526b80 4 client.16098 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.316+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56500cf3bdf0 con 0x56500d059f90 2023-10-14T08:58:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.317+0000 7fb442ffd700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d059f90 0x56500d05c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.318+0000 7fb426ff5700 10 client.16098 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.318+0000 7fb442ffd700 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d059f90 0x56500d05c380 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=481c1c20ba861375 server_cookie=c06ff80d6c4fb0a3 in_seq=0 out_seq=0 2023-10-14T08:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.354+0000 7fb426ff5700 1 -- 172.21.15.6:0/1503707196 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56500cf3bdf0 con 0x56500d059f90 2023-10-14T08:58:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.354+0000 7fb426ff5700 10 client.16098 handle_command_reply: tid=0 2023-10-14T08:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.354+0000 7fb455526b80 1 client.16098 shutdown 2023-10-14T08:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 msgr2=0x56500d00c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500d00c8b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb438009990 tx=0x7fb4380286e0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 shutdown_connections 2023-10-14T08:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56500d059f90 0x56500d05c380 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56500cff10a0 0x56500d058200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56500cfef850 0x56500d00c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 --2- 172.21.15.6:0/1503707196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56500cff01b0 0x56500d00c8b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 >> 172.21.15.6:0/1503707196 conn(0x56500cf1dd70 msgr2=0x56500d008170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb426ff5700 0 client.16098 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:58:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 shutdown_connections 2023-10-14T08:58:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.355+0000 7fb455526b80 1 -- 172.21.15.6:0/1503707196 wait complete. 2023-10-14T08:58:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb455526b80 20 client.16098 trim_cache size 0 max 16384 2023-10-14T08:58:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:58:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:58:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:58:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:58:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb42c0a1580 msgr2=0x7fb42c0a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb42c0a1580 0x7fb42c0a3a40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb4440ff240 tx=0x7fb438009260 comp rx=0 tx=0).stop 2023-10-14T08:58:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 msgr2=0x7fb44410fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:58:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 0x7fb44410fdc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb43400d950 tx=0x7fb43400dd10 comp rx=0 tx=0).stop 2023-10-14T08:58:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 shutdown_connections 2023-10-14T08:58:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb444105a70 0x7fb4441ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4441005f0 0x7fb44410fdc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb42c0a1580 0x7fb42c0a3a40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 --2- 172.21.15.6:0/1450555678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb444102fb0 0x7fb444110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:58:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 >> 172.21.15.6:0/1450555678 conn(0x7fb4440fa6c0 msgr2=0x7fb444101260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:58:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 shutdown_connections 2023-10-14T08:58:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:58:59.356+0000 7fb44933c700 1 -- 172.21.15.6:0/1450555678 wait complete. 2023-10-14T08:58:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:58:59 smithi178 ceph-mon[103612]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.92k op/s 2023-10-14T08:58:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:58:59 smithi057 ceph-mon[103313]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.92k op/s 2023-10-14T08:58:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:58:59 smithi006 ceph-mon[99452]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 MiB/s wr, 1.92k op/s 2023-10-14T08:59:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 360.0 s, 2522.4 tps, lat 39.997 ms stddev 43.056 2023-10-14T08:59:01.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:01 smithi178 ceph-mon[103612]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 1.81k op/s 2023-10-14T08:59:01.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:01 smithi057 ceph-mon[103313]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 1.81k op/s 2023-10-14T08:59:01.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:01 smithi006 ceph-mon[99452]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 1.81k op/s 2023-10-14T08:59:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:03 smithi178 ceph-mon[103612]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 1.92k op/s 2023-10-14T08:59:03.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:03 smithi057 ceph-mon[103313]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 1.92k op/s 2023-10-14T08:59:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:03 smithi006 ceph-mon[99452]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 38 MiB/s wr, 1.92k op/s 2023-10-14T08:59:05.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:05 smithi178 ceph-mon[103612]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 39 MiB/s wr, 1.90k op/s 2023-10-14T08:59:05.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:05 smithi057 ceph-mon[103313]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 39 MiB/s wr, 1.90k op/s 2023-10-14T08:59:05.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:05 smithi006 ceph-mon[99452]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 39 MiB/s wr, 1.90k op/s 2023-10-14T08:59:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 365.0 s, 2421.6 tps, lat 41.122 ms stddev 45.304 2023-10-14T08:59:07.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:07 smithi178 ceph-mon[103612]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 1.58k op/s 2023-10-14T08:59:07.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:07 smithi057 ceph-mon[103313]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 1.58k op/s 2023-10-14T08:59:07.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:07 smithi006 ceph-mon[99452]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 32 MiB/s wr, 1.58k op/s 2023-10-14T08:59:08.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:08 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:08 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:08.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:08 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:09.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:09 smithi178 ceph-mon[103612]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 MiB/s wr, 987 op/s 2023-10-14T08:59:09.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:09 smithi057 ceph-mon[103313]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 MiB/s wr, 987 op/s 2023-10-14T08:59:09.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:09 smithi006 ceph-mon[99452]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 MiB/s wr, 987 op/s 2023-10-14T08:59:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 370.0 s, 2304.0 tps, lat 43.346 ms stddev 45.756 2023-10-14T08:59:11.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:11 smithi178 ceph-mon[103612]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 676 op/s 2023-10-14T08:59:11.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:11 smithi057 ceph-mon[103313]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 676 op/s 2023-10-14T08:59:11.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:11 smithi006 ceph-mon[99452]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 676 op/s 2023-10-14T08:59:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.500+0000 7f1d94ea3700 1 -- 172.21.15.6:0/1285196253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 msgr2=0x7f1d90108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.500+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/1285196253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d90108240 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800b0d0 tx=0x7f1d8800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 -- 172.21.15.6:0/1285196253 shutdown_connections 2023-10-14T08:59:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/1285196253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d90108240 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/1285196253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d900ffe00 0x7f1d90100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/1285196253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d90100ff0 0x7f1d90101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 -- 172.21.15.6:0/1285196253 >> 172.21.15.6:0/1285196253 conn(0x7f1d900fb3b0 msgr2=0x7f1d900fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 -- 172.21.15.6:0/1285196253 shutdown_connections 2023-10-14T08:59:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.501+0000 7f1d94ea3700 1 -- 172.21.15.6:0/1285196253 wait complete. 2023-10-14T08:59:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 Processor -- start 2023-10-14T08:59:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 -- start start 2023-10-14T08:59:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 0x7f1d90195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d90100ff0 0x7f1d901961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d9019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9019d7e0 con 0x7f1d90101990 2023-10-14T08:59:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9019d950 con 0x7f1d900ffe00 2023-10-14T08:59:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d94ea3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9019db10 con 0x7f1d90100ff0 2023-10-14T08:59:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d9019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 0x7f1d90195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d9019d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34718/0 (socket says 172.21.15.6:34718) 2023-10-14T08:59:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 0x7f1d90195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33474/0 (socket says 172.21.15.6:33474) 2023-10-14T08:59:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/2836189811 learned_addr learned my addr 172.21.15.6:0/2836189811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/2836189811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d90100ff0 msgr2=0x7f1d901961b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T08:59:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d90100ff0 0x7f1d901961b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/2836189811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 msgr2=0x7f1d90195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 0x7f1d90195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/2836189811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88009d00 con 0x7f1d90101990 2023-10-14T08:59:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.502+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 0x7f1d90195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.503+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d9019d210 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1d88007990 tx=0x7f1d88008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.503+0000 7f1d7f7fe700 1 -- 172.21.15.6:0/2836189811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800e040 con 0x7f1d90101990 2023-10-14T08:59:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.503+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9019dd90 con 0x7f1d90101990 2023-10-14T08:59:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.503+0000 7f1d7f7fe700 1 -- 172.21.15.6:0/2836189811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d8800be30 con 0x7f1d90101990 2023-10-14T08:59:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.503+0000 7f1d7f7fe700 1 -- 172.21.15.6:0/2836189811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8801d6d0 con 0x7f1d90101990 2023-10-14T08:59:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.503+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9019e280 con 0x7f1d90101990 2023-10-14T08:59:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.506+0000 7f1d7f7fe700 1 -- 172.21.15.6:0/2836189811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1d880051b0 con 0x7f1d90101990 2023-10-14T08:59:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.509+0000 7f1da108db80 1 Processor -- start 2023-10-14T08:59:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.509+0000 7f1da108db80 1 -- start start 2023-10-14T08:59:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1d7f7fe700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d780a1500 0x7f1d780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1da108db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef87f0 0x55a435ef8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1da108db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef9150 0x55a435ef9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1da108db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435efa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1da108db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435e6dc10 con 0x55a435ef87f0 2023-10-14T08:59:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1da108db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435e52c00 con 0x55a435ef9150 2023-10-14T08:59:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1da108db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435e50520 con 0x55a435efa040 2023-10-14T08:59:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1d7f7fe700 1 -- 172.21.15.6:0/2836189811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1d880cdd60 con 0x7f1d90101990 2023-10-14T08:59:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef87f0 0x55a435ef8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef87f0 0x55a435ef8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34720/0 (socket says 172.21.15.6:34720) 2023-10-14T08:59:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1d8ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435efa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.510+0000 7f1d8e59c700 1 -- 172.21.15.6:0/3547194707 learned_addr learned my addr 172.21.15.6:0/3547194707 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/3547194707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef9150 msgr2=0x55a435ef9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef9150 0x55a435ef9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/3547194707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef87f0 msgr2=0x55a435ef8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef87f0 0x55a435ef8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8ed9d700 1 -- 172.21.15.6:0/3547194707 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a435e09390 con 0x55a435efa040 2023-10-14T08:59:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d780a1500 0x7f1d780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435efa4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d8809add0 tx=0x7f1d8800b3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290b92424930ba7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d7cff9700 1 -- 172.21.15.6:0/3547194707 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88011e50 con 0x55a435efa040 2023-10-14T08:59:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d7cff9700 1 -- 172.21.15.6:0/3547194707 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d8809b7d0 con 0x55a435efa040 2023-10-14T08:59:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.511+0000 7f1d7cff9700 1 -- 172.21.15.6:0/3547194707 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88004a50 con 0x55a435efa040 2023-10-14T08:59:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 -- 172.21.15.6:0/3547194707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 msgr2=0x55a435efa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d780a1500 0x7f1d780a39c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55a435ef9550 tx=0x7f1d84009460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435efa4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d8809add0 tx=0x7f1d8800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 -- 172.21.15.6:0/3547194707 shutdown_connections 2023-10-14T08:59:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435efa4c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef87f0 0x55a435ef8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 --2- 172.21.15.6:0/3547194707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef9150 0x55a435ef9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 -- 172.21.15.6:0/3547194707 >> 172.21.15.6:0/3547194707 conn(0x55a435e26d70 msgr2=0x55a435ef3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 -- 172.21.15.6:0/3547194707 shutdown_connections 2023-10-14T08:59:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.512+0000 7f1da108db80 1 -- 172.21.15.6:0/3547194707 wait complete. 2023-10-14T08:59:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 -- start start 2023-10-14T08:59:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 Processor -- start 2023-10-14T08:59:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435ef87f0 0x55a435f02540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f02a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435efa040 0x55a435f09ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435e4be10 con 0x55a435ef9150 2023-10-14T08:59:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435de86b0 con 0x55a435efa040 2023-10-14T08:59:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435de8350 con 0x55a435ef87f0 2023-10-14T08:59:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1da108db80 10 client.0 _ll_register_callbacks cb 0x55a435c457a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f02a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435ef87f0 0x55a435f02540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f02a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34730/0 (socket says 172.21.15.6:34730) 2023-10-14T08:59:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/1612801944 learned_addr learned my addr 172.21.15.6:0/1612801944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435efa040 0x55a435f09ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435ef87f0 msgr2=0x55a435f02540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435ef87f0 0x55a435f02540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/1612801944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435efa040 msgr2=0x55a435f09ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435efa040 0x55a435f09ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.513+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/1612801944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9019e280 con 0x55a435ef9150 2023-10-14T08:59:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f02a80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1d84005d90 tx=0x7f1d840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a27f3c4414ac341 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:12.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:59:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d75ffb700 1 -- 172.21.15.6:0/1612801944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84025460 con 0x55a435ef9150 2023-10-14T08:59:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a435e50e90 con 0x55a435ef9150 2023-10-14T08:59:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d75ffb700 1 -- 172.21.15.6:0/1612801944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1d8401c420 con 0x55a435ef9150 2023-10-14T08:59:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d75ffb700 1 -- 172.21.15.6:0/1612801944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8401c5e0 con 0x55a435ef9150 2023-10-14T08:59:12.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1da108db80 10 client.16110 fetch_fsmap learned FSMap version 42 2023-10-14T08:59:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55a435c76d80 con 0x55a435ef9150 2023-10-14T08:59:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d75ffb700 1 -- 172.21.15.6:0/1612801944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a435e50e90 con 0x55a435ef9150 2023-10-14T08:59:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.514+0000 7f1d75ffb700 1 -- 172.21.15.6:0/1612801944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f1d84018070 con 0x55a435ef9150 2023-10-14T08:59:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1da108db80 10 client.16110 fetch_fsmap finished waiting for FSMap version 42 2023-10-14T08:59:12.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1da108db80 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1da108db80 20 client.16110 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1da108db80 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f1f420 0x55a435f21840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1da108db80 4 client.16110 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:59:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a435ec8bb0 con 0x55a435f1f420 2023-10-14T08:59:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f1f420 0x55a435f21840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1d75ffb700 10 client.16110 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.515+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f1f420 0x55a435f21840 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c25d2257d784ddd server_cookie=bfdb7d3c468afafa in_seq=0 out_seq=0 2023-10-14T08:59:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1d75ffb700 1 -- 172.21.15.6:0/1612801944 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a435ec8bb0 con 0x55a435f1f420 2023-10-14T08:59:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1d75ffb700 10 client.16110 handle_command_reply: tid=0 2023-10-14T08:59:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 client.16110 shutdown 2023-10-14T08:59:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 msgr2=0x55a435f02a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f02a80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1d84005d90 tx=0x7f1d840047c0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 shutdown_connections 2023-10-14T08:59:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f1f420 0x55a435f21840 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435efa040 0x55a435f09ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435ef87f0 0x55a435f02540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 --2- 172.21.15.6:0/1612801944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f02a80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 >> 172.21.15.6:0/1612801944 conn(0x55a435e26d70 msgr2=0x55a435ef3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1d75ffb700 0 client.16110 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 shutdown_connections 2023-10-14T08:59:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.516+0000 7f1da108db80 1 -- 172.21.15.6:0/1612801944 wait complete. 2023-10-14T08:59:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.517+0000 7f1da108db80 20 client.16110 trim_cache size 0 max 16384 2023-10-14T08:59:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 Processor -- start 2023-10-14T08:59:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 -- start start 2023-10-14T08:59:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435efd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f09a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f02540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435ccc8c0 con 0x55a435ef9150 2023-10-14T08:59:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435efa8c0 con 0x55a435ef87f0 2023-10-14T08:59:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1da108db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435ef9840 con 0x55a435efa040 2023-10-14T08:59:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1d8dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f09a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.536+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435efd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435efd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33494/0 (socket says 172.21.15.6:33494) 2023-10-14T08:59:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 -- 172.21.15.6:0/2097753768 learned_addr learned my addr 172.21.15.6:0/2097753768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f09a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34738/0 (socket says 172.21.15.6:34738) 2023-10-14T08:59:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8ed9d700 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f02540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 -- 172.21.15.6:0/2097753768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 msgr2=0x55a435f02540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f02540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 -- 172.21.15.6:0/2097753768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 msgr2=0x55a435f09a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f09a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 -- 172.21.15.6:0/2097753768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a435c5fc00 con 0x55a435ef87f0 2023-10-14T08:59:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435efd580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55a435ef8590 tx=0x7f1d80008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b350082f4955715a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d7d7fa700 1 -- 172.21.15.6:0/2097753768 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80016e20 con 0x55a435ef87f0 2023-10-14T08:59:12.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d7d7fa700 1 -- 172.21.15.6:0/2097753768 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d8001c040 con 0x55a435ef87f0 2023-10-14T08:59:12.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.537+0000 7f1d7d7fa700 1 -- 172.21.15.6:0/2097753768 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800256c0 con 0x55a435ef87f0 2023-10-14T08:59:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 -- 172.21.15.6:0/2097753768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 msgr2=0x55a435efd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435efd580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55a435ef8590 tx=0x7f1d80008040 comp rx=0 tx=0).stop 2023-10-14T08:59:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 -- 172.21.15.6:0/2097753768 shutdown_connections 2023-10-14T08:59:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f02540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435efd580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 --2- 172.21.15.6:0/2097753768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f09a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 -- 172.21.15.6:0/2097753768 >> 172.21.15.6:0/2097753768 conn(0x55a435e26d70 msgr2=0x55a435f0a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:12.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 -- 172.21.15.6:0/2097753768 shutdown_connections 2023-10-14T08:59:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 -- 172.21.15.6:0/2097753768 wait complete. 2023-10-14T08:59:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 -- start start 2023-10-14T08:59:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.538+0000 7f1da108db80 1 Processor -- start 2023-10-14T08:59:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435f07350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f07890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f088a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435f08de0 con 0x55a435ef9150 2023-10-14T08:59:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435f08f50 con 0x55a435ef87f0 2023-10-14T08:59:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435f09110 con 0x55a435efa040 2023-10-14T08:59:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 10 client.0 _ll_register_callbacks cb 0x7f1d8400ede0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435f07350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f07890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f07890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34744/0 (socket says 172.21.15.6:34744) 2023-10-14T08:59:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435f07350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33500/0 (socket says 172.21.15.6:33500) 2023-10-14T08:59:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/380127096 learned_addr learned my addr 172.21.15.6:0/380127096 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 msgr2=0x55a435f088a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f088a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/380127096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 msgr2=0x55a435f07350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435f07350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 -- 172.21.15.6:0/380127096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d80016430 con 0x55a435ef9150 2023-10-14T08:59:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435f07350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d8dd9b700 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f07890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1d84025b30 tx=0x7f1d840259f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c90c5359849ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:59:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d75ffb700 1 -- 172.21.15.6:0/380127096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400f920 con 0x55a435ef9150 2023-10-14T08:59:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1d75ffb700 1 -- 172.21.15.6:0/380127096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1d84009260 con 0x55a435ef9150 2023-10-14T08:59:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.539+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d8809b7d0 con 0x55a435ef9150 2023-10-14T08:59:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1d75ffb700 1 -- 172.21.15.6:0/380127096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d8400fa80 con 0x55a435ef9150 2023-10-14T08:59:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 10 client.16116 fetch_fsmap learned FSMap version 42 2023-10-14T08:59:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55a435c9d1f0 con 0x55a435ef9150 2023-10-14T08:59:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1d75ffb700 1 -- 172.21.15.6:0/380127096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d8809b7d0 con 0x55a435ef9150 2023-10-14T08:59:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1d75ffb700 1 -- 172.21.15.6:0/380127096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f1d84010430 con 0x55a435ef9150 2023-10-14T08:59:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 10 client.16116 fetch_fsmap finished waiting for FSMap version 42 2023-10-14T08:59:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 20 client.16116 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f73d80 0x55a435f761a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 4 client.16116 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:59:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a435e44df0 con 0x55a435f73d80 2023-10-14T08:59:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.540+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f73d80 0x55a435f761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.541+0000 7f1d75ffb700 10 client.16116 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.541+0000 7f1d8e59c700 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f73d80 0x55a435f761a0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7fa5f3ecd1f8f1e server_cookie=e347ee7801d611f5 in_seq=0 out_seq=0 2023-10-14T08:59:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.557+0000 7f1d75ffb700 1 -- 172.21.15.6:0/380127096 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a435e44df0 con 0x55a435f73d80 2023-10-14T08:59:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.557+0000 7f1d75ffb700 10 client.16116 handle_command_reply: tid=0 2023-10-14T08:59:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.557+0000 7f1da108db80 1 client.16116 shutdown 2023-10-14T08:59:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 msgr2=0x55a435f07890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f07890 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1d84025b30 tx=0x7f1d840259f0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 shutdown_connections 2023-10-14T08:59:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a435f73d80 0x55a435f761a0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a435efa040 0x55a435f088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1d75ffb700 0 client.16116 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a435ef87f0 0x55a435f07350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 --2- 172.21.15.6:0/380127096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a435ef9150 0x55a435f07890 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 >> 172.21.15.6:0/380127096 conn(0x55a435e26d70 msgr2=0x55a435f0a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 shutdown_connections 2023-10-14T08:59:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.558+0000 7f1da108db80 1 -- 172.21.15.6:0/380127096 wait complete. 2023-10-14T08:59:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.560+0000 7f1da108db80 20 client.16116 trim_cache size 0 max 16384 2023-10-14T08:59:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:59:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:59:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:59:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:59:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d780a1500 msgr2=0x7f1d780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d780a1500 0x7f1d780a39c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55a435ef9550 tx=0x7f1d84009460 comp rx=0 tx=0).stop 2023-10-14T08:59:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 msgr2=0x7f1d9019d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d9019d210 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1d88007990 tx=0x7f1d88008eb0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 shutdown_connections 2023-10-14T08:59:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d90101990 0x7f1d9019d210 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d780a1500 0x7f1d780a39c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d900ffe00 0x7f1d90195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 --2- 172.21.15.6:0/2836189811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d90100ff0 0x7f1d901961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 >> 172.21.15.6:0/2836189811 conn(0x7f1d900fb3b0 msgr2=0x7f1d90104490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 shutdown_connections 2023-10-14T08:59:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:12.561+0000 7f1d94ea3700 1 -- 172.21.15.6:0/2836189811 wait complete. 2023-10-14T08:59:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:13 smithi178 ceph-mon[103612]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 778 op/s 2023-10-14T08:59:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:13 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:13.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:13 smithi057 ceph-mon[103313]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 778 op/s 2023-10-14T08:59:13.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:13 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:13 smithi006 ceph-mon[99452]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 778 op/s 2023-10-14T08:59:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:13 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:15 smithi178 ceph-mon[103612]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-14T08:59:15.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:15 smithi057 ceph-mon[103313]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-14T08:59:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:15 smithi006 ceph-mon[99452]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-14T08:59:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 375.0 s, 2290.4 tps, lat 43.253 ms stddev 46.957 2023-10-14T08:59:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:17 smithi178 ceph-mon[103612]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 796 op/s 2023-10-14T08:59:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:17 smithi057 ceph-mon[103313]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 796 op/s 2023-10-14T08:59:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:17 smithi006 ceph-mon[99452]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 796 op/s 2023-10-14T08:59:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:19 smithi178 ceph-mon[103612]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 802 op/s 2023-10-14T08:59:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:19 smithi057 ceph-mon[103313]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 802 op/s 2023-10-14T08:59:19.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:19 smithi006 ceph-mon[99452]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 802 op/s 2023-10-14T08:59:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 380.0 s, 2213.4 tps, lat 45.435 ms stddev 54.955 2023-10-14T08:59:21.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:21 smithi178 ceph-mon[103612]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 748 op/s 2023-10-14T08:59:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:21 smithi057 ceph-mon[103313]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 748 op/s 2023-10-14T08:59:21.740 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:21 smithi006 ceph-mon[99452]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 748 op/s 2023-10-14T08:59:23.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:23 smithi057 ceph-mon[103313]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 777 op/s 2023-10-14T08:59:23.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:23 smithi006 ceph-mon[99452]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 777 op/s 2023-10-14T08:59:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:23 smithi178 ceph-mon[103612]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 777 op/s 2023-10-14T08:59:24.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:24 smithi006 ceph-mon[99452]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 737 op/s 2023-10-14T08:59:24.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:24 smithi178 ceph-mon[103612]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 737 op/s 2023-10-14T08:59:24.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:24 smithi057 ceph-mon[103313]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 737 op/s 2023-10-14T08:59:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 -- 172.21.15.6:0/3251442470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a20101990 msgr2=0x7f8a20108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 --2- 172.21.15.6:0/3251442470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a20101990 0x7f8a20108240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800b0d0 tx=0x7f8a1800b3e0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 -- 172.21.15.6:0/3251442470 shutdown_connections 2023-10-14T08:59:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 --2- 172.21.15.6:0/3251442470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a20101990 0x7f8a20108240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 --2- 172.21.15.6:0/3251442470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a200ffe00 0x7f8a20100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 --2- 172.21.15.6:0/3251442470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a20100ff0 0x7f8a20101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 -- 172.21.15.6:0/3251442470 >> 172.21.15.6:0/3251442470 conn(0x7f8a200fb390 msgr2=0x7f8a200fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 -- 172.21.15.6:0/3251442470 shutdown_connections 2023-10-14T08:59:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 -- 172.21.15.6:0/3251442470 wait complete. 2023-10-14T08:59:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.724+0000 7f8a25d36700 1 Processor -- start 2023-10-14T08:59:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 -- start start 2023-10-14T08:59:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 0x7f8a2010c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a20100ff0 0x7f8a2010aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a20101990 0x7f8a2010afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2010b770 con 0x7f8a200ffe00 2023-10-14T08:59:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2010b8e0 con 0x7f8a20101990 2023-10-14T08:59:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a25d36700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201a0d80 con 0x7f8a20100ff0 2023-10-14T08:59:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 0x7f8a2010c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 0x7f8a2010c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34756/0 (socket says 172.21.15.6:34756) 2023-10-14T08:59:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1212233361 learned_addr learned my addr 172.21.15.6:0/1212233361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a20101990 0x7f8a2010afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a20100ff0 0x7f8a2010aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1212233361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a20100ff0 msgr2=0x7f8a2010aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a20100ff0 0x7f8a2010aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1212233361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a20101990 msgr2=0x7f8a2010afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a20101990 0x7f8a2010afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1212233361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18009d00 con 0x7f8a200ffe00 2023-10-14T08:59:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 0x7f8a2010c450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000e970 tx=0x7f8a1000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.725+0000 7f8a1cff9700 1 -- 172.21.15.6:0/1212233361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10009790 con 0x7f8a200ffe00 2023-10-14T08:59:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.726+0000 7f8a1cff9700 1 -- 172.21.15.6:0/1212233361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a1000c7e0 con 0x7f8a200ffe00 2023-10-14T08:59:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.726+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a201a1060 con 0x7f8a200ffe00 2023-10-14T08:59:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.726+0000 7f8a1cff9700 1 -- 172.21.15.6:0/1212233361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10003c70 con 0x7f8a200ffe00 2023-10-14T08:59:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.726+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a201a1570 con 0x7f8a200ffe00 2023-10-14T08:59:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a1cff9700 1 -- 172.21.15.6:0/1212233361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8a1000cc50 con 0x7f8a200ffe00 2023-10-14T08:59:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a1cff9700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a080a1480 0x7f8a080a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a31f20b80 1 Processor -- start 2023-10-14T08:59:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a31f20b80 1 -- start start 2023-10-14T08:59:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a1cff9700 1 -- 172.21.15.6:0/1212233361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8a10014070 con 0x7f8a200ffe00 2023-10-14T08:59:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a080a1480 0x7f8a080a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.729+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e5630c10 con 0x5607e56bd0a0 2023-10-14T08:59:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e5615c00 con 0x5607e56bc1b0 2023-10-14T08:59:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e5613520 con 0x5607e56bb850 2023-10-14T08:59:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56bd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34768/0 (socket says 172.21.15.6:34768) 2023-10-14T08:59:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 -- 172.21.15.6:0/1880700419 learned_addr learned my addr 172.21.15.6:0/1880700419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a080a1480 0x7f8a080a3940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009c70 tx=0x7f8a14011720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 -- 172.21.15.6:0/1880700419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 msgr2=0x5607e56bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 -- 172.21.15.6:0/1880700419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 msgr2=0x5607e56bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56bcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 -- 172.21.15.6:0/1880700419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607e55cc390 con 0x5607e56bd0a0 2023-10-14T08:59:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56bd520 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8a18015000 tx=0x7f8a18005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289b6208c0155ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.730+0000 7f8a05ffb700 1 -- 172.21.15.6:0/1880700419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e040 con 0x5607e56bd0a0 2023-10-14T08:59:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a05ffb700 1 -- 172.21.15.6:0/1880700419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a1800baa0 con 0x5607e56bd0a0 2023-10-14T08:59:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a05ffb700 1 -- 172.21.15.6:0/1880700419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18005070 con 0x5607e56bd0a0 2023-10-14T08:59:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1880700419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 msgr2=0x5607e56bd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56bd520 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8a18015000 tx=0x7f8a18005b00 comp rx=0 tx=0).stop 2023-10-14T08:59:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1880700419 shutdown_connections 2023-10-14T08:59:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56bd520 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1880700419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1880700419 >> 172.21.15.6:0/1880700419 conn(0x5607e55e9d70 msgr2=0x5607e56b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1880700419 shutdown_connections 2023-10-14T08:59:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.731+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1880700419 wait complete. 2023-10-14T08:59:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 -- start start 2023-10-14T08:59:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 Processor -- start 2023-10-14T08:59:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bb850 0x5607e56cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bc1b0 0x5607e56ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e560ee10 con 0x5607e56bd0a0 2023-10-14T08:59:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e55ab6b0 con 0x5607e56bb850 2023-10-14T08:59:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e55ab350 con 0x5607e56bc1b0 2023-10-14T08:59:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a31f20b80 10 client.0 _ll_register_callbacks cb 0x5607e54087a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a1f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bb850 0x5607e56cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a1f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bb850 0x5607e56cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33528/0 (socket says 172.21.15.6:33528) 2023-10-14T08:59:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a1effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bc1b0 0x5607e56ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56d5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34774/0 (socket says 172.21.15.6:34774) 2023-10-14T08:59:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.732+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/3306305235 learned_addr learned my addr 172.21.15.6:0/3306305235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1ffff700 1 -- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bc1b0 msgr2=0x5607e56ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bc1b0 0x5607e56ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1ffff700 1 -- 172.21.15.6:0/3306305235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bb850 msgr2=0x5607e56cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bb850 0x5607e56cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1ffff700 1 -- 172.21.15.6:0/3306305235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a20108b90 con 0x5607e56bd0a0 2023-10-14T08:59:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1effd700 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bc1b0 0x5607e56ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56d5420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5607e56b7a20 tx=0x7f8a180076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf20734d7a7ec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f89feffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:59:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f89feffd700 1 -- 172.21.15.6:0/3306305235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e040 con 0x5607e56bd0a0 2023-10-14T08:59:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f89feffd700 1 -- 172.21.15.6:0/3306305235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8a180052d0 con 0x5607e56bd0a0 2023-10-14T08:59:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607e5613e90 con 0x5607e56bd0a0 2023-10-14T08:59:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f89feffd700 1 -- 172.21.15.6:0/3306305235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a180054b0 con 0x5607e56bd0a0 2023-10-14T08:59:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a31f20b80 10 client.16128 fetch_fsmap learned FSMap version 42 2023-10-14T08:59:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5607e5439d80 con 0x5607e56bd0a0 2023-10-14T08:59:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.733+0000 7f89feffd700 1 -- 172.21.15.6:0/3306305235 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5607e5613e90 con 0x5607e56bd0a0 2023-10-14T08:59:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f89feffd700 1 -- 172.21.15.6:0/3306305235 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8a1800b100 con 0x5607e56bd0a0 2023-10-14T08:59:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a31f20b80 10 client.16128 fetch_fsmap finished waiting for FSMap version 42 2023-10-14T08:59:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a31f20b80 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a31f20b80 20 client.16128 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e56d9770 0x5607e56dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a31f20b80 4 client.16128 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:59:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607e568bbb0 con 0x5607e56d9770 2023-10-14T08:59:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e56d9770 0x5607e56dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f89feffd700 10 client.16128 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.734+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e56d9770 0x5607e56dbb60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f6c95bc0620ceb server_cookie=73a810fe6f48e3f2 in_seq=0 out_seq=0 2023-10-14T08:59:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f89feffd700 1 -- 172.21.15.6:0/3306305235 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607e568bbb0 con 0x5607e56d9770 2023-10-14T08:59:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f89feffd700 10 client.16128 handle_command_reply: tid=0 2023-10-14T08:59:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 client.16128 shutdown 2023-10-14T08:59:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 msgr2=0x5607e56d5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56d5420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5607e56b7a20 tx=0x7f8a180076d0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 shutdown_connections 2023-10-14T08:59:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e56d9770 0x5607e56dbb60 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bd0a0 0x5607e56d5420 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bb850 0x5607e56cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f89feffd700 0 client.16128 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/3306305235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bc1b0 0x5607e56ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 >> 172.21.15.6:0/3306305235 conn(0x5607e55e9d70 msgr2=0x5607e56b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 shutdown_connections 2023-10-14T08:59:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 1 -- 172.21.15.6:0/3306305235 wait complete. 2023-10-14T08:59:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.735+0000 7f8a31f20b80 20 client.16128 trim_cache size 0 max 16384 2023-10-14T08:59:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.756+0000 7f8a31f20b80 1 Processor -- start 2023-10-14T08:59:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.756+0000 7f8a31f20b80 1 -- start start 2023-10-14T08:59:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.756+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 0x5607e56d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bd0a0 0x5607e56c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e548f8c0 con 0x5607e56bc1b0 2023-10-14T08:59:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e56cc9d0 con 0x5607e56bd0a0 2023-10-14T08:59:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e56cd350 con 0x5607e56bb850 2023-10-14T08:59:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 0x5607e56d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 0x5607e56d53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34778/0 (socket says 172.21.15.6:34778) 2023-10-14T08:59:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1effd700 1 -- 172.21.15.6:0/2218823530 learned_addr learned my addr 172.21.15.6:0/2218823530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bd0a0 0x5607e56c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 -- 172.21.15.6:0/2218823530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 msgr2=0x5607e56ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 -- 172.21.15.6:0/2218823530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 msgr2=0x5607e56d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 0x5607e56d53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 -- 172.21.15.6:0/2218823530 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607e5422c00 con 0x5607e56bd0a0 2023-10-14T08:59:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1effd700 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 0x5607e56d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.757+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bd0a0 0x5607e56c3410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a18007a30 tx=0x7f8a18005050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c62ad25134e312 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.758+0000 7f8a067fc700 1 -- 172.21.15.6:0/2218823530 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e070 con 0x5607e56bd0a0 2023-10-14T08:59:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.758+0000 7f8a067fc700 1 -- 172.21.15.6:0/2218823530 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a18025450 con 0x5607e56bd0a0 2023-10-14T08:59:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.758+0000 7f8a067fc700 1 -- 172.21.15.6:0/2218823530 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1802d450 con 0x5607e56bd0a0 2023-10-14T08:59:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.758+0000 7f8a31f20b80 1 -- 172.21.15.6:0/2218823530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bd0a0 msgr2=0x5607e56c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.759+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bd0a0 0x5607e56c3410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a18007a30 tx=0x7f8a18005050 comp rx=0 tx=0).stop 2023-10-14T08:59:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.759+0000 7f8a31f20b80 1 -- 172.21.15.6:0/2218823530 shutdown_connections 2023-10-14T08:59:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.759+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bd0a0 0x5607e56c3410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.759+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bb850 0x5607e56ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.759+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/2218823530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bc1b0 0x5607e56d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.759+0000 7f8a31f20b80 1 -- 172.21.15.6:0/2218823530 >> 172.21.15.6:0/2218823530 conn(0x5607e55e9d70 msgr2=0x5607e56e04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.760+0000 7f8a31f20b80 1 -- 172.21.15.6:0/2218823530 shutdown_connections 2023-10-14T08:59:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.760+0000 7f8a31f20b80 1 -- 172.21.15.6:0/2218823530 wait complete. 2023-10-14T08:59:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.760+0000 7f8a31f20b80 1 -- start start 2023-10-14T08:59:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.760+0000 7f8a31f20b80 1 Processor -- start 2023-10-14T08:59:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 0x5607e56d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bd0a0 0x5607e56d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e56d4890 con 0x5607e56bb850 2023-10-14T08:59:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e56d4a00 con 0x5607e56bc1b0 2023-10-14T08:59:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607e56d4bc0 con 0x5607e56bd0a0 2023-10-14T08:59:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a31f20b80 10 client.0 _ll_register_callbacks cb 0x7f8a14009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 0x5607e56d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56d1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33542/0 (socket says 172.21.15.6:33542) 2023-10-14T08:59:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 -- 172.21.15.6:0/1553742542 learned_addr learned my addr 172.21.15.6:0/1553742542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 0x5607e56d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34784/0 (socket says 172.21.15.6:34784) 2023-10-14T08:59:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1ffff700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bd0a0 0x5607e56d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 -- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bd0a0 msgr2=0x5607e56d4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bd0a0 0x5607e56d4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 -- 172.21.15.6:0/1553742542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 msgr2=0x5607e56d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 0x5607e56d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 -- 172.21.15.6:0/1553742542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1400f7a0 con 0x5607e56bc1b0 2023-10-14T08:59:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 0x5607e56d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f8a1effd700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56d1330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400ff30 tx=0x7f8a140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a72a821712e6d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.761+0000 7f89feffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:59:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f89feffd700 1 -- 172.21.15.6:0/1553742542 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140283f0 con 0x5607e56bc1b0 2023-10-14T08:59:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f89feffd700 1 -- 172.21.15.6:0/1553742542 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8a14028550 con 0x5607e56bc1b0 2023-10-14T08:59:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a1800baa0 con 0x5607e56bc1b0 2023-10-14T08:59:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f89feffd700 1 -- 172.21.15.6:0/1553742542 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a14028710 con 0x5607e56bc1b0 2023-10-14T08:59:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 10 client.25739 fetch_fsmap learned FSMap version 42 2023-10-14T08:59:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5607e5439d80 con 0x5607e56bc1b0 2023-10-14T08:59:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f89feffd700 1 -- 172.21.15.6:0/1553742542 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a14037020 con 0x5607e56bc1b0 2023-10-14T08:59:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f89feffd700 1 -- 172.21.15.6:0/1553742542 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 42) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f8a14027070 con 0x5607e56bc1b0 2023-10-14T08:59:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 10 client.25739 fetch_fsmap finished waiting for FSMap version 42 2023-10-14T08:59:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 20 client.25739 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e572e2d0 0x5607e57306f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 4 client.25739 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:59:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.762+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5607e5607df0 con 0x5607e572e2d0 2023-10-14T08:59:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.763+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e572e2d0 0x5607e57306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.763+0000 7f89feffd700 10 client.25739 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.763+0000 7f8a1f7fe700 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e572e2d0 0x5607e57306f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a496e07fc880d95f server_cookie=13fe190fce46c4c9 in_seq=0 out_seq=0 2023-10-14T08:59:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f89feffd700 1 -- 172.21.15.6:0/1553742542 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5607e5607df0 con 0x5607e572e2d0 2023-10-14T08:59:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f89feffd700 10 client.25739 handle_command_reply: tid=0 2023-10-14T08:59:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 client.25739 shutdown 2023-10-14T08:59:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 msgr2=0x5607e56d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56d1330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400ff30 tx=0x7f8a140047c0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 shutdown_connections 2023-10-14T08:59:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607e572e2d0 0x5607e57306f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607e56bd0a0 0x5607e56d4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f89feffd700 0 client.25739 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607e56bb850 0x5607e56d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 --2- 172.21.15.6:0/1553742542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607e56bc1b0 0x5607e56d1330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 >> 172.21.15.6:0/1553742542 conn(0x5607e55e9d70 msgr2=0x5607e56ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 shutdown_connections 2023-10-14T08:59:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 1 -- 172.21.15.6:0/1553742542 wait complete. 2023-10-14T08:59:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.843+0000 7f8a31f20b80 20 client.25739 trim_cache size 0 max 16384 2023-10-14T08:59:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:59:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:59:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:59:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:59:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a080a1480 msgr2=0x7f8a080a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a080a1480 0x7f8a080a3940 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009c70 tx=0x7f8a14011720 comp rx=0 tx=0).stop 2023-10-14T08:59:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 msgr2=0x7f8a2010c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 0x7f8a2010c450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000e970 tx=0x7f8a1000ec80 comp rx=0 tx=0).stop 2023-10-14T08:59:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 shutdown_connections 2023-10-14T08:59:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8a080a1480 0x7f8a080a3940 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a20101990 0x7f8a2010afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a200ffe00 0x7f8a2010c450 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 --2- 172.21.15.6:0/1212233361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a20100ff0 0x7f8a2010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 >> 172.21.15.6:0/1212233361 conn(0x7f8a200fb390 msgr2=0x7f8a20104480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 shutdown_connections 2023-10-14T08:59:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:25.844+0000 7f8a25d36700 1 -- 172.21.15.6:0/1212233361 wait complete. 2023-10-14T08:59:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 385.0 s, 1515.4 tps, lat 65.697 ms stddev 82.292 2023-10-14T08:59:27.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:27 smithi178 ceph-mon[103612]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 745 op/s 2023-10-14T08:59:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:27 smithi057 ceph-mon[103313]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 745 op/s 2023-10-14T08:59:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:27 smithi006 ceph-mon[99452]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 745 op/s 2023-10-14T08:59:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:29 smithi178 ceph-mon[103612]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 787 op/s 2023-10-14T08:59:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:29 smithi057 ceph-mon[103313]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 787 op/s 2023-10-14T08:59:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:29 smithi006 ceph-mon[99452]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 787 op/s 2023-10-14T08:59:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 390.0 s, 1678.8 tps, lat 60.121 ms stddev 72.394 2023-10-14T08:59:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:31 smithi178 ceph-mon[103612]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 727 op/s 2023-10-14T08:59:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:31 smithi057 ceph-mon[103313]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 727 op/s 2023-10-14T08:59:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:31 smithi006 ceph-mon[99452]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 727 op/s 2023-10-14T08:59:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:33 smithi178 ceph-mon[103612]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 800 op/s 2023-10-14T08:59:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:33 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:33 smithi057 ceph-mon[103313]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 800 op/s 2023-10-14T08:59:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:33 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:33.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:33 smithi006 ceph-mon[99452]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 800 op/s 2023-10-14T08:59:33.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:33 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T08:59:34.644 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:34 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:59:34.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:34 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:59:34.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:34 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T08:59:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:35 smithi178 ceph-mon[103612]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 789 op/s 2023-10-14T08:59:35.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:59:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:59:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:59:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:35 smithi057 ceph-mon[103313]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 789 op/s 2023-10-14T08:59:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:59:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:59:35.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:59:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:35 smithi006 ceph-mon[99452]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 789 op/s 2023-10-14T08:59:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T08:59:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T08:59:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T08:59:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 395.0 s, 1738.2 tps, lat 57.288 ms stddev 58.978 2023-10-14T08:59:37.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:37 smithi178 ceph-mon[103612]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 819 op/s 2023-10-14T08:59:37.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:37 smithi057 ceph-mon[103313]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 819 op/s 2023-10-14T08:59:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:37 smithi006 ceph-mon[99452]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 819 op/s 2023-10-14T08:59:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 -- 172.21.15.6:0/2118525322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 msgr2=0x7fa64010b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 --2- 172.21.15.6:0/2118525322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64010b3b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009990 tx=0x7fa63c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 -- 172.21.15.6:0/2118525322 shutdown_connections 2023-10-14T08:59:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 --2- 172.21.15.6:0/2118525322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64010e270 0x7fa640110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 --2- 172.21.15.6:0/2118525322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64010b3b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 --2- 172.21.15.6:0/2118525322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa64010b8f0 0x7fa64010dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 -- 172.21.15.6:0/2118525322 >> 172.21.15.6:0/2118525322 conn(0x7fa64006dcf0 msgr2=0x7fa640070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 -- 172.21.15.6:0/2118525322 shutdown_connections 2023-10-14T08:59:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.004+0000 7fa647edc700 1 -- 172.21.15.6:0/2118525322 wait complete. 2023-10-14T08:59:39.009 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 Processor -- start 2023-10-14T08:59:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 -- start start 2023-10-14T08:59:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64010b8f0 0x7fa64019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa64010e270 0x7fa6401a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401a6f70 con 0x7fa640108fc0 2023-10-14T08:59:39.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401a70b0 con 0x7fa64010e270 2023-10-14T08:59:39.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa647edc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401a7240 con 0x7fa64010b8f0 2023-10-14T08:59:39.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa645c78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa645c78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34798/0 (socket says 172.21.15.6:34798) 2023-10-14T08:59:39.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa645c78700 1 -- 172.21.15.6:0/4143939088 learned_addr learned my addr 172.21.15.6:0/4143939088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:39.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa646479700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa64010e270 0x7fa6401a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.005+0000 7fa645477700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64010b8f0 0x7fa64019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa645c78700 1 -- 172.21.15.6:0/4143939088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64010b8f0 msgr2=0x7fa64019f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa645c78700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64010b8f0 0x7fa64019f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa645c78700 1 -- 172.21.15.6:0/4143939088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa64010e270 msgr2=0x7fa6401a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa645c78700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa64010e270 0x7fa6401a69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa645c78700 1 -- 172.21.15.6:0/4143939088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0095f0 con 0x7fa640108fc0 2023-10-14T08:59:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa645c78700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64019f3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00b680 tx=0x7fa63c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa636ffd700 1 -- 172.21.15.6:0/4143939088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c01d070 con 0x7fa640108fc0 2023-10-14T08:59:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa636ffd700 1 -- 172.21.15.6:0/4143939088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa63c0054f0 con 0x7fa640108fc0 2023-10-14T08:59:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6401a74c0 con 0x7fa640108fc0 2023-10-14T08:59:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa636ffd700 1 -- 172.21.15.6:0/4143939088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c004c00 con 0x7fa640108fc0 2023-10-14T08:59:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.006+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6401a7880 con 0x7fa640108fc0 2023-10-14T08:59:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.010+0000 7fa636ffd700 1 -- 172.21.15.6:0/4143939088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa63c00fb90 con 0x7fa640108fc0 2023-10-14T08:59:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.010+0000 7fa636ffd700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa62c0a1500 0x7fa62c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.011+0000 7fa636ffd700 1 -- 172.21.15.6:0/4143939088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa63c0cdf70 con 0x7fa640108fc0 2023-10-14T08:59:39.019 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.011+0000 7fa645477700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa62c0a1500 0x7fa62c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.011+0000 7fa6540c6b80 1 Processor -- start 2023-10-14T08:59:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.011+0000 7fa645477700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa62c0a1500 0x7fa62c0a39c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa630009c60 tx=0x7fa630009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.011+0000 7fa6540c6b80 1 -- start start 2023-10-14T08:59:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.011+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9da4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 0x55fcd9da5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da60a0 0x55fcd9da6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9d19c10 con 0x55fcd9da51b0 2023-10-14T08:59:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9cfec00 con 0x55fcd9da60a0 2023-10-14T08:59:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9cfc520 con 0x55fcd9da4850 2023-10-14T08:59:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 0x55fcd9da5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 0x55fcd9da5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34808/0 (socket says 172.21.15.6:34808) 2023-10-14T08:59:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 -- 172.21.15.6:0/639161905 learned_addr learned my addr 172.21.15.6:0/639161905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa646479700 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da60a0 0x55fcd9da6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645c78700 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9da4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 -- 172.21.15.6:0/639161905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 msgr2=0x55fcd9da4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:39.022 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9da4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 -- 172.21.15.6:0/639161905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da60a0 msgr2=0x55fcd9da6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da60a0 0x55fcd9da6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 -- 172.21.15.6:0/639161905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcd9cb5390 con 0x55fcd9da51b0 2023-10-14T08:59:39.023 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645c78700 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9da4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T08:59:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa645477700 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 0x55fcd9da5ac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa63000e4e0 tx=0x7fa630014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2d1c633093ec73 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa62bfff700 1 -- 172.21.15.6:0/639161905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000ee00 con 0x55fcd9da51b0 2023-10-14T08:59:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa62bfff700 1 -- 172.21.15.6:0/639161905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa630021070 con 0x55fcd9da51b0 2023-10-14T08:59:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.012+0000 7fa62bfff700 1 -- 172.21.15.6:0/639161905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63001d7b0 con 0x55fcd9da51b0 2023-10-14T08:59:39.024 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 -- 172.21.15.6:0/639161905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 msgr2=0x55fcd9da5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 0x55fcd9da5ac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa63000e4e0 tx=0x7fa630014000 comp rx=0 tx=0).stop 2023-10-14T08:59:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 -- 172.21.15.6:0/639161905 shutdown_connections 2023-10-14T08:59:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da60a0 0x55fcd9da6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9da4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/639161905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da51b0 0x55fcd9da5ac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 -- 172.21.15.6:0/639161905 >> 172.21.15.6:0/639161905 conn(0x55fcd9cd2d70 msgr2=0x55fcd9d9fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 -- 172.21.15.6:0/639161905 shutdown_connections 2023-10-14T08:59:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.013+0000 7fa6540c6b80 1 -- 172.21.15.6:0/639161905 wait complete. 2023-10-14T08:59:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 -- start start 2023-10-14T08:59:39.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 Processor -- start 2023-10-14T08:59:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9dae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9daec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9cf7e10 con 0x55fcd9da60a0 2023-10-14T08:59:39.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9c946b0 con 0x55fcd9da51b0 2023-10-14T08:59:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9c94350 con 0x55fcd9da4850 2023-10-14T08:59:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.014+0000 7fa6540c6b80 10 client.0 _ll_register_callbacks cb 0x55fcd9af17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa646479700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa645477700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9daec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa646479700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34814/0 (socket says 172.21.15.6:34814) 2023-10-14T08:59:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa646479700 1 -- 172.21.15.6:0/2554100927 learned_addr learned my addr 172.21.15.6:0/2554100927 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa645477700 1 -- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 msgr2=0x55fcd9dae750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:59:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa645477700 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9dae750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa645477700 1 -- 172.21.15.6:0/2554100927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 msgr2=0x55fcd9db5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa645477700 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.015+0000 7fa645477700 1 -- 172.21.15.6:0/2554100927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa630017070 con 0x55fcd9da51b0 2023-10-14T08:59:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa645477700 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9daec90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa63000ead0 tx=0x7fa63000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7542365846f4bf9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6297fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:59:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6297fa700 1 -- 172.21.15.6:0/2554100927 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6300053d0 con 0x55fcd9da51b0 2023-10-14T08:59:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6297fa700 1 -- 172.21.15.6:0/2554100927 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa630005530 con 0x55fcd9da51b0 2023-10-14T08:59:39.030 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcd9cfce90 con 0x55fcd9da51b0 2023-10-14T08:59:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6297fa700 1 -- 172.21.15.6:0/2554100927 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6300056f0 con 0x55fcd9da51b0 2023-10-14T08:59:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 10 client.25751 fetch_fsmap learned FSMap version 43 2023-10-14T08:59:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55fcd9b22d80 con 0x55fcd9da51b0 2023-10-14T08:59:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6297fa700 1 -- 172.21.15.6:0/2554100927 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fcd9cfce90 con 0x55fcd9da51b0 2023-10-14T08:59:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6297fa700 1 -- 172.21.15.6:0/2554100927 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa63001c8a0 con 0x55fcd9da51b0 2023-10-14T08:59:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 10 client.25751 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T08:59:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 10 client.25751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 20 client.25751 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9dbe710 0x55fcd9dc0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 4 client.25751 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:59:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.016+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcd9d74bb0 con 0x55fcd9dbe710 2023-10-14T08:59:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.017+0000 7fa645c78700 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9dbe710 0x55fcd9dc0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.017+0000 7fa6297fa700 10 client.25751 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.017+0000 7fa645c78700 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9dbe710 0x55fcd9dc0b80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc68e56b63d10f0 server_cookie=9521180b8ae13a56 in_seq=0 out_seq=0 2023-10-14T08:59:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6297fa700 1 -- 172.21.15.6:0/2554100927 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fcd9d74bb0 con 0x55fcd9dbe710 2023-10-14T08:59:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6297fa700 10 client.25751 handle_command_reply: tid=0 2023-10-14T08:59:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 client.25751 shutdown 2023-10-14T08:59:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 msgr2=0x55fcd9daec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9daec90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa63000ead0 tx=0x7fa63000ee80 comp rx=0 tx=0).stop 2023-10-14T08:59:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 shutdown_connections 2023-10-14T08:59:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9dbe710 0x55fcd9dc0b80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da4850 0x55fcd9dae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6297fa700 0 client.25751 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/2554100927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9daec90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 >> 172.21.15.6:0/2554100927 conn(0x55fcd9cd2d70 msgr2=0x55fcd9d9f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 shutdown_connections 2023-10-14T08:59:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 1 -- 172.21.15.6:0/2554100927 wait complete. 2023-10-14T08:59:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.018+0000 7fa6540c6b80 20 client.25751 trim_cache size 0 max 16384 2023-10-14T08:59:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.043+0000 7fa6540c6b80 1 Processor -- start 2023-10-14T08:59:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 -- start start 2023-10-14T08:59:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 0x55fcd9da1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9dad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da60a0 0x55fcd9dac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9dae320 con 0x55fcd9da4850 2023-10-14T08:59:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9b788c0 con 0x55fcd9da51b0 2023-10-14T08:59:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9dadc00 con 0x55fcd9da60a0 2023-10-14T08:59:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa645c78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 0x55fcd9da1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa645c78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 0x55fcd9da1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34818/0 (socket says 172.21.15.6:34818) 2023-10-14T08:59:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa645c78700 1 -- 172.21.15.6:0/1283448064 learned_addr learned my addr 172.21.15.6:0/1283448064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.045+0000 7fa646479700 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da60a0 0x55fcd9dac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa645c78700 1 -- 172.21.15.6:0/1283448064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da60a0 msgr2=0x55fcd9dac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa645c78700 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da60a0 0x55fcd9dac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa645c78700 1 -- 172.21.15.6:0/1283448064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 msgr2=0x55fcd9dad3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:59:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa645c78700 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9dad3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa645c78700 1 -- 172.21.15.6:0/1283448064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcd9b0bc00 con 0x55fcd9da4850 2023-10-14T08:59:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa646479700 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da60a0 0x55fcd9dac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa645c78700 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 0x55fcd9da1780 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa63c097d50 tx=0x7fa63c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef5743d4d71e358 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa634ff9700 1 -- 172.21.15.6:0/1283448064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c09b2e0 con 0x55fcd9da4850 2023-10-14T08:59:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa634ff9700 1 -- 172.21.15.6:0/1283448064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa63c09f430 con 0x55fcd9da4850 2023-10-14T08:59:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.046+0000 7fa634ff9700 1 -- 172.21.15.6:0/1283448064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c09a7d0 con 0x55fcd9da4850 2023-10-14T08:59:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 -- 172.21.15.6:0/1283448064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 msgr2=0x55fcd9da1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 0x55fcd9da1780 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa63c097d50 tx=0x7fa63c009ca0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 -- 172.21.15.6:0/1283448064 shutdown_connections 2023-10-14T08:59:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9da60a0 0x55fcd9dac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da4850 0x55fcd9da1780 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/1283448064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da51b0 0x55fcd9dad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.047+0000 7fa6540c6b80 1 -- 172.21.15.6:0/1283448064 >> 172.21.15.6:0/1283448064 conn(0x55fcd9cd2d70 msgr2=0x55fcd9dc5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.053+0000 7fa6540c6b80 1 -- 172.21.15.6:0/1283448064 shutdown_connections 2023-10-14T08:59:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.053+0000 7fa6540c6b80 1 -- 172.21.15.6:0/1283448064 wait complete. 2023-10-14T08:59:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.053+0000 7fa6540c6b80 1 -- start start 2023-10-14T08:59:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 Processor -- start 2023-10-14T08:59:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 0x55fcd9db9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9dbaae0 0x55fcd9db5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9dba0b0 con 0x55fcd9da60a0 2023-10-14T08:59:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9dbaf60 con 0x55fcd9da4850 2023-10-14T08:59:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd9dbb120 con 0x55fcd9dbaae0 2023-10-14T08:59:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa6540c6b80 10 client.0 _ll_register_callbacks cb 0x7fa638003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa645c78700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 0x55fcd9db9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa645c78700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 0x55fcd9db9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33580/0 (socket says 172.21.15.6:33580) 2023-10-14T08:59:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.054+0000 7fa645c78700 1 -- 172.21.15.6:0/255257922 learned_addr learned my addr 172.21.15.6:0/255257922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa646479700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9dbaae0 0x55fcd9db5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645477700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645c78700 1 -- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9dbaae0 msgr2=0x55fcd9db5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645c78700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9dbaae0 0x55fcd9db5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645c78700 1 -- 172.21.15.6:0/255257922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 msgr2=0x55fcd9db9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645c78700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645c78700 1 -- 172.21.15.6:0/255257922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6380099c0 con 0x55fcd9da4850 2023-10-14T08:59:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa645c78700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 0x55fcd9db9590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0977e0 tx=0x7fa63c097750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99d9c29f678c49f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa6297fa700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T08:59:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa6297fa700 1 -- 172.21.15.6:0/255257922 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c09a7d0 con 0x55fcd9da4850 2023-10-14T08:59:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa630021070 con 0x55fcd9da4850 2023-10-14T08:59:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.055+0000 7fa6297fa700 1 -- 172.21.15.6:0/255257922 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa63c09a930 con 0x55fcd9da4850 2023-10-14T08:59:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.056+0000 7fa6297fa700 1 -- 172.21.15.6:0/255257922 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa63c0a3150 con 0x55fcd9da4850 2023-10-14T08:59:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.056+0000 7fa6540c6b80 10 client.25754 fetch_fsmap learned FSMap version 43 2023-10-14T08:59:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.056+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fa6401a7880 con 0x55fcd9da4850 2023-10-14T08:59:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.056+0000 7fa6297fa700 1 -- 172.21.15.6:0/255257922 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa630021070 con 0x55fcd9da4850 2023-10-14T08:59:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.056+0000 7fa6297fa700 1 -- 172.21.15.6:0/255257922 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa63c07e020 con 0x55fcd9da4850 2023-10-14T08:59:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6540c6b80 10 client.25754 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T08:59:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6540c6b80 10 client.25754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6540c6b80 20 client.25754 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9e17640 0x55fcd9e19a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6540c6b80 4 client.25754 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:59:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fcd9cf0df0 con 0x55fcd9e17640 2023-10-14T08:59:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa645477700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9e17640 0x55fcd9e19a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa6297fa700 10 client.25754 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.057+0000 7fa645477700 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9e17640 0x55fcd9e19a60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754c22e5dddf890c server_cookie=289f4973c0a202da in_seq=0 out_seq=0 2023-10-14T08:59:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.146+0000 7fa6297fa700 1 -- 172.21.15.6:0/255257922 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fcd9cf0df0 con 0x55fcd9e17640 2023-10-14T08:59:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.146+0000 7fa6297fa700 10 client.25754 handle_command_reply: tid=0 2023-10-14T08:59:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.146+0000 7fa6540c6b80 1 client.25754 shutdown 2023-10-14T08:59:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.146+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 msgr2=0x55fcd9db9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.146+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 0x55fcd9db9590 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa63c0977e0 tx=0x7fa63c097750 comp rx=0 tx=0).stop 2023-10-14T08:59:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 shutdown_connections 2023-10-14T08:59:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcd9e17640 0x55fcd9e19a60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcd9dbaae0 0x55fcd9db5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcd9da4850 0x55fcd9db9590 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 --2- 172.21.15.6:0/255257922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcd9da60a0 0x55fcd9db9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6297fa700 0 client.25754 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 >> 172.21.15.6:0/255257922 conn(0x55fcd9cd2d70 msgr2=0x55fcd9dad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 shutdown_connections 2023-10-14T08:59:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 1 -- 172.21.15.6:0/255257922 wait complete. 2023-10-14T08:59:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa6540c6b80 20 client.25754 trim_cache size 0 max 16384 2023-10-14T08:59:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:59:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:59:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:59:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:59:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa62c0a1500 msgr2=0x7fa62c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa62c0a1500 0x7fa62c0a39c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa630009c60 tx=0x7fa630009260 comp rx=0 tx=0).stop 2023-10-14T08:59:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 msgr2=0x7fa64019f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64019f3f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00b680 tx=0x7fa63c004730 comp rx=0 tx=0).stop 2023-10-14T08:59:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 shutdown_connections 2023-10-14T08:59:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa62c0a1500 0x7fa62c0a39c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa64010e270 0x7fa6401a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa640108fc0 0x7fa64019f3f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 --2- 172.21.15.6:0/4143939088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64010b8f0 0x7fa64019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 >> 172.21.15.6:0/4143939088 conn(0x7fa64006dcf0 msgr2=0x7fa64010a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.147+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 shutdown_connections 2023-10-14T08:59:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:39.148+0000 7fa647edc700 1 -- 172.21.15.6:0/4143939088 wait complete. 2023-10-14T08:59:39.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:39 smithi178 ceph-mon[103612]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 811 op/s 2023-10-14T08:59:39.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:39 smithi057 ceph-mon[103313]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 811 op/s 2023-10-14T08:59:39.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:39 smithi006 ceph-mon[99452]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 MiB/s wr, 811 op/s 2023-10-14T08:59:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 400.0 s, 1302.2 tps, lat 74.356 ms stddev 125.215 2023-10-14T08:59:41.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:41 smithi178 ceph-mon[103612]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 703 op/s 2023-10-14T08:59:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:41 smithi057 ceph-mon[103313]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 703 op/s 2023-10-14T08:59:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:41 smithi006 ceph-mon[99452]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 703 op/s 2023-10-14T08:59:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:43 smithi178 ceph-mon[103612]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 1.04k op/s 2023-10-14T08:59:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:43 smithi057 ceph-mon[103313]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 1.04k op/s 2023-10-14T08:59:43.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:43 smithi006 ceph-mon[99452]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 MiB/s wr, 1.04k op/s 2023-10-14T08:59:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:45 smithi057 ceph-mon[103313]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 MiB/s wr, 1.42k op/s 2023-10-14T08:59:45.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:45 smithi006 ceph-mon[99452]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 MiB/s wr, 1.42k op/s 2023-10-14T08:59:45.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:45 smithi178 ceph-mon[103612]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 31 MiB/s wr, 1.42k op/s 2023-10-14T08:59:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 405.0 s, 1913.6 tps, lat 54.032 ms stddev 77.898 2023-10-14T08:59:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:47 smithi057 ceph-mon[103313]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 MiB/s wr, 1.89k op/s 2023-10-14T08:59:47.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:47 smithi006 ceph-mon[99452]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 MiB/s wr, 1.89k op/s 2023-10-14T08:59:47.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:47 smithi178 ceph-mon[103612]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 41 MiB/s wr, 1.89k op/s 2023-10-14T08:59:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:49 smithi057 ceph-mon[103313]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 40 MiB/s wr, 1.92k op/s 2023-10-14T08:59:49.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:49 smithi006 ceph-mon[99452]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 40 MiB/s wr, 1.92k op/s 2023-10-14T08:59:49.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:49 smithi178 ceph-mon[103612]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 40 MiB/s wr, 1.92k op/s 2023-10-14T08:59:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 410.0 s, 2202.0 tps, lat 45.588 ms stddev 51.097 2023-10-14T08:59:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:51 smithi057 ceph-mon[103313]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 1.83k op/s 2023-10-14T08:59:51.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:51 smithi006 ceph-mon[99452]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 1.83k op/s 2023-10-14T08:59:51.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:51 smithi178 ceph-mon[103612]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 1.83k op/s 2023-10-14T08:59:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 -- 172.21.15.6:0/980642503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 msgr2=0x7f20f81026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 --2- 172.21.15.6:0/980642503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f81026d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009990 tx=0x7f20e4009ca0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 -- 172.21.15.6:0/980642503 shutdown_connections 2023-10-14T08:59:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 --2- 172.21.15.6:0/980642503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 0x7f20f81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 --2- 172.21.15.6:0/980642503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20f80ff200 0x7f20f80ff620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 --2- 172.21.15.6:0/980642503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f81026d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 -- 172.21.15.6:0/980642503 >> 172.21.15.6:0/980642503 conn(0x7f20f80fab10 msgr2=0x7f20f80fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 -- 172.21.15.6:0/980642503 shutdown_connections 2023-10-14T08:59:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 -- 172.21.15.6:0/980642503 wait complete. 2023-10-14T08:59:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 Processor -- start 2023-10-14T08:59:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.314+0000 7f20fecdf700 1 -- start start 2023-10-14T08:59:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fecdf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20f80ff200 0x7f20f8101be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fecdf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f8100220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fecdf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 0x7f20f8100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fecdf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8100f00 con 0x7f20f8102270 2023-10-14T08:59:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fecdf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8101070 con 0x7f20f8102c10 2023-10-14T08:59:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fecdf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81a0c10 con 0x7f20f80ff200 2023-10-14T08:59:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f8100220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f8100220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34838/0 (socket says 172.21.15.6:34838) 2023-10-14T08:59:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 -- 172.21.15.6:0/315101123 learned_addr learned my addr 172.21.15.6:0/315101123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fd27c700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 0x7f20f8100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fca7b700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20f80ff200 0x7f20f8101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 -- 172.21.15.6:0/315101123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20f80ff200 msgr2=0x7f20f8101be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20f80ff200 0x7f20f8101be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 -- 172.21.15.6:0/315101123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 msgr2=0x7f20f8100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 0x7f20f8100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20f7fff700 1 -- 172.21.15.6:0/315101123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e40095f0 con 0x7f20f8102270 2023-10-14T08:59:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.315+0000 7f20fd27c700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 0x7f20f8100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.316+0000 7f20f7fff700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f8100220 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.317+0000 7f20f5ffb700 1 -- 172.21.15.6:0/315101123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e401d070 con 0x7f20f8102270 2023-10-14T08:59:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.317+0000 7f20f5ffb700 1 -- 172.21.15.6:0/315101123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20e400fc00 con 0x7f20f8102270 2023-10-14T08:59:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.317+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f81a0e90 con 0x7f20f8102270 2023-10-14T08:59:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.317+0000 7f20f5ffb700 1 -- 172.21.15.6:0/315101123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e4017650 con 0x7f20f8102270 2023-10-14T08:59:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.317+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f81a12c0 con 0x7f20f8102270 2023-10-14T08:59:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.321+0000 7f20f5ffb700 1 -- 172.21.15.6:0/315101123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f20e4021410 con 0x7f20f8102270 2023-10-14T08:59:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.321+0000 7f20f5ffb700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f20e80a15d0 0x7f20e80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.321+0000 7f20f5ffb700 1 -- 172.21.15.6:0/315101123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f20e40ce0c0 con 0x7f20f8102270 2023-10-14T08:59:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.321+0000 7f20fca7b700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f20e80a15d0 0x7f20e80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 Processor -- start 2023-10-14T08:59:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 -- start start 2023-10-14T08:59:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fb060 0x563cdd1fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1fb9c0 0x563cdd1fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd167c10 con 0x563cdd1fc8b0 2023-10-14T08:59:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd14cc00 con 0x563cdd1fb060 2023-10-14T08:59:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.322+0000 7f210aec9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd14a520 con 0x563cdd1fb9c0 2023-10-14T08:59:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34846/0 (socket says 172.21.15.6:34846) 2023-10-14T08:59:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 -- 172.21.15.6:0/3385312575 learned_addr learned my addr 172.21.15.6:0/3385312575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 -- 172.21.15.6:0/3385312575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1fb9c0 msgr2=0x563cdd1fc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1fb9c0 0x563cdd1fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 -- 172.21.15.6:0/3385312575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fb060 msgr2=0x563cdd1fb480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:59:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fb060 0x563cdd1fb480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 -- 172.21.15.6:0/3385312575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cdd103390 con 0x563cdd1fc8b0 2023-10-14T08:59:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20fd27c700 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1fcd30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f20f0003e40 tx=0x7f20f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf40e722df4776 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.323+0000 7f20e2ffd700 1 -- 172.21.15.6:0/3385312575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00092d0 con 0x563cdd1fc8b0 2023-10-14T08:59:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f20e2ffd700 1 -- 172.21.15.6:0/3385312575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20f000f040 con 0x563cdd1fc8b0 2023-10-14T08:59:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f20e2ffd700 1 -- 172.21.15.6:0/3385312575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000e870 con 0x563cdd1fc8b0 2023-10-14T08:59:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 -- 172.21.15.6:0/3385312575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 msgr2=0x563cdd1fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1fcd30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f20f0003e40 tx=0x7f20f0009920 comp rx=0 tx=0).stop 2023-10-14T08:59:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 -- 172.21.15.6:0/3385312575 shutdown_connections 2023-10-14T08:59:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1fcd30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fb060 0x563cdd1fb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3385312575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1fb9c0 0x563cdd1fc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.324+0000 7f210aec9b80 1 -- 172.21.15.6:0/3385312575 >> 172.21.15.6:0/3385312575 conn(0x563cdd120d70 msgr2=0x563cdd1edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.325+0000 7f20fca7b700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f20e80a15d0 0x7f20e80a3a90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20f80690f0 tx=0x7f20ec007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.326+0000 7f210aec9b80 1 -- 172.21.15.6:0/3385312575 shutdown_connections 2023-10-14T08:59:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.327+0000 7f210aec9b80 1 -- 172.21.15.6:0/3385312575 wait complete. 2023-10-14T08:59:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.327+0000 7f210aec9b80 1 -- start start 2023-10-14T08:59:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.327+0000 7f210aec9b80 1 Processor -- start 2023-10-14T08:59:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.327+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f210aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd145e10 con 0x563cdd1f4ac0 2023-10-14T08:59:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f210aec9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd0e26b0 con 0x563cdd1fc8b0 2023-10-14T08:59:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f210aec9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd0e2350 con 0x563cdd1f4640 2023-10-14T08:59:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f210aec9b80 10 client.0 _ll_register_callbacks cb 0x563cdcf3f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f20fd27c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f20fd27c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34848/0 (socket says 172.21.15.6:34848) 2023-10-14T08:59:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.328+0000 7f20fd27c700 1 -- 172.21.15.6:0/3119353027 learned_addr learned my addr 172.21.15.6:0/3119353027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20fd27c700 1 -- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 msgr2=0x563cdd1f9670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:59:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20fd27c700 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f9670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20fd27c700 1 -- 172.21.15.6:0/3119353027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 msgr2=0x563cdd1f4100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T08:59:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20fd27c700 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f4100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20fd27c700 1 -- 172.21.15.6:0/3119353027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f0003b20 con 0x563cdd1f4ac0 2023-10-14T08:59:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20fd27c700 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9c10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009b00 tx=0x7f20f00077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89be9a345a35061 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:59:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20d7fff700 1 -- 172.21.15.6:0/3119353027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000e810 con 0x563cdd1f4ac0 2023-10-14T08:59:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f20d7fff700 1 -- 172.21.15.6:0/3119353027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f20f0025070 con 0x563cdd1f4ac0 2023-10-14T08:59:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.329+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cdd14ae90 con 0x563cdd1f4ac0 2023-10-14T08:59:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.330+0000 7f20d7fff700 1 -- 172.21.15.6:0/3119353027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20f000e970 con 0x563cdd1f4ac0 2023-10-14T08:59:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.330+0000 7f210aec9b80 10 client.16164 fetch_fsmap learned FSMap version 43 2023-10-14T08:59:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.330+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563cdcf70d80 con 0x563cdd1f4ac0 2023-10-14T08:59:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f20d7fff700 1 -- 172.21.15.6:0/3119353027 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563cdd14ae90 con 0x563cdd1f4ac0 2023-10-14T08:59:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f20d7fff700 1 -- 172.21.15.6:0/3119353027 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f20f002abd0 con 0x563cdd1f4ac0 2023-10-14T08:59:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f210aec9b80 10 client.16164 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T08:59:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f210aec9b80 10 client.16164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f210aec9b80 20 client.16164 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd219f90 0x563cdd21c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f210aec9b80 4 client.16164 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T08:59:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cdd1c2bb0 con 0x563cdd219f90 2023-10-14T08:59:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f20fca7b700 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd219f90 0x563cdd21c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f20fca7b700 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd219f90 0x563cdd21c3b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02c1b775ed18d7a server_cookie=558cb6d7bc41d4a in_seq=0 out_seq=0 2023-10-14T08:59:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.331+0000 7f20d7fff700 10 client.16164 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f20d7fff700 1 -- 172.21.15.6:0/3119353027 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563cdd1c2bb0 con 0x563cdd219f90 2023-10-14T08:59:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f20d7fff700 10 client.16164 handle_command_reply: tid=0 2023-10-14T08:59:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 client.16164 shutdown 2023-10-14T08:59:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 msgr2=0x563cdd1f9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9c10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009b00 tx=0x7f20f00077e0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 shutdown_connections 2023-10-14T08:59:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd219f90 0x563cdd21c3b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9c10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 --2- 172.21.15.6:0/3119353027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 >> 172.21.15.6:0/3119353027 conn(0x563cdd120d70 msgr2=0x563cdd1ed830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f20d7fff700 0 client.16164 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 shutdown_connections 2023-10-14T08:59:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.332+0000 7f210aec9b80 1 -- 172.21.15.6:0/3119353027 wait complete. 2023-10-14T08:59:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.333+0000 7f210aec9b80 20 client.16164 trim_cache size 0 max 16384 2023-10-14T08:59:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 Processor -- start 2023-10-14T08:59:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 -- start start 2023-10-14T08:59:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdcfc68c0 con 0x563cdd1fc8b0 2023-10-14T08:59:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd14ae90 con 0x563cdd1f4ac0 2023-10-14T08:59:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.351+0000 7f210aec9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd1f52f0 con 0x563cdd1f4640 2023-10-14T08:59:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33610/0 (socket says 172.21.15.6:33610) 2023-10-14T08:59:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20f7fff700 1 -- 172.21.15.6:0/967084824 learned_addr learned my addr 172.21.15.6:0/967084824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fca7b700 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 -- 172.21.15.6:0/967084824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 msgr2=0x563cdd1f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 -- 172.21.15.6:0/967084824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 msgr2=0x563cdd1f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 -- 172.21.15.6:0/967084824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cdcf59c00 con 0x563cdd1fc8b0 2023-10-14T08:59:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20f7fff700 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T08:59:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fca7b700 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T08:59:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20fd27c700 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f9b70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f20f0000f80 tx=0x7f20f00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a4748c7f2ee31f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20e37fe700 1 -- 172.21.15.6:0/967084824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0004c50 con 0x563cdd1fc8b0 2023-10-14T08:59:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20e37fe700 1 -- 172.21.15.6:0/967084824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20f0030030 con 0x563cdd1fc8b0 2023-10-14T08:59:52.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.352+0000 7f20e37fe700 1 -- 172.21.15.6:0/967084824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f002a6e0 con 0x563cdd1fc8b0 2023-10-14T08:59:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.353+0000 7f210aec9b80 1 -- 172.21.15.6:0/967084824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 msgr2=0x563cdd1f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.353+0000 7f210aec9b80 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f9b70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f20f0000f80 tx=0x7f20f00021d0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.355+0000 7f210aec9b80 1 -- 172.21.15.6:0/967084824 shutdown_connections 2023-10-14T08:59:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.355+0000 7f210aec9b80 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f9b70 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.355+0000 7f210aec9b80 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4640 0x563cdd1f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.355+0000 7f210aec9b80 1 --2- 172.21.15.6:0/967084824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.355+0000 7f210aec9b80 1 -- 172.21.15.6:0/967084824 >> 172.21.15.6:0/967084824 conn(0x563cdd120d70 msgr2=0x563cdd1ece30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 -- 172.21.15.6:0/967084824 shutdown_connections 2023-10-14T08:59:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 -- 172.21.15.6:0/967084824 wait complete. 2023-10-14T08:59:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 -- start start 2023-10-14T08:59:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 Processor -- start 2023-10-14T08:59:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 0x563cdd1f7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.356+0000 7f210aec9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f210aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd1f91e0 con 0x563cdd1f4640 2023-10-14T08:59:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f210aec9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd1f9350 con 0x563cdd1fc8b0 2023-10-14T08:59:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f210aec9b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cdd1f9510 con 0x563cdd1f4ac0 2023-10-14T08:59:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f210aec9b80 10 client.0 _ll_register_callbacks cb 0x7f20f0003d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T08:59:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 0x563cdd1f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 0x563cdd1f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34858/0 (socket says 172.21.15.6:34858) 2023-10-14T08:59:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 -- 172.21.15.6:0/1014457928 learned_addr learned my addr 172.21.15.6:0/1014457928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T08:59:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20f7fff700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fd27c700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 -- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4ac0 msgr2=0x563cdd1f7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 -- 172.21.15.6:0/1014457928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 msgr2=0x563cdd1f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T08:59:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 -- 172.21.15.6:0/1014457928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f81a12c0 con 0x563cdd1f4640 2023-10-14T08:59:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20fca7b700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 0x563cdd1f7750 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x563cdd1fbe80 tx=0x7f20ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5de257b1f68847a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T08:59:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T08:59:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20d7fff700 1 -- 172.21.15.6:0/1014457928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004520 con 0x563cdd1f4640 2023-10-14T08:59:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20f000f040 con 0x563cdd1f4640 2023-10-14T08:59:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.357+0000 7f20d7fff700 1 -- 172.21.15.6:0/1014457928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f20ec017070 con 0x563cdd1f4640 2023-10-14T08:59:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f20d7fff700 1 -- 172.21.15.6:0/1014457928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20ec003680 con 0x563cdd1f4640 2023-10-14T08:59:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 10 client.16170 fetch_fsmap learned FSMap version 43 2023-10-14T08:59:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x563cdcf70d80 con 0x563cdd1f4640 2023-10-14T08:59:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f20d7fff700 1 -- 172.21.15.6:0/1014457928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20f000f040 con 0x563cdd1f4640 2023-10-14T08:59:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f20d7fff700 1 -- 172.21.15.6:0/1014457928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f20ec011b10 con 0x563cdd1f4640 2023-10-14T08:59:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 10 client.16170 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T08:59:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 10 client.16170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T08:59:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 20 client.16170 populate_metadata read hostname 'smithi006' 2023-10-14T08:59:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd26ebe0 0x563cdd271000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T08:59:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 4 client.16170 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T08:59:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563cdd13edf0 con 0x563cdd26ebe0 2023-10-14T08:59:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.358+0000 7f20f7fff700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd26ebe0 0x563cdd271000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T08:59:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.359+0000 7f20d7fff700 10 client.16170 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.359+0000 7f20f7fff700 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd26ebe0 0x563cdd271000 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf88285daa06e8e4 server_cookie=609e9cf8982e34af in_seq=0 out_seq=0 2023-10-14T08:59:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f20d7fff700 1 -- 172.21.15.6:0/1014457928 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563cdd13edf0 con 0x563cdd26ebe0 2023-10-14T08:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f20d7fff700 10 client.16170 handle_command_reply: tid=0 2023-10-14T08:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 client.16170 shutdown 2023-10-14T08:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 msgr2=0x563cdd1f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 0x563cdd1f7750 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x563cdd1fbe80 tx=0x7f20ec0047c0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 shutdown_connections 2023-10-14T08:59:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x563cdd26ebe0 0x563cdd271000 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563cdd1fc8b0 0x563cdd1f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f20d7fff700 0 client.16170 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T08:59:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563cdd1f4640 0x563cdd1f7750 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 --2- 172.21.15.6:0/1014457928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cdd1f4ac0 0x563cdd1f7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 >> 172.21.15.6:0/1014457928 conn(0x563cdd120d70 msgr2=0x563cdd1f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 shutdown_connections 2023-10-14T08:59:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 1 -- 172.21.15.6:0/1014457928 wait complete. 2023-10-14T08:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.462+0000 7f210aec9b80 20 client.16170 trim_cache size 0 max 16384 2023-10-14T08:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T08:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T08:59:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T08:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T08:59:52.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f20e80a15d0 msgr2=0x7f20e80a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f20e80a15d0 0x7f20e80a3a90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20f80690f0 tx=0x7f20ec007400 comp rx=0 tx=0).stop 2023-10-14T08:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 msgr2=0x7f20f8100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T08:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f8100220 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e400f460 comp rx=0 tx=0).stop 2023-10-14T08:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 shutdown_connections 2023-10-14T08:59:52.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f20e80a15d0 0x7f20e80a3a90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20f8102c10 0x7f20f8100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20f80ff200 0x7f20f8101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 --2- 172.21.15.6:0/315101123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f8102270 0x7f20f8100220 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T08:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 >> 172.21.15.6:0/315101123 conn(0x7f20f80fab10 msgr2=0x7f20f80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T08:59:52.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 shutdown_connections 2023-10-14T08:59:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T08:59:52.463+0000 7f20fecdf700 1 -- 172.21.15.6:0/315101123 wait complete. 2023-10-14T08:59:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:53 smithi006 ceph-mon[99452]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 1.88k op/s 2023-10-14T08:59:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:53 smithi178 ceph-mon[103612]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 1.88k op/s 2023-10-14T08:59:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:53 smithi057 ceph-mon[103313]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 1.88k op/s 2023-10-14T08:59:55.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:55 smithi006 ceph-mon[99452]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2023-10-14T08:59:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:55 smithi178 ceph-mon[103612]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2023-10-14T08:59:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:55 smithi057 ceph-mon[103313]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2023-10-14T08:59:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 415.0 s, 1822.4 tps, lat 54.257 ms stddev 62.312 2023-10-14T08:59:57.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:57 smithi178 ceph-mon[103612]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 MiB/s wr, 1.16k op/s 2023-10-14T08:59:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:57 smithi057 ceph-mon[103313]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 MiB/s wr, 1.16k op/s 2023-10-14T08:59:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:57 smithi006 ceph-mon[99452]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 25 MiB/s wr, 1.16k op/s 2023-10-14T08:59:59.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 08:59:59 smithi178 ceph-mon[103612]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 712 op/s 2023-10-14T08:59:59.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 08:59:59 smithi057 ceph-mon[103313]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 712 op/s 2023-10-14T08:59:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 08:59:59 smithi006 ceph-mon[99452]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 14 MiB/s wr, 712 op/s 2023-10-14T09:00:00.317 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:00 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T08:59:59.999+0000 7f9827670700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-14T09:00:00.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:00 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T08:59:59.999+0000 7f9827670700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-14T09:00:00.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:00 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T08:59:59.999+0000 7f9827670700 -1 log_channel(cluster) log [ERR] : mds.b(mds.1): Metadata damage detected 2023-10-14T09:00:00.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:00 smithi006 ceph-mon[99452]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-14T09:00:00.318 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:00 smithi006 ceph-mon[99452]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-14T09:00:00.319 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:00 smithi006 ceph-mon[99452]: mds.b(mds.1): Metadata damage detected 2023-10-14T09:00:00.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:00 smithi178 ceph-mon[103612]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-14T09:00:00.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:00 smithi178 ceph-mon[103612]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-14T09:00:00.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:00 smithi178 ceph-mon[103612]: mds.b(mds.1): Metadata damage detected 2023-10-14T09:00:00.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:00 smithi057 ceph-mon[103313]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-10-14T09:00:00.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:00 smithi057 ceph-mon[103313]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-10-14T09:00:00.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:00 smithi057 ceph-mon[103313]: mds.b(mds.1): Metadata damage detected 2023-10-14T09:00:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 420.0 s, 2238.4 tps, lat 45.235 ms stddev 52.929 2023-10-14T09:00:01.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:01 smithi178 ceph-mon[103612]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 617 op/s 2023-10-14T09:00:01.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:01 smithi057 ceph-mon[103313]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 617 op/s 2023-10-14T09:00:01.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:01 smithi006 ceph-mon[99452]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 617 op/s 2023-10-14T09:00:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:03 smithi178 ceph-mon[103612]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 684 op/s 2023-10-14T09:00:03.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:03 smithi057 ceph-mon[103313]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 684 op/s 2023-10-14T09:00:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:03 smithi006 ceph-mon[99452]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 684 op/s 2023-10-14T09:00:05.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 -- 172.21.15.6:0/550529140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 msgr2=0x7f5e2810f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 --2- 172.21.15.6:0/550529140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e2810f8b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009f90 tx=0x7f5e2000b330 comp rx=0 tx=0).stop 2023-10-14T09:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 -- 172.21.15.6:0/550529140 shutdown_connections 2023-10-14T09:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 --2- 172.21.15.6:0/550529140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e2810f8b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 --2- 172.21.15.6:0/550529140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28074ef0 0x7f5e28073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 --2- 172.21.15.6:0/550529140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28073910 0x7f5e28073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 -- 172.21.15.6:0/550529140 >> 172.21.15.6:0/550529140 conn(0x7f5e280fc460 msgr2=0x7f5e280fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 -- 172.21.15.6:0/550529140 shutdown_connections 2023-10-14T09:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.623+0000 7f5e302d6700 1 -- 172.21.15.6:0/550529140 wait complete. 2023-10-14T09:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 Processor -- start 2023-10-14T09:00:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 -- start start 2023-10-14T09:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28073910 0x7f5e2819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 0x7f5e2819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e281a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281a4e30 con 0x7f5e28074ef0 2023-10-14T09:00:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281a4f70 con 0x7f5e28073910 2023-10-14T09:00:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e302d6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281a5100 con 0x7f5e2810d4c0 2023-10-14T09:00:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e2d871700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 0x7f5e2819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e2d871700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 0x7f5e2819d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34882/0 (socket says 172.21.15.6:34882) 2023-10-14T09:00:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e2d871700 1 -- 172.21.15.6:0/1495172413 learned_addr learned my addr 172.21.15.6:0/1495172413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28073910 0x7f5e2819d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.624+0000 7f5e2e873700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e281a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2d871700 1 -- 172.21.15.6:0/1495172413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 msgr2=0x7f5e281a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2d871700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e281a4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2d871700 1 -- 172.21.15.6:0/1495172413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28073910 msgr2=0x7f5e2819d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2d871700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28073910 0x7f5e2819d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2d871700 1 -- 172.21.15.6:0/1495172413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20009c40 con 0x7f5e28074ef0 2023-10-14T09:00:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2e873700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e281a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:00:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28073910 0x7f5e2819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e2d871700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 0x7f5e2819d840 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800e9f0 tx=0x7f5e1800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e1f7fe700 1 -- 172.21.15.6:0/1495172413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18004220 con 0x7f5e28074ef0 2023-10-14T09:00:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e1f7fe700 1 -- 172.21.15.6:0/1495172413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e18004380 con 0x7f5e28074ef0 2023-10-14T09:00:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e281a53e0 con 0x7f5e28074ef0 2023-10-14T09:00:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e1f7fe700 1 -- 172.21.15.6:0/1495172413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18003c00 con 0x7f5e28074ef0 2023-10-14T09:00:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.625+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e281a58f0 con 0x7f5e28074ef0 2023-10-14T09:00:05.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:05 smithi178 ceph-mon[103612]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 692 op/s 2023-10-14T09:00:05.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.628+0000 7f5e1f7fe700 1 -- 172.21.15.6:0/1495172413 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f5e1800c7c0 con 0x7f5e28074ef0 2023-10-14T09:00:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.628+0000 7f5e1f7fe700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5e140a1480 0x7f5e140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.629+0000 7f5e1f7fe700 1 -- 172.21.15.6:0/1495172413 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5e18014070 con 0x7f5e28074ef0 2023-10-14T09:00:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.629+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5e140a1480 0x7f5e140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.629+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5e140a1480 0x7f5e140a3940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e24011490 tx=0x7f5e24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.629+0000 7f5e3c4c0b80 1 Processor -- start 2023-10-14T09:00:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.629+0000 7f5e3c4c0b80 1 -- start start 2023-10-14T09:00:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b465c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b466ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b467520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b3dac10 con 0x55d73b4670a0 2023-10-14T09:00:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b3bfc00 con 0x55d73b4661b0 2023-10-14T09:00:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b3bd520 con 0x55d73b465850 2023-10-14T09:00:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b467520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b467520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34892/0 (socket says 172.21.15.6:34892) 2023-10-14T09:00:05.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 -- 172.21.15.6:0/59219105 learned_addr learned my addr 172.21.15.6:0/59219105 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e072700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b465c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2d871700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b466ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 -- 172.21.15.6:0/59219105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 msgr2=0x55d73b465c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b465c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 -- 172.21.15.6:0/59219105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 msgr2=0x55d73b466ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b466ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 -- 172.21.15.6:0/59219105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d73b376390 con 0x55d73b4670a0 2023-10-14T09:00:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2d871700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b466ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:00:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e072700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b465c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:05.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.630+0000 7f5e2e873700 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b467520 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5e200093c0 tx=0x7f5e200093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7e086be6bf791c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.631+0000 7f5e1cd82700 1 -- 172.21.15.6:0/59219105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000e070 con 0x55d73b4670a0 2023-10-14T09:00:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.631+0000 7f5e1cd82700 1 -- 172.21.15.6:0/59219105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e20007520 con 0x55d73b4670a0 2023-10-14T09:00:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.631+0000 7f5e1cd82700 1 -- 172.21.15.6:0/59219105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000bcc0 con 0x55d73b4670a0 2023-10-14T09:00:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/59219105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 msgr2=0x55d73b467520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b467520 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5e200093c0 tx=0x7f5e200093f0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/59219105 shutdown_connections 2023-10-14T09:00:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b467520 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b465c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/59219105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b466ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/59219105 >> 172.21.15.6:0/59219105 conn(0x55d73b393d70 msgr2=0x55d73b460c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/59219105 shutdown_connections 2023-10-14T09:00:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.633+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/59219105 wait complete. 2023-10-14T09:00:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 -- start start 2023-10-14T09:00:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 Processor -- start 2023-10-14T09:00:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b465850 0x55d73b46f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4661b0 0x55d73b46fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b476ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b3b8e10 con 0x55d73b4670a0 2023-10-14T09:00:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b3556b0 con 0x55d73b465850 2023-10-14T09:00:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b355350 con 0x55d73b4661b0 2023-10-14T09:00:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e3c4c0b80 10 client.0 _ll_register_callbacks cb 0x55d73b1b27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.634+0000 7f5e2e873700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b476ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e873700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b476ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34898/0 (socket says 172.21.15.6:34898) 2023-10-14T09:00:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b465850 0x55d73b46f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e873700 1 -- 172.21.15.6:0/1948490737 learned_addr learned my addr 172.21.15.6:0/1948490737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2d871700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4661b0 0x55d73b46fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 -- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4661b0 msgr2=0x55d73b46fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4661b0 0x55d73b46fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 -- 172.21.15.6:0/1948490737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 msgr2=0x55d73b476ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b476ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 -- 172.21.15.6:0/1948490737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e24017070 con 0x55d73b465850 2023-10-14T09:00:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e873700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b476ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e2e072700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b465850 0x55d73b46f720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005c30 tx=0x7f5e240047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33a57aba9bcdf1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:00:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e11ffb700 1 -- 172.21.15.6:0/1948490737 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2401f9d0 con 0x55d73b465850 2023-10-14T09:00:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e11ffb700 1 -- 172.21.15.6:0/1948490737 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5e2401fb30 con 0x55d73b465850 2023-10-14T09:00:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.635+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d73b3bde90 con 0x55d73b465850 2023-10-14T09:00:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e11ffb700 1 -- 172.21.15.6:0/1948490737 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e2401fcf0 con 0x55d73b465850 2023-10-14T09:00:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 10 client.25778 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f5e28110260 con 0x55d73b465850 2023-10-14T09:00:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e11ffb700 1 -- 172.21.15.6:0/1948490737 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d73b3bde90 con 0x55d73b465850 2023-10-14T09:00:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e11ffb700 1 -- 172.21.15.6:0/1948490737 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5e24032400 con 0x55d73b465850 2023-10-14T09:00:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 10 client.25778 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 10 client.25778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 20 client.25778 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b47b580 0x55d73b47d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 4 client.25778 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:00:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d73b435bb0 con 0x55d73b47b580 2023-10-14T09:00:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.636+0000 7f5e2d871700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b47b580 0x55d73b47d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.637+0000 7f5e11ffb700 10 client.25778 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.637+0000 7f5e2d871700 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b47b580 0x55d73b47d9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab758c5eb6e4e79 server_cookie=985a4fb840e8dca7 in_seq=0 out_seq=0 2023-10-14T09:00:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.637+0000 7f5e11ffb700 1 -- 172.21.15.6:0/1948490737 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d73b435bb0 con 0x55d73b47b580 2023-10-14T09:00:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.637+0000 7f5e11ffb700 10 client.25778 handle_command_reply: tid=0 2023-10-14T09:00:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.637+0000 7f5e3c4c0b80 1 client.25778 shutdown 2023-10-14T09:00:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b465850 msgr2=0x55d73b46f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b465850 0x55d73b46f720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e24005c30 tx=0x7f5e240047c0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 shutdown_connections 2023-10-14T09:00:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b47b580 0x55d73b47d9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b4670a0 0x55d73b476ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b465850 0x55d73b46f720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e11ffb700 0 client.25778 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/1948490737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4661b0 0x55d73b46fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 >> 172.21.15.6:0/1948490737 conn(0x55d73b393d70 msgr2=0x55d73b460830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 shutdown_connections 2023-10-14T09:00:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/1948490737 wait complete. 2023-10-14T09:00:05.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.638+0000 7f5e3c4c0b80 20 client.25778 trim_cache size 0 max 16384 2023-10-14T09:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 Processor -- start 2023-10-14T09:00:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 -- start start 2023-10-14T09:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b465850 0x55d73b4674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b476c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4670a0 0x55d73b46d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b2398c0 con 0x55d73b465850 2023-10-14T09:00:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b466950 con 0x55d73b4661b0 2023-10-14T09:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b4604b0 con 0x55d73b4670a0 2023-10-14T09:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2e072700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b465850 0x55d73b4674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2d871700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b476c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2e072700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b465850 0x55d73b4674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34902/0 (socket says 172.21.15.6:34902) 2023-10-14T09:00:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2e072700 1 -- 172.21.15.6:0/3516243612 learned_addr learned my addr 172.21.15.6:0/3516243612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2e873700 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4670a0 0x55d73b46d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2d871700 1 -- 172.21.15.6:0/3516243612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4670a0 msgr2=0x55d73b46d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2d871700 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4670a0 0x55d73b46d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2d871700 1 -- 172.21.15.6:0/3516243612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b465850 msgr2=0x55d73b4674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.660+0000 7f5e2d871700 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b465850 0x55d73b4674a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.661+0000 7f5e2d871700 1 -- 172.21.15.6:0/3516243612 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d73b1e3d80 con 0x55d73b4661b0 2023-10-14T09:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.661+0000 7f5e2e873700 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4670a0 0x55d73b46d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.661+0000 7f5e2d871700 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b476c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cabd0 tx=0x7f5e18003fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e3c7f8c32c3f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.662+0000 7f5e1d583700 1 -- 172.21.15.6:0/3516243612 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1809a3f0 con 0x55d73b4661b0 2023-10-14T09:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.662+0000 7f5e1d583700 1 -- 172.21.15.6:0/3516243612 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1809e540 con 0x55d73b4661b0 2023-10-14T09:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.662+0000 7f5e1d583700 1 -- 172.21.15.6:0/3516243612 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1809e0c0 con 0x55d73b4661b0 2023-10-14T09:00:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/3516243612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 msgr2=0x55d73b476c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b476c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cabd0 tx=0x7f5e18003fb0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/3516243612 shutdown_connections 2023-10-14T09:00:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b4670a0 0x55d73b46d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b465850 0x55d73b4674a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/3516243612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4661b0 0x55d73b476c30 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cabd0 tx=0x7f5e18003fb0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/3516243612 >> 172.21.15.6:0/3516243612 conn(0x55d73b393d70 msgr2=0x55d73b46e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/3516243612 shutdown_connections 2023-10-14T09:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.663+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/3516243612 wait complete. 2023-10-14T09:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 -- start start 2023-10-14T09:00:05.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 Processor -- start 2023-10-14T09:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b474470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4670a0 0x55d73b4749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b47b580 0x55d73b4759c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b475f00 con 0x55d73b47b580 2023-10-14T09:00:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b476070 con 0x55d73b4670a0 2023-10-14T09:00:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73b476230 con 0x55d73b465850 2023-10-14T09:00:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e3c4c0b80 10 client.0 _ll_register_callbacks cb 0x7f5e240045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e2d871700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4670a0 0x55d73b4749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e2e072700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b474470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e2d871700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4670a0 0x55d73b4749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33668/0 (socket says 172.21.15.6:33668) 2023-10-14T09:00:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e2e873700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b47b580 0x55d73b4759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.664+0000 7f5e2d871700 1 -- 172.21.15.6:0/2302639668 learned_addr learned my addr 172.21.15.6:0/2302639668 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e2e072700 1 -- 172.21.15.6:0/2302639668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4670a0 msgr2=0x55d73b4749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e2e072700 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4670a0 0x55d73b4749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e2e072700 1 -- 172.21.15.6:0/2302639668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b47b580 msgr2=0x55d73b4759c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e2e072700 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b47b580 0x55d73b4759c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e2e072700 1 -- 172.21.15.6:0/2302639668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d73b376390 con 0x55d73b465850 2023-10-14T09:00:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e2e072700 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b474470 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e240097c0 tx=0x7f5e24032630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c26df2e677dec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:00:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e11ffb700 1 -- 172.21.15.6:0/2302639668 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24032bd0 con 0x55d73b465850 2023-10-14T09:00:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e20007520 con 0x55d73b465850 2023-10-14T09:00:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e11ffb700 1 -- 172.21.15.6:0/2302639668 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f5e2402e030 con 0x55d73b465850 2023-10-14T09:00:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e11ffb700 1 -- 172.21.15.6:0/2302639668 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e24032d30 con 0x55d73b465850 2023-10-14T09:00:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e3c4c0b80 10 client.25822 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.665+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7f5e281a58f0 con 0x55d73b465850 2023-10-14T09:00:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e11ffb700 1 -- 172.21.15.6:0/2302639668 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e20007520 con 0x55d73b465850 2023-10-14T09:00:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e11ffb700 1 -- 172.21.15.6:0/2302639668 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5e2403b5e0 con 0x55d73b465850 2023-10-14T09:00:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e3c4c0b80 10 client.25822 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e3c4c0b80 10 client.25822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e3c4c0b80 20 client.25822 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b4cfd00 0x55d73b4d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e3c4c0b80 4 client.25822 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:00:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d73b3b1df0 con 0x55d73b4cfd00 2023-10-14T09:00:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e2d871700 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b4cfd00 0x55d73b4d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.666+0000 7f5e11ffb700 10 client.25822 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.667+0000 7f5e2d871700 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b4cfd00 0x55d73b4d2120 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65c4be5f984b96bd server_cookie=84a240ff5e2b9a4d in_seq=0 out_seq=0 2023-10-14T09:00:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.683+0000 7f5e11ffb700 1 -- 172.21.15.6:0/2302639668 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d73b3b1df0 con 0x55d73b4cfd00 2023-10-14T09:00:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.683+0000 7f5e11ffb700 10 client.25822 handle_command_reply: tid=0 2023-10-14T09:00:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.683+0000 7f5e3c4c0b80 1 client.25822 shutdown 2023-10-14T09:00:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 msgr2=0x55d73b474470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b474470 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e240097c0 tx=0x7f5e24032630 comp rx=0 tx=0).stop 2023-10-14T09:00:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 shutdown_connections 2023-10-14T09:00:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55d73b4cfd00 0x55d73b4d2120 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d73b47b580 0x55d73b4759c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d73b465850 0x55d73b474470 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e11ffb700 0 client.25822 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 --2- 172.21.15.6:0/2302639668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d73b4670a0 0x55d73b4749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 >> 172.21.15.6:0/2302639668 conn(0x55d73b393d70 msgr2=0x55d73b46d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 shutdown_connections 2023-10-14T09:00:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 1 -- 172.21.15.6:0/2302639668 wait complete. 2023-10-14T09:00:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e3c4c0b80 20 client.25822 trim_cache size 0 max 16384 2023-10-14T09:00:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:00:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:00:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:00:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:00:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5e140a1480 msgr2=0x7f5e140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5e140a1480 0x7f5e140a3940 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e24011490 tx=0x7f5e24009260 comp rx=0 tx=0).stop 2023-10-14T09:00:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 msgr2=0x7f5e2819d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 0x7f5e2819d840 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800e9f0 tx=0x7f5e1800ed00 comp rx=0 tx=0).stop 2023-10-14T09:00:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 shutdown_connections 2023-10-14T09:00:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e2810d4c0 0x7f5e281a4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f5e140a1480 0x7f5e140a3940 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e28073910 0x7f5e2819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 --2- 172.21.15.6:0/1495172413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e28074ef0 0x7f5e2819d840 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.684+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 >> 172.21.15.6:0/1495172413 conn(0x7f5e280fc460 msgr2=0x7f5e280fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.685+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 shutdown_connections 2023-10-14T09:00:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:05.685+0000 7f5e302d6700 1 -- 172.21.15.6:0/1495172413 wait complete. 2023-10-14T09:00:05.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:05 smithi057 ceph-mon[103313]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 692 op/s 2023-10-14T09:00:05.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:05 smithi006 ceph-mon[99452]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 MiB/s wr, 692 op/s 2023-10-14T09:00:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 425.0 s, 1981.4 tps, lat 49.685 ms stddev 53.236 2023-10-14T09:00:07.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:07 smithi057 ceph-mon[103313]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 707 op/s 2023-10-14T09:00:07.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:07 smithi006 ceph-mon[99452]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 707 op/s 2023-10-14T09:00:07.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:07 smithi178 ceph-mon[103612]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 707 op/s 2023-10-14T09:00:09.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:09 smithi057 ceph-mon[103313]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 698 op/s 2023-10-14T09:00:09.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:09 smithi006 ceph-mon[99452]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 698 op/s 2023-10-14T09:00:09.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:09 smithi178 ceph-mon[103612]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 698 op/s 2023-10-14T09:00:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 430.0 s, 1323.8 tps, lat 76.086 ms stddev 94.703 2023-10-14T09:00:11.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:11 smithi057 ceph-mon[103313]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 662 op/s 2023-10-14T09:00:11.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:11 smithi006 ceph-mon[99452]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 662 op/s 2023-10-14T09:00:11.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:11 smithi178 ceph-mon[103612]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 662 op/s 2023-10-14T09:00:13.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:13 smithi057 ceph-mon[103313]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 793 op/s 2023-10-14T09:00:13.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:13 smithi006 ceph-mon[99452]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 793 op/s 2023-10-14T09:00:13.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:13 smithi178 ceph-mon[103612]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 793 op/s 2023-10-14T09:00:15.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:15 smithi057 ceph-mon[103313]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 830 op/s 2023-10-14T09:00:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:15 smithi006 ceph-mon[99452]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 830 op/s 2023-10-14T09:00:15.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:15 smithi178 ceph-mon[103612]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 18 MiB/s wr, 830 op/s 2023-10-14T09:00:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 435.0 s, 1530.2 tps, lat 65.320 ms stddev 80.813 2023-10-14T09:00:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:17 smithi006 ceph-mon[99452]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 866 op/s 2023-10-14T09:00:17.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:17 smithi178 ceph-mon[103612]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 866 op/s 2023-10-14T09:00:17.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:17 smithi057 ceph-mon[103313]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 866 op/s 2023-10-14T09:00:18.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.876+0000 7fb642593700 1 -- 172.21.15.6:0/1764861794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 msgr2=0x7fb63c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.876+0000 7fb642593700 1 --2- 172.21.15.6:0/1764861794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c10a2e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb630009990 tx=0x7fb630009ca0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.877+0000 7fb642593700 1 -- 172.21.15.6:0/1764861794 shutdown_connections 2023-10-14T09:00:18.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.877+0000 7fb642593700 1 --2- 172.21.15.6:0/1764861794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb63c10d1f0 0x7fb63c10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.877+0000 7fb642593700 1 --2- 172.21.15.6:0/1764861794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c10a2e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.877+0000 7fb642593700 1 --2- 172.21.15.6:0/1764861794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 0x7fb63c10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.877+0000 7fb642593700 1 -- 172.21.15.6:0/1764861794 >> 172.21.15.6:0/1764861794 conn(0x7fb63c06dcf0 msgr2=0x7fb63c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:18.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.878+0000 7fb642593700 1 -- 172.21.15.6:0/1764861794 shutdown_connections 2023-10-14T09:00:18.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.881+0000 7fb642593700 1 -- 172.21.15.6:0/1764861794 wait complete. 2023-10-14T09:00:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 Processor -- start 2023-10-14T09:00:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 -- start start 2023-10-14T09:00:18.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c1a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 0x7fb63c1a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb63c10d1f0 0x7fb63c1acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1ad560 con 0x7fb63c107eb0 2023-10-14T09:00:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1ad6a0 con 0x7fb63c10d1f0 2023-10-14T09:00:18.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.882+0000 7fb642593700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1ad830 con 0x7fb63c10a820 2023-10-14T09:00:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.885+0000 7fb63b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 0x7fb63c1a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.885+0000 7fb63b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 0x7fb63c1a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60556/0 (socket says 172.21.15.6:60556) 2023-10-14T09:00:18.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.885+0000 7fb63b7fe700 1 -- 172.21.15.6:0/468706343 learned_addr learned my addr 172.21.15.6:0/468706343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:18.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c1a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb640b30700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb63c10d1f0 0x7fb63c1acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 -- 172.21.15.6:0/468706343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 msgr2=0x7fb63c1a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 0x7fb63c1a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 -- 172.21.15.6:0/468706343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb63c10d1f0 msgr2=0x7fb63c1acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb63c10d1f0 0x7fb63c1acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 -- 172.21.15.6:0/468706343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300095f0 con 0x7fb63c107eb0 2023-10-14T09:00:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.887+0000 7fb63bfff700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c1a59e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb630000c00 tx=0x7fb63000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:18.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.888+0000 7fb6397fa700 1 -- 172.21.15.6:0/468706343 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63001d070 con 0x7fb63c107eb0 2023-10-14T09:00:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.888+0000 7fb6397fa700 1 -- 172.21.15.6:0/468706343 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb630004cf0 con 0x7fb63c107eb0 2023-10-14T09:00:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.888+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c1adab0 con 0x7fb63c107eb0 2023-10-14T09:00:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.888+0000 7fb6397fa700 1 -- 172.21.15.6:0/468706343 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630005490 con 0x7fb63c107eb0 2023-10-14T09:00:18.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.888+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c1ade70 con 0x7fb63c107eb0 2023-10-14T09:00:18.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.891+0000 7fb6397fa700 1 -- 172.21.15.6:0/468706343 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fb63000fb80 con 0x7fb63c107eb0 2023-10-14T09:00:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.892+0000 7fb6397fa700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6240a1500 0x7fb6240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.892+0000 7fb6397fa700 1 -- 172.21.15.6:0/468706343 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6300ce030 con 0x7fb63c107eb0 2023-10-14T09:00:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 Processor -- start 2023-10-14T09:00:18.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 -- start start 2023-10-14T09:00:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x563953546c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 0x563953547ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x563953548520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639534bbc10 con 0x5639535471b0 2023-10-14T09:00:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639534a0c00 con 0x563953546850 2023-10-14T09:00:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb64e77db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395349e520 con 0x5639535480a0 2023-10-14T09:00:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb63bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x563953546c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb63bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x563953546c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33688/0 (socket says 172.21.15.6:33688) 2023-10-14T09:00:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.893+0000 7fb63bfff700 1 -- 172.21.15.6:0/2237396065 learned_addr learned my addr 172.21.15.6:0/2237396065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.894+0000 7fb63bfff700 1 -- 172.21.15.6:0/2237396065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 msgr2=0x563953548520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.894+0000 7fb63bfff700 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x563953548520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.894+0000 7fb63bfff700 1 -- 172.21.15.6:0/2237396065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 msgr2=0x563953547ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.894+0000 7fb63bfff700 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 0x563953547ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.894+0000 7fb63bfff700 1 -- 172.21.15.6:0/2237396065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563953457390 con 0x563953546850 2023-10-14T09:00:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.894+0000 7fb63bfff700 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x563953546c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb63009b330 tx=0x7fb630009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db45b7450ef2ba5a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.895+0000 7fb6227fc700 1 -- 172.21.15.6:0/2237396065 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63009b3a0 con 0x563953546850 2023-10-14T09:00:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.895+0000 7fb6227fc700 1 -- 172.21.15.6:0/2237396065 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6300b1070 con 0x563953546850 2023-10-14T09:00:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.895+0000 7fb6227fc700 1 -- 172.21.15.6:0/2237396065 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63009b600 con 0x563953546850 2023-10-14T09:00:18.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.895+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6240a1500 0x7fb6240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 -- 172.21.15.6:0/2237396065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 msgr2=0x563953546c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6240a1500 0x7fb6240a39c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00cd20 tx=0x7fb62c00c330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x563953546c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb63009b330 tx=0x7fb630009ee0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 -- 172.21.15.6:0/2237396065 shutdown_connections 2023-10-14T09:00:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x563953548520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x563953546c70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2237396065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 0x563953547ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 -- 172.21.15.6:0/2237396065 >> 172.21.15.6:0/2237396065 conn(0x563953474d70 msgr2=0x563953541c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 -- 172.21.15.6:0/2237396065 shutdown_connections 2023-10-14T09:00:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 -- 172.21.15.6:0/2237396065 wait complete. 2023-10-14T09:00:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.896+0000 7fb64e77db80 1 -- start start 2023-10-14T09:00:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 Processor -- start 2023-10-14T09:00:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535480a0 0x563953557920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563953499e10 con 0x5639535480a0 2023-10-14T09:00:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639534366b0 con 0x5639535471b0 2023-10-14T09:00:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563953436350 con 0x563953546850 2023-10-14T09:00:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb64e77db80 10 client.0 _ll_register_callbacks cb 0x5639532937a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb63b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb63b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33696/0 (socket says 172.21.15.6:33696) 2023-10-14T09:00:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb63b7fe700 1 -- 172.21.15.6:0/2803343496 learned_addr learned my addr 172.21.15.6:0/2803343496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.897+0000 7fb640b30700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535480a0 0x563953557920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb63b7fe700 1 -- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563953546850 msgr2=0x5639535503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb63b7fe700 1 -- 172.21.15.6:0/2803343496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535480a0 msgr2=0x563953557920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535480a0 0x563953557920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb63b7fe700 1 -- 172.21.15.6:0/2803343496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c1ade70 con 0x5639535471b0 2023-10-14T09:00:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb640b30700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535480a0 0x563953557920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:00:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535508e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb62c004800 tx=0x7fb62c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70d077d34996a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb61b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:00:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb61b7fe700 1 -- 172.21.15.6:0/2803343496 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c01b810 con 0x5639535471b0 2023-10-14T09:00:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb61b7fe700 1 -- 172.21.15.6:0/2803343496 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb62c00ce60 con 0x5639535471b0 2023-10-14T09:00:18.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.898+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56395349ee90 con 0x5639535471b0 2023-10-14T09:00:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb61b7fe700 1 -- 172.21.15.6:0/2803343496 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb62c01b970 con 0x5639535471b0 2023-10-14T09:00:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 10 client.25796 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5639532c4d80 con 0x5639535471b0 2023-10-14T09:00:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb61b7fe700 1 -- 172.21.15.6:0/2803343496 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56395349ee90 con 0x5639535471b0 2023-10-14T09:00:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb61b7fe700 1 -- 172.21.15.6:0/2803343496 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb62c024d10 con 0x5639535471b0 2023-10-14T09:00:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 10 client.25796 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 20 client.25796 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56395355c250 0x56395355e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 4 client.25796 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:00:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.899+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563953516bb0 con 0x56395355c250 2023-10-14T09:00:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.900+0000 7fb63bfff700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56395355c250 0x56395355e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.901+0000 7fb61b7fe700 10 client.25796 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.901+0000 7fb63bfff700 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56395355c250 0x56395355e670 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d304f1788a7969 server_cookie=fe384ced4ba79c0e in_seq=0 out_seq=0 2023-10-14T09:00:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.901+0000 7fb61b7fe700 1 -- 172.21.15.6:0/2803343496 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563953516bb0 con 0x56395355c250 2023-10-14T09:00:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.901+0000 7fb61b7fe700 10 client.25796 handle_command_reply: tid=0 2023-10-14T09:00:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.901+0000 7fb64e77db80 1 client.25796 shutdown 2023-10-14T09:00:18.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 msgr2=0x5639535508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535508e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb62c004800 tx=0x7fb62c00b260 comp rx=0 tx=0).stop 2023-10-14T09:00:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 shutdown_connections 2023-10-14T09:00:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56395355c250 0x56395355e670 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535480a0 0x563953557920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb61b7fe700 0 client.25796 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 --2- 172.21.15.6:0/2803343496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535508e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 >> 172.21.15.6:0/2803343496 conn(0x563953474d70 msgr2=0x563953541830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 shutdown_connections 2023-10-14T09:00:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 1 -- 172.21.15.6:0/2803343496 wait complete. 2023-10-14T09:00:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.902+0000 7fb64e77db80 20 client.25796 trim_cache size 0 max 16384 2023-10-14T09:00:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.924+0000 7fb64e77db80 1 Processor -- start 2023-10-14T09:00:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 -- start start 2023-10-14T09:00:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 0x5639535578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395331a8c0 con 0x5639535471b0 2023-10-14T09:00:18.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56395354f6b0 con 0x563953546850 2023-10-14T09:00:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb64e77db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563953559610 con 0x5639535480a0 2023-10-14T09:00:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb63bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb640b30700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb63bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33702/0 (socket says 172.21.15.6:33702) 2023-10-14T09:00:18.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb63bfff700 1 -- 172.21.15.6:0/492189478 learned_addr learned my addr 172.21.15.6:0/492189478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb640b30700 1 -- 172.21.15.6:0/492189478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 msgr2=0x5639535503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb640b30700 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb640b30700 1 -- 172.21.15.6:0/492189478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 msgr2=0x5639535578e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:00:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb640b30700 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 0x5639535578e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.925+0000 7fb640b30700 1 -- 172.21.15.6:0/492189478 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639532adc00 con 0x5639535480a0 2023-10-14T09:00:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.926+0000 7fb640b30700 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535508e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb6340060b0 tx=0x7fb634009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd8f7a62d71d6cf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.926+0000 7fb622ffd700 1 -- 172.21.15.6:0/492189478 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634007bd0 con 0x5639535480a0 2023-10-14T09:00:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.926+0000 7fb622ffd700 1 -- 172.21.15.6:0/492189478 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb63400f070 con 0x5639535480a0 2023-10-14T09:00:18.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.926+0000 7fb622ffd700 1 -- 172.21.15.6:0/492189478 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340145b0 con 0x5639535480a0 2023-10-14T09:00:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 -- 172.21.15.6:0/492189478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 msgr2=0x5639535508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535508e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb6340060b0 tx=0x7fb634009e00 comp rx=0 tx=0).stop 2023-10-14T09:00:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 -- 172.21.15.6:0/492189478 shutdown_connections 2023-10-14T09:00:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535508e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563953546850 0x5639535503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 --2- 172.21.15.6:0/492189478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639535471b0 0x5639535578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 -- 172.21.15.6:0/492189478 >> 172.21.15.6:0/492189478 conn(0x563953474d70 msgr2=0x5639535580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 -- 172.21.15.6:0/492189478 shutdown_connections 2023-10-14T09:00:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 -- 172.21.15.6:0/492189478 wait complete. 2023-10-14T09:00:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.927+0000 7fb64e77db80 1 -- start start 2023-10-14T09:00:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 Processor -- start 2023-10-14T09:00:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 0x563953557190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563953555dc0 con 0x563953546850 2023-10-14T09:00:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563953555f30 con 0x5639535471b0 2023-10-14T09:00:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639535560f0 con 0x5639535480a0 2023-10-14T09:00:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb64e77db80 10 client.0 _ll_register_callbacks cb 0x7fb62c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 0x563953557190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 0x563953557190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34948/0 (socket says 172.21.15.6:34948) 2023-10-14T09:00:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33708/0 (socket says 172.21.15.6:33708) 2023-10-14T09:00:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 -- 172.21.15.6:0/750738591 learned_addr learned my addr 172.21.15.6:0/750738591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb640b30700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 -- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 msgr2=0x5639535557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 -- 172.21.15.6:0/750738591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 msgr2=0x5639535576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb63bfff700 1 -- 172.21.15.6:0/750738591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb634009800 con 0x563953546850 2023-10-14T09:00:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.928+0000 7fb640b30700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:00:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb63bfff700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 0x563953557190 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb6300996f0 tx=0x7fb63009b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d7f8f536d55583 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb61b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:00:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb61b7fe700 1 -- 172.21.15.6:0/750738591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63009b3a0 con 0x563953546850 2023-10-14T09:00:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb61b7fe700 1 -- 172.21.15.6:0/750738591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fb6300a36a0 con 0x563953546850 2023-10-14T09:00:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6300b1070 con 0x563953546850 2023-10-14T09:00:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb61b7fe700 1 -- 172.21.15.6:0/750738591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb630099740 con 0x563953546850 2023-10-14T09:00:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 10 client.16200 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5639532eb1f0 con 0x563953546850 2023-10-14T09:00:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb61b7fe700 1 -- 172.21.15.6:0/750738591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6300b1070 con 0x563953546850 2023-10-14T09:00:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb61b7fe700 1 -- 172.21.15.6:0/750738591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb63007b020 con 0x563953546850 2023-10-14T09:00:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 10 client.16200 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 20 client.16200 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639535b0f00 0x5639535b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 4 client.16200 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:00:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.929+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563953492df0 con 0x5639535b0f00 2023-10-14T09:00:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.930+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639535b0f00 0x5639535b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.932+0000 7fb63b7fe700 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639535b0f00 0x5639535b3320 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c30af3527bb0e5e7 server_cookie=258c6f4b378c367e in_seq=0 out_seq=0 2023-10-14T09:00:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.932+0000 7fb61b7fe700 10 client.16200 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:18.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb61b7fe700 1 -- 172.21.15.6:0/750738591 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563953492df0 con 0x5639535b0f00 2023-10-14T09:00:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb61b7fe700 10 client.16200 handle_command_reply: tid=0 2023-10-14T09:00:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 client.16200 shutdown 2023-10-14T09:00:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 msgr2=0x563953557190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 0x563953557190 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb6300996f0 tx=0x7fb63009b010 comp rx=0 tx=0).stop 2023-10-14T09:00:18.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 shutdown_connections 2023-10-14T09:00:18.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5639535b0f00 0x5639535b3320 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5639535480a0 0x5639535557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563953546850 0x563953557190 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 --2- 172.21.15.6:0/750738591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5639535471b0 0x5639535576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb61b7fe700 0 client.16200 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:18.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 >> 172.21.15.6:0/750738591 conn(0x563953474d70 msgr2=0x563953550340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 shutdown_connections 2023-10-14T09:00:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.949+0000 7fb64e77db80 1 -- 172.21.15.6:0/750738591 wait complete. 2023-10-14T09:00:18.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb64e77db80 20 client.16200 trim_cache size 0 max 16384 2023-10-14T09:00:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:00:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:00:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:00:18.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:00:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6240a1500 msgr2=0x7fb6240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6240a1500 0x7fb6240a39c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00cd20 tx=0x7fb62c00c330 comp rx=0 tx=0).stop 2023-10-14T09:00:18.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 msgr2=0x7fb63c1a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c1a59e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb630000c00 tx=0x7fb63000f690 comp rx=0 tx=0).stop 2023-10-14T09:00:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 shutdown_connections 2023-10-14T09:00:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fb6240a1500 0x7fb6240a39c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb63c10d1f0 0x7fb63c1acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb63c107eb0 0x7fb63c1a59e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 --2- 172.21.15.6:0/468706343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c10a820 0x7fb63c1a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 >> 172.21.15.6:0/468706343 conn(0x7fb63c06dcf0 msgr2=0x7fb63c10b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 shutdown_connections 2023-10-14T09:00:18.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:18.950+0000 7fb642593700 1 -- 172.21.15.6:0/468706343 wait complete. 2023-10-14T09:00:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:19 smithi006 ceph-mon[99452]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 923 op/s 2023-10-14T09:00:19.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:19 smithi178 ceph-mon[103612]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 923 op/s 2023-10-14T09:00:19.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:19 smithi057 ceph-mon[103313]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 923 op/s 2023-10-14T09:00:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 440.0 s, 1470.8 tps, lat 68.265 ms stddev 78.051 2023-10-14T09:00:21.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:21 smithi178 ceph-mon[103612]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 879 op/s 2023-10-14T09:00:21.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:21 smithi057 ceph-mon[103313]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 879 op/s 2023-10-14T09:00:21.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:21 smithi006 ceph-mon[99452]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 879 op/s 2023-10-14T09:00:22.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:22 smithi178 ceph-mon[103612]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 923 op/s 2023-10-14T09:00:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:22 smithi057 ceph-mon[103313]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 923 op/s 2023-10-14T09:00:22.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:22 smithi006 ceph-mon[99452]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 923 op/s 2023-10-14T09:00:25.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:24 smithi178 ceph-mon[103612]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 862 op/s 2023-10-14T09:00:25.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:24 smithi057 ceph-mon[103313]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 862 op/s 2023-10-14T09:00:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:24 smithi006 ceph-mon[99452]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 19 MiB/s wr, 862 op/s 2023-10-14T09:00:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 445.0 s, 1189.4 tps, lat 83.496 ms stddev 146.633 2023-10-14T09:00:27.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:27 smithi178 ceph-mon[103612]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2023-10-14T09:00:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:27 smithi057 ceph-mon[103313]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2023-10-14T09:00:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:27 smithi006 ceph-mon[99452]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.35k op/s 2023-10-14T09:00:29.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:29 smithi178 ceph-mon[103612]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 1.93k op/s 2023-10-14T09:00:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:29 smithi057 ceph-mon[103313]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 1.93k op/s 2023-10-14T09:00:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:29 smithi006 ceph-mon[99452]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 1.93k op/s 2023-10-14T09:00:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 450.0 s, 1749.2 tps, lat 57.157 ms stddev 66.663 2023-10-14T09:00:31.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:31 smithi178 ceph-mon[103612]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 1.90k op/s 2023-10-14T09:00:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:31 smithi057 ceph-mon[103313]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 1.90k op/s 2023-10-14T09:00:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:31 smithi006 ceph-mon[99452]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 1.90k op/s 2023-10-14T09:00:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 -- 172.21.15.6:0/506408363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a80ff750 msgr2=0x7fa6a8101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 --2- 172.21.15.6:0/506408363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a80ff750 0x7fa6a8101b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009990 tx=0x7fa69c009ca0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 -- 172.21.15.6:0/506408363 shutdown_connections 2023-10-14T09:00:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 --2- 172.21.15.6:0/506408363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a8104a90 0x7fa6a8104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 --2- 172.21.15.6:0/506408363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a80ff750 0x7fa6a8101b80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 --2- 172.21.15.6:0/506408363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a81020c0 0x7fa6a8104550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 -- 172.21.15.6:0/506408363 >> 172.21.15.6:0/506408363 conn(0x7fa6a80fb370 msgr2=0x7fa6a80fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 -- 172.21.15.6:0/506408363 shutdown_connections 2023-10-14T09:00:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.139+0000 7fa6aee51700 1 -- 172.21.15.6:0/506408363 wait complete. 2023-10-14T09:00:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 Processor -- start 2023-10-14T09:00:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 -- start start 2023-10-14T09:00:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80ff750 0x7fa6a819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 0x7fa6a819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a8104a90 0x7fa6a81a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81a4da0 con 0x7fa6a81020c0 2023-10-14T09:00:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81a4ee0 con 0x7fa6a8104a90 2023-10-14T09:00:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.140+0000 7fa6aee51700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81a5070 con 0x7fa6a80ff750 2023-10-14T09:00:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 0x7fa6a819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 0x7fa6a819d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34964/0 (socket says 172.21.15.6:34964) 2023-10-14T09:00:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 -- 172.21.15.6:0/2046110639 learned_addr learned my addr 172.21.15.6:0/2046110639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6acbed700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80ff750 0x7fa6a819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6ad3ee700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a8104a90 0x7fa6a81a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 -- 172.21.15.6:0/2046110639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80ff750 msgr2=0x7fa6a819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80ff750 0x7fa6a819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 -- 172.21.15.6:0/2046110639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a8104a90 msgr2=0x7fa6a81a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a8104a90 0x7fa6a81a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 -- 172.21.15.6:0/2046110639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0095f0 con 0x7fa6a81020c0 2023-10-14T09:00:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.141+0000 7fa6a7fff700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 0x7fa6a819d760 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa69400e9a0 tx=0x7fa69400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.142+0000 7fa6a5ffb700 1 -- 172.21.15.6:0/2046110639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400ca10 con 0x7fa6a81020c0 2023-10-14T09:00:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.142+0000 7fa6a5ffb700 1 -- 172.21.15.6:0/2046110639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69400cb70 con 0x7fa6a81020c0 2023-10-14T09:00:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.142+0000 7fa6a5ffb700 1 -- 172.21.15.6:0/2046110639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa694018680 con 0x7fa6a81020c0 2023-10-14T09:00:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.142+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a81a5350 con 0x7fa6a81020c0 2023-10-14T09:00:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.142+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a8105fb0 con 0x7fa6a81020c0 2023-10-14T09:00:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.147+0000 7fa6bb03bb80 1 Processor -- start 2023-10-14T09:00:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.148+0000 7fa6bb03bb80 1 -- start start 2023-10-14T09:00:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 0x5642015c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 0x5642015c5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564201538c10 con 0x5642015c3850 2023-10-14T09:00:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420151dc00 con 0x5642015c50a0 2023-10-14T09:00:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56420151b520 con 0x5642015c41b0 2023-10-14T09:00:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6acbed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 0x5642015c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6acbed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 0x5642015c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60602/0 (socket says 172.21.15.6:60602) 2023-10-14T09:00:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6acbed700 1 -- 172.21.15.6:0/704942148 learned_addr learned my addr 172.21.15.6:0/704942148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6acbed700 1 -- 172.21.15.6:0/704942148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 msgr2=0x5642015c5520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:00:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.149+0000 7fa6acbed700 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 0x5642015c5520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa6acbed700 1 -- 172.21.15.6:0/704942148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 msgr2=0x5642015c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa6acbed700 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa6acbed700 1 -- 172.21.15.6:0/704942148 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642014d4390 con 0x5642015c41b0 2023-10-14T09:00:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa6acbed700 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 0x5642015c4ac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa69c015000 tx=0x7fa69c005ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25a9b91cbd026e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa692ffd700 1 -- 172.21.15.6:0/704942148 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c01d070 con 0x5642015c41b0 2023-10-14T09:00:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa692ffd700 1 -- 172.21.15.6:0/704942148 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c01e040 con 0x5642015c41b0 2023-10-14T09:00:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa6a5ffb700 1 -- 172.21.15.6:0/2046110639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa694010430 con 0x7fa6a81020c0 2023-10-14T09:00:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.150+0000 7fa692ffd700 1 -- 172.21.15.6:0/704942148 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c0049a0 con 0x5642015c41b0 2023-10-14T09:00:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6a5ffb700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa6980a1500 0x7fa6980a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6a5ffb700 1 -- 172.21.15.6:0/2046110639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa694014070 con 0x7fa6a81020c0 2023-10-14T09:00:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/704942148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 msgr2=0x5642015c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 0x5642015c4ac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa69c015000 tx=0x7fa69c005ea0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6ad3ee700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa6980a1500 0x7fa6980a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/704942148 shutdown_connections 2023-10-14T09:00:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 0x5642015c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/704942148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c41b0 0x5642015c4ac0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/704942148 >> 172.21.15.6:0/704942148 conn(0x5642014f1d70 msgr2=0x5642015bec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/704942148 shutdown_connections 2023-10-14T09:00:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.151+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/704942148 wait complete. 2023-10-14T09:00:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6ad3ee700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa6980a1500 0x7fa6980a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000f4a0 tx=0x7fa6a0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 -- start start 2023-10-14T09:00:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 Processor -- start 2023-10-14T09:00:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c41b0 0x5642015cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 0x5642015d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564201516e10 con 0x5642015c41b0 2023-10-14T09:00:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642014b36b0 con 0x5642015c50a0 2023-10-14T09:00:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.152+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642014b3350 con 0x5642015c3850 2023-10-14T09:00:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6bb03bb80 10 client.0 _ll_register_callbacks cb 0x5642013107a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60608/0 (socket says 172.21.15.6:60608) 2023-10-14T09:00:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 -- 172.21.15.6:0/1147441246 learned_addr learned my addr 172.21.15.6:0/1147441246 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 -- 172.21.15.6:0/1147441246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 msgr2=0x5642015d4c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:00:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 0x5642015d4c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 -- 172.21.15.6:0/1147441246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c41b0 msgr2=0x5642015cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c41b0 0x5642015cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.153+0000 7fa6acbed700 1 -- 172.21.15.6:0/1147441246 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a8105a40 con 0x5642015c3850 2023-10-14T09:00:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa6acbed700 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015cd6b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098e0 tx=0x7fa69c0226e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871b971e2c505ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa687fff700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:00:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa687fff700 1 -- 172.21.15.6:0/1147441246 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c032070 con 0x5642015c3850 2023-10-14T09:00:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa687fff700 1 -- 172.21.15.6:0/1147441246 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa69c022bd0 con 0x5642015c3850 2023-10-14T09:00:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56420151be90 con 0x5642015c3850 2023-10-14T09:00:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa687fff700 1 -- 172.21.15.6:0/1147441246 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa69c01d070 con 0x5642015c3850 2023-10-14T09:00:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa6bb03bb80 10 client.25846 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.154+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x564201341d80 con 0x5642015c3850 2023-10-14T09:00:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.155+0000 7fa687fff700 1 -- 172.21.15.6:0/1147441246 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56420151be90 con 0x5642015c3850 2023-10-14T09:00:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.155+0000 7fa687fff700 1 -- 172.21.15.6:0/1147441246 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa69c035020 con 0x5642015c3850 2023-10-14T09:00:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6bb03bb80 10 client.25846 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6bb03bb80 10 client.25846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6bb03bb80 20 client.25846 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5642015ea080 0x5642015ec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6bb03bb80 4 client.25846 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:00:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564201593bb0 con 0x5642015ea080 2023-10-14T09:00:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6a7fff700 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5642015ea080 0x5642015ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.156+0000 7fa6a7fff700 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5642015ea080 0x5642015ec470 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68bd5e4f2e04b90 server_cookie=8a7a46b6998a2dd7 in_seq=0 out_seq=0 2023-10-14T09:00:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.157+0000 7fa687fff700 10 client.25846 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.157+0000 7fa687fff700 1 -- 172.21.15.6:0/1147441246 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564201593bb0 con 0x5642015ea080 2023-10-14T09:00:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.157+0000 7fa687fff700 10 client.25846 handle_command_reply: tid=0 2023-10-14T09:00:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.157+0000 7fa6bb03bb80 1 client.25846 shutdown 2023-10-14T09:00:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.159+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 msgr2=0x5642015cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.159+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015cd6b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098e0 tx=0x7fa69c0226e0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 shutdown_connections 2023-10-14T09:00:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5642015ea080 0x5642015ec470 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c50a0 0x5642015d4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015cd6b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/1147441246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c41b0 0x5642015cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa687fff700 0 client.25846 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 >> 172.21.15.6:0/1147441246 conn(0x5642014f1d70 msgr2=0x5642015be830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 shutdown_connections 2023-10-14T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.163+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/1147441246 wait complete. 2023-10-14T09:00:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.164+0000 7fa6bb03bb80 20 client.25846 trim_cache size 0 max 16384 2023-10-14T09:00:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.190+0000 7fa6bb03bb80 1 Processor -- start 2023-10-14T09:00:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.190+0000 7fa6bb03bb80 1 -- start start 2023-10-14T09:00:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 0x5642015d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c50a0 0x5642015e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642013978c0 con 0x5642015c3850 2023-10-14T09:00:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642015c4f50 con 0x5642015c41b0 2023-10-14T09:00:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642015c4590 con 0x5642015c50a0 2023-10-14T09:00:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34980/0 (socket says 172.21.15.6:34980) 2023-10-14T09:00:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 -- 172.21.15.6:0/3280482796 learned_addr learned my addr 172.21.15.6:0/3280482796 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 -- 172.21.15.6:0/3280482796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c50a0 msgr2=0x5642015e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c50a0 0x5642015e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 -- 172.21.15.6:0/3280482796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 msgr2=0x5642015d4bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:00:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 0x5642015d4bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.191+0000 7fa6acbed700 1 -- 172.21.15.6:0/3280482796 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56420132ac00 con 0x5642015c3850 2023-10-14T09:00:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.192+0000 7fa6acbed700 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015cc3d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009350 tx=0x7fa69c02c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9ede6da5c20aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.192+0000 7fa6937fe700 1 -- 172.21.15.6:0/3280482796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c032020 con 0x5642015c3850 2023-10-14T09:00:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.192+0000 7fa6937fe700 1 -- 172.21.15.6:0/3280482796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c0058e0 con 0x5642015c3850 2023-10-14T09:00:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.192+0000 7fa6937fe700 1 -- 172.21.15.6:0/3280482796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c01d040 con 0x5642015c3850 2023-10-14T09:00:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3280482796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 msgr2=0x5642015cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015cc3d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009350 tx=0x7fa69c02c6c0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3280482796 shutdown_connections 2023-10-14T09:00:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c50a0 0x5642015e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c3850 0x5642015cc3d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3280482796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 0x5642015d4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3280482796 >> 172.21.15.6:0/3280482796 conn(0x5642014f1d70 msgr2=0x5642015f0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3280482796 shutdown_connections 2023-10-14T09:00:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3280482796 wait complete. 2023-10-14T09:00:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 -- start start 2023-10-14T09:00:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.193+0000 7fa6bb03bb80 1 Processor -- start 2023-10-14T09:00:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 0x5642015d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 0x5642015d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642015d4290 con 0x5642015c50a0 2023-10-14T09:00:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642015d4400 con 0x5642015c41b0 2023-10-14T09:00:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642015d45c0 con 0x5642015c3850 2023-10-14T09:00:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6bb03bb80 10 client.0 _ll_register_callbacks cb 0x7fa69c009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:32.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 0x5642015d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 0x5642015d3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34990/0 (socket says 172.21.15.6:34990) 2023-10-14T09:00:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 -- 172.21.15.6:0/3301829597 learned_addr learned my addr 172.21.15.6:0/3301829597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 -- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 msgr2=0x5642015d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:32.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 -- 172.21.15.6:0/3301829597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 msgr2=0x5642015d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 0x5642015d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 -- 172.21.15.6:0/3301829597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564201341d80 con 0x5642015c50a0 2023-10-14T09:00:32.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa6ad3ee700 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 0x5642015d3d50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0008ac0 tx=0x7fa6a0008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d112604cd6b4491 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:32.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.194+0000 7fa687fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:00:32.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa687fff700 1 -- 172.21.15.6:0/3301829597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0026070 con 0x5642015c50a0 2023-10-14T09:00:32.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa687fff700 1 -- 172.21.15.6:0/3301829597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa6a0003a00 con 0x5642015c50a0 2023-10-14T09:00:32.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa69c01e040 con 0x5642015c50a0 2023-10-14T09:00:32.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa687fff700 1 -- 172.21.15.6:0/3301829597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6a001c040 con 0x5642015c50a0 2023-10-14T09:00:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 10 client.16212 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x5642013681f0 con 0x5642015c50a0 2023-10-14T09:00:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa687fff700 1 -- 172.21.15.6:0/3301829597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c01e040 con 0x5642015c50a0 2023-10-14T09:00:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa687fff700 1 -- 172.21.15.6:0/3301829597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa6a0029030 con 0x5642015c50a0 2023-10-14T09:00:32.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 10 client.16212 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 10 client.16212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 20 client.16212 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56420163ee30 0x564201641250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 4 client.16212 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:00:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.195+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56420150fdf0 con 0x56420163ee30 2023-10-14T09:00:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.204+0000 7fa6acbed700 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56420163ee30 0x564201641250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.208+0000 7fa687fff700 10 client.16212 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.208+0000 7fa6acbed700 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56420163ee30 0x564201641250 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e8b6e0feda1caac server_cookie=80c356822dbdd733 in_seq=0 out_seq=0 2023-10-14T09:00:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa687fff700 1 -- 172.21.15.6:0/3301829597 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56420150fdf0 con 0x56420163ee30 2023-10-14T09:00:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa687fff700 10 client.16212 handle_command_reply: tid=0 2023-10-14T09:00:32.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 client.16212 shutdown 2023-10-14T09:00:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 msgr2=0x5642015d3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 0x5642015d3d50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0008ac0 tx=0x7fa6a0008e80 comp rx=0 tx=0).stop 2023-10-14T09:00:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 shutdown_connections 2023-10-14T09:00:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56420163ee30 0x564201641250 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5642015c50a0 0x5642015d3d50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5642015c3850 0x5642015d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa687fff700 0 client.16212 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 --2- 172.21.15.6:0/3301829597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5642015c41b0 0x5642015d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 >> 172.21.15.6:0/3301829597 conn(0x5642014f1d70 msgr2=0x5642015cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:32.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 shutdown_connections 2023-10-14T09:00:32.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.252+0000 7fa6bb03bb80 1 -- 172.21.15.6:0/3301829597 wait complete. 2023-10-14T09:00:32.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.253+0000 7fa6bb03bb80 20 client.16212 trim_cache size 0 max 16384 2023-10-14T09:00:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:00:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:00:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:00:32.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:00:32.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa6980a1500 msgr2=0x7fa6980a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa6980a1500 0x7fa6980a39c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000f4a0 tx=0x7fa6a0009920 comp rx=0 tx=0).stop 2023-10-14T09:00:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 msgr2=0x7fa6a819d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 0x7fa6a819d760 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa69400e9a0 tx=0x7fa69400ecb0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 shutdown_connections 2023-10-14T09:00:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa6980a1500 0x7fa6980a39c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6a8104a90 0x7fa6a81a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6a80ff750 0x7fa6a819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 --2- 172.21.15.6:0/2046110639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6a81020c0 0x7fa6a819d760 secure :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa69400e9a0 tx=0x7fa69400ecb0 comp rx=0 tx=0).stop 2023-10-14T09:00:32.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.254+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 >> 172.21.15.6:0/2046110639 conn(0x7fa6a80fb370 msgr2=0x7fa6a8102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.256+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 shutdown_connections 2023-10-14T09:00:32.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:32.256+0000 7fa6aee51700 1 -- 172.21.15.6:0/2046110639 wait complete. 2023-10-14T09:00:33.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:33 smithi178 ceph-mon[103612]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.94k op/s 2023-10-14T09:00:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:33 smithi057 ceph-mon[103313]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.94k op/s 2023-10-14T09:00:33.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:33 smithi006 ceph-mon[99452]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.94k op/s 2023-10-14T09:00:35.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:35 smithi178 ceph-mon[103612]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 1.90k op/s 2023-10-14T09:00:35.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:35 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:00:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:35 smithi057 ceph-mon[103313]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 1.90k op/s 2023-10-14T09:00:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:35 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:00:35.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:35 smithi006 ceph-mon[99452]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 1.90k op/s 2023-10-14T09:00:35.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:35 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:00:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 455.0 s, 1790.3 tps, lat 55.934 ms stddev 58.948 2023-10-14T09:00:36.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.638 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.639 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:00:36.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:00:36.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:36 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:00:36.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:00:36.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:00:36.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:36 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:00:36.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-14T09:00:36.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:00:36.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:00:36.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:36 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:00:37.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 37 MiB/s wr, 1.89k op/s 2023-10-14T09:00:37.641 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi057 to 197.2M 2023-10-14T09:00:37.642 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: Unable to set osd_memory_target on smithi057 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-10-14T09:00:37.642 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-10-14T09:00:37.642 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: Unable to set osd_memory_target on smithi006 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-14T09:00:37.642 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: Adjusting osd_memory_target on smithi178 to 196.2M 2023-10-14T09:00:37.643 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:37 smithi178 ceph-mon[103612]: Unable to set osd_memory_target on smithi178 to 205738086: error parsing value: Value '205738086' is below minimum 939524096 2023-10-14T09:00:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 37 MiB/s wr, 1.89k op/s 2023-10-14T09:00:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi057 to 197.2M 2023-10-14T09:00:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: Unable to set osd_memory_target on smithi057 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-10-14T09:00:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-10-14T09:00:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: Unable to set osd_memory_target on smithi006 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-14T09:00:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: Adjusting osd_memory_target on smithi178 to 196.2M 2023-10-14T09:00:37.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:37 smithi057 ceph-mon[103313]: Unable to set osd_memory_target on smithi178 to 205738086: error parsing value: Value '205738086' is below minimum 939524096 2023-10-14T09:00:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 37 MiB/s wr, 1.89k op/s 2023-10-14T09:00:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi057 to 197.2M 2023-10-14T09:00:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: Unable to set osd_memory_target on smithi057 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-10-14T09:00:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-10-14T09:00:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: Unable to set osd_memory_target on smithi006 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-14T09:00:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: Adjusting osd_memory_target on smithi178 to 196.2M 2023-10-14T09:00:37.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:37 smithi006 ceph-mon[99452]: Unable to set osd_memory_target on smithi178 to 205738086: error parsing value: Value '205738086' is below minimum 939524096 2023-10-14T09:00:39.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:39 smithi178 ceph-mon[103612]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 27 MiB/s wr, 1.36k op/s 2023-10-14T09:00:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:39 smithi057 ceph-mon[103313]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 27 MiB/s wr, 1.36k op/s 2023-10-14T09:00:39.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:39 smithi006 ceph-mon[99452]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 27 MiB/s wr, 1.36k op/s 2023-10-14T09:00:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 460.0 s, 2166.0 tps, lat 46.361 ms stddev 53.169 2023-10-14T09:00:41.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:41 smithi178 ceph-mon[103612]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 693 op/s 2023-10-14T09:00:41.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:41 smithi057 ceph-mon[103313]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 693 op/s 2023-10-14T09:00:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:41 smithi006 ceph-mon[99452]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 693 op/s 2023-10-14T09:00:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:43 smithi178 ceph-mon[103612]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 706 op/s 2023-10-14T09:00:43.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:43 smithi057 ceph-mon[103313]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 706 op/s 2023-10-14T09:00:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:43 smithi006 ceph-mon[99452]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 706 op/s 2023-10-14T09:00:45.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 -- 172.21.15.6:0/6631944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 msgr2=0x7fa094076f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 --2- 172.21.15.6:0/6631944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa094076f30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0880098f0 tx=0x7fa088009c00 comp rx=0 tx=0).stop 2023-10-14T09:00:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 -- 172.21.15.6:0/6631944 shutdown_connections 2023-10-14T09:00:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 --2- 172.21.15.6:0/6631944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa094077470 0x7fa094077cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 --2- 172.21.15.6:0/6631944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa094075c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 --2- 172.21.15.6:0/6631944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa094076f30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 -- 172.21.15.6:0/6631944 >> 172.21.15.6:0/6631944 conn(0x7fa0940fe6a0 msgr2=0x7fa094100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 -- 172.21.15.6:0/6631944 shutdown_connections 2023-10-14T09:00:45.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.428+0000 7fa09a218700 1 -- 172.21.15.6:0/6631944 wait complete. 2023-10-14T09:00:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.429+0000 7fa09a218700 1 Processor -- start 2023-10-14T09:00:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 -- start start 2023-10-14T09:00:45.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa09419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa09419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa094077470 0x7fa0941a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0941a4dd0 con 0x7fa094075870 2023-10-14T09:00:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094102b60 con 0x7fa094076ab0 2023-10-14T09:00:45.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa09a218700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094102cf0 con 0x7fa094077470 2023-10-14T09:00:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa0937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa09419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa09419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa0937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa09419d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34998/0 (socket says 172.21.15.6:34998) 2023-10-14T09:00:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa0937fe700 1 -- 172.21.15.6:0/1442440670 learned_addr learned my addr 172.21.15.6:0/1442440670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:45.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa093fff700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa094077470 0x7fa0941a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 -- 172.21.15.6:0/1442440670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa094077470 msgr2=0x7fa0941a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa094077470 0x7fa0941a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 -- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 msgr2=0x7fa09419d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa09419d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 -- 172.21.15.6:0/1442440670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840095f0 con 0x7fa094076ab0 2023-10-14T09:00:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa0937fe700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa09419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.430+0000 7fa092ffd700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa09419d790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa088009230 tx=0x7fa08800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.431+0000 7fa090ff9700 1 -- 172.21.15.6:0/1442440670 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08801c070 con 0x7fa094076ab0 2023-10-14T09:00:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.431+0000 7fa090ff9700 1 -- 172.21.15.6:0/1442440670 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08800f860 con 0x7fa094076ab0 2023-10-14T09:00:45.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.431+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088009520 con 0x7fa094076ab0 2023-10-14T09:00:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.431+0000 7fa090ff9700 1 -- 172.21.15.6:0/1442440670 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088003a40 con 0x7fa094076ab0 2023-10-14T09:00:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.431+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa094103260 con 0x7fa094076ab0 2023-10-14T09:00:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.436+0000 7fa090ff9700 1 -- 172.21.15.6:0/1442440670 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa088020070 con 0x7fa094076ab0 2023-10-14T09:00:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.437+0000 7fa090ff9700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa07c0a1500 0x7fa07c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.437+0000 7fa0937fe700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa07c0a1500 0x7fa07c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.437+0000 7fa090ff9700 1 -- 172.21.15.6:0/1442440670 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa0880cd740 con 0x7fa094076ab0 2023-10-14T09:00:45.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.437+0000 7fa0937fe700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa07c0a1500 0x7fa07c0a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa084005d10 tx=0x7fa084009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.438+0000 7fa0a6402b80 1 Processor -- start 2023-10-14T09:00:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 -- start start 2023-10-14T09:00:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cb4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cb5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cb6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57c29c10 con 0x560c57cb51b0 2023-10-14T09:00:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57c0ec00 con 0x560c57cb60a0 2023-10-14T09:00:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57c0c520 con 0x560c57cb4850 2023-10-14T09:00:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cb5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cb5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35006/0 (socket says 172.21.15.6:35006) 2023-10-14T09:00:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa092ffd700 1 -- 172.21.15.6:0/3544023152 learned_addr learned my addr 172.21.15.6:0/3544023152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa093fff700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cb6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.439+0000 7fa0937fe700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cb4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa093fff700 1 -- 172.21.15.6:0/3544023152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 msgr2=0x560c57cb4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa093fff700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cb4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa093fff700 1 -- 172.21.15.6:0/3544023152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 msgr2=0x560c57cb5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa093fff700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cb5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa093fff700 1 -- 172.21.15.6:0/3544023152 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c57bc5390 con 0x560c57cb60a0 2023-10-14T09:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa0937fe700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cb4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:00:45.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa092ffd700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cb5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa093fff700 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cb6520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa08c003f20 tx=0x7fa08c009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98d54e7d550c31e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa079ffb700 1 -- 172.21.15.6:0/3544023152 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c019070 con 0x560c57cb60a0 2023-10-14T09:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa079ffb700 1 -- 172.21.15.6:0/3544023152 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x560c57cb60a0 2023-10-14T09:00:45.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.440+0000 7fa079ffb700 1 -- 172.21.15.6:0/3544023152 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c007990 con 0x560c57cb60a0 2023-10-14T09:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3544023152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 msgr2=0x560c57cb6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cb6520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa08c003f20 tx=0x7fa08c009ba0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3544023152 shutdown_connections 2023-10-14T09:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cb6520 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cb4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3544023152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cb5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3544023152 >> 172.21.15.6:0/3544023152 conn(0x560c57be2d70 msgr2=0x560c57cafc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3544023152 shutdown_connections 2023-10-14T09:00:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.441+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3544023152 wait complete. 2023-10-14T09:00:45.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 -- start start 2023-10-14T09:00:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 Processor -- start 2023-10-14T09:00:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57c07e10 con 0x560c57cb51b0 2023-10-14T09:00:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57ba46b0 con 0x560c57cb60a0 2023-10-14T09:00:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57ba4350 con 0x560c57cb4850 2023-10-14T09:00:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa0a6402b80 10 client.0 _ll_register_callbacks cb 0x560c57a017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.442+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35014/0 (socket says 172.21.15.6:35014) 2023-10-14T09:00:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 -- 172.21.15.6:0/262866121 learned_addr learned my addr 172.21.15.6:0/262866121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa0937fe700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa093fff700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 -- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 msgr2=0x560c57cbe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 -- 172.21.15.6:0/262866121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 msgr2=0x560c57cc5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 -- 172.21.15.6:0/262866121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa094103260 con 0x560c57cb51b0 2023-10-14T09:00:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa092ffd700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa088096fa0 tx=0x7fa08800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a0901c284baa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa072ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:00:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa072ffd700 1 -- 172.21.15.6:0/262866121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08809ec40 con 0x560c57cb51b0 2023-10-14T09:00:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa072ffd700 1 -- 172.21.15.6:0/262866121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa0880a2df0 con 0x560c57cb51b0 2023-10-14T09:00:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c57c0ce90 con 0x560c57cb51b0 2023-10-14T09:00:45.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa072ffd700 1 -- 172.21.15.6:0/262866121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0880b3220 con 0x560c57cb51b0 2023-10-14T09:00:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa0a6402b80 10 client.16224 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.443+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x7fa08c003b50 con 0x560c57cb51b0 2023-10-14T09:00:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa072ffd700 1 -- 172.21.15.6:0/262866121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08807d020 con 0x560c57cb51b0 2023-10-14T09:00:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa072ffd700 1 -- 172.21.15.6:0/262866121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0880a2a60 con 0x560c57cb51b0 2023-10-14T09:00:45.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa0a6402b80 10 client.16224 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa0a6402b80 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa0a6402b80 20 client.16224 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57cca1b0 0x560c57ccc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa0a6402b80 4 client.16224 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:00:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.444+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c57c84bb0 con 0x560c57cca1b0 2023-10-14T09:00:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.446+0000 7fa0937fe700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57cca1b0 0x560c57ccc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.447+0000 7fa0937fe700 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57cca1b0 0x560c57ccc5d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd8c1738bad12 server_cookie=d032a79d1a6d306e in_seq=0 out_seq=0 2023-10-14T09:00:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.447+0000 7fa072ffd700 10 client.16224 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.448+0000 7fa072ffd700 1 -- 172.21.15.6:0/262866121 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560c57c84bb0 con 0x560c57cca1b0 2023-10-14T09:00:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.448+0000 7fa072ffd700 10 client.16224 handle_command_reply: tid=0 2023-10-14T09:00:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.448+0000 7fa0a6402b80 1 client.16224 shutdown 2023-10-14T09:00:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.448+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 msgr2=0x560c57cbec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.448+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa088096fa0 tx=0x7fa08800bbc0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 shutdown_connections 2023-10-14T09:00:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57cca1b0 0x560c57ccc5d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa072ffd700 0 client.16224 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/262866121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 >> 172.21.15.6:0/262866121 conn(0x560c57be2d70 msgr2=0x560c57caf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 shutdown_connections 2023-10-14T09:00:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 1 -- 172.21.15.6:0/262866121 wait complete. 2023-10-14T09:00:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.449+0000 7fa0a6402b80 20 client.16224 trim_cache size 0 max 16384 2023-10-14T09:00:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 Processor -- start 2023-10-14T09:00:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 -- start start 2023-10-14T09:00:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57a888c0 con 0x560c57cb51b0 2023-10-14T09:00:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57cbf910 con 0x560c57cb60a0 2023-10-14T09:00:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57cbd1f0 con 0x560c57cb4850 2023-10-14T09:00:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa093fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.470+0000 7fa092ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35022/0 (socket says 172.21.15.6:35022) 2023-10-14T09:00:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa092ffd700 1 -- 172.21.15.6:0/643209730 learned_addr learned my addr 172.21.15.6:0/643209730 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa0937fe700 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa093fff700 1 -- 172.21.15.6:0/643209730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 msgr2=0x560c57cbe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa093fff700 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa093fff700 1 -- 172.21.15.6:0/643209730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 msgr2=0x560c57cbec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa093fff700 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa093fff700 1 -- 172.21.15.6:0/643209730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c57a32d80 con 0x560c57cb60a0 2023-10-14T09:00:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa092ffd700 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.471+0000 7fa093fff700 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5c60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0075e0 tx=0x7fa08c009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec326a9b932427dd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.472+0000 7fa07a7fc700 1 -- 172.21.15.6:0/643209730 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c019070 con 0x560c57cb60a0 2023-10-14T09:00:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.472+0000 7fa07a7fc700 1 -- 172.21.15.6:0/643209730 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08c01a040 con 0x560c57cb60a0 2023-10-14T09:00:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.472+0000 7fa07a7fc700 1 -- 172.21.15.6:0/643209730 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c005720 con 0x560c57cb60a0 2023-10-14T09:00:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.472+0000 7fa0a6402b80 1 -- 172.21.15.6:0/643209730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 msgr2=0x560c57cc5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.472+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5c60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0075e0 tx=0x7fa08c009460 comp rx=0 tx=0).stop 2023-10-14T09:00:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 -- 172.21.15.6:0/643209730 shutdown_connections 2023-10-14T09:00:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb60a0 0x560c57cc5c60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb4850 0x560c57cbe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/643209730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb51b0 0x560c57cbec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 -- 172.21.15.6:0/643209730 >> 172.21.15.6:0/643209730 conn(0x560c57be2d70 msgr2=0x560c57cb8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 -- 172.21.15.6:0/643209730 shutdown_connections 2023-10-14T09:00:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 -- 172.21.15.6:0/643209730 wait complete. 2023-10-14T09:00:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 -- start start 2023-10-14T09:00:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.473+0000 7fa0a6402b80 1 Processor -- start 2023-10-14T09:00:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 0x560c57cc5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb51b0 0x560c57cc5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb60a0 0x560c57cc2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57cc2590 con 0x560c57cb60a0 2023-10-14T09:00:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57cc2700 con 0x560c57cb4850 2023-10-14T09:00:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c57cc28c0 con 0x560c57cb51b0 2023-10-14T09:00:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0a6402b80 10 client.0 _ll_register_callbacks cb 0x560c57a017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 0x560c57cc5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 0x560c57cc5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33784/0 (socket says 172.21.15.6:33784) 2023-10-14T09:00:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 -- 172.21.15.6:0/3644614370 learned_addr learned my addr 172.21.15.6:0/3644614370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa093fff700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb60a0 0x560c57cc2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa092ffd700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb51b0 0x560c57cc5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 -- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb51b0 msgr2=0x560c57cc5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb51b0 0x560c57cc5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 -- 172.21.15.6:0/3644614370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb60a0 msgr2=0x560c57cc2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb60a0 0x560c57cc2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa0937fe700 1 -- 172.21.15.6:0/3644614370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c003b50 con 0x560c57cb4850 2023-10-14T09:00:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.474+0000 7fa092ffd700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb51b0 0x560c57cc5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0937fe700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 0x560c57cc5570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa084009930 tx=0x7fa0840047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6532faa757019952 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa072ffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:00:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa072ffd700 1 -- 172.21.15.6:0/3644614370 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084022040 con 0x560c57cb4850 2023-10-14T09:00:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa072ffd700 1 -- 172.21.15.6:0/3644614370 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa084027900 con 0x560c57cb4850 2023-10-14T09:00:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa08c00f040 con 0x560c57cb4850 2023-10-14T09:00:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa072ffd700 1 -- 172.21.15.6:0/3644614370 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa084027ac0 con 0x560c57cb4850 2023-10-14T09:00:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 10 client.25826 fetch_fsmap learned FSMap version 43 2023-10-14T09:00:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x560c57bc5390 con 0x560c57cb4850 2023-10-14T09:00:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa072ffd700 1 -- 172.21.15.6:0/3644614370 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa08c00f040 con 0x560c57cb4850 2023-10-14T09:00:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa072ffd700 1 -- 172.21.15.6:0/3644614370 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 43) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa084030460 con 0x560c57cb4850 2023-10-14T09:00:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 10 client.25826 fetch_fsmap finished waiting for FSMap version 43 2023-10-14T09:00:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 20 client.25826 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57d1f580 0x560c57d219a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 4 client.25826 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:00:45.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.475+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560c57c00df0 con 0x560c57d1f580 2023-10-14T09:00:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.476+0000 7fa092ffd700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57d1f580 0x560c57d219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.476+0000 7fa092ffd700 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57d1f580 0x560c57d219a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcff0748a2764bc0 server_cookie=75afaf99eba6517a in_seq=0 out_seq=0 2023-10-14T09:00:45.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.476+0000 7fa072ffd700 10 client.25826 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:00:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:00:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:00:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:00:45.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa072ffd700 1 -- 172.21.15.6:0/3644614370 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560c57c00df0 con 0x560c57d1f580 2023-10-14T09:00:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa072ffd700 10 client.25826 handle_command_reply: tid=0 2023-10-14T09:00:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 client.25826 shutdown 2023-10-14T09:00:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 msgr2=0x560c57cc5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 0x560c57cc5570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa084009930 tx=0x7fa0840047c0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 shutdown_connections 2023-10-14T09:00:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560c57d1f580 0x560c57d219a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560c57cb60a0 0x560c57cc2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560c57cb4850 0x560c57cc5570 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa084009930 tx=0x7fa0840047c0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 --2- 172.21.15.6:0/3644614370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57cb51b0 0x560c57cc5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 >> 172.21.15.6:0/3644614370 conn(0x560c57be2d70 msgr2=0x560c57cb8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.546+0000 7fa072ffd700 0 client.25826 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.547+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 shutdown_connections 2023-10-14T09:00:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.548+0000 7fa0a6402b80 1 -- 172.21.15.6:0/3644614370 wait complete. 2023-10-14T09:00:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.548+0000 7fa0a6402b80 20 client.25826 trim_cache size 0 max 16384 2023-10-14T09:00:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa07c0a1500 msgr2=0x7fa07c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa07c0a1500 0x7fa07c0a39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa084005d10 tx=0x7fa084009310 comp rx=0 tx=0).stop 2023-10-14T09:00:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 msgr2=0x7fa09419d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa09419d790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa088009230 tx=0x7fa08800b790 comp rx=0 tx=0).stop 2023-10-14T09:00:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 shutdown_connections 2023-10-14T09:00:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa094077470 0x7fa0941a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa094075870 0x7fa09419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa07c0a1500 0x7fa07c0a39c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 --2- 172.21.15.6:0/1442440670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa094076ab0 0x7fa09419d790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 >> 172.21.15.6:0/1442440670 conn(0x7fa0940fe6a0 msgr2=0x7fa094100440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 shutdown_connections 2023-10-14T09:00:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:45.549+0000 7fa09a218700 1 -- 172.21.15.6:0/1442440670 wait complete. 2023-10-14T09:00:45.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:45 smithi178 ceph-mon[103612]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 727 op/s 2023-10-14T09:00:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:45 smithi057 ceph-mon[103313]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 727 op/s 2023-10-14T09:00:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:45 smithi006 ceph-mon[99452]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 727 op/s 2023-10-14T09:00:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 465.0 s, 1978.4 tps, lat 50.225 ms stddev 55.079 2023-10-14T09:00:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:47 smithi178 ceph-mon[103612]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 756 op/s 2023-10-14T09:00:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:47 smithi057 ceph-mon[103313]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 756 op/s 2023-10-14T09:00:47.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:47 smithi006 ceph-mon[99452]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 756 op/s 2023-10-14T09:00:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:49 smithi178 ceph-mon[103612]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 803 op/s 2023-10-14T09:00:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:49 smithi057 ceph-mon[103313]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 803 op/s 2023-10-14T09:00:49.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:49 smithi006 ceph-mon[99452]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 803 op/s 2023-10-14T09:00:50.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 470.0 s, 1720.2 tps, lat 58.216 ms stddev 63.913 2023-10-14T09:00:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:51 smithi057 ceph-mon[103313]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 732 op/s 2023-10-14T09:00:51.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:51 smithi006 ceph-mon[99452]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 732 op/s 2023-10-14T09:00:51.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:51 smithi178 ceph-mon[103612]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 732 op/s 2023-10-14T09:00:53.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:53 smithi057 ceph-mon[103313]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 771 op/s 2023-10-14T09:00:53.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:53 smithi006 ceph-mon[99452]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 771 op/s 2023-10-14T09:00:53.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:53 smithi178 ceph-mon[103612]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 771 op/s 2023-10-14T09:00:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:55 smithi006 ceph-mon[99452]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 762 op/s 2023-10-14T09:00:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:55 smithi178 ceph-mon[103612]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 762 op/s 2023-10-14T09:00:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:55 smithi057 ceph-mon[103313]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 762 op/s 2023-10-14T09:00:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 475.0 s, 1326.4 tps, lat 75.886 ms stddev 84.970 2023-10-14T09:00:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:57 smithi006 ceph-mon[99452]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 781 op/s 2023-10-14T09:00:57.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:57 smithi178 ceph-mon[103612]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 781 op/s 2023-10-14T09:00:57.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:57 smithi057 ceph-mon[103313]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 13 MiB/s wr, 781 op/s 2023-10-14T09:00:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 -- 172.21.15.6:0/2851865206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c100a20 msgr2=0x7ff64c1082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 --2- 172.21.15.6:0/2851865206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c100a20 0x7ff64c1082e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff644009990 tx=0x7ff644009ca0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 -- 172.21.15.6:0/2851865206 shutdown_connections 2023-10-14T09:00:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 --2- 172.21.15.6:0/2851865206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c100a20 0x7ff64c1082e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 --2- 172.21.15.6:0/2851865206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c1013e0 0x7ff64c101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 --2- 172.21.15.6:0/2851865206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff64c100080 0x7ff64c1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 -- 172.21.15.6:0/2851865206 >> 172.21.15.6:0/2851865206 conn(0x7ff64c0faaf0 msgr2=0x7ff64c0fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 -- 172.21.15.6:0/2851865206 shutdown_connections 2023-10-14T09:00:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 -- 172.21.15.6:0/2851865206 wait complete. 2023-10-14T09:00:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.711+0000 7ff653809700 1 Processor -- start 2023-10-14T09:00:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 -- start start 2023-10-14T09:00:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c100080 0x7ff64c196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff64c100a20 0x7ff64c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 0x7ff64c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19e730 con 0x7ff64c1013e0 2023-10-14T09:00:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19e870 con 0x7ff64c100a20 2023-10-14T09:00:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff653809700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19ea00 con 0x7ff64c100080 2023-10-14T09:00:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 0x7ff64c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 0x7ff64c19e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35044/0 (socket says 172.21.15.6:35044) 2023-10-14T09:00:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 -- 172.21.15.6:0/603439306 learned_addr learned my addr 172.21.15.6:0/603439306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff650da4700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff64c100a20 0x7ff64c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff6515a5700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c100080 0x7ff64c196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 -- 172.21.15.6:0/603439306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c100080 msgr2=0x7ff64c196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c100080 0x7ff64c196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 -- 172.21.15.6:0/603439306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff64c100a20 msgr2=0x7ff64c1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff64c100a20 0x7ff64c1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 -- 172.21.15.6:0/603439306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440095f0 con 0x7ff64c1013e0 2023-10-14T09:00:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff6515a5700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c100080 0x7ff64c196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:00:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.712+0000 7ff651da6700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 0x7ff64c19e160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff644005910 tx=0x7ff644005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.713+0000 7ff6427fc700 1 -- 172.21.15.6:0/603439306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64401d070 con 0x7ff64c1013e0 2023-10-14T09:00:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.713+0000 7ff6427fc700 1 -- 172.21.15.6:0/603439306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff644022470 con 0x7ff64c1013e0 2023-10-14T09:00:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.713+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c19ec80 con 0x7ff64c1013e0 2023-10-14T09:00:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.713+0000 7ff6427fc700 1 -- 172.21.15.6:0/603439306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644017650 con 0x7ff64c1013e0 2023-10-14T09:00:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.713+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c19f100 con 0x7ff64c1013e0 2023-10-14T09:00:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.715+0000 7ff6427fc700 1 -- 172.21.15.6:0/603439306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff64400fb00 con 0x7ff64c1013e0 2023-10-14T09:00:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.716+0000 7ff6427fc700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6380a1500 0x7ff6380a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.716+0000 7ff6427fc700 1 -- 172.21.15.6:0/603439306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff6440ce170 con 0x7ff64c1013e0 2023-10-14T09:00:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.717+0000 7ff6515a5700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6380a1500 0x7ff6380a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.717+0000 7ff65f9f3b80 1 Processor -- start 2023-10-14T09:00:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 -- start start 2023-10-14T09:00:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff6515a5700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6380a1500 0x7ff6380a39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff64c068200 tx=0x7ff64800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bb9f60 0x556c94bb8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bb9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bc6cc0 0x556c94bc90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94b2dc10 con 0x556c94bb8cd0 2023-10-14T09:00:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94b12c00 con 0x556c94bc6cc0 2023-10-14T09:00:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94b10520 con 0x556c94bb9f60 2023-10-14T09:00:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff6515a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bb9f60 0x556c94bb8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff6515a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bb9f60 0x556c94bb8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60682/0 (socket says 172.21.15.6:60682) 2023-10-14T09:00:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff6515a5700 1 -- 172.21.15.6:0/3204710115 learned_addr learned my addr 172.21.15.6:0/3204710115 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff650da4700 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bb9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.718+0000 7ff651da6700 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bc6cc0 0x556c94bc90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff650da4700 1 -- 172.21.15.6:0/3204710115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bb9f60 msgr2=0x556c94bb8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff650da4700 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bb9f60 0x556c94bb8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff650da4700 1 -- 172.21.15.6:0/3204710115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bc6cc0 msgr2=0x556c94bc90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff650da4700 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bc6cc0 0x556c94bc90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff650da4700 1 -- 172.21.15.6:0/3204710115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c94ac9390 con 0x556c94bb8cd0 2023-10-14T09:00:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff650da4700 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bb9150 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00bc80 tx=0x7ff63c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81911bfab577d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff6377fe700 1 -- 172.21.15.6:0/3204710115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c010be0 con 0x556c94bb8cd0 2023-10-14T09:00:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff6377fe700 1 -- 172.21.15.6:0/3204710115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c015070 con 0x556c94bb8cd0 2023-10-14T09:00:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.719+0000 7ff6377fe700 1 -- 172.21.15.6:0/3204710115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c004e70 con 0x556c94bb8cd0 2023-10-14T09:00:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3204710115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 msgr2=0x556c94bb9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bb9150 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00bc80 tx=0x7ff63c00bf90 comp rx=0 tx=0).stop 2023-10-14T09:00:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3204710115 shutdown_connections 2023-10-14T09:00:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bc6cc0 0x556c94bc90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bb9f60 0x556c94bb8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3204710115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bb9150 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3204710115 >> 172.21.15.6:0/3204710115 conn(0x556c94ae6d70 msgr2=0x556c94bb39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3204710115 shutdown_connections 2023-10-14T09:00:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3204710115 wait complete. 2023-10-14T09:00:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.720+0000 7ff65f9f3b80 1 -- start start 2023-10-14T09:00:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 Processor -- start 2023-10-14T09:00:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bdbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 0x556c94bdc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94b0be10 con 0x556c94bb8cd0 2023-10-14T09:00:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94aa86b0 con 0x556c94bb9f60 2023-10-14T09:00:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94aa8350 con 0x556c94bc6cc0 2023-10-14T09:00:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff65f9f3b80 10 client.0 _ll_register_callbacks cb 0x556c949057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:58.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff6515a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bdbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff650da4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 0x556c94bdc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff651da6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff650da4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 0x556c94bdc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33814/0 (socket says 172.21.15.6:33814) 2023-10-14T09:00:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff6515a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bdbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35054/0 (socket says 172.21.15.6:35054) 2023-10-14T09:00:58.734 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.721+0000 7ff650da4700 1 -- 172.21.15.6:0/1544987827 learned_addr learned my addr 172.21.15.6:0/1544987827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff650da4700 1 -- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 msgr2=0x556c94be34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff650da4700 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff650da4700 1 -- 172.21.15.6:0/1544987827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 msgr2=0x556c94bdbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff650da4700 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bdbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff650da4700 1 -- 172.21.15.6:0/1544987827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c00b8e0 con 0x556c94bb9f60 2023-10-14T09:00:58.735 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff6515a5700 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bdbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:00:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff650da4700 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 0x556c94bdc470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff63c000c00 tx=0x7ff63c010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12269976ffb0d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff634ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:00:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff634ff9700 1 -- 172.21.15.6:0/1544987827 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c020070 con 0x556c94bb9f60 2023-10-14T09:00:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff634ff9700 1 -- 172.21.15.6:0/1544987827 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff63c017070 con 0x556c94bb9f60 2023-10-14T09:00:58.736 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c94b10e90 con 0x556c94bb9f60 2023-10-14T09:00:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff634ff9700 1 -- 172.21.15.6:0/1544987827 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c004820 con 0x556c94bb9f60 2023-10-14T09:00:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff65f9f3b80 10 client.25838 fetch_fsmap learned FSMap version 44 2023-10-14T09:00:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.722+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x556c94936d80 con 0x556c94bb9f60 2023-10-14T09:00:58.737 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.723+0000 7ff634ff9700 1 -- 172.21.15.6:0/1544987827 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c94b10e90 con 0x556c94bb9f60 2023-10-14T09:00:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff634ff9700 1 -- 172.21.15.6:0/1544987827 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 44) v1 ==== 7886+0+0 (secure 0 0 0) 0x7ff63c011440 con 0x556c94bb9f60 2023-10-14T09:00:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff65f9f3b80 10 client.25838 fetch_fsmap finished waiting for FSMap version 44 2023-10-14T09:00:58.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff65f9f3b80 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff65f9f3b80 20 client.25838 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94be7d20 0x556c94bea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff65f9f3b80 4 client.25838 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:00:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c94b88bb0 con 0x556c94be7d20 2023-10-14T09:00:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.724+0000 7ff6515a5700 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94be7d20 0x556c94bea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.725+0000 7ff634ff9700 10 client.25838 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.725+0000 7ff6515a5700 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94be7d20 0x556c94bea140 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a850bd6ff8b581 server_cookie=8767983a26da0533 in_seq=0 out_seq=0 2023-10-14T09:00:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.725+0000 7ff634ff9700 1 -- 172.21.15.6:0/1544987827 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556c94b88bb0 con 0x556c94be7d20 2023-10-14T09:00:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.725+0000 7ff634ff9700 10 client.25838 handle_command_reply: tid=0 2023-10-14T09:00:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.726+0000 7ff65f9f3b80 1 client.25838 shutdown 2023-10-14T09:00:58.741 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 msgr2=0x556c94bdc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 0x556c94bdc470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff63c000c00 tx=0x7ff63c010c10 comp rx=0 tx=0).stop 2023-10-14T09:00:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 shutdown_connections 2023-10-14T09:00:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94be7d20 0x556c94bea140 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff634ff9700 0 client.25838 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb8cd0 0x556c94bdbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1544987827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb9f60 0x556c94bdc470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 >> 172.21.15.6:0/1544987827 conn(0x556c94ae6d70 msgr2=0x556c94bb3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 shutdown_connections 2023-10-14T09:00:58.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1544987827 wait complete. 2023-10-14T09:00:58.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.727+0000 7ff65f9f3b80 20 client.25838 trim_cache size 0 max 16384 2023-10-14T09:00:58.744 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:58 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:00:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 Processor -- start 2023-10-14T09:00:58.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 -- start start 2023-10-14T09:00:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94bc62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94bdbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.746 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c9498c8c0 con 0x556c94bb9f60 2023-10-14T09:00:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94b10e90 con 0x556c94bb8cd0 2023-10-14T09:00:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94bdb430 con 0x556c94bc6cc0 2023-10-14T09:00:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff650da4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff650da4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35062/0 (socket says 172.21.15.6:35062) 2023-10-14T09:00:58.747 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff650da4700 1 -- 172.21.15.6:0/3309107575 learned_addr learned my addr 172.21.15.6:0/3309107575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff651da6700 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94bdbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.748 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.744+0000 7ff6515a5700 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94bc62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff650da4700 1 -- 172.21.15.6:0/3309107575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 msgr2=0x556c94bdbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff650da4700 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94bdbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.749 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff650da4700 1 -- 172.21.15.6:0/3309107575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 msgr2=0x556c94bc62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff650da4700 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94bc62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff650da4700 1 -- 172.21.15.6:0/3309107575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c9491fc00 con 0x556c94bb9f60 2023-10-14T09:00:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff651da6700 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94bdbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:00:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.745+0000 7ff650da4700 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be33d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00b5a0 tx=0x7ff63c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9a17fcded434c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.746+0000 7ff637fff700 1 -- 172.21.15.6:0/3309107575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c020070 con 0x556c94bb9f60 2023-10-14T09:00:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.746+0000 7ff637fff700 1 -- 172.21.15.6:0/3309107575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c011440 con 0x556c94bb9f60 2023-10-14T09:00:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.746+0000 7ff637fff700 1 -- 172.21.15.6:0/3309107575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c012ea0 con 0x556c94bb9f60 2023-10-14T09:00:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3309107575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 msgr2=0x556c94be33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be33d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00b5a0 tx=0x7ff63c005f60 comp rx=0 tx=0).stop 2023-10-14T09:00:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3309107575 shutdown_connections 2023-10-14T09:00:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94bdbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94bc62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/3309107575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be33d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3309107575 >> 172.21.15.6:0/3309107575 conn(0x556c94ae6d70 msgr2=0x556c94bc2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3309107575 shutdown_connections 2023-10-14T09:00:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.747+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/3309107575 wait complete. 2023-10-14T09:00:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.748+0000 7ff65f9f3b80 1 -- start start 2023-10-14T09:00:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.748+0000 7ff65f9f3b80 1 Processor -- start 2023-10-14T09:00:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.748+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94be1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.748+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff65f9f3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94be2c10 con 0x556c94bb9f60 2023-10-14T09:00:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94be2d80 con 0x556c94bb8cd0 2023-10-14T09:00:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff65f9f3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c94be2f40 con 0x556c94bc6cc0 2023-10-14T09:00:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff65f9f3b80 10 client.0 _ll_register_callbacks cb 0x7ff648009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:00:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94be1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94be1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33826/0 (socket says 172.21.15.6:33826) 2023-10-14T09:00:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 -- 172.21.15.6:0/1513460995 learned_addr learned my addr 172.21.15.6:0/1513460995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:00:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff651da6700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff650da4700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 -- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 msgr2=0x556c94be26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 -- 172.21.15.6:0/1513460995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 msgr2=0x556c94be16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:00:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff6515a5700 1 -- 172.21.15.6:0/1513460995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c19f100 con 0x556c94bb8cd0 2023-10-14T09:00:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.749+0000 7ff650da4700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:00:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff6515a5700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94be1180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff648007b70 tx=0x7ff648004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4839ae8e6537d3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:00:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff634ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:00:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff634ff9700 1 -- 172.21.15.6:0/1513460995 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64802a070 con 0x556c94bb8cd0 2023-10-14T09:00:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff634ff9700 1 -- 172.21.15.6:0/1513460995 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff64802a7a0 con 0x556c94bb8cd0 2023-10-14T09:00:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff63c015070 con 0x556c94bb8cd0 2023-10-14T09:00:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff634ff9700 1 -- 172.21.15.6:0/1513460995 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff64800e050 con 0x556c94bb8cd0 2023-10-14T09:00:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff65f9f3b80 10 client.25844 fetch_fsmap learned FSMap version 44 2023-10-14T09:00:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x556c94936d80 con 0x556c94bb8cd0 2023-10-14T09:00:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.750+0000 7ff634ff9700 1 -- 172.21.15.6:0/1513460995 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c015070 con 0x556c94bb8cd0 2023-10-14T09:00:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff634ff9700 1 -- 172.21.15.6:0/1513460995 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 44) v1 ==== 7886+0+0 (secure 0 0 0) 0x7ff6480249b0 con 0x556c94bb8cd0 2023-10-14T09:00:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff65f9f3b80 10 client.25844 fetch_fsmap finished waiting for FSMap version 44 2023-10-14T09:00:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff65f9f3b80 10 client.25844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:00:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff65f9f3b80 20 client.25844 populate_metadata read hostname 'smithi006' 2023-10-14T09:00:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94c3c9f0 0x556c94c3ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:00:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff65f9f3b80 4 client.25844 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:00:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556c94b04df0 con 0x556c94c3c9f0 2023-10-14T09:00:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff650da4700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94c3c9f0 0x556c94c3ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:00:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff634ff9700 10 client.25844 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.751+0000 7ff650da4700 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94c3c9f0 0x556c94c3ee10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdf839d06f5a3e6a server_cookie=ab5fdd3f97f02fd5 in_seq=0 out_seq=0 2023-10-14T09:00:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff634ff9700 1 -- 172.21.15.6:0/1513460995 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556c94b04df0 con 0x556c94c3c9f0 2023-10-14T09:00:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff634ff9700 10 client.25844 handle_command_reply: tid=0 2023-10-14T09:00:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 client.25844 shutdown 2023-10-14T09:00:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 msgr2=0x556c94be1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94be1180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff648007b70 tx=0x7ff648004ad0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 shutdown_connections 2023-10-14T09:00:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556c94c3c9f0 0x556c94c3ee10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556c94bc6cc0 0x556c94be26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff634ff9700 0 client.25844 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:00:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556c94bb8cd0 0x556c94be1180 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 --2- 172.21.15.6:0/1513460995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c94bb9f60 0x556c94be16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 >> 172.21.15.6:0/1513460995 conn(0x556c94ae6d70 msgr2=0x556c94bc62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 shutdown_connections 2023-10-14T09:00:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 1 -- 172.21.15.6:0/1513460995 wait complete. 2023-10-14T09:00:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.854+0000 7ff65f9f3b80 20 client.25844 trim_cache size 0 max 16384 2023-10-14T09:00:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:00:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:00:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:00:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:00:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6380a1500 msgr2=0x7ff6380a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6380a1500 0x7ff6380a39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff64c068200 tx=0x7ff64800b040 comp rx=0 tx=0).stop 2023-10-14T09:00:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 msgr2=0x7ff64c19e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:00:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 0x7ff64c19e160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff644005910 tx=0x7ff644005720 comp rx=0 tx=0).stop 2023-10-14T09:00:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 shutdown_connections 2023-10-14T09:00:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff64c1013e0 0x7ff64c19e160 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff64c100080 0x7ff64c196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff6380a1500 0x7ff6380a39c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 --2- 172.21.15.6:0/603439306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff64c100a20 0x7ff64c1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:00:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 >> 172.21.15.6:0/603439306 conn(0x7ff64c0faaf0 msgr2=0x7ff64c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:00:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 shutdown_connections 2023-10-14T09:00:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:00:58.855+0000 7ff653809700 1 -- 172.21.15.6:0/603439306 wait complete. 2023-10-14T09:00:58.883 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:58 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:00:58.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:58 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:00:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:00:59 smithi006 ceph-mon[99452]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 848 op/s 2023-10-14T09:00:59.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:00:59 smithi178 ceph-mon[103612]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 848 op/s 2023-10-14T09:00:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:00:59 smithi057 ceph-mon[103313]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 848 op/s 2023-10-14T09:01:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 480.0 s, 1676.8 tps, lat 59.552 ms stddev 66.453 2023-10-14T09:01:01.757 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:01 smithi057 ceph-mon[103313]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-14T09:01:01.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:01 smithi178 ceph-mon[103612]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-14T09:01:01.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:01 smithi006 ceph-mon[99452]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 13 MiB/s wr, 752 op/s 2023-10-14T09:01:03.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:03 smithi178 ceph-mon[103612]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 17 MiB/s wr, 847 op/s 2023-10-14T09:01:03.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:03 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:01:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:03 smithi057 ceph-mon[103313]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 17 MiB/s wr, 847 op/s 2023-10-14T09:01:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:03 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:01:03.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:03 smithi006 ceph-mon[99452]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 17 MiB/s wr, 847 op/s 2023-10-14T09:01:03.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:03 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:01:04.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:04 smithi178 ceph-mon[103612]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 18 MiB/s wr, 824 op/s 2023-10-14T09:01:04.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:04 smithi057 ceph-mon[103313]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 18 MiB/s wr, 824 op/s 2023-10-14T09:01:04.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:04 smithi006 ceph-mon[99452]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 18 MiB/s wr, 824 op/s 2023-10-14T09:01:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 485.0 s, 1823.8 tps, lat 55.063 ms stddev 58.025 2023-10-14T09:01:07.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:07 smithi178 ceph-mon[103612]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 805 op/s 2023-10-14T09:01:07.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:07 smithi057 ceph-mon[103313]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 805 op/s 2023-10-14T09:01:07.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:07 smithi006 ceph-mon[99452]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 805 op/s 2023-10-14T09:01:09.640 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:09 smithi178 ceph-mon[103612]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 18 MiB/s wr, 794 op/s 2023-10-14T09:01:09.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:09 smithi057 ceph-mon[103313]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 18 MiB/s wr, 794 op/s 2023-10-14T09:01:09.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:09 smithi006 ceph-mon[99452]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 18 MiB/s wr, 794 op/s 2023-10-14T09:01:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 490.0 s, 1230.8 tps, lat 77.231 ms stddev 148.504 2023-10-14T09:01:11.644 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:11 smithi178 ceph-mon[103612]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 666 op/s 2023-10-14T09:01:11.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:11 smithi057 ceph-mon[103313]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 666 op/s 2023-10-14T09:01:11.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:11 smithi006 ceph-mon[99452]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 666 op/s 2023-10-14T09:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 -- 172.21.15.6:0/2617665435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d0107eb0 msgr2=0x7f32d010a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 --2- 172.21.15.6:0/2617665435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d0107eb0 0x7f32d010a2e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009990 tx=0x7f32c0009ca0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 -- 172.21.15.6:0/2617665435 shutdown_connections 2023-10-14T09:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 --2- 172.21.15.6:0/2617665435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32d010d1f0 0x7f32d010d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 --2- 172.21.15.6:0/2617665435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d0107eb0 0x7f32d010a2e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 --2- 172.21.15.6:0/2617665435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32d010a820 0x7f32d010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.034+0000 7f32d5bee700 1 -- 172.21.15.6:0/2617665435 >> 172.21.15.6:0/2617665435 conn(0x7f32d006dcf0 msgr2=0x7f32d0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:12.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.049+0000 7f32d5bee700 1 -- 172.21.15.6:0/2617665435 shutdown_connections 2023-10-14T09:01:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.052+0000 7f32d5bee700 1 -- 172.21.15.6:0/2617665435 wait complete. 2023-10-14T09:01:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.052+0000 7f32d5bee700 1 Processor -- start 2023-10-14T09:01:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 -- start start 2023-10-14T09:01:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32d0107eb0 0x7f32d01a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32d010a820 0x7f32d01a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 0x7f32d01acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d01ad4c0 con 0x7f32d010d1f0 2023-10-14T09:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d010f5e0 con 0x7f32d0107eb0 2023-10-14T09:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.059+0000 7f32d5bee700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d010f770 con 0x7f32d010a820 2023-10-14T09:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 0x7f32d01acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 0x7f32d01acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35084/0 (socket says 172.21.15.6:35084) 2023-10-14T09:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 -- 172.21.15.6:0/1838081917 learned_addr learned my addr 172.21.15.6:0/1838081917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 -- 172.21.15.6:0/1838081917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32d010a820 msgr2=0x7f32d01a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32d010a820 0x7f32d01a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 -- 172.21.15.6:0/1838081917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32d0107eb0 msgr2=0x7f32d01a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32d0107eb0 0x7f32d01a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.060+0000 7f32cffff700 1 -- 172.21.15.6:0/1838081917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00095f0 con 0x7f32d010d1f0 2023-10-14T09:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.061+0000 7f32cffff700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 0x7f32d01acef0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f32c800ef30 tx=0x7f32c800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.061+0000 7f32ccff9700 1 -- 172.21.15.6:0/1838081917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8018070 con 0x7f32d010d1f0 2023-10-14T09:01:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.061+0000 7f32ccff9700 1 -- 172.21.15.6:0/1838081917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32c800f040 con 0x7f32d010d1f0 2023-10-14T09:01:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.061+0000 7f32ccff9700 1 -- 172.21.15.6:0/1838081917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8003dc0 con 0x7f32d010d1f0 2023-10-14T09:01:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.061+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d010f9f0 con 0x7f32d010d1f0 2023-10-14T09:01:12.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.061+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d010feb0 con 0x7f32d010d1f0 2023-10-14T09:01:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.065+0000 7f32ccff9700 1 -- 172.21.15.6:0/1838081917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f32c800caa0 con 0x7f32d010d1f0 2023-10-14T09:01:12.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.066+0000 7f32e1dd8b80 1 Processor -- start 2023-10-14T09:01:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.066+0000 7f32ccff9700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32b80a1500 0x7f32b80a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.066+0000 7f32e1dd8b80 1 -- start start 2023-10-14T09:01:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.066+0000 7f32ccff9700 1 -- 172.21.15.6:0/1838081917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f32c80cc0d0 con 0x7f32d010d1f0 2023-10-14T09:01:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.066+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef618c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.067+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef619ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.067+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.067+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef58dc10 con 0x55bdef618850 2023-10-14T09:01:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.067+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef572c00 con 0x55bdef6191b0 2023-10-14T09:01:12.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.067+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef570520 con 0x55bdef61a0a0 2023-10-14T09:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef618c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef618c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35092/0 (socket says 172.21.15.6:35092) 2023-10-14T09:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32ceffd700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32b80a1500 0x7f32b80a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 -- 172.21.15.6:0/2116971553 learned_addr learned my addr 172.21.15.6:0/2116971553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 -- 172.21.15.6:0/2116971553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 msgr2=0x55bdef61a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 -- 172.21.15.6:0/2116971553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 msgr2=0x55bdef619ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef619ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.068+0000 7f32cf7fe700 1 -- 172.21.15.6:0/2116971553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdef529390 con 0x55bdef618850 2023-10-14T09:01:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.069+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef618c70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f32c0006010 tx=0x7f32c0009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc1d13dbc1c59df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.069+0000 7f32ceffd700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32b80a1500 0x7f32b80a39c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f32d00727a0 tx=0x7f32c4009780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.069+0000 7f32b5ffb700 1 -- 172.21.15.6:0/2116971553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c001d070 con 0x55bdef618850 2023-10-14T09:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.069+0000 7f32b5ffb700 1 -- 172.21.15.6:0/2116971553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32c000bd10 con 0x55bdef618850 2023-10-14T09:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.069+0000 7f32b5ffb700 1 -- 172.21.15.6:0/2116971553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c000fe20 con 0x55bdef618850 2023-10-14T09:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2116971553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 msgr2=0x55bdef618c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef618c70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f32c0006010 tx=0x7f32c0009530 comp rx=0 tx=0).stop 2023-10-14T09:01:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2116971553 shutdown_connections 2023-10-14T09:01:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef618c70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2116971553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef619ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2116971553 >> 172.21.15.6:0/2116971553 conn(0x55bdef546d70 msgr2=0x55bdef613c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2116971553 shutdown_connections 2023-10-14T09:01:12.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2116971553 wait complete. 2023-10-14T09:01:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.070+0000 7f32e1dd8b80 1 -- start start 2023-10-14T09:01:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 Processor -- start 2023-10-14T09:01:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef618850 0x55bdef622780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 0x55bdef622cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef629d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef56be10 con 0x55bdef6191b0 2023-10-14T09:01:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef5086b0 con 0x55bdef61a0a0 2023-10-14T09:01:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef508350 con 0x55bdef618850 2023-10-14T09:01:12.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32e1dd8b80 10 client.0 _ll_register_callbacks cb 0x55bdef3657a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32ceffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 0x55bdef622cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.071+0000 7f32ceffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 0x55bdef622cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35098/0 (socket says 172.21.15.6:35098) 2023-10-14T09:01:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 -- 172.21.15.6:0/3969951944 learned_addr learned my addr 172.21.15.6:0/3969951944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:12.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 -- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef618850 msgr2=0x55bdef622780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:01:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef618850 0x55bdef622780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 -- 172.21.15.6:0/3969951944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 msgr2=0x55bdef629d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef629d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 -- 172.21.15.6:0/3969951944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d010e240 con 0x55bdef6191b0 2023-10-14T09:01:12.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32ceffd700 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 0x55bdef622cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32c40126d0 tx=0x7f32c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7502b7ee37b48d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:01:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.072+0000 7f32aeffd700 1 -- 172.21.15.6:0/3969951944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c401e630 con 0x55bdef6191b0 2023-10-14T09:01:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32aeffd700 1 -- 172.21.15.6:0/3969951944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f32c401e790 con 0x55bdef6191b0 2023-10-14T09:01:12.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdef570e90 con 0x55bdef6191b0 2023-10-14T09:01:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32aeffd700 1 -- 172.21.15.6:0/3969951944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c401e950 con 0x55bdef6191b0 2023-10-14T09:01:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 10 client.16257 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55bdef396d80 con 0x55bdef6191b0 2023-10-14T09:01:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32aeffd700 1 -- 172.21.15.6:0/3969951944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bdef570e90 con 0x55bdef6191b0 2023-10-14T09:01:12.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32aeffd700 1 -- 172.21.15.6:0/3969951944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f32c40319c0 con 0x55bdef6191b0 2023-10-14T09:01:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 10 client.16257 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 20 client.16257 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef62e6b0 0x55bdef630af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 4 client.16257 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:01:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.073+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdef5e8bb0 con 0x55bdef62e6b0 2023-10-14T09:01:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.074+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef62e6b0 0x55bdef630af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.075+0000 7f32aeffd700 10 client.16257 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.075+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef62e6b0 0x55bdef630af0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7680befc233134a server_cookie=69aa38a1a630b7d0 in_seq=0 out_seq=0 2023-10-14T09:01:12.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.075+0000 7f32aeffd700 1 -- 172.21.15.6:0/3969951944 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bdef5e8bb0 con 0x55bdef62e6b0 2023-10-14T09:01:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.075+0000 7f32aeffd700 10 client.16257 handle_command_reply: tid=0 2023-10-14T09:01:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 client.16257 shutdown 2023-10-14T09:01:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 msgr2=0x55bdef622cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 0x55bdef622cc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32c40126d0 tx=0x7f32c4004750 comp rx=0 tx=0).stop 2023-10-14T09:01:12.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 shutdown_connections 2023-10-14T09:01:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef62e6b0 0x55bdef630af0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef629d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32aeffd700 0 client.16257 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:12.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef618850 0x55bdef622780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3969951944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef6191b0 0x55bdef622cc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 >> 172.21.15.6:0/3969951944 conn(0x55bdef546d70 msgr2=0x55bdef613830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 shutdown_connections 2023-10-14T09:01:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3969951944 wait complete. 2023-10-14T09:01:12.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.076+0000 7f32e1dd8b80 20 client.16257 trim_cache size 0 max 16384 2023-10-14T09:01:12.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 Processor -- start 2023-10-14T09:01:12.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 -- start start 2023-10-14T09:01:12.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef61d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef629cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef3ec8c0 con 0x55bdef618850 2023-10-14T09:01:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef60ef70 con 0x55bdef6191b0 2023-10-14T09:01:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.102+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef619f20 con 0x55bdef61a0a0 2023-10-14T09:01:12.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32cffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef629cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef629cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33864/0 (socket says 172.21.15.6:33864) 2023-10-14T09:01:12.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32cffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60738/0 (socket says 172.21.15.6:60738) 2023-10-14T09:01:12.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 -- 172.21.15.6:0/3029752996 learned_addr learned my addr 172.21.15.6:0/3029752996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef61d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 -- 172.21.15.6:0/3029752996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 msgr2=0x55bdef61d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 -- 172.21.15.6:0/3029752996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 msgr2=0x55bdef61d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef61d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 -- 172.21.15.6:0/3029752996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdef37fc00 con 0x55bdef6191b0 2023-10-14T09:01:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32cffff700 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:01:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.103+0000 7f32ceffd700 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef629cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32c4031d70 tx=0x7f32c40095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9be9b56da99cb94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:12.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.104+0000 7f32b67fc700 1 -- 172.21.15.6:0/3029752996 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4012ea0 con 0x55bdef6191b0 2023-10-14T09:01:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.104+0000 7f32b67fc700 1 -- 172.21.15.6:0/3029752996 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32c40099f0 con 0x55bdef6191b0 2023-10-14T09:01:12.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.104+0000 7f32b67fc700 1 -- 172.21.15.6:0/3029752996 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c401ec50 con 0x55bdef6191b0 2023-10-14T09:01:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3029752996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 msgr2=0x55bdef629cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef629cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32c4031d70 tx=0x7f32c40095c0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3029752996 shutdown_connections 2023-10-14T09:01:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef61a0a0 0x55bdef61d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef61d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/3029752996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef6191b0 0x55bdef629cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.105+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3029752996 >> 172.21.15.6:0/3029752996 conn(0x55bdef546d70 msgr2=0x55bdef620530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.106+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3029752996 shutdown_connections 2023-10-14T09:01:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.106+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/3029752996 wait complete. 2023-10-14T09:01:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.106+0000 7f32e1dd8b80 1 -- start start 2023-10-14T09:01:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 Processor -- start 2023-10-14T09:01:12.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef627940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef6191b0 0x55bdef627e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef628e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef6293d0 con 0x55bdef618850 2023-10-14T09:01:12.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef629540 con 0x55bdef61a0a0 2023-10-14T09:01:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdef629700 con 0x55bdef6191b0 2023-10-14T09:01:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32e1dd8b80 10 client.0 _ll_register_callbacks cb 0x7f32c4010ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef628e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef627940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef628e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33872/0 (socket says 172.21.15.6:33872) 2023-10-14T09:01:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 -- 172.21.15.6:0/2438409079 learned_addr learned my addr 172.21.15.6:0/2438409079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32ceffd700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef6191b0 0x55bdef627e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef627940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35110/0 (socket says 172.21.15.6:35110) 2023-10-14T09:01:12.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 -- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef6191b0 msgr2=0x55bdef627e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef6191b0 0x55bdef627e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 -- 172.21.15.6:0/2438409079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 msgr2=0x55bdef627940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.107+0000 7f32cffff700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef627940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.108+0000 7f32cffff700 1 -- 172.21.15.6:0/2438409079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bdef396d80 con 0x55bdef61a0a0 2023-10-14T09:01:12.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.108+0000 7f32cffff700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef628e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32c8095e60 tx=0x7f32c8054470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a509d1abbdd18b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.108+0000 7f32aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:01:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.108+0000 7f32aeffd700 1 -- 172.21.15.6:0/2438409079 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8053070 con 0x55bdef61a0a0 2023-10-14T09:01:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.108+0000 7f32aeffd700 1 -- 172.21.15.6:0/2438409079 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f32c809d540 con 0x55bdef61a0a0 2023-10-14T09:01:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.108+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32c000bd10 con 0x55bdef61a0a0 2023-10-14T09:01:12.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32aeffd700 1 -- 172.21.15.6:0/2438409079 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c80a1780 con 0x55bdef61a0a0 2023-10-14T09:01:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32e1dd8b80 10 client.25853 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55bdef3bd1f0 con 0x55bdef61a0a0 2023-10-14T09:01:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32aeffd700 1 -- 172.21.15.6:0/2438409079 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32c000bd10 con 0x55bdef61a0a0 2023-10-14T09:01:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32aeffd700 1 -- 172.21.15.6:0/2438409079 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f32c80b0030 con 0x55bdef61a0a0 2023-10-14T09:01:12.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32e1dd8b80 10 client.25853 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.109+0000 7f32e1dd8b80 10 client.25853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.110+0000 7f32e1dd8b80 20 client.25853 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.110+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef683450 0x55bdef685870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:12.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.110+0000 7f32e1dd8b80 4 client.25853 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:01:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.110+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bdef564df0 con 0x55bdef683450 2023-10-14T09:01:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.110+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef683450 0x55bdef685870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.110+0000 7f32aeffd700 10 client.25853 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:12.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.111+0000 7f32cf7fe700 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef683450 0x55bdef685870 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a677a253d6a85e94 server_cookie=fc6b7d84f8512c80 in_seq=0 out_seq=0 2023-10-14T09:01:12.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.148+0000 7f32aeffd700 1 -- 172.21.15.6:0/2438409079 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bdef564df0 con 0x55bdef683450 2023-10-14T09:01:12.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.148+0000 7f32aeffd700 10 client.25853 handle_command_reply: tid=0 2023-10-14T09:01:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.148+0000 7f32e1dd8b80 1 client.25853 shutdown 2023-10-14T09:01:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 msgr2=0x55bdef628e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef628e90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32c8095e60 tx=0x7f32c8054470 comp rx=0 tx=0).stop 2023-10-14T09:01:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 shutdown_connections 2023-10-14T09:01:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bdef683450 0x55bdef685870 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bdef61a0a0 0x55bdef628e90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bdef618850 0x55bdef627940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32aeffd700 0 client.25853 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 --2- 172.21.15.6:0/2438409079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bdef6191b0 0x55bdef627e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 >> 172.21.15.6:0/2438409079 conn(0x55bdef546d70 msgr2=0x55bdef61d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 shutdown_connections 2023-10-14T09:01:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.149+0000 7f32e1dd8b80 1 -- 172.21.15.6:0/2438409079 wait complete. 2023-10-14T09:01:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32e1dd8b80 20 client.25853 trim_cache size 0 max 16384 2023-10-14T09:01:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:01:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:01:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:01:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:01:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32b80a1500 msgr2=0x7f32b80a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32b80a1500 0x7f32b80a39c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f32d00727a0 tx=0x7f32c4009780 comp rx=0 tx=0).stop 2023-10-14T09:01:12.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 msgr2=0x7f32d01acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 0x7f32d01acef0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f32c800ef30 tx=0x7f32c800c450 comp rx=0 tx=0).stop 2023-10-14T09:01:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 shutdown_connections 2023-10-14T09:01:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32d010d1f0 0x7f32d01acef0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f32b80a1500 0x7f32b80a39c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32d0107eb0 0x7f32d01a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 --2- 172.21.15.6:0/1838081917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32d010a820 0x7f32d01a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.150+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 >> 172.21.15.6:0/1838081917 conn(0x7f32d006dcf0 msgr2=0x7f32d010b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.151+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 shutdown_connections 2023-10-14T09:01:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:12.151+0000 7f32d5bee700 1 -- 172.21.15.6:0/1838081917 wait complete. 2023-10-14T09:01:13.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:13 smithi178 ceph-mon[103612]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 1.25k op/s 2023-10-14T09:01:13.706 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:13 smithi057 ceph-mon[103313]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 1.25k op/s 2023-10-14T09:01:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:13 smithi006 ceph-mon[99452]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 1.25k op/s 2023-10-14T09:01:15.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:15 smithi178 ceph-mon[103612]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 MiB/s wr, 1.65k op/s 2023-10-14T09:01:15.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:15 smithi057 ceph-mon[103313]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 MiB/s wr, 1.65k op/s 2023-10-14T09:01:15.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:15 smithi006 ceph-mon[99452]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 MiB/s wr, 1.65k op/s 2023-10-14T09:01:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 495.0 s, 1744.2 tps, lat 60.056 ms stddev 90.069 2023-10-14T09:01:17.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:17 smithi178 ceph-mon[103612]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 2.01k op/s 2023-10-14T09:01:17.698 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:17 smithi057 ceph-mon[103313]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 2.01k op/s 2023-10-14T09:01:17.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:17 smithi006 ceph-mon[99452]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 2.01k op/s 2023-10-14T09:01:19.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:19 smithi178 ceph-mon[103612]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 36 MiB/s wr, 2.03k op/s 2023-10-14T09:01:19.702 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:19 smithi057 ceph-mon[103313]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 36 MiB/s wr, 2.03k op/s 2023-10-14T09:01:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:19 smithi006 ceph-mon[99452]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 36 MiB/s wr, 2.03k op/s 2023-10-14T09:01:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 500.0 s, 1935.2 tps, lat 51.529 ms stddev 58.463 2023-10-14T09:01:21.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:21 smithi178 ceph-mon[103612]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.96k op/s 2023-10-14T09:01:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:21 smithi057 ceph-mon[103313]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.96k op/s 2023-10-14T09:01:21.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:21 smithi006 ceph-mon[99452]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.96k op/s 2023-10-14T09:01:23.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:23 smithi057 ceph-mon[103313]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 2.01k op/s 2023-10-14T09:01:23.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:23 smithi006 ceph-mon[99452]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 2.01k op/s 2023-10-14T09:01:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:23 smithi178 ceph-mon[103612]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 2.01k op/s 2023-10-14T09:01:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1043797946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98101930 msgr2=0x7faa981081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1043797946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98101930 0x7faa981081e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faa9000b0d0 tx=0x7faa9000b3e0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1043797946 shutdown_connections 2023-10-14T09:01:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1043797946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98101930 0x7faa981081e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1043797946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 0x7faa981001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1043797946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa98100f90 0x7faa981013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1043797946 >> 172.21.15.6:0/1043797946 conn(0x7faa980fb2d0 msgr2=0x7faa980fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1043797946 shutdown_connections 2023-10-14T09:01:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.299+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1043797946 wait complete. 2023-10-14T09:01:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 Processor -- start 2023-10-14T09:01:25.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 -- start start 2023-10-14T09:01:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 0x7faa980699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 0x7faa9819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa98101930 0x7faa9819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9819e830 con 0x7faa98100f90 2023-10-14T09:01:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9819e9a0 con 0x7faa980ffda0 2023-10-14T09:01:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa9e5a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9819eb60 con 0x7faa98101930 2023-10-14T09:01:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 0x7faa9819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 0x7faa9819ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35126/0 (socket says 172.21.15.6:35126) 2023-10-14T09:01:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa977fe700 1 -- 172.21.15.6:0/1680692116 learned_addr learned my addr 172.21.15.6:0/1680692116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.300+0000 7faa97fff700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 0x7faa980699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa977fe700 1 -- 172.21.15.6:0/1680692116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa98101930 msgr2=0x7faa9819e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa977fe700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa98101930 0x7faa9819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa977fe700 1 -- 172.21.15.6:0/1680692116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 msgr2=0x7faa980699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa977fe700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 0x7faa980699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa977fe700 1 -- 172.21.15.6:0/1680692116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009d00 con 0x7faa98100f90 2023-10-14T09:01:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa97fff700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 0x7faa980699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa977fe700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 0x7faa9819ba10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e9a0 tx=0x7faa8c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa957fa700 1 -- 172.21.15.6:0/1680692116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c009790 con 0x7faa98100f90 2023-10-14T09:01:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa957fa700 1 -- 172.21.15.6:0/1680692116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8c00cbd0 con 0x7faa98100f90 2023-10-14T09:01:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa957fa700 1 -- 172.21.15.6:0/1680692116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c018680 con 0x7faa98100f90 2023-10-14T09:01:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9819ee40 con 0x7faa98100f90 2023-10-14T09:01:25.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.301+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9819f2c0 con 0x7faa98100f90 2023-10-14T09:01:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.306+0000 7faa957fa700 1 -- 172.21.15.6:0/1680692116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7faa8c00cd40 con 0x7faa98100f90 2023-10-14T09:01:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.306+0000 7faaaa793b80 1 Processor -- start 2023-10-14T09:01:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.306+0000 7faaaa793b80 1 -- start start 2023-10-14T09:01:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea6a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faaaa793b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea617c10 con 0x55f8ea6a31b0 2023-10-14T09:01:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faaaa793b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea5fcc00 con 0x55f8ea6a2850 2023-10-14T09:01:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faaaa793b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea5fa520 con 0x55f8ea6a40a0 2023-10-14T09:01:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa957fa700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa800a1580 0x7faa800a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6a3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35132/0 (socket says 172.21.15.6:35132) 2023-10-14T09:01:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 -- 172.21.15.6:0/2165296394 learned_addr learned my addr 172.21.15.6:0/2165296394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa9cb46700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa800a1580 0x7faa800a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa957fa700 1 -- 172.21.15.6:0/1680692116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faa8c014070 con 0x7faa98100f90 2023-10-14T09:01:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa9cb46700 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea6a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 -- 172.21.15.6:0/2165296394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 msgr2=0x55f8ea6a4520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:01:25.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a4520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 -- 172.21.15.6:0/2165296394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 msgr2=0x55f8ea6a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea6a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa97fff700 1 -- 172.21.15.6:0/2165296394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ea5b3390 con 0x55f8ea6a31b0 2023-10-14T09:01:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.307+0000 7faa9cb46700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa800a1580 0x7faa800a3a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faa90005c20 tx=0x7faa90005b90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:25.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.308+0000 7faa97fff700 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6a3ac0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faa880115c0 tx=0x7faa880118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba3c091a8e27956 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.308+0000 7faa7e7fc700 1 -- 172.21.15.6:0/2165296394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88004220 con 0x55f8ea6a31b0 2023-10-14T09:01:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.308+0000 7faa7e7fc700 1 -- 172.21.15.6:0/2165296394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa88004cf0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.308+0000 7faa7e7fc700 1 -- 172.21.15.6:0/2165296394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa880055e0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 -- 172.21.15.6:0/2165296394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 msgr2=0x55f8ea6a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6a3ac0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7faa880115c0 tx=0x7faa880118d0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 -- 172.21.15.6:0/2165296394 shutdown_connections 2023-10-14T09:01:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea6a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2165296394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6a3ac0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 -- 172.21.15.6:0/2165296394 >> 172.21.15.6:0/2165296394 conn(0x55f8ea5d0d70 msgr2=0x55f8ea69dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 -- 172.21.15.6:0/2165296394 shutdown_connections 2023-10-14T09:01:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 -- 172.21.15.6:0/2165296394 wait complete. 2023-10-14T09:01:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.309+0000 7faaaa793b80 1 -- start start 2023-10-14T09:01:25.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 Processor -- start 2023-10-14T09:01:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a2850 0x55f8ea6ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea5f5e10 con 0x55f8ea6a31b0 2023-10-14T09:01:25.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea5926b0 con 0x55f8ea6a40a0 2023-10-14T09:01:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea592350 con 0x55f8ea6a2850 2023-10-14T09:01:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faaaa793b80 10 client.0 _ll_register_callbacks cb 0x55f8ea3ef7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faa977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faa977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35140/0 (socket says 172.21.15.6:35140) 2023-10-14T09:01:25.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faa977fe700 1 -- 172.21.15.6:0/1938064649 learned_addr learned my addr 172.21.15.6:0/1938064649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faa97fff700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a2850 0x55f8ea6ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.310+0000 7faa9cb46700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa97fff700 1 -- 172.21.15.6:0/1938064649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a40a0 msgr2=0x55f8ea6b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa97fff700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa97fff700 1 -- 172.21.15.6:0/1938064649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 msgr2=0x55f8ea6acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa97fff700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa97fff700 1 -- 172.21.15.6:0/1938064649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa88009d50 con 0x55f8ea6a2850 2023-10-14T09:01:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa977fe700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:25.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa97fff700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a2850 0x55f8ea6ac750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa8801b040 tx=0x7faa88005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7fea2db7cf53677 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa777fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:01:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa777fe700 1 -- 172.21.15.6:0/1938064649 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88024480 con 0x55f8ea6a2850 2023-10-14T09:01:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa777fe700 1 -- 172.21.15.6:0/1938064649 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faa880245e0 con 0x55f8ea6a2850 2023-10-14T09:01:25.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8ea5fae90 con 0x55f8ea6a2850 2023-10-14T09:01:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faa777fe700 1 -- 172.21.15.6:0/1938064649 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa880247a0 con 0x55f8ea6a2850 2023-10-14T09:01:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faaaa793b80 10 client.25894 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.311+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55f8ea420d80 con 0x55f8ea6a2850 2023-10-14T09:01:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faa777fe700 1 -- 172.21.15.6:0/1938064649 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f8ea5fae90 con 0x55f8ea6a2850 2023-10-14T09:01:25.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faa777fe700 1 -- 172.21.15.6:0/1938064649 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faa88019950 con 0x55f8ea6a2850 2023-10-14T09:01:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faaaa793b80 10 client.25894 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faaaa793b80 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faaaa793b80 20 client.25894 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faaaa793b80 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea6c9450 0x55f8ea6cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faaaa793b80 4 client.25894 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:01:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8ea672bb0 con 0x55f8ea6c9450 2023-10-14T09:01:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faa977fe700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea6c9450 0x55f8ea6cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faa977fe700 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea6c9450 0x55f8ea6cb870 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7853dd49b2a55f3 server_cookie=1d51678ea1867c10 in_seq=0 out_seq=0 2023-10-14T09:01:25.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.312+0000 7faa777fe700 10 client.25894 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faa777fe700 1 -- 172.21.15.6:0/1938064649 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f8ea672bb0 con 0x55f8ea6c9450 2023-10-14T09:01:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faa777fe700 10 client.25894 handle_command_reply: tid=0 2023-10-14T09:01:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 client.25894 shutdown 2023-10-14T09:01:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a2850 msgr2=0x55f8ea6ac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a2850 0x55f8ea6ac750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa8801b040 tx=0x7faa88005dc0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 shutdown_connections 2023-10-14T09:01:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea6c9450 0x55f8ea6cb870 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a2850 0x55f8ea6ac750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faa777fe700 0 client.25894 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 --2- 172.21.15.6:0/1938064649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 >> 172.21.15.6:0/1938064649 conn(0x55f8ea5d0d70 msgr2=0x55f8ea69d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 shutdown_connections 2023-10-14T09:01:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.313+0000 7faaaa793b80 1 -- 172.21.15.6:0/1938064649 wait complete. 2023-10-14T09:01:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.314+0000 7faaaa793b80 20 client.25894 trim_cache size 0 max 16384 2023-10-14T09:01:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.349+0000 7faaaa793b80 1 Processor -- start 2023-10-14T09:01:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 -- start start 2023-10-14T09:01:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea69f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea6ac320 con 0x55f8ea6a40a0 2023-10-14T09:01:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea4768c0 con 0x55f8ea6a2850 2023-10-14T09:01:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faaaa793b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea69a400 con 0x55f8ea6a31b0 2023-10-14T09:01:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.353+0000 7faa9cb46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35148/0 (socket says 172.21.15.6:35148) 2023-10-14T09:01:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 -- 172.21.15.6:0/806624281 learned_addr learned my addr 172.21.15.6:0/806624281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa977fe700 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 -- 172.21.15.6:0/806624281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a31b0 msgr2=0x55f8ea6aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 -- 172.21.15.6:0/806624281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 msgr2=0x55f8ea69f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea69f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 -- 172.21.15.6:0/806624281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8ea409c00 con 0x55f8ea6a40a0 2023-10-14T09:01:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.354+0000 7faa9cb46700 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a6fb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7faa90009fd0 tx=0x7faa90022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41691d09b23f8af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.355+0000 7faa7effd700 1 -- 172.21.15.6:0/806624281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9000e070 con 0x55f8ea6a40a0 2023-10-14T09:01:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.355+0000 7faa7effd700 1 -- 172.21.15.6:0/806624281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa90003c50 con 0x55f8ea6a40a0 2023-10-14T09:01:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.355+0000 7faa7effd700 1 -- 172.21.15.6:0/806624281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9001e690 con 0x55f8ea6a40a0 2023-10-14T09:01:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.356+0000 7faaaa793b80 1 -- 172.21.15.6:0/806624281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 msgr2=0x55f8ea6a6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.356+0000 7faaaa793b80 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a6fb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7faa90009fd0 tx=0x7faa90022000 comp rx=0 tx=0).stop 2023-10-14T09:01:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.361+0000 7faaaa793b80 1 -- 172.21.15.6:0/806624281 shutdown_connections 2023-10-14T09:01:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.361+0000 7faaaa793b80 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6a6fb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.361+0000 7faaaa793b80 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a2850 0x55f8ea69f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.361+0000 7faaaa793b80 1 --2- 172.21.15.6:0/806624281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.361+0000 7faaaa793b80 1 -- 172.21.15.6:0/806624281 >> 172.21.15.6:0/806624281 conn(0x55f8ea5d0d70 msgr2=0x55f8ea69ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.362+0000 7faaaa793b80 1 -- 172.21.15.6:0/806624281 shutdown_connections 2023-10-14T09:01:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.362+0000 7faaaa793b80 1 -- 172.21.15.6:0/806624281 wait complete. 2023-10-14T09:01:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.362+0000 7faaaa793b80 1 -- start start 2023-10-14T09:01:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.362+0000 7faaaa793b80 1 Processor -- start 2023-10-14T09:01:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a2850 0x55f8ea6afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea6b3370 con 0x55f8ea6a2850 2023-10-14T09:01:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea6b34e0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8ea6b3650 con 0x55f8ea6a40a0 2023-10-14T09:01:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.363+0000 7faaaa793b80 10 client.0 _ll_register_callbacks cb 0x7faa8c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.364+0000 7faa977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.364+0000 7faa977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33912/0 (socket says 172.21.15.6:33912) 2023-10-14T09:01:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.364+0000 7faa977fe700 1 -- 172.21.15.6:0/2532503409 learned_addr learned my addr 172.21.15.6:0/2532503409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.365+0000 7faa977fe700 1 -- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 msgr2=0x55f8ea6b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.365+0000 7faa977fe700 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.365+0000 7faa977fe700 1 -- 172.21.15.6:0/2532503409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a2850 msgr2=0x55f8ea6afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.365+0000 7faa977fe700 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a2850 0x55f8ea6afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.365+0000 7faa977fe700 1 -- 172.21.15.6:0/2532503409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa90025070 con 0x55f8ea6a31b0 2023-10-14T09:01:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.373+0000 7faa977fe700 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6b0400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa8c096cb0 tx=0x7faa8c09a780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c3c04ecbff71cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.373+0000 7faa777fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:01:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.374+0000 7faa777fe700 1 -- 172.21.15.6:0/2532503409 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c09a240 con 0x55f8ea6a31b0 2023-10-14T09:01:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.374+0000 7faa777fe700 1 -- 172.21.15.6:0/2532503409 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7faa8c09e390 con 0x55f8ea6a31b0 2023-10-14T09:01:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.374+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa88004cf0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.375+0000 7faa777fe700 1 -- 172.21.15.6:0/2532503409 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa8c0a25d0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.375+0000 7faaaa793b80 10 client.25868 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.375+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55f8ea4471f0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faa777fe700 1 -- 172.21.15.6:0/2532503409 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa88004cf0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faa777fe700 1 -- 172.21.15.6:0/2532503409 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faa8c0991a0 con 0x55f8ea6a31b0 2023-10-14T09:01:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faaaa793b80 10 client.25868 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faaaa793b80 10 client.25868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faaaa793b80 20 client.25868 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea71a1c0 0x55f8ea71c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faaaa793b80 4 client.25868 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:01:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.377+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f8ea5eedf0 con 0x55f8ea71a1c0 2023-10-14T09:01:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.378+0000 7faa97fff700 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea71a1c0 0x55f8ea71c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.394+0000 7faa777fe700 10 client.25868 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.394+0000 7faa97fff700 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea71a1c0 0x55f8ea71c5e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168113d20e748970 server_cookie=7950d244ecf7dba1 in_seq=0 out_seq=0 2023-10-14T09:01:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.431+0000 7faa777fe700 1 -- 172.21.15.6:0/2532503409 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f8ea5eedf0 con 0x55f8ea71a1c0 2023-10-14T09:01:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.431+0000 7faa777fe700 10 client.25868 handle_command_reply: tid=0 2023-10-14T09:01:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.431+0000 7faaaa793b80 1 client.25868 shutdown 2023-10-14T09:01:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 msgr2=0x55f8ea6b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6b0400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa8c096cb0 tx=0x7faa8c09a780 comp rx=0 tx=0).stop 2023-10-14T09:01:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 shutdown_connections 2023-10-14T09:01:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f8ea71a1c0 0x55f8ea71c5e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f8ea6a40a0 0x55f8ea6b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f8ea6a2850 0x55f8ea6afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faa777fe700 0 client.25868 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 --2- 172.21.15.6:0/2532503409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f8ea6a31b0 0x55f8ea6b0400 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 >> 172.21.15.6:0/2532503409 conn(0x55f8ea5d0d70 msgr2=0x55f8ea6aa470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 shutdown_connections 2023-10-14T09:01:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 1 -- 172.21.15.6:0/2532503409 wait complete. 2023-10-14T09:01:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faaaa793b80 20 client.25868 trim_cache size 0 max 16384 2023-10-14T09:01:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:01:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:01:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:01:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:01:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa800a1580 msgr2=0x7faa800a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.432+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa800a1580 0x7faa800a3a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faa90005c20 tx=0x7faa90005b90 comp rx=0 tx=0).stop 2023-10-14T09:01:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 msgr2=0x7faa9819ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 0x7faa9819ba10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00e9a0 tx=0x7faa8c00ecb0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 shutdown_connections 2023-10-14T09:01:25.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa98101930 0x7faa9819e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7faa800a1580 0x7faa800a3a40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa980ffda0 0x7faa980699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 --2- 172.21.15.6:0/1680692116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa98100f90 0x7faa9819ba10 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 >> 172.21.15.6:0/1680692116 conn(0x7faa980fb2d0 msgr2=0x7faa98104460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 shutdown_connections 2023-10-14T09:01:25.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:25.433+0000 7faa9e5a9700 1 -- 172.21.15.6:0/1680692116 wait complete. 2023-10-14T09:01:25.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:25 smithi057 ceph-mon[103313]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2023-10-14T09:01:25.745 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:25 smithi006 ceph-mon[99452]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2023-10-14T09:01:25.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:25 smithi178 ceph-mon[103612]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 26 MiB/s wr, 1.46k op/s 2023-10-14T09:01:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 505.0 s, 1835.4 tps, lat 54.369 ms stddev 60.298 2023-10-14T09:01:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:27 smithi057 ceph-mon[103313]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-10-14T09:01:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:27 smithi006 ceph-mon[99452]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-10-14T09:01:27.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:27 smithi178 ceph-mon[103612]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-10-14T09:01:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:29 smithi057 ceph-mon[103313]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 698 op/s 2023-10-14T09:01:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:29 smithi006 ceph-mon[99452]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 698 op/s 2023-10-14T09:01:29.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:29 smithi178 ceph-mon[103612]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 698 op/s 2023-10-14T09:01:30.965 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 510.0 s, 1860.4 tps, lat 53.816 ms stddev 61.350 2023-10-14T09:01:31.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:31 smithi057 ceph-mon[103313]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 616 op/s 2023-10-14T09:01:31.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:31 smithi006 ceph-mon[99452]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 616 op/s 2023-10-14T09:01:31.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:31 smithi178 ceph-mon[103612]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 616 op/s 2023-10-14T09:01:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:33 smithi057 ceph-mon[103313]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 654 op/s 2023-10-14T09:01:33.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:33 smithi006 ceph-mon[99452]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 654 op/s 2023-10-14T09:01:33.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:33 smithi178 ceph-mon[103612]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 654 op/s 2023-10-14T09:01:35.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:35 smithi006 ceph-mon[99452]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 668 op/s 2023-10-14T09:01:35.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:35 smithi178 ceph-mon[103612]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 668 op/s 2023-10-14T09:01:35.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:35 smithi057 ceph-mon[103313]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 668 op/s 2023-10-14T09:01:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 515.0 s, 2083.5 tps, lat 48.166 ms stddev 54.748 2023-10-14T09:01:37.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:37 smithi178 ceph-mon[103612]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 666 op/s 2023-10-14T09:01:37.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:01:37.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:01:37.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:01:37.637 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:37 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:01:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:37 smithi057 ceph-mon[103313]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 666 op/s 2023-10-14T09:01:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:01:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:01:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:01:37.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:37 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:01:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:37 smithi006 ceph-mon[99452]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 666 op/s 2023-10-14T09:01:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:01:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:01:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:01:37.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:37 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:01:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/2045614877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 msgr2=0x7f7d481081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/2045614877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 0x7f7d481081e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000b0a0 tx=0x7f7d4000b3b0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/2045614877 shutdown_connections 2023-10-14T09:01:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/2045614877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 0x7f7d481081e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/2045614877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d48101330 0x7f7d48101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/2045614877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d480fff80 0x7f7d48100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/2045614877 >> 172.21.15.6:0/2045614877 conn(0x7f7d480faa10 msgr2=0x7f7d480fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:38.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/2045614877 shutdown_connections 2023-10-14T09:01:38.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.577+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/2045614877 wait complete. 2023-10-14T09:01:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 Processor -- start 2023-10-14T09:01:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 -- start start 2023-10-14T09:01:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 0x7f7d480ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 0x7f7d4819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48101330 0x7f7d4819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819e810 con 0x7f7d48100940 2023-10-14T09:01:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819e980 con 0x7f7d48101330 2023-10-14T09:01:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.578+0000 7f7d4e9fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819eb40 con 0x7f7d480fff80 2023-10-14T09:01:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 0x7f7d480ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 0x7f7d480ffa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60800/0 (socket says 172.21.15.6:60800) 2023-10-14T09:01:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 -- 172.21.15.6:0/3785991910 learned_addr learned my addr 172.21.15.6:0/3785991910 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48101330 0x7f7d4819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 -- 172.21.15.6:0/3785991910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48101330 msgr2=0x7f7d4819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48101330 0x7f7d4819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 -- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 msgr2=0x7f7d4819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 0x7f7d4819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 -- 172.21.15.6:0/3785991910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40009d00 con 0x7f7d480fff80 2023-10-14T09:01:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.579+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 0x7f7d480ffa00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800be80 tx=0x7f7d3800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.580+0000 7f7d457fa700 1 -- 172.21.15.6:0/3785991910 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38004220 con 0x7f7d480fff80 2023-10-14T09:01:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.580+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d48195820 con 0x7f7d480fff80 2023-10-14T09:01:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.580+0000 7f7d457fa700 1 -- 172.21.15.6:0/3785991910 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d38004380 con 0x7f7d480fff80 2023-10-14T09:01:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.580+0000 7f7d457fa700 1 -- 172.21.15.6:0/3785991910 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38009d20 con 0x7f7d480fff80 2023-10-14T09:01:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.580+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d48195d80 con 0x7f7d480fff80 2023-10-14T09:01:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.582+0000 7f7d457fa700 1 -- 172.21.15.6:0/3785991910 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7d38012760 con 0x7f7d480fff80 2023-10-14T09:01:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.583+0000 7f7d457fa700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.583+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.583+0000 7f7d457fa700 1 -- 172.21.15.6:0/3785991910 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7d380d0920 con 0x7f7d480fff80 2023-10-14T09:01:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ff770 tx=0x7f7d3c0096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 Processor -- start 2023-10-14T09:01:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 -- start start 2023-10-14T09:01:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7626c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b7627ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7628520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b759bc10 con 0x5648b7626850 2023-10-14T09:01:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7580c00 con 0x5648b76280a0 2023-10-14T09:01:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b757e520 con 0x5648b76271b0 2023-10-14T09:01:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7626c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7626c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35174/0 (socket says 172.21.15.6:35174) 2023-10-14T09:01:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d47fff700 1 -- 172.21.15.6:0/1860966601 learned_addr learned my addr 172.21.15.6:0/1860966601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7628520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d477fe700 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b7627ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d4cf98700 1 -- 172.21.15.6:0/1860966601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 msgr2=0x5648b7627ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.584+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b7627ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d4cf98700 1 -- 172.21.15.6:0/1860966601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 msgr2=0x5648b7626c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7626c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d4cf98700 1 -- 172.21.15.6:0/1860966601 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648b7537390 con 0x5648b76280a0 2023-10-14T09:01:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7628520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000b070 tx=0x7f7d40009320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d8d30098a6fc3a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d2e7fc700 1 -- 172.21.15.6:0/1860966601 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000e040 con 0x5648b76280a0 2023-10-14T09:01:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d2e7fc700 1 -- 172.21.15.6:0/1860966601 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d4000ba50 con 0x5648b76280a0 2023-10-14T09:01:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.585+0000 7f7d2e7fc700 1 -- 172.21.15.6:0/1860966601 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4001c6a0 con 0x5648b76280a0 2023-10-14T09:01:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.586+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/1860966601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 msgr2=0x5648b7628520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.586+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7628520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000b070 tx=0x7f7d40009320 comp rx=0 tx=0).stop 2023-10-14T09:01:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/1860966601 shutdown_connections 2023-10-14T09:01:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7628520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7626c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/1860966601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b7627ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/1860966601 >> 172.21.15.6:0/1860966601 conn(0x5648b7554d70 msgr2=0x5648b7621c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/1860966601 shutdown_connections 2023-10-14T09:01:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/1860966601 wait complete. 2023-10-14T09:01:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.587+0000 7f7d5abe5b80 1 -- start start 2023-10-14T09:01:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 Processor -- start 2023-10-14T09:01:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b762f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76271b0 0x5648b762fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7636d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7579e10 con 0x5648b7626850 2023-10-14T09:01:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b75166b0 con 0x5648b76271b0 2023-10-14T09:01:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7516350 con 0x5648b76280a0 2023-10-14T09:01:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d5abe5b80 10 client.0 _ll_register_callbacks cb 0x5648b73737a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b762f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b762f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35180/0 (socket says 172.21.15.6:35180) 2023-10-14T09:01:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 -- 172.21.15.6:0/3932348151 learned_addr learned my addr 172.21.15.6:0/3932348151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76271b0 0x5648b762fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7636d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 -- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 msgr2=0x5648b7636d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7636d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 -- 172.21.15.6:0/3932348151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76271b0 msgr2=0x5648b762fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76271b0 0x5648b762fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d47fff700 1 -- 172.21.15.6:0/3932348151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d48108b10 con 0x5648b7626850 2023-10-14T09:01:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.588+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76271b0 0x5648b762fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b762f7c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d3809e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74fa8f4807f6185 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d277fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:01:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d277fe700 1 -- 172.21.15.6:0/3932348151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b5070 con 0x5648b7626850 2023-10-14T09:01:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d277fe700 1 -- 172.21.15.6:0/3932348151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7d3809dc40 con 0x5648b7626850 2023-10-14T09:01:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648b757ee90 con 0x5648b7626850 2023-10-14T09:01:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d277fe700 1 -- 172.21.15.6:0/3932348151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d380a1d90 con 0x5648b7626850 2023-10-14T09:01:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 10 client.16287 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5648b73a4d80 con 0x5648b7626850 2023-10-14T09:01:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d277fe700 1 -- 172.21.15.6:0/3932348151 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d38067020 con 0x5648b7626850 2023-10-14T09:01:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d277fe700 1 -- 172.21.15.6:0/3932348151 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7d3809d130 con 0x5648b7626850 2023-10-14T09:01:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 10 client.16287 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 20 client.16287 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b763b560 0x5648b763da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 4 client.16287 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:01:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.589+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648b75f6bb0 con 0x5648b763b560 2023-10-14T09:01:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.590+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b763b560 0x5648b763da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.590+0000 7f7d277fe700 10 client.16287 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.590+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b763b560 0x5648b763da00 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a962cd1b85871763 server_cookie=5f917bad925932ed in_seq=0 out_seq=0 2023-10-14T09:01:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.591+0000 7f7d277fe700 1 -- 172.21.15.6:0/3932348151 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648b75f6bb0 con 0x5648b763b560 2023-10-14T09:01:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.591+0000 7f7d277fe700 10 client.16287 handle_command_reply: tid=0 2023-10-14T09:01:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.591+0000 7f7d5abe5b80 1 client.16287 shutdown 2023-10-14T09:01:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 msgr2=0x5648b762f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b762f7c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d3809e3c0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 shutdown_connections 2023-10-14T09:01:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b763b560 0x5648b763da00 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7636d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b762f7c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d277fe700 0 client.16287 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3932348151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76271b0 0x5648b762fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 >> 172.21.15.6:0/3932348151 conn(0x5648b7554d70 msgr2=0x5648b7621830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 shutdown_connections 2023-10-14T09:01:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3932348151 wait complete. 2023-10-14T09:01:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.592+0000 7f7d5abe5b80 20 client.16287 trim_cache size 0 max 16384 2023-10-14T09:01:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.629+0000 7f7d5abe5b80 1 Processor -- start 2023-10-14T09:01:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.648+0000 7f7d5abe5b80 1 -- start start 2023-10-14T09:01:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7645260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b762e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7621740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b73fa8c0 con 0x5648b7626850 2023-10-14T09:01:38.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7627f50 con 0x5648b76280a0 2023-10-14T09:01:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7640b80 con 0x5648b76271b0 2023-10-14T09:01:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d477fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b762e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d477fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b762e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60822/0 (socket says 172.21.15.6:60822) 2023-10-14T09:01:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.649+0000 7f7d477fe700 1 -- 172.21.15.6:0/2623690295 learned_addr learned my addr 172.21.15.6:0/2623690295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:38.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.658+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7621740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.660+0000 7f7d4cf98700 1 -- 172.21.15.6:0/2623690295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 msgr2=0x5648b762e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.660+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b762e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.660+0000 7f7d4cf98700 1 -- 172.21.15.6:0/2623690295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 msgr2=0x5648b7645260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.660+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7645260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.660+0000 7f7d4cf98700 1 -- 172.21.15.6:0/2623690295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648b738dc00 con 0x5648b76280a0 2023-10-14T09:01:38.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.661+0000 7f7d4cf98700 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7621740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d40007a20 tx=0x7f7d40006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5d2a2cb38501df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.661+0000 7f7d2effd700 1 -- 172.21.15.6:0/2623690295 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000e040 con 0x5648b76280a0 2023-10-14T09:01:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.661+0000 7f7d2effd700 1 -- 172.21.15.6:0/2623690295 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d40003cb0 con 0x5648b76280a0 2023-10-14T09:01:38.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.661+0000 7f7d2effd700 1 -- 172.21.15.6:0/2623690295 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40005450 con 0x5648b76280a0 2023-10-14T09:01:38.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/2623690295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 msgr2=0x5648b7621740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7621740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d40007a20 tx=0x7f7d40006000 comp rx=0 tx=0).stop 2023-10-14T09:01:38.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/2623690295 shutdown_connections 2023-10-14T09:01:38.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b76280a0 0x5648b7621740 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b7626850 0x5648b7645260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/2623690295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76271b0 0x5648b762e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.662+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/2623690295 >> 172.21.15.6:0/2623690295 conn(0x5648b7554d70 msgr2=0x5648b7640350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:38.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.663+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/2623690295 shutdown_connections 2023-10-14T09:01:38.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.663+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/2623690295 wait complete. 2023-10-14T09:01:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.663+0000 7f7d5abe5b80 1 -- start start 2023-10-14T09:01:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 Processor -- start 2023-10-14T09:01:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b7626850 0x5648b7692b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b76271b0 0x5648b76950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7697630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7697c00 con 0x5648b76271b0 2023-10-14T09:01:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7697d70 con 0x5648b7626850 2023-10-14T09:01:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b7697f30 con 0x5648b76280a0 2023-10-14T09:01:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d5abe5b80 10 client.0 _ll_register_callbacks cb 0x7f7d3809d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:38.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d4cf98700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7697630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b76271b0 0x5648b76950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d4cf98700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7697630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60830/0 (socket says 172.21.15.6:60830) 2023-10-14T09:01:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.664+0000 7f7d4cf98700 1 -- 172.21.15.6:0/3015538472 learned_addr learned my addr 172.21.15.6:0/3015538472 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.665+0000 7f7d477fe700 1 -- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 msgr2=0x5648b7697630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.665+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7697630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.665+0000 7f7d477fe700 1 -- 172.21.15.6:0/3015538472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b7626850 msgr2=0x5648b7692b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.665+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b7626850 0x5648b7692b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.665+0000 7f7d477fe700 1 -- 172.21.15.6:0/3015538472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648b7537390 con 0x5648b76271b0 2023-10-14T09:01:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.665+0000 7f7d477fe700 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b76271b0 0x5648b76950e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009900 tx=0x7f7d3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757b29a97bed883f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:38.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d277fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:01:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d277fe700 1 -- 172.21.15.6:0/3015538472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c022040 con 0x5648b76271b0 2023-10-14T09:01:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d277fe700 1 -- 172.21.15.6:0/3015538472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7d3c030480 con 0x5648b76271b0 2023-10-14T09:01:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d4000ba50 con 0x5648b76271b0 2023-10-14T09:01:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d277fe700 1 -- 172.21.15.6:0/3015538472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d3c030640 con 0x5648b76271b0 2023-10-14T09:01:38.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d5abe5b80 10 client.16290 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x5648b73cb1f0 con 0x5648b76271b0 2023-10-14T09:01:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.666+0000 7f7d277fe700 1 -- 172.21.15.6:0/3015538472 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d4000ba50 con 0x5648b76271b0 2023-10-14T09:01:38.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d277fe700 1 -- 172.21.15.6:0/3015538472 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7d3c010430 con 0x5648b76271b0 2023-10-14T09:01:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d5abe5b80 10 client.16290 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d5abe5b80 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d5abe5b80 20 client.16290 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b7699910 0x5648b769bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:38.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d5abe5b80 4 client.16290 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:01:38.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.668+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5648b7572df0 con 0x5648b7699910 2023-10-14T09:01:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.674+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b7699910 0x5648b769bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.675+0000 7f7d277fe700 10 client.16290 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:38.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.675+0000 7f7d47fff700 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b7699910 0x5648b769bd00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51912d74de6d1cf server_cookie=b47257fbac15e77b in_seq=0 out_seq=0 2023-10-14T09:01:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.708+0000 7f7d277fe700 1 -- 172.21.15.6:0/3015538472 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5648b7572df0 con 0x5648b7699910 2023-10-14T09:01:38.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.708+0000 7f7d277fe700 10 client.16290 handle_command_reply: tid=0 2023-10-14T09:01:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 client.16290 shutdown 2023-10-14T09:01:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b76271b0 msgr2=0x5648b76950e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b76271b0 0x5648b76950e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009900 tx=0x7f7d3c009260 comp rx=0 tx=0).stop 2023-10-14T09:01:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 shutdown_connections 2023-10-14T09:01:38.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5648b7699910 0x5648b769bd00 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5648b76280a0 0x5648b7697630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5648b7626850 0x5648b7692b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d277fe700 0 client.16290 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 --2- 172.21.15.6:0/3015538472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648b76271b0 0x5648b76950e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 >> 172.21.15.6:0/3015538472 conn(0x5648b7554d70 msgr2=0x5648b762e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 shutdown_connections 2023-10-14T09:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 1 -- 172.21.15.6:0/3015538472 wait complete. 2023-10-14T09:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.710+0000 7f7d5abe5b80 20 client.16290 trim_cache size 0 max 16384 2023-10-14T09:01:38.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:01:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:01:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:01:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 msgr2=0x7f7d300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7d480ff770 tx=0x7f7d3c0096c0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 msgr2=0x7f7d480ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 0x7f7d480ffa00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800be80 tx=0x7f7d3800dc60 comp rx=0 tx=0).stop 2023-10-14T09:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 shutdown_connections 2023-10-14T09:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48101330 0x7f7d4819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d480fff80 0x7f7d480ffa00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 --2- 172.21.15.6:0/3785991910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48100940 0x7f7d4819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 >> 172.21.15.6:0/3785991910 conn(0x7f7d480faa10 msgr2=0x7f7d480fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 shutdown_connections 2023-10-14T09:01:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:38.711+0000 7f7d4e9fb700 1 -- 172.21.15.6:0/3785991910 wait complete. 2023-10-14T09:01:39.644 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:39 smithi178 ceph-mon[103612]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 694 op/s 2023-10-14T09:01:39.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:39 smithi057 ceph-mon[103313]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 694 op/s 2023-10-14T09:01:39.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:39 smithi006 ceph-mon[99452]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 694 op/s 2023-10-14T09:01:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 520.0 s, 1736.4 tps, lat 57.311 ms stddev 68.821 2023-10-14T09:01:41.643 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:41 smithi178 ceph-mon[103612]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 621 op/s 2023-10-14T09:01:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:41 smithi057 ceph-mon[103313]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 621 op/s 2023-10-14T09:01:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:41 smithi006 ceph-mon[99452]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 621 op/s 2023-10-14T09:01:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:43 smithi178 ceph-mon[103612]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 709 op/s 2023-10-14T09:01:43.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:43 smithi057 ceph-mon[103313]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 709 op/s 2023-10-14T09:01:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:43 smithi006 ceph-mon[99452]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 709 op/s 2023-10-14T09:01:45.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:45 smithi178 ceph-mon[103612]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 725 op/s 2023-10-14T09:01:45.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:45 smithi057 ceph-mon[103313]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 725 op/s 2023-10-14T09:01:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:45 smithi006 ceph-mon[99452]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 725 op/s 2023-10-14T09:01:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 525.0 s, 1574.2 tps, lat 63.316 ms stddev 71.655 2023-10-14T09:01:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:47 smithi178 ceph-mon[103612]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 717 op/s 2023-10-14T09:01:47.700 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:47 smithi057 ceph-mon[103313]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 717 op/s 2023-10-14T09:01:47.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:47 smithi006 ceph-mon[99452]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 717 op/s 2023-10-14T09:01:49.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:49 smithi178 ceph-mon[103612]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 770 op/s 2023-10-14T09:01:49.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:49 smithi057 ceph-mon[103313]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 770 op/s 2023-10-14T09:01:49.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:49 smithi006 ceph-mon[99452]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 770 op/s 2023-10-14T09:01:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 530.0 s, 1794.2 tps, lat 54.490 ms stddev 62.242 2023-10-14T09:01:51.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:51 smithi178 ceph-mon[103612]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 724 op/s 2023-10-14T09:01:51.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:51 smithi057 ceph-mon[103313]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 724 op/s 2023-10-14T09:01:51.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:51 smithi006 ceph-mon[99452]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 724 op/s 2023-10-14T09:01:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 -- 172.21.15.6:0/3954137110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102090 msgr2=0x7fbf8c102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 --2- 172.21.15.6:0/3954137110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102090 0x7fbf8c102510 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009990 tx=0x7fbf80009ca0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 -- 172.21.15.6:0/3954137110 shutdown_connections 2023-10-14T09:01:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 --2- 172.21.15.6:0/3954137110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c102a50 0x7fbf8c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 --2- 172.21.15.6:0/3954137110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c100eb0 0x7fbf8c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 --2- 172.21.15.6:0/3954137110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102090 0x7fbf8c102510 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.862+0000 7fbf91f46700 1 -- 172.21.15.6:0/3954137110 >> 172.21.15.6:0/3954137110 conn(0x7fbf8c0fc470 msgr2=0x7fbf8c0fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.863+0000 7fbf91f46700 1 -- 172.21.15.6:0/3954137110 shutdown_connections 2023-10-14T09:01:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.863+0000 7fbf91f46700 1 -- 172.21.15.6:0/3954137110 wait complete. 2023-10-14T09:01:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.863+0000 7fbf91f46700 1 Processor -- start 2023-10-14T09:01:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 -- start start 2023-10-14T09:01:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c100eb0 0x7fbf8c196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c102090 0x7fbf8c197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102a50 0x7fbf8c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c19e760 con 0x7fbf8c102a50 2023-10-14T09:01:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c19e8d0 con 0x7fbf8c100eb0 2023-10-14T09:01:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf91f46700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c19ea90 con 0x7fbf8c102090 2023-10-14T09:01:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102a50 0x7fbf8c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c100eb0 0x7fbf8c196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c102090 0x7fbf8c197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c100eb0 0x7fbf8c196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33966/0 (socket says 172.21.15.6:33966) 2023-10-14T09:01:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8b7fe700 1 -- 172.21.15.6:0/4209164518 learned_addr learned my addr 172.21.15.6:0/4209164518 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8bfff700 1 -- 172.21.15.6:0/4209164518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c102090 msgr2=0x7fbf8c197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c102090 0x7fbf8c197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8bfff700 1 -- 172.21.15.6:0/4209164518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c100eb0 msgr2=0x7fbf8c196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c100eb0 0x7fbf8c196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8bfff700 1 -- 172.21.15.6:0/4209164518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800095f0 con 0x7fbf8c102a50 2023-10-14T09:01:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.864+0000 7fbf8affd700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c102090 0x7fbf8c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.865+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102a50 0x7fbf8c19e190 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400efc0 tx=0x7fbf8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.865+0000 7fbf88ff9700 1 -- 172.21.15.6:0/4209164518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84018070 con 0x7fbf8c102a50 2023-10-14T09:01:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.865+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c19ed10 con 0x7fbf8c102a50 2023-10-14T09:01:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.865+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c19f1c0 con 0x7fbf8c102a50 2023-10-14T09:01:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.865+0000 7fbf88ff9700 1 -- 172.21.15.6:0/4209164518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf8400f040 con 0x7fbf8c102a50 2023-10-14T09:01:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.865+0000 7fbf88ff9700 1 -- 172.21.15.6:0/4209164518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400cd40 con 0x7fbf8c102a50 2023-10-14T09:01:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.871+0000 7fbf88ff9700 1 -- 172.21.15.6:0/4209164518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbf84004ad0 con 0x7fbf8c102a50 2023-10-14T09:01:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.872+0000 7fbf88ff9700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf740a1500 0x7fbf740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.872+0000 7fbf88ff9700 1 -- 172.21.15.6:0/4209164518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbf840cc760 con 0x7fbf8c102a50 2023-10-14T09:01:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.872+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf740a1500 0x7fbf740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.872+0000 7fbf9e130b80 1 Processor -- start 2023-10-14T09:01:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.872+0000 7fbf9e130b80 1 -- start start 2023-10-14T09:01:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x56097320f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973210120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x5609732200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560973184c10 con 0x56097320fca0 2023-10-14T09:01:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560973169c00 con 0x56097321dcc0 2023-10-14T09:01:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560973167520 con 0x560973210f70 2023-10-14T09:01:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x5609732200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x5609732200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:33978/0 (socket says 172.21.15.6:33978) 2023-10-14T09:01:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf740a1500 0x7fbf740a39c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c1980f0 tx=0x7fbf7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 -- 172.21.15.6:0/1660214984 learned_addr learned my addr 172.21.15.6:0/1660214984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x56097320f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8affd700 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973210120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 -- 172.21.15.6:0/1660214984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 msgr2=0x56097320f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x56097320f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 -- 172.21.15.6:0/1660214984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 msgr2=0x560973210120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973210120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 -- 172.21.15.6:0/1660214984 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560973120390 con 0x56097321dcc0 2023-10-14T09:01:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8affd700 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973210120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:01:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.873+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x5609732200b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf84096580 tx=0x7fbf840996d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346e94153dbe87cc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.874+0000 7fbf71ffb700 1 -- 172.21.15.6:0/1660214984 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84005aa0 con 0x56097321dcc0 2023-10-14T09:01:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.874+0000 7fbf71ffb700 1 -- 172.21.15.6:0/1660214984 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf84084040 con 0x56097321dcc0 2023-10-14T09:01:51.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.874+0000 7fbf71ffb700 1 -- 172.21.15.6:0/1660214984 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84099000 con 0x56097321dcc0 2023-10-14T09:01:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 -- 172.21.15.6:0/1660214984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 msgr2=0x5609732200b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x5609732200b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf84096580 tx=0x7fbf840996d0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 -- 172.21.15.6:0/1660214984 shutdown_connections 2023-10-14T09:01:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x5609732200b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x56097320f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/1660214984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973210120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 -- 172.21.15.6:0/1660214984 >> 172.21.15.6:0/1660214984 conn(0x56097313dd70 msgr2=0x56097320a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 -- 172.21.15.6:0/1660214984 shutdown_connections 2023-10-14T09:01:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 -- 172.21.15.6:0/1660214984 wait complete. 2023-10-14T09:01:51.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.875+0000 7fbf9e130b80 1 -- start start 2023-10-14T09:01:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 Processor -- start 2023-10-14T09:01:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973216e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x560973217390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x56097321c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560973162e10 con 0x56097320fca0 2023-10-14T09:01:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609730ff6b0 con 0x56097321dcc0 2023-10-14T09:01:51.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609730ff350 con 0x560973210f70 2023-10-14T09:01:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf9e130b80 10 client.0 _ll_register_callbacks cb 0x560972f5c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x560973217390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973216e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x560973217390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60858/0 (socket says 172.21.15.6:60858) 2023-10-14T09:01:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf8affd700 1 -- 172.21.15.6:0/2309560136 learned_addr learned my addr 172.21.15.6:0/2309560136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.876+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x56097321c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf8affd700 1 -- 172.21.15.6:0/2309560136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 msgr2=0x56097321c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x56097321c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf8affd700 1 -- 172.21.15.6:0/2309560136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 msgr2=0x560973216e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973216e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf8affd700 1 -- 172.21.15.6:0/2309560136 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c19f1c0 con 0x560973210f70 2023-10-14T09:01:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x560973217390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c100bd0 tx=0x7fbf80005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73e380526a6f0e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:51.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf6affd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:01:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf6affd700 1 -- 172.21.15.6:0/2309560136 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8001d070 con 0x560973210f70 2023-10-14T09:01:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf6affd700 1 -- 172.21.15.6:0/2309560136 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbf80004910 con 0x560973210f70 2023-10-14T09:01:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.877+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560973167e90 con 0x560973210f70 2023-10-14T09:01:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf6affd700 1 -- 172.21.15.6:0/2309560136 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf80004b10 con 0x560973210f70 2023-10-14T09:01:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 10 client.25927 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560972f8dd80 con 0x560973210f70 2023-10-14T09:01:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf6affd700 1 -- 172.21.15.6:0/2309560136 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560973167e90 con 0x560973210f70 2023-10-14T09:01:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf6affd700 1 -- 172.21.15.6:0/2309560136 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbf80024c90 con 0x560973210f70 2023-10-14T09:01:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 10 client.25927 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 10 client.25927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 20 client.25927 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560973236650 0x560973238a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 4 client.25927 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:01:51.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609731dfbb0 con 0x560973236650 2023-10-14T09:01:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.878+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560973236650 0x560973238a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.879+0000 7fbf6affd700 10 client.25927 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.879+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560973236650 0x560973238a70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a809312e46d57ad9 server_cookie=c80972b328701e6b in_seq=0 out_seq=0 2023-10-14T09:01:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf6affd700 1 -- 172.21.15.6:0/2309560136 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5609731dfbb0 con 0x560973236650 2023-10-14T09:01:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf6affd700 10 client.25927 handle_command_reply: tid=0 2023-10-14T09:01:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 client.25927 shutdown 2023-10-14T09:01:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 msgr2=0x560973217390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x560973217390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c100bd0 tx=0x7fbf80005270 comp rx=0 tx=0).stop 2023-10-14T09:01:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 shutdown_connections 2023-10-14T09:01:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560973236650 0x560973238a70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097321dcc0 0x56097321c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097320fca0 0x560973216e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf6affd700 0 client.25927 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2309560136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560973210f70 0x560973217390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 >> 172.21.15.6:0/2309560136 conn(0x56097313dd70 msgr2=0x56097320a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 shutdown_connections 2023-10-14T09:01:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2309560136 wait complete. 2023-10-14T09:01:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.880+0000 7fbf9e130b80 20 client.25927 trim_cache size 0 max 16384 2023-10-14T09:01:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.903+0000 7fbf9e130b80 1 Processor -- start 2023-10-14T09:01:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 -- start start 2023-10-14T09:01:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097320fca0 0x560973246210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 0x560973215920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 0x56097320b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560972fe38c0 con 0x560973210f70 2023-10-14T09:01:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609731dfbb0 con 0x56097320fca0 2023-10-14T09:01:51.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.904+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560973210950 con 0x56097321dcc0 2023-10-14T09:01:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 0x560973215920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 0x56097320b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 0x56097320b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60864/0 (socket says 172.21.15.6:60864) 2023-10-14T09:01:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8bfff700 1 -- 172.21.15.6:0/2533760382 learned_addr learned my addr 172.21.15.6:0/2533760382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 0x560973215920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35232/0 (socket says 172.21.15.6:35232) 2023-10-14T09:01:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 -- 172.21.15.6:0/2533760382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 msgr2=0x56097320b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 0x56097320b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 -- 172.21.15.6:0/2533760382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097320fca0 msgr2=0x560973246210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:01:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097320fca0 0x560973246210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 -- 172.21.15.6:0/2533760382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560972f76c00 con 0x560973210f70 2023-10-14T09:01:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 0x56097320b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf8affd700 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 0x560973215920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000f500 tx=0x7fbf80009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac629d344af5cb0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:51.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf727fc700 1 -- 172.21.15.6:0/2533760382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8001d070 con 0x560973210f70 2023-10-14T09:01:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf727fc700 1 -- 172.21.15.6:0/2533760382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf8001e040 con 0x560973210f70 2023-10-14T09:01:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.905+0000 7fbf727fc700 1 -- 172.21.15.6:0/2533760382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80004da0 con 0x560973210f70 2023-10-14T09:01:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2533760382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 msgr2=0x560973215920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 0x560973215920 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000f500 tx=0x7fbf80009310 comp rx=0 tx=0).stop 2023-10-14T09:01:51.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2533760382 shutdown_connections 2023-10-14T09:01:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097321dcc0 0x56097320b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56097320fca0 0x560973246210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/2533760382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560973210f70 0x560973215920 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2533760382 >> 172.21.15.6:0/2533760382 conn(0x56097313dd70 msgr2=0x560973215210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:51.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2533760382 shutdown_connections 2023-10-14T09:01:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.906+0000 7fbf9e130b80 1 -- 172.21.15.6:0/2533760382 wait complete. 2023-10-14T09:01:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 -- start start 2023-10-14T09:01:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 Processor -- start 2023-10-14T09:01:51.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097320fca0 0x560973284b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 0x560973287090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609732875d0 0x5609732899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560973289f00 con 0x56097321dcc0 2023-10-14T09:01:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097328a040 con 0x5609732875d0 2023-10-14T09:01:51.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097328a180 con 0x56097320fca0 2023-10-14T09:01:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf9e130b80 10 client.0 _ll_register_callbacks cb 0x7fbf80009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:01:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 0x560973287090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 0x560973287090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35236/0 (socket says 172.21.15.6:35236) 2023-10-14T09:01:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf8affd700 1 -- 172.21.15.6:0/3686016774 learned_addr learned my addr 172.21.15.6:0/3686016774 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:01:51.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097320fca0 0x560973284b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.907+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609732875d0 0x5609732899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8b7fe700 1 -- 172.21.15.6:0/3686016774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609732875d0 msgr2=0x5609732899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609732875d0 0x5609732899c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8b7fe700 1 -- 172.21.15.6:0/3686016774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 msgr2=0x560973287090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:01:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 0x560973287090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8b7fe700 1 -- 172.21.15.6:0/3686016774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560973120390 con 0x56097320fca0 2023-10-14T09:01:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8affd700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 0x560973287090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8bfff700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609732875d0 0x5609732899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:01:51.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf8b7fe700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097320fca0 0x560973284b40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x560973239310 tx=0x7fbf7c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0a057099b1daf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:01:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf6affd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:01:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf6affd700 1 -- 172.21.15.6:0/3686016774 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c024040 con 0x56097320fca0 2023-10-14T09:01:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf84084040 con 0x56097320fca0 2023-10-14T09:01:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf6affd700 1 -- 172.21.15.6:0/3686016774 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbf7c004a30 con 0x56097320fca0 2023-10-14T09:01:51.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf6affd700 1 -- 172.21.15.6:0/3686016774 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf7c0295c0 con 0x56097320fca0 2023-10-14T09:01:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf9e130b80 10 client.25933 fetch_fsmap learned FSMap version 45 2023-10-14T09:01:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.908+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x560972f8dd80 con 0x56097320fca0 2023-10-14T09:01:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf6affd700 1 -- 172.21.15.6:0/3686016774 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf84084040 con 0x56097320fca0 2023-10-14T09:01:51.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf6affd700 1 -- 172.21.15.6:0/3686016774 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 45) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbf7c003680 con 0x56097320fca0 2023-10-14T09:01:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf9e130b80 10 client.25933 fetch_fsmap finished waiting for FSMap version 45 2023-10-14T09:01:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf9e130b80 10 client.25933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:01:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf9e130b80 20 client.25933 populate_metadata read hostname 'smithi006' 2023-10-14T09:01:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56097328bbe0 0x56097328e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:01:51.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf9e130b80 4 client.25933 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:01:51.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.909+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56097315bdf0 con 0x56097328bbe0 2023-10-14T09:01:51.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.923+0000 7fbf8affd700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56097328bbe0 0x56097328e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:01:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.951+0000 7fbf8affd700 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56097328bbe0 0x56097328e000 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bfb5164314e6018 server_cookie=d59880c247fc2b4f in_seq=0 out_seq=0 2023-10-14T09:01:51.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:51.952+0000 7fbf6affd700 10 client.25933 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.041+0000 7fbf6affd700 1 -- 172.21.15.6:0/3686016774 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56097315bdf0 con 0x56097328bbe0 2023-10-14T09:01:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.041+0000 7fbf6affd700 10 client.25933 handle_command_reply: tid=0 2023-10-14T09:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 client.25933 shutdown 2023-10-14T09:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097320fca0 msgr2=0x560973284b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097320fca0 0x560973284b40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x560973239310 tx=0x7fbf7c0047c0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 shutdown_connections 2023-10-14T09:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56097328bbe0 0x56097328e000 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5609732875d0 0x5609732899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf6affd700 0 client.25933 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56097320fca0 0x560973284b40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 --2- 172.21.15.6:0/3686016774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56097321dcc0 0x560973287090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 >> 172.21.15.6:0/3686016774 conn(0x56097313dd70 msgr2=0x560973217300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 shutdown_connections 2023-10-14T09:01:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 1 -- 172.21.15.6:0/3686016774 wait complete. 2023-10-14T09:01:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.042+0000 7fbf9e130b80 20 client.25933 trim_cache size 0 max 16384 2023-10-14T09:01:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:01:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:01:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:01:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:01:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf740a1500 msgr2=0x7fbf740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf740a1500 0x7fbf740a39c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c1980f0 tx=0x7fbf7c009260 comp rx=0 tx=0).stop 2023-10-14T09:01:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102a50 msgr2=0x7fbf8c19e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:01:52.050 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102a50 0x7fbf8c19e190 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400efc0 tx=0x7fbf8400c3a0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 shutdown_connections 2023-10-14T09:01:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf8c102a50 0x7fbf8c19e190 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbf740a1500 0x7fbf740a39c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c100eb0 0x7fbf8c196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.051 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 --2- 172.21.15.6:0/4209164518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c102090 0x7fbf8c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:01:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 >> 172.21.15.6:0/4209164518 conn(0x7fbf8c0fc470 msgr2=0x7fbf8c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:01:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 shutdown_connections 2023-10-14T09:01:52.052 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:01:52.043+0000 7fbf91f46700 1 -- 172.21.15.6:0/4209164518 wait complete. 2023-10-14T09:01:53.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:53 smithi057 ceph-mon[103313]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 811 op/s 2023-10-14T09:01:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:53 smithi006 ceph-mon[99452]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 811 op/s 2023-10-14T09:01:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:53 smithi178 ceph-mon[103612]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 811 op/s 2023-10-14T09:01:55.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:55 smithi057 ceph-mon[103313]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 758 op/s 2023-10-14T09:01:55.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:55 smithi006 ceph-mon[99452]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 758 op/s 2023-10-14T09:01:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:55 smithi178 ceph-mon[103612]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 758 op/s 2023-10-14T09:01:55.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 535.0 s, 1196.2 tps, lat 85.847 ms stddev 96.488 2023-10-14T09:01:57.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:57 smithi057 ceph-mon[103313]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 11 MiB/s wr, 769 op/s 2023-10-14T09:01:57.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:57 smithi006 ceph-mon[99452]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 11 MiB/s wr, 769 op/s 2023-10-14T09:01:57.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:57 smithi178 ceph-mon[103612]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 11 MiB/s wr, 769 op/s 2023-10-14T09:01:59.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:01:59 smithi006 ceph-mon[99452]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-14T09:01:59.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:01:59 smithi178 ceph-mon[103612]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-14T09:01:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:01:59 smithi057 ceph-mon[103313]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-14T09:02:00.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 540.0 s, 1535.8 tps, lat 59.233 ms stddev 69.584 2023-10-14T09:02:01.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:01 smithi006 ceph-mon[99452]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 798 op/s 2023-10-14T09:02:01.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:01 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:01.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:01 smithi178 ceph-mon[103612]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 798 op/s 2023-10-14T09:02:01.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:01 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:01 smithi057 ceph-mon[103313]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 798 op/s 2023-10-14T09:02:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:01 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:03.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:03 smithi006 ceph-mon[99452]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 808 op/s 2023-10-14T09:02:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:03 smithi178 ceph-mon[103612]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 808 op/s 2023-10-14T09:02:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:03 smithi057 ceph-mon[103313]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 808 op/s 2023-10-14T09:02:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 -- 172.21.15.6:0/1545711820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b24100fd0 msgr2=0x7f3b24101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/1545711820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b24100fd0 0x7f3b24101430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b100099c0 tx=0x7f3b10009cd0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 -- 172.21.15.6:0/1545711820 shutdown_connections 2023-10-14T09:02:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/1545711820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b24108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/1545711820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b240ffde0 0x7f3b24100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/1545711820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b24100fd0 0x7f3b24101430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 -- 172.21.15.6:0/1545711820 >> 172.21.15.6:0/1545711820 conn(0x7f3b240fb370 msgr2=0x7f3b240fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 -- 172.21.15.6:0/1545711820 shutdown_connections 2023-10-14T09:02:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.188+0000 7f3b2ae66700 1 -- 172.21.15.6:0/1545711820 wait complete. 2023-10-14T09:02:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 Processor -- start 2023-10-14T09:02:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 -- start start 2023-10-14T09:02:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 0x7f3b2419d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b24100fd0 0x7f3b2419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b241a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241a4d90 con 0x7f3b24101970 2023-10-14T09:02:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241a4ed0 con 0x7f3b240ffde0 2023-10-14T09:02:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b2ae66700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b241a5060 con 0x7f3b24100fd0 2023-10-14T09:02:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b29403700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b241a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b28c02700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 0x7f3b2419d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b23fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b24100fd0 0x7f3b2419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b28c02700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 0x7f3b2419d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34008/0 (socket says 172.21.15.6:34008) 2023-10-14T09:02:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b29403700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b241a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35254/0 (socket says 172.21.15.6:35254) 2023-10-14T09:02:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.189+0000 7f3b28c02700 1 -- 172.21.15.6:0/559549552 learned_addr learned my addr 172.21.15.6:0/559549552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b28c02700 1 -- 172.21.15.6:0/559549552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b24100fd0 msgr2=0x7f3b2419d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b28c02700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b24100fd0 0x7f3b2419d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b28c02700 1 -- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 msgr2=0x7f3b241a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b28c02700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b241a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b28c02700 1 -- 172.21.15.6:0/559549552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b100095f0 con 0x7f3b240ffde0 2023-10-14T09:02:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b29403700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b241a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b28c02700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 0x7f3b2419d210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800e970 tx=0x7f3b1800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b21ffb700 1 -- 172.21.15.6:0/559549552 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18009790 con 0x7f3b240ffde0 2023-10-14T09:02:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b241a5340 con 0x7f3b240ffde0 2023-10-14T09:02:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b21ffb700 1 -- 172.21.15.6:0/559549552 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b1800c7e0 con 0x7f3b240ffde0 2023-10-14T09:02:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b21ffb700 1 -- 172.21.15.6:0/559549552 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18003c70 con 0x7f3b240ffde0 2023-10-14T09:02:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.190+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b241a5850 con 0x7f3b240ffde0 2023-10-14T09:02:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.192+0000 7f3b21ffb700 1 -- 172.21.15.6:0/559549552 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3b1800cc50 con 0x7f3b240ffde0 2023-10-14T09:02:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.193+0000 7f3b21ffb700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b140a1480 0x7f3b140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.193+0000 7f3b21ffb700 1 -- 172.21.15.6:0/559549552 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3b18014070 con 0x7f3b240ffde0 2023-10-14T09:02:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 Processor -- start 2023-10-14T09:02:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 -- start start 2023-10-14T09:02:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64197c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba64199530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba640fbc10 con 0x55ba641981c0 2023-10-14T09:02:05.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba640e0c00 con 0x55ba64197860 2023-10-14T09:02:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b37050b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba640de520 con 0x55ba641990b0 2023-10-14T09:02:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b23fff700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b140a1480 0x7f3b140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b29403700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba64199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b29403700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba64199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60892/0 (socket says 172.21.15.6:60892) 2023-10-14T09:02:05.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b23fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b29403700 1 -- 172.21.15.6:0/2836665944 learned_addr learned my addr 172.21.15.6:0/2836665944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.196+0000 7f3b28c02700 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b29403700 1 -- 172.21.15.6:0/2836665944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 msgr2=0x55ba64197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b29403700 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b29403700 1 -- 172.21.15.6:0/2836665944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 msgr2=0x55ba64198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b29403700 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b29403700 1 -- 172.21.15.6:0/2836665944 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba64097390 con 0x55ba641990b0 2023-10-14T09:02:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b29403700 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba64199530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0078a0 tx=0x7f3b1c007bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=961c77def59428fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b0effd700 1 -- 172.21.15.6:0/2836665944 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c004bb0 con 0x55ba641990b0 2023-10-14T09:02:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b0effd700 1 -- 172.21.15.6:0/2836665944 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b1c00f040 con 0x55ba641990b0 2023-10-14T09:02:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.197+0000 7f3b0effd700 1 -- 172.21.15.6:0/2836665944 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c005420 con 0x55ba641990b0 2023-10-14T09:02:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 -- 172.21.15.6:0/2836665944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 msgr2=0x55ba64199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b23fff700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b140a1480 0x7f3b140a3940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b580 tx=0x7f3b10005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba64199530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0078a0 tx=0x7f3b1c007bb0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 -- 172.21.15.6:0/2836665944 shutdown_connections 2023-10-14T09:02:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba64199530 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2836665944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 -- 172.21.15.6:0/2836665944 >> 172.21.15.6:0/2836665944 conn(0x55ba640b4d70 msgr2=0x55ba64181c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:05.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 -- 172.21.15.6:0/2836665944 shutdown_connections 2023-10-14T09:02:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 -- 172.21.15.6:0/2836665944 wait complete. 2023-10-14T09:02:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.198+0000 7f3b37050b80 1 -- start start 2023-10-14T09:02:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 Processor -- start 2023-10-14T09:02:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64187c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64188150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba640d9e10 con 0x55ba641981c0 2023-10-14T09:02:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba640766b0 con 0x55ba64197860 2023-10-14T09:02:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba64076350 con 0x55ba641990b0 2023-10-14T09:02:05.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b37050b80 10 client.0 _ll_register_callbacks cb 0x55ba63ed37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b23fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64188150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b29403700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b29403700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60902/0 (socket says 172.21.15.6:60902) 2023-10-14T09:02:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b29403700 1 -- 172.21.15.6:0/1188367619 learned_addr learned my addr 172.21.15.6:0/1188367619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.199+0000 7f3b28c02700 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64187c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b29403700 1 -- 172.21.15.6:0/1188367619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 msgr2=0x55ba64187c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b29403700 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64187c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b29403700 1 -- 172.21.15.6:0/1188367619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 msgr2=0x55ba64188150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b29403700 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64188150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b29403700 1 -- 172.21.15.6:0/1188367619 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c007500 con 0x55ba641990b0 2023-10-14T09:02:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b29403700 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c007fd0 tx=0x7f3b1c015860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aafa2468ecf2fdec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b03fff700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:02:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b03fff700 1 -- 172.21.15.6:0/1188367619 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c015cd0 con 0x55ba641990b0 2023-10-14T09:02:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b03fff700 1 -- 172.21.15.6:0/1188367619 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3b1c015a00 con 0x55ba641990b0 2023-10-14T09:02:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba640dee90 con 0x55ba641990b0 2023-10-14T09:02:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b03fff700 1 -- 172.21.15.6:0/1188367619 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b1c005330 con 0x55ba641990b0 2023-10-14T09:02:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b37050b80 10 client.25945 fetch_fsmap learned FSMap version 46 2023-10-14T09:02:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.200+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55ba63f04d80 con 0x55ba641990b0 2023-10-14T09:02:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b03fff700 1 -- 172.21.15.6:0/1188367619 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ba640dee90 con 0x55ba641990b0 2023-10-14T09:02:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b03fff700 1 -- 172.21.15.6:0/1188367619 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 46) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f3b1c024020 con 0x55ba641990b0 2023-10-14T09:02:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b37050b80 10 client.25945 fetch_fsmap finished waiting for FSMap version 46 2023-10-14T09:02:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b37050b80 10 client.25945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b37050b80 20 client.25945 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba641939a0 0x55ba64195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b37050b80 4 client.25945 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:02:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba64156bb0 con 0x55ba641939a0 2023-10-14T09:02:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.201+0000 7f3b28c02700 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba641939a0 0x55ba64195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b03fff700 10 client.25945 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b28c02700 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba641939a0 0x55ba64195dc0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162975289eefef97 server_cookie=84cc942512f41575 in_seq=0 out_seq=0 2023-10-14T09:02:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b03fff700 1 -- 172.21.15.6:0/1188367619 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba64156bb0 con 0x55ba641939a0 2023-10-14T09:02:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b03fff700 10 client.25945 handle_command_reply: tid=0 2023-10-14T09:02:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b37050b80 1 client.25945 shutdown 2023-10-14T09:02:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 msgr2=0x55ba6418f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.202+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c007fd0 tx=0x7f3b1c015860 comp rx=0 tx=0).stop 2023-10-14T09:02:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 shutdown_connections 2023-10-14T09:02:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba641939a0 0x55ba64195dc0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba64197860 0x55ba64187c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b03fff700 0 client.25945 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1188367619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba641981c0 0x55ba64188150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 >> 172.21.15.6:0/1188367619 conn(0x55ba640b4d70 msgr2=0x55ba64181830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 shutdown_connections 2023-10-14T09:02:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 1 -- 172.21.15.6:0/1188367619 wait complete. 2023-10-14T09:02:05.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.203+0000 7f3b37050b80 20 client.25945 trim_cache size 0 max 16384 2023-10-14T09:02:05.245 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 Processor -- start 2023-10-14T09:02:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 -- start start 2023-10-14T09:02:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba641868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.247 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba63f5a8c0 con 0x55ba64197860 2023-10-14T09:02:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba64198f30 con 0x55ba641981c0 2023-10-14T09:02:05.248 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b37050b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba641870c0 con 0x55ba641990b0 2023-10-14T09:02:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b28c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba641868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.244+0000 7f3b28c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba641868c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35272/0 (socket says 172.21.15.6:35272) 2023-10-14T09:02:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 -- 172.21.15.6:0/2377280640 learned_addr learned my addr 172.21.15.6:0/2377280640 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:05.249 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b23fff700 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 -- 172.21.15.6:0/2377280640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 msgr2=0x55ba6418f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 -- 172.21.15.6:0/2377280640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 msgr2=0x55ba6418f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.250 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 -- 172.21.15.6:0/2377280640 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba63eedc00 con 0x55ba64197860 2023-10-14T09:02:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b28c02700 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba641868c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b18096710 tx=0x7f3b180cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df8b37aedbc32f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b0f7fe700 1 -- 172.21.15.6:0/2377280640 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1809a210 con 0x55ba64197860 2023-10-14T09:02:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b0f7fe700 1 -- 172.21.15.6:0/2377280640 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b1809e360 con 0x55ba64197860 2023-10-14T09:02:05.251 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.245+0000 7f3b0f7fe700 1 -- 172.21.15.6:0/2377280640 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18098690 con 0x55ba64197860 2023-10-14T09:02:05.254 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 -- 172.21.15.6:0/2377280640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 msgr2=0x55ba641868c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba641868c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b18096710 tx=0x7f3b180cc040 comp rx=0 tx=0).stop 2023-10-14T09:02:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 -- 172.21.15.6:0/2377280640 shutdown_connections 2023-10-14T09:02:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba641868c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.255 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 --2- 172.21.15.6:0/2377280640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 -- 172.21.15.6:0/2377280640 >> 172.21.15.6:0/2377280640 conn(0x55ba640b4d70 msgr2=0x55ba641a3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 -- 172.21.15.6:0/2377280640 shutdown_connections 2023-10-14T09:02:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.246+0000 7f3b37050b80 1 -- 172.21.15.6:0/2377280640 wait complete. 2023-10-14T09:02:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 -- start start 2023-10-14T09:02:05.256 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 Processor -- start 2023-10-14T09:02:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba6418b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6419ed30 con 0x55ba64197860 2023-10-14T09:02:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6418e060 con 0x55ba641981c0 2023-10-14T09:02:05.257 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6418e220 con 0x55ba641990b0 2023-10-14T09:02:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.247+0000 7f3b37050b80 10 client.0 _ll_register_callbacks cb 0x7f3b18005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba6418b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba6418b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35278/0 (socket says 172.21.15.6:35278) 2023-10-14T09:02:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 -- 172.21.15.6:0/1290927510 learned_addr learned my addr 172.21.15.6:0/1290927510 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b29403700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 -- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 msgr2=0x55ba6418db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 -- 172.21.15.6:0/1290927510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 msgr2=0x55ba6418d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 -- 172.21.15.6:0/1290927510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b241a5850 con 0x55ba64197860 2023-10-14T09:02:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b29403700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b28c02700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba6418b090 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b180a2070 tx=0x7f3b18098690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e3a5e379b3c7a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b03fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:02:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b03fff700 1 -- 172.21.15.6:0/1290927510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18098350 con 0x55ba64197860 2023-10-14T09:02:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.248+0000 7f3b03fff700 1 -- 172.21.15.6:0/1290927510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3b1809a210 con 0x55ba64197860 2023-10-14T09:02:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b1c00f040 con 0x55ba64197860 2023-10-14T09:02:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b03fff700 1 -- 172.21.15.6:0/1290927510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b180b82d0 con 0x55ba64197860 2023-10-14T09:02:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 10 client.16326 fetch_fsmap learned FSMap version 46 2023-10-14T09:02:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55ba63f2b1f0 con 0x55ba64197860 2023-10-14T09:02:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b03fff700 1 -- 172.21.15.6:0/1290927510 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b1c00f040 con 0x55ba64197860 2023-10-14T09:02:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b03fff700 1 -- 172.21.15.6:0/1290927510 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f3b18099700 con 0x55ba64197860 2023-10-14T09:02:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 10 client.16326 fetch_fsmap finished waiting for FSMap version 46 2023-10-14T09:02:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 10 client.16326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 20 client.16326 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba642022b0 0x55ba642046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 4 client.16326 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:02:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ba640d2df0 con 0x55ba642022b0 2023-10-14T09:02:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.249+0000 7f3b23fff700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba642022b0 0x55ba642046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.250+0000 7f3b03fff700 10 client.16326 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.250+0000 7f3b23fff700 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba642022b0 0x55ba642046d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b9d8204b54980d server_cookie=42404b410d194e58 in_seq=0 out_seq=0 2023-10-14T09:02:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.269+0000 7f3b03fff700 1 -- 172.21.15.6:0/1290927510 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ba640d2df0 con 0x55ba642022b0 2023-10-14T09:02:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.269+0000 7f3b03fff700 10 client.16326 handle_command_reply: tid=0 2023-10-14T09:02:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.269+0000 7f3b37050b80 1 client.16326 shutdown 2023-10-14T09:02:05.272 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.269+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 msgr2=0x55ba6418b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.269+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba6418b090 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b180a2070 tx=0x7f3b18098690 comp rx=0 tx=0).stop 2023-10-14T09:02:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 shutdown_connections 2023-10-14T09:02:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ba642022b0 0x55ba642046d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba641990b0 0x55ba6418db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba64197860 0x55ba6418b090 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.273 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b03fff700 0 client.16326 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 --2- 172.21.15.6:0/1290927510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ba641981c0 0x55ba6418d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 >> 172.21.15.6:0/1290927510 conn(0x55ba640b4d70 msgr2=0x55ba641868c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 shutdown_connections 2023-10-14T09:02:05.274 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 1 -- 172.21.15.6:0/1290927510 wait complete. 2023-10-14T09:02:05.275 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b37050b80 20 client.16326 trim_cache size 0 max 16384 2023-10-14T09:02:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:02:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:02:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:02:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:02:05.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b140a1480 msgr2=0x7f3b140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b140a1480 0x7f3b140a3940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b580 tx=0x7f3b10005bc0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 msgr2=0x7f3b2419d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 0x7f3b2419d210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800e970 tx=0x7f3b1800ec80 comp rx=0 tx=0).stop 2023-10-14T09:02:05.280 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 shutdown_connections 2023-10-14T09:02:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b24101970 0x7f3b241a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3b140a1480 0x7f3b140a3940 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b240ffde0 0x7f3b2419d210 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 --2- 172.21.15.6:0/559549552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b24100fd0 0x7f3b2419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:05.281 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.270+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 >> 172.21.15.6:0/559549552 conn(0x7f3b240fb370 msgr2=0x7f3b240fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.271+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 shutdown_connections 2023-10-14T09:02:05.282 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:05.271+0000 7f3b2ae66700 1 -- 172.21.15.6:0/559549552 wait complete. 2023-10-14T09:02:05.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:05 smithi006 ceph-mon[99452]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 751 op/s 2023-10-14T09:02:05.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:05 smithi178 ceph-mon[103612]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 751 op/s 2023-10-14T09:02:05.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:05 smithi057 ceph-mon[103313]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 751 op/s 2023-10-14T09:02:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 545.0 s, 1533.1 tps, lat 70.906 ms stddev 164.826 2023-10-14T09:02:06.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:06 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:06.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:06 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:06.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:06 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:07.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:07 smithi178 ceph-mon[103612]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 766 op/s 2023-10-14T09:02:07.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:07 smithi057 ceph-mon[103313]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 766 op/s 2023-10-14T09:02:07.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:07 smithi006 ceph-mon[99452]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 766 op/s 2023-10-14T09:02:09.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:09 smithi178 ceph-mon[103612]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 744 op/s 2023-10-14T09:02:09.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:09 smithi057 ceph-mon[103313]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 744 op/s 2023-10-14T09:02:09.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:09 smithi006 ceph-mon[99452]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 744 op/s 2023-10-14T09:02:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 550.0 s, 1651.8 tps, lat 60.686 ms stddev 66.052 2023-10-14T09:02:11.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:11 smithi178 ceph-mon[103612]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 670 op/s 2023-10-14T09:02:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:11 smithi057 ceph-mon[103313]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 670 op/s 2023-10-14T09:02:11.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:11 smithi006 ceph-mon[99452]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 670 op/s 2023-10-14T09:02:12.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:12 smithi178 ceph-mon[103612]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 663 op/s 2023-10-14T09:02:12.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:12 smithi057 ceph-mon[103313]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 663 op/s 2023-10-14T09:02:12.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:12 smithi006 ceph-mon[99452]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 663 op/s 2023-10-14T09:02:15.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:14 smithi178 ceph-mon[103612]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 MiB/s wr, 1.02k op/s 2023-10-14T09:02:15.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:14 smithi057 ceph-mon[103313]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 MiB/s wr, 1.02k op/s 2023-10-14T09:02:15.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:14 smithi006 ceph-mon[99452]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 MiB/s wr, 1.02k op/s 2023-10-14T09:02:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 555.0 s, 1007.6 tps, lat 98.191 ms stddev 170.716 2023-10-14T09:02:17.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:17 smithi057 ceph-mon[103313]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 1.59k op/s 2023-10-14T09:02:17.740 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:17 smithi006 ceph-mon[99452]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 1.59k op/s 2023-10-14T09:02:17.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:17 smithi178 ceph-mon[103612]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 29 MiB/s wr, 1.59k op/s 2023-10-14T09:02:18.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 -- 172.21.15.6:0/2673211262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 msgr2=0x7f147c10ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 --2- 172.21.15.6:0/2673211262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c10ccb0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1470009990 tx=0x7f1470009ca0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 -- 172.21.15.6:0/2673211262 shutdown_connections 2023-10-14T09:02:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 --2- 172.21.15.6:0/2673211262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 0x7f147c10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 --2- 172.21.15.6:0/2673211262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 0x7f147c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 --2- 172.21.15.6:0/2673211262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c10ccb0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.415+0000 7f148126e700 1 -- 172.21.15.6:0/2673211262 >> 172.21.15.6:0/2673211262 conn(0x7f147c06dcf0 msgr2=0x7f147c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 -- 172.21.15.6:0/2673211262 shutdown_connections 2023-10-14T09:02:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 -- 172.21.15.6:0/2673211262 wait complete. 2023-10-14T09:02:18.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 Processor -- start 2023-10-14T09:02:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 -- start start 2023-10-14T09:02:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 0x7f147c1a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c1a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 0x7f147c1acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1ad5a0 con 0x7f147c10a820 2023-10-14T09:02:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1ad6e0 con 0x7f147c10d1f0 2023-10-14T09:02:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.416+0000 7f148126e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1ad870 con 0x7f147c107eb0 2023-10-14T09:02:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c1a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c1a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35302/0 (socket says 172.21.15.6:35302) 2023-10-14T09:02:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147a7fc700 1 -- 172.21.15.6:0/4174213326 learned_addr learned my addr 172.21.15.6:0/4174213326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 0x7f147c1acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147affd700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 0x7f147c1a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 -- 172.21.15.6:0/4174213326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 msgr2=0x7f147c1a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 0x7f147c1a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 -- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 msgr2=0x7f147c1a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c1a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 -- 172.21.15.6:0/4174213326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009c40 con 0x7f147c10d1f0 2023-10-14T09:02:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147a7fc700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c1a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147affd700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 0x7f147c1a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.417+0000 7f147b7fe700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 0x7f147c1acfd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e970 tx=0x7f146c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.418+0000 7f1463fff700 1 -- 172.21.15.6:0/4174213326 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c004220 con 0x7f147c10d1f0 2023-10-14T09:02:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.418+0000 7f1463fff700 1 -- 172.21.15.6:0/4174213326 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f146c004cf0 con 0x7f147c10d1f0 2023-10-14T09:02:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.418+0000 7f1463fff700 1 -- 172.21.15.6:0/4174213326 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c005660 con 0x7f147c10d1f0 2023-10-14T09:02:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.418+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700095f0 con 0x7f147c10d1f0 2023-10-14T09:02:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.418+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c1ade80 con 0x7f147c10d1f0 2023-10-14T09:02:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.420+0000 7f1463fff700 1 -- 172.21.15.6:0/4174213326 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f146c004750 con 0x7f147c10d1f0 2023-10-14T09:02:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f1463fff700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f14640a1500 0x7f14640a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 Processor -- start 2023-10-14T09:02:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f147affd700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f14640a1500 0x7f14640a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 -- start start 2023-10-14T09:02:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f1463fff700 1 -- 172.21.15.6:0/4174213326 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f146c014070 con 0x7f147c10d1f0 2023-10-14T09:02:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760c4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb76037c10 con 0x55eb760c2850 2023-10-14T09:02:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb7601cc00 con 0x55eb760c31b0 2023-10-14T09:02:18.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.421+0000 7f148d458b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb7601a520 con 0x55eb760c40a0 2023-10-14T09:02:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35308/0 (socket says 172.21.15.6:35308) 2023-10-14T09:02:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 -- 172.21.15.6:0/2083656193 learned_addr learned my addr 172.21.15.6:0/2083656193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:18.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147a7fc700 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147b7fe700 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f14640a1500 0x7f14640a39c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f147c071fa0 tx=0x7f1474009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 -- 172.21.15.6:0/2083656193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 msgr2=0x55eb760c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 -- 172.21.15.6:0/2083656193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 msgr2=0x55eb760c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147affd700 1 -- 172.21.15.6:0/2083656193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb75fd3390 con 0x55eb760c2850 2023-10-14T09:02:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.422+0000 7f147a7fc700 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.423+0000 7f147affd700 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760c2c70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f147400e920 tx=0x7f147401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ef4006b9227cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.423+0000 7f14617fa700 1 -- 172.21.15.6:0/2083656193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474003c00 con 0x55eb760c2850 2023-10-14T09:02:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.423+0000 7f14617fa700 1 -- 172.21.15.6:0/2083656193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f147400f040 con 0x55eb760c2850 2023-10-14T09:02:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.423+0000 7f14617fa700 1 -- 172.21.15.6:0/2083656193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147401a870 con 0x55eb760c2850 2023-10-14T09:02:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 -- 172.21.15.6:0/2083656193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 msgr2=0x55eb760c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760c2c70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f147400e920 tx=0x7f147401c000 comp rx=0 tx=0).stop 2023-10-14T09:02:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 -- 172.21.15.6:0/2083656193 shutdown_connections 2023-10-14T09:02:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760c2c70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 --2- 172.21.15.6:0/2083656193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 -- 172.21.15.6:0/2083656193 >> 172.21.15.6:0/2083656193 conn(0x55eb75ff0d70 msgr2=0x55eb760bdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 -- 172.21.15.6:0/2083656193 shutdown_connections 2023-10-14T09:02:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.424+0000 7f148d458b80 1 -- 172.21.15.6:0/2083656193 wait complete. 2023-10-14T09:02:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 -- start start 2023-10-14T09:02:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 Processor -- start 2023-10-14T09:02:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760eed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 0x55eb760f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb76015e10 con 0x55eb760c40a0 2023-10-14T09:02:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb75fb26b0 con 0x55eb760c31b0 2023-10-14T09:02:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb75fb2350 con 0x55eb760c2850 2023-10-14T09:02:18.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f148d458b80 10 client.0 _ll_register_callbacks cb 0x55eb75e0f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f147b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 0x55eb760f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f147a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f147b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 0x55eb760f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35318/0 (socket says 172.21.15.6:35318) 2023-10-14T09:02:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f147affd700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.425+0000 7f147b7fe700 1 -- 172.21.15.6:0/1597261396 learned_addr learned my addr 172.21.15.6:0/1597261396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147b7fe700 1 -- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 msgr2=0x55eb760ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147b7fe700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147b7fe700 1 -- 172.21.15.6:0/1597261396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 msgr2=0x55eb760eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147b7fe700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147b7fe700 1 -- 172.21.15.6:0/1597261396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c10e240 con 0x55eb760c40a0 2023-10-14T09:02:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147affd700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147a7fc700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f147b7fe700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 0x55eb760f5d40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e940 tx=0x7f146c09a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3593350c50b3755e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f145eff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:02:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f145eff5700 1 -- 172.21.15.6:0/1597261396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c09de70 con 0x55eb760c40a0 2023-10-14T09:02:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f145eff5700 1 -- 172.21.15.6:0/1597261396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f146c0a20b0 con 0x55eb760c40a0 2023-10-14T09:02:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb7601ae90 con 0x55eb760c40a0 2023-10-14T09:02:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f145eff5700 1 -- 172.21.15.6:0/1597261396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f146c099f80 con 0x55eb760c40a0 2023-10-14T09:02:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f148d458b80 10 client.16338 fetch_fsmap learned FSMap version 47 2023-10-14T09:02:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f147400e600 con 0x55eb760c40a0 2023-10-14T09:02:18.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.426+0000 7f145eff5700 1 -- 172.21.15.6:0/1597261396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eb7601ae90 con 0x55eb760c40a0 2023-10-14T09:02:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f145eff5700 1 -- 172.21.15.6:0/1597261396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f146c0a1c20 con 0x55eb760c40a0 2023-10-14T09:02:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f148d458b80 10 client.16338 fetch_fsmap finished waiting for FSMap version 47 2023-10-14T09:02:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f148d458b80 10 client.16338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f148d458b80 20 client.16338 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f148d458b80 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb760fa700 0x55eb760fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f148d458b80 4 client.16338 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:02:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb76092bb0 con 0x55eb760fa700 2023-10-14T09:02:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f147affd700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb760fa700 0x55eb760fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f147affd700 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb760fa700 0x55eb760fcb20 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd02d54a95fade58 server_cookie=7a05199c61964225 in_seq=0 out_seq=0 2023-10-14T09:02:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.427+0000 7f145eff5700 10 client.16338 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f145eff5700 1 -- 172.21.15.6:0/1597261396 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eb76092bb0 con 0x55eb760fa700 2023-10-14T09:02:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f145eff5700 10 client.16338 handle_command_reply: tid=0 2023-10-14T09:02:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 client.16338 shutdown 2023-10-14T09:02:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 msgr2=0x55eb760f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 0x55eb760f5d40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e940 tx=0x7f146c09a560 comp rx=0 tx=0).stop 2023-10-14T09:02:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 shutdown_connections 2023-10-14T09:02:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb760fa700 0x55eb760fcb20 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c40a0 0x55eb760f5d40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f145eff5700 0 client.16338 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 --2- 172.21.15.6:0/1597261396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.428+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 >> 172.21.15.6:0/1597261396 conn(0x55eb75ff0d70 msgr2=0x55eb760bd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:18.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.429+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 shutdown_connections 2023-10-14T09:02:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.429+0000 7f148d458b80 1 -- 172.21.15.6:0/1597261396 wait complete. 2023-10-14T09:02:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.429+0000 7f148d458b80 20 client.16338 trim_cache size 0 max 16384 2023-10-14T09:02:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 Processor -- start 2023-10-14T09:02:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 -- start start 2023-10-14T09:02:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760ed410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb75e968c0 con 0x55eb760c2850 2023-10-14T09:02:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb760ed200 con 0x55eb760c31b0 2023-10-14T09:02:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.447+0000 7f148d458b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb760ee330 con 0x55eb760c40a0 2023-10-14T09:02:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760ee7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60960/0 (socket says 172.21.15.6:60960) 2023-10-14T09:02:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 -- 172.21.15.6:0/2573147839 learned_addr learned my addr 172.21.15.6:0/2573147839 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147a7fc700 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 -- 172.21.15.6:0/2573147839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 msgr2=0x55eb760f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 -- 172.21.15.6:0/2573147839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 msgr2=0x55eb760ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 -- 172.21.15.6:0/2573147839 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb75e40d80 con 0x55eb760c40a0 2023-10-14T09:02:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147a7fc700 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:02:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.448+0000 7f147b7fe700 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760ee7c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f146c098070 tx=0x7f146c099ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a3b039e87e9e658 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.449+0000 7f1461ffb700 1 -- 172.21.15.6:0/2573147839 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c09de70 con 0x55eb760c40a0 2023-10-14T09:02:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.449+0000 7f1461ffb700 1 -- 172.21.15.6:0/2573147839 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f146c095c10 con 0x55eb760c40a0 2023-10-14T09:02:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.449+0000 7f1461ffb700 1 -- 172.21.15.6:0/2573147839 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c09a1e0 con 0x55eb760c40a0 2023-10-14T09:02:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.449+0000 7f148d458b80 1 -- 172.21.15.6:0/2573147839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 msgr2=0x55eb760ee7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.449+0000 7f148d458b80 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760ee7c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f146c098070 tx=0x7f146c099ea0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- 172.21.15.6:0/2573147839 shutdown_connections 2023-10-14T09:02:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c40a0 0x55eb760ee7c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c2850 0x55eb760ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 --2- 172.21.15.6:0/2573147839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c31b0 0x55eb760f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- 172.21.15.6:0/2573147839 >> 172.21.15.6:0/2573147839 conn(0x55eb75ff0d70 msgr2=0x55eb760ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- 172.21.15.6:0/2573147839 shutdown_connections 2023-10-14T09:02:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- 172.21.15.6:0/2573147839 wait complete. 2023-10-14T09:02:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- start start 2023-10-14T09:02:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 Processor -- start 2023-10-14T09:02:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c31b0 0x55eb760f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c40a0 0x55eb760f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb760f5030 con 0x55eb760c31b0 2023-10-14T09:02:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb760f51a0 con 0x55eb760c40a0 2023-10-14T09:02:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb760f5360 con 0x55eb760c2850 2023-10-14T09:02:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f148d458b80 10 client.0 _ll_register_callbacks cb 0x7f146c004e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f147a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c31b0 0x55eb760f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f147affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f147b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c40a0 0x55eb760f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f147affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60962/0 (socket says 172.21.15.6:60962) 2023-10-14T09:02:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.450+0000 7f147affd700 1 -- 172.21.15.6:0/927364710 learned_addr learned my addr 172.21.15.6:0/927364710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f147affd700 1 -- 172.21.15.6:0/927364710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c40a0 msgr2=0x55eb760f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f147affd700 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c40a0 0x55eb760f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f147affd700 1 -- 172.21.15.6:0/927364710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c31b0 msgr2=0x55eb760f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f147affd700 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c31b0 0x55eb760f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f147affd700 1 -- 172.21.15.6:0/927364710 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147400e600 con 0x55eb760c2850 2023-10-14T09:02:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f147affd700 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760f35a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1474007ed0 tx=0x7f1474009460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa149c7f360cf55c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f145eff5700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:02:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f145eff5700 1 -- 172.21.15.6:0/927364710 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740095e0 con 0x55eb760c2850 2023-10-14T09:02:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f145eff5700 1 -- 172.21.15.6:0/927364710 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f14740337a0 con 0x55eb760c2850 2023-10-14T09:02:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f147400f040 con 0x55eb760c2850 2023-10-14T09:02:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f145eff5700 1 -- 172.21.15.6:0/927364710 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1474033960 con 0x55eb760c2850 2023-10-14T09:02:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f148d458b80 10 client.25966 fetch_fsmap learned FSMap version 47 2023-10-14T09:02:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55eb75e29c00 con 0x55eb760c2850 2023-10-14T09:02:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.451+0000 7f145eff5700 1 -- 172.21.15.6:0/927364710 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1474042020 con 0x55eb760c2850 2023-10-14T09:02:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f145eff5700 1 -- 172.21.15.6:0/927364710 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 47) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f147403a060 con 0x55eb760c2850 2023-10-14T09:02:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f148d458b80 10 client.25966 fetch_fsmap finished waiting for FSMap version 47 2023-10-14T09:02:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f148d458b80 10 client.25966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f148d458b80 20 client.25966 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f148d458b80 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb7614f010 0x55eb76151430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f148d458b80 4 client.25966 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:02:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eb7600edf0 con 0x55eb7614f010 2023-10-14T09:02:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f147a7fc700 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb7614f010 0x55eb76151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f147a7fc700 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb7614f010 0x55eb76151430 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5ab3e1a8461905 server_cookie=e8657708194140d4 in_seq=0 out_seq=0 2023-10-14T09:02:18.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.452+0000 7f145eff5700 10 client.25966 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:18.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f145eff5700 1 -- 172.21.15.6:0/927364710 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eb7600edf0 con 0x55eb7614f010 2023-10-14T09:02:18.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f145eff5700 10 client.25966 handle_command_reply: tid=0 2023-10-14T09:02:18.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 client.25966 shutdown 2023-10-14T09:02:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 msgr2=0x55eb760f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760f35a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1474007ed0 tx=0x7f1474009460 comp rx=0 tx=0).stop 2023-10-14T09:02:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 shutdown_connections 2023-10-14T09:02:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55eb7614f010 0x55eb76151430 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55eb760c40a0 0x55eb760f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb760c2850 0x55eb760f35a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 --2- 172.21.15.6:0/927364710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb760c31b0 0x55eb760f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 >> 172.21.15.6:0/927364710 conn(0x55eb75ff0d70 msgr2=0x55eb760ed410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.465+0000 7f145eff5700 0 client.25966 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 shutdown_connections 2023-10-14T09:02:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148d458b80 1 -- 172.21.15.6:0/927364710 wait complete. 2023-10-14T09:02:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148d458b80 20 client.25966 trim_cache size 0 max 16384 2023-10-14T09:02:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:02:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:02:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:02:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:02:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f14640a1500 msgr2=0x7f14640a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f14640a1500 0x7f14640a39c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f147c071fa0 tx=0x7f1474009920 comp rx=0 tx=0).stop 2023-10-14T09:02:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 msgr2=0x7f147c1acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 0x7f147c1acfd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e970 tx=0x7f146c00ec80 comp rx=0 tx=0).stop 2023-10-14T09:02:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 shutdown_connections 2023-10-14T09:02:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f14640a1500 0x7f14640a39c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f147c10d1f0 0x7f147c1acfd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f147c107eb0 0x7f147c1a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 --2- 172.21.15.6:0/4174213326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c10a820 0x7f147c1a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 >> 172.21.15.6:0/4174213326 conn(0x7f147c06dcf0 msgr2=0x7f147c108bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 shutdown_connections 2023-10-14T09:02:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:18.466+0000 7f148126e700 1 -- 172.21.15.6:0/4174213326 wait complete. 2023-10-14T09:02:19.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:19 smithi057 ceph-mon[103313]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 1.86k op/s 2023-10-14T09:02:19.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:19 smithi006 ceph-mon[99452]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 1.86k op/s 2023-10-14T09:02:19.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:19 smithi178 ceph-mon[103612]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 1.86k op/s 2023-10-14T09:02:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 560.0 s, 1708.8 tps, lat 59.038 ms stddev 61.698 2023-10-14T09:02:21.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:21 smithi057 ceph-mon[103313]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 1.94k op/s 2023-10-14T09:02:21.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:21 smithi006 ceph-mon[99452]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 1.94k op/s 2023-10-14T09:02:21.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:21 smithi178 ceph-mon[103612]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 1.94k op/s 2023-10-14T09:02:23.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:23 smithi057 ceph-mon[103313]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.92k op/s 2023-10-14T09:02:23.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:23 smithi006 ceph-mon[99452]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.92k op/s 2023-10-14T09:02:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:23 smithi178 ceph-mon[103612]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.92k op/s 2023-10-14T09:02:25.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:25 smithi006 ceph-mon[99452]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.90k op/s 2023-10-14T09:02:25.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:25 smithi178 ceph-mon[103612]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.90k op/s 2023-10-14T09:02:25.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:25 smithi057 ceph-mon[103313]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.90k op/s 2023-10-14T09:02:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 565.0 s, 1642.2 tps, lat 61.404 ms stddev 76.669 2023-10-14T09:02:27.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:27 smithi178 ceph-mon[103612]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 1.55k op/s 2023-10-14T09:02:27.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:27 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:27.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:27 smithi057 ceph-mon[103313]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 1.55k op/s 2023-10-14T09:02:27.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:27 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:27.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:27 smithi006 ceph-mon[99452]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 1.55k op/s 2023-10-14T09:02:27.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:27 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:29.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:29 smithi178 ceph-mon[103612]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 966 op/s 2023-10-14T09:02:29.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:29 smithi057 ceph-mon[103313]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 966 op/s 2023-10-14T09:02:29.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:29 smithi006 ceph-mon[99452]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 966 op/s 2023-10-14T09:02:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 570.0 s, 1853.8 tps, lat 53.760 ms stddev 60.481 2023-10-14T09:02:31.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 -- 172.21.15.6:0/2341300768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 msgr2=0x7f9a041013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/2341300768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a041013f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009990 tx=0x7f99f4009ca0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 -- 172.21.15.6:0/2341300768 shutdown_connections 2023-10-14T09:02:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/2341300768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 0x7f9a04108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/2341300768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a040ffe20 0x7f9a04100240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/2341300768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a041013f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 -- 172.21.15.6:0/2341300768 >> 172.21.15.6:0/2341300768 conn(0x7f9a040fb370 msgr2=0x7f9a040fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 -- 172.21.15.6:0/2341300768 shutdown_connections 2023-10-14T09:02:31.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.625+0000 7f9a0bc22700 1 -- 172.21.15.6:0/2341300768 wait complete. 2023-10-14T09:02:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.626+0000 7f9a0bc22700 1 Processor -- start 2023-10-14T09:02:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.626+0000 7f9a0bc22700 1 -- start start 2023-10-14T09:02:31.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0bc22700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a040ffe20 0x7f9a04069950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0bc22700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a04199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0bc22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 0x7f9a04199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0bc22700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0419a510 con 0x7f9a04100f70 2023-10-14T09:02:31.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0bc22700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0419a680 con 0x7f9a04101930 2023-10-14T09:02:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0bc22700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0419a840 con 0x7f9a040ffe20 2023-10-14T09:02:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a091bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a04199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a091bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a04199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35346/0 (socket says 172.21.15.6:35346) 2023-10-14T09:02:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a091bd700 1 -- 172.21.15.6:0/4065836753 learned_addr learned my addr 172.21.15.6:0/4065836753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:31.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 0x7f9a04199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a099be700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a040ffe20 0x7f9a04069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/4065836753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a040ffe20 msgr2=0x7f9a04069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a040ffe20 0x7f9a04069950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 msgr2=0x7f9a04199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a04199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/4065836753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40095f0 con 0x7f9a04101930 2023-10-14T09:02:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.627+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 0x7f9a04199d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00efc0 tx=0x7f99fc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.628+0000 7f99faffd700 1 -- 172.21.15.6:0/4065836753 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc018070 con 0x7f9a04101930 2023-10-14T09:02:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.628+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0419aac0 con 0x7f9a04101930 2023-10-14T09:02:31.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.628+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0419afd0 con 0x7f9a04101930 2023-10-14T09:02:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.628+0000 7f99faffd700 1 -- 172.21.15.6:0/4065836753 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99fc00f040 con 0x7f9a04101930 2023-10-14T09:02:31.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.628+0000 7f99faffd700 1 -- 172.21.15.6:0/4065836753 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00cda0 con 0x7f9a04101930 2023-10-14T09:02:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.630+0000 7f99faffd700 1 -- 172.21.15.6:0/4065836753 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f99fc003fa0 con 0x7f9a04101930 2023-10-14T09:02:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.631+0000 7f99faffd700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99f00a1500 0x7f99f00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.631+0000 7f9a099be700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99f00a1500 0x7f99f00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.631+0000 7f99faffd700 1 -- 172.21.15.6:0/4065836753 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f99fc0cc6c0 con 0x7f9a04101930 2023-10-14T09:02:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 Processor -- start 2023-10-14T09:02:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a099be700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99f00a1500 0x7f99f00a39c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009c60 tx=0x7f9a00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:31.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 -- start start 2023-10-14T09:02:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b69c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b6aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6b0a0 0x55f773b6b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773adec10 con 0x55f773b6b0a0 2023-10-14T09:02:31.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773ac3c00 con 0x55f773b6a1b0 2023-10-14T09:02:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773ac1520 con 0x55f773b69850 2023-10-14T09:02:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a099be700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b69c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a091bd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b6aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.632+0000 7f9a0a1bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6b0a0 0x55f773b6b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b69c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:60986/0 (socket says 172.21.15.6:60986) 2023-10-14T09:02:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 -- 172.21.15.6:0/2610243810 learned_addr learned my addr 172.21.15.6:0/2610243810 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 -- 172.21.15.6:0/2610243810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 msgr2=0x55f773b6aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b6aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 -- 172.21.15.6:0/2610243810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6b0a0 msgr2=0x55f773b6b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6b0a0 0x55f773b6b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 -- 172.21.15.6:0/2610243810 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f773a7a390 con 0x55f773b69850 2023-10-14T09:02:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a091bd700 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b6aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.633+0000 7f9a099be700 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b69c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000e4e0 tx=0x7f9a00014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3adacdf07aa258b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.635+0000 7f99effff700 1 -- 172.21.15.6:0/2610243810 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0000ee00 con 0x55f773b69850 2023-10-14T09:02:31.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.635+0000 7f99effff700 1 -- 172.21.15.6:0/2610243810 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a00021070 con 0x55f773b69850 2023-10-14T09:02:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.635+0000 7f99effff700 1 -- 172.21.15.6:0/2610243810 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0001d7d0 con 0x55f773b69850 2023-10-14T09:02:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2610243810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 msgr2=0x55f773b69c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b69c70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000e4e0 tx=0x7f9a00014000 comp rx=0 tx=0).stop 2023-10-14T09:02:31.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2610243810 shutdown_connections 2023-10-14T09:02:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6b0a0 0x55f773b6b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b69c70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2610243810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b6aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2610243810 >> 172.21.15.6:0/2610243810 conn(0x55f773a97d70 msgr2=0x55f773b64c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:31.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2610243810 shutdown_connections 2023-10-14T09:02:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2610243810 wait complete. 2023-10-14T09:02:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.636+0000 7f9a17e0cb80 1 -- start start 2023-10-14T09:02:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 Processor -- start 2023-10-14T09:02:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b73d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6b0a0 0x55f773b7ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773abce10 con 0x55f773b6a1b0 2023-10-14T09:02:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773a596b0 con 0x55f773b6b0a0 2023-10-14T09:02:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773a59350 con 0x55f773b69850 2023-10-14T09:02:31.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a17e0cb80 10 client.0 _ll_register_callbacks cb 0x55f7738b67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a091bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b73d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a091bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b73d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35358/0 (socket says 172.21.15.6:35358) 2023-10-14T09:02:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a091bd700 1 -- 172.21.15.6:0/1660872106 learned_addr learned my addr 172.21.15.6:0/1660872106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a099be700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.637+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6b0a0 0x55f773b7ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a099be700 1 -- 172.21.15.6:0/1660872106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6b0a0 msgr2=0x55f773b7ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a099be700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6b0a0 0x55f773b7ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a099be700 1 -- 172.21.15.6:0/1660872106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 msgr2=0x55f773b73d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a099be700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b73d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a099be700 1 -- 172.21.15.6:0/1660872106 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a04108b80 con 0x55f773b69850 2023-10-14T09:02:31.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a091bd700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b73d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a099be700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b737c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000ead0 tx=0x7f9a0000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47408d6a21076e53 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f99ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:02:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f99ed7fa700 1 -- 172.21.15.6:0/1660872106 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00005250 con 0x55f773b69850 2023-10-14T09:02:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f99ed7fa700 1 -- 172.21.15.6:0/1660872106 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9a000053b0 con 0x55f773b69850 2023-10-14T09:02:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f773ac1e90 con 0x55f773b69850 2023-10-14T09:02:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f99ed7fa700 1 -- 172.21.15.6:0/1660872106 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a00005570 con 0x55f773b69850 2023-10-14T09:02:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a17e0cb80 10 client.25978 fetch_fsmap learned FSMap version 49 2023-10-14T09:02:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.638+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f9a00017070 con 0x55f773b69850 2023-10-14T09:02:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f99ed7fa700 1 -- 172.21.15.6:0/1660872106 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f773ac1e90 con 0x55f773b69850 2023-10-14T09:02:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f99ed7fa700 1 -- 172.21.15.6:0/1660872106 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 49) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f9a0001c670 con 0x55f773b69850 2023-10-14T09:02:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a17e0cb80 10 client.25978 fetch_fsmap finished waiting for FSMap version 49 2023-10-14T09:02:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a17e0cb80 10 client.25978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a17e0cb80 20 client.25978 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773b7f590 0x55f773b819b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a17e0cb80 4 client.25978 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:02:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f773b39bb0 con 0x55f773b7f590 2023-10-14T09:02:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.639+0000 7f9a091bd700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773b7f590 0x55f773b819b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.640+0000 7f99ed7fa700 10 client.25978 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.640+0000 7f9a091bd700 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773b7f590 0x55f773b819b0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c65135c2e1ff6da2 server_cookie=43f109effbc70f8 in_seq=0 out_seq=0 2023-10-14T09:02:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.640+0000 7f99ed7fa700 1 -- 172.21.15.6:0/1660872106 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f773b39bb0 con 0x55f773b7f590 2023-10-14T09:02:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.640+0000 7f99ed7fa700 10 client.25978 handle_command_reply: tid=0 2023-10-14T09:02:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.640+0000 7f9a17e0cb80 1 client.25978 shutdown 2023-10-14T09:02:31.658 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 msgr2=0x55f773b737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b737c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000ead0 tx=0x7f9a0000ed60 comp rx=0 tx=0).stop 2023-10-14T09:02:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 shutdown_connections 2023-10-14T09:02:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773b7f590 0x55f773b819b0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6b0a0 0x55f773b7ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b69850 0x55f773b737c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f99ed7fa700 0 client.25978 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/1660872106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b73d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 >> 172.21.15.6:0/1660872106 conn(0x55f773a97d70 msgr2=0x55f773b64830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 shutdown_connections 2023-10-14T09:02:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/1660872106 wait complete. 2023-10-14T09:02:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.641+0000 7f9a17e0cb80 20 client.25978 trim_cache size 0 max 16384 2023-10-14T09:02:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.665+0000 7f9a17e0cb80 1 Processor -- start 2023-10-14T09:02:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 -- start start 2023-10-14T09:02:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b69850 0x55f773b69c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b7acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f77393d8c0 con 0x55f773b69850 2023-10-14T09:02:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773b73330 con 0x55f773b6a1b0 2023-10-14T09:02:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.672+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773b69490 con 0x55f773b6b0a0 2023-10-14T09:02:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.673+0000 7f9a0a1bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.673+0000 7f9a099be700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b69850 0x55f773b69c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.673+0000 7f9a0a1bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32768/0 (socket says 172.21.15.6:32768) 2023-10-14T09:02:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.673+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/2625986292 learned_addr learned my addr 172.21.15.6:0/2625986292 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f9a099be700 1 -- 172.21.15.6:0/2625986292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 msgr2=0x55f773b714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f9a099be700 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f9a099be700 1 -- 172.21.15.6:0/2625986292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 msgr2=0x55f773b7acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f9a099be700 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b7acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f9a099be700 1 -- 172.21.15.6:0/2625986292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7738e7d80 con 0x55f773b69850 2023-10-14T09:02:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f9a099be700 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b69850 0x55f773b69c30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9a00011ab0 tx=0x7f9a0001d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e6b5e40dc58f3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f99f8d82700 1 -- 172.21.15.6:0/2625986292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0005f030 con 0x55f773b69850 2023-10-14T09:02:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f99f8d82700 1 -- 172.21.15.6:0/2625986292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a0001cba0 con 0x55f773b69850 2023-10-14T09:02:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.674+0000 7f99f8d82700 1 -- 172.21.15.6:0/2625986292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000038e0 con 0x55f773b69850 2023-10-14T09:02:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.675+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2625986292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b69850 msgr2=0x55f773b69c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.675+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b69850 0x55f773b69c30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9a00011ab0 tx=0x7f9a0001d490 comp rx=0 tx=0).stop 2023-10-14T09:02:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.685+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2625986292 shutdown_connections 2023-10-14T09:02:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.685+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.685+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b69850 0x55f773b69c30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.685+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/2625986292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b6a1b0 0x55f773b7acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.685+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2625986292 >> 172.21.15.6:0/2625986292 conn(0x55f773a97d70 msgr2=0x55f773b72400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:31.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.695+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2625986292 shutdown_connections 2023-10-14T09:02:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.700+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/2625986292 wait complete. 2023-10-14T09:02:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.700+0000 7f9a17e0cb80 1 -- start start 2023-10-14T09:02:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.700+0000 7f9a17e0cb80 1 Processor -- start 2023-10-14T09:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b69850 0x55f773b782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b787f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773b79d40 con 0x55f773b6a1b0 2023-10-14T09:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773b79eb0 con 0x55f773b69850 2023-10-14T09:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f773b7a070 con 0x55f773b6b0a0 2023-10-14T09:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.711+0000 7f9a17e0cb80 10 client.0 _ll_register_callbacks cb 0x7f99fc095750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b79800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32774/0 (socket says 172.21.15.6:32774) 2023-10-14T09:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/3726292080 learned_addr learned my addr 172.21.15.6:0/3726292080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a091bd700 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/3726292080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b69850 msgr2=0x55f773b782b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:02:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b69850 0x55f773b782b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/3726292080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 msgr2=0x55f773b787f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b787f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.712+0000 7f9a0a1bf700 1 -- 172.21.15.6:0/3726292080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a00017070 con 0x55f773b6b0a0 2023-10-14T09:02:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.719+0000 7f9a0a1bf700 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b79800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0ca130 tx=0x7f99fc004db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba989c92087107f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.719+0000 7f99ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:02:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.738+0000 7f99ed7fa700 1 -- 172.21.15.6:0/3726292080 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0b22b0 con 0x55f773b6b0a0 2023-10-14T09:02:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.738+0000 7f99ed7fa700 1 -- 172.21.15.6:0/3726292080 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f99fc099a70 con 0x55f773b6b0a0 2023-10-14T09:02:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.738+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a00021070 con 0x55f773b6b0a0 2023-10-14T09:02:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.741+0000 7f99ed7fa700 1 -- 172.21.15.6:0/3726292080 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99fc09dbc0 con 0x55f773b6b0a0 2023-10-14T09:02:31.742 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.741+0000 7f9a17e0cb80 10 client.25984 fetch_fsmap learned FSMap version 49 2023-10-14T09:02:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.741+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55f7738d0c00 con 0x55f773b6b0a0 2023-10-14T09:02:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.741+0000 7f99ed7fa700 1 -- 172.21.15.6:0/3726292080 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a00021070 con 0x55f773b6b0a0 2023-10-14T09:02:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f99ed7fa700 1 -- 172.21.15.6:0/3726292080 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 49) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f99fc0b90b0 con 0x55f773b6b0a0 2023-10-14T09:02:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f9a17e0cb80 10 client.25984 fetch_fsmap finished waiting for FSMap version 49 2023-10-14T09:02:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f9a17e0cb80 10 client.25984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f9a17e0cb80 20 client.25984 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773bd3b30 0x55f773bd5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f9a17e0cb80 4 client.25984 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:02:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.742+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f773ab5df0 con 0x55f773bd3b30 2023-10-14T09:02:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.749+0000 7f9a099be700 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773bd3b30 0x55f773bd5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.753+0000 7f99ed7fa700 10 client.25984 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.753+0000 7f9a099be700 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773bd3b30 0x55f773bd5f50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bfbe3643c2ce961 server_cookie=edda25896247fc5c in_seq=0 out_seq=0 2023-10-14T09:02:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f99ed7fa700 1 -- 172.21.15.6:0/3726292080 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f773ab5df0 con 0x55f773bd3b30 2023-10-14T09:02:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f99ed7fa700 10 client.25984 handle_command_reply: tid=0 2023-10-14T09:02:31.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 client.25984 shutdown 2023-10-14T09:02:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 msgr2=0x55f773b79800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b79800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0ca130 tx=0x7f99fc004db0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 shutdown_connections 2023-10-14T09:02:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f773bd3b30 0x55f773bd5f50 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f773b6b0a0 0x55f773b79800 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f773b69850 0x55f773b782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f99ed7fa700 0 client.25984 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 --2- 172.21.15.6:0/3726292080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f773b6a1b0 0x55f773b787f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 >> 172.21.15.6:0/3726292080 conn(0x55f773a97d70 msgr2=0x55f773b72400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 shutdown_connections 2023-10-14T09:02:31.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 1 -- 172.21.15.6:0/3726292080 wait complete. 2023-10-14T09:02:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.768+0000 7f9a17e0cb80 20 client.25984 trim_cache size 0 max 16384 2023-10-14T09:02:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:02:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:02:31.773 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:02:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:02:31.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99f00a1500 msgr2=0x7f99f00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99f00a1500 0x7f99f00a39c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009c60 tx=0x7f9a00009260 comp rx=0 tx=0).stop 2023-10-14T09:02:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 msgr2=0x7f9a04199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 0x7f9a04199d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00efc0 tx=0x7f99fc00c3a0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 shutdown_connections 2023-10-14T09:02:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f99f00a1500 0x7f99f00a39c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a04101930 0x7f9a04199d40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a040ffe20 0x7f9a04069950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 --2- 172.21.15.6:0/4065836753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a04100f70 0x7f9a04199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 >> 172.21.15.6:0/4065836753 conn(0x7f9a040fb370 msgr2=0x7f9a04104530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 shutdown_connections 2023-10-14T09:02:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:31.769+0000 7f9a0bc22700 1 -- 172.21.15.6:0/4065836753 wait complete. 2023-10-14T09:02:31.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:31 smithi178 ceph-mon[103612]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 692 op/s 2023-10-14T09:02:31.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:31 smithi057 ceph-mon[103313]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 692 op/s 2023-10-14T09:02:31.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:31 smithi006 ceph-mon[99452]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 692 op/s 2023-10-14T09:02:32.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:32 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:32.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:32 smithi178 ceph-mon[103612]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 651 op/s 2023-10-14T09:02:32.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:32 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:32.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:32 smithi057 ceph-mon[103313]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 651 op/s 2023-10-14T09:02:32.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:32 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:32.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:32 smithi006 ceph-mon[99452]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 651 op/s 2023-10-14T09:02:35.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:34 smithi178 ceph-mon[103612]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 641 op/s 2023-10-14T09:02:35.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:34 smithi057 ceph-mon[103313]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 641 op/s 2023-10-14T09:02:35.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:34 smithi006 ceph-mon[99452]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 641 op/s 2023-10-14T09:02:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 575.0 s, 1609.2 tps, lat 62.101 ms stddev 68.071 2023-10-14T09:02:37.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:37 smithi178 ceph-mon[103612]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 629 op/s 2023-10-14T09:02:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:37 smithi057 ceph-mon[103313]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 629 op/s 2023-10-14T09:02:37.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:37 smithi006 ceph-mon[99452]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 629 op/s 2023-10-14T09:02:38.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:38 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:02:38.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:38 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:02:38.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:38 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:02:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:39 smithi057 ceph-mon[103313]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 633 op/s 2023-10-14T09:02:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:02:39.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:02:39.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:02:39.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:39 smithi006 ceph-mon[99452]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 633 op/s 2023-10-14T09:02:39.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:02:39.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:02:39.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:02:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:39 smithi178 ceph-mon[103612]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 633 op/s 2023-10-14T09:02:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:02:39.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:02:39.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:02:40.965 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 580.0 s, 1994.8 tps, lat 49.903 ms stddev 56.738 2023-10-14T09:02:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:41 smithi057 ceph-mon[103313]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 685 op/s 2023-10-14T09:02:41.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:41 smithi006 ceph-mon[99452]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 685 op/s 2023-10-14T09:02:41.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:41 smithi178 ceph-mon[103612]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 685 op/s 2023-10-14T09:02:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:43 smithi057 ceph-mon[103313]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 677 op/s 2023-10-14T09:02:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:43 smithi006 ceph-mon[99452]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 677 op/s 2023-10-14T09:02:43.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:43 smithi178 ceph-mon[103612]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 677 op/s 2023-10-14T09:02:44.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 -- 172.21.15.6:0/1649625533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d101013d0 msgr2=0x7f3d101017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1649625533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d101013d0 0x7f3d101017f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009990 tx=0x7f3cf8009ca0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 -- 172.21.15.6:0/1649625533 shutdown_connections 2023-10-14T09:02:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1649625533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101009e0 0x7f3d10108280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1649625533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d101013d0 0x7f3d101017f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1649625533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d10100020 0x7f3d101004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.922+0000 7f3d159a7700 1 -- 172.21.15.6:0/1649625533 >> 172.21.15.6:0/1649625533 conn(0x7f3d100faaf0 msgr2=0x7f3d100fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.923+0000 7f3d159a7700 1 -- 172.21.15.6:0/1649625533 shutdown_connections 2023-10-14T09:02:44.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.925+0000 7f3d159a7700 1 -- 172.21.15.6:0/1649625533 wait complete. 2023-10-14T09:02:44.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.925+0000 7f3d159a7700 1 Processor -- start 2023-10-14T09:02:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 -- start start 2023-10-14T09:02:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 0x7f3d10198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d101009e0 0x7f3d10199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101013d0 0x7f3d101a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101a09a0 con 0x7f3d10100020 2023-10-14T09:02:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101a0ae0 con 0x7f3d101013d0 2023-10-14T09:02:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d159a7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101a0c70 con 0x7f3d101009e0 2023-10-14T09:02:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 0x7f3d10198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 0x7f3d10198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35386/0 (socket says 172.21.15.6:35386) 2023-10-14T09:02:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d101009e0 0x7f3d10199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d0effd700 1 -- 172.21.15.6:0/1782382417 learned_addr learned my addr 172.21.15.6:0/1782382417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.927+0000 7f3d0f7fe700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101013d0 0x7f3d101a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/1782382417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101013d0 msgr2=0x7f3d101a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101013d0 0x7f3d101a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 msgr2=0x7f3d10198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 0x7f3d10198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/1782382417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80095f0 con 0x7f3d101009e0 2023-10-14T09:02:44.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0f7fe700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101013d0 0x7f3d101a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0effd700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 0x7f3d10198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d101009e0 0x7f3d10199360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000d720 tx=0x7f3d0000da30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d149a5700 1 -- 172.21.15.6:0/1782382417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000f690 con 0x7f3d101009e0 2023-10-14T09:02:44.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d149a5700 1 -- 172.21.15.6:0/1782382417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d0000fcb0 con 0x7f3d101009e0 2023-10-14T09:02:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d101a0f50 con 0x7f3d101009e0 2023-10-14T09:02:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d149a5700 1 -- 172.21.15.6:0/1782382417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00010e60 con 0x7f3d101009e0 2023-10-14T09:02:44.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.928+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d101a13d0 con 0x7f3d101009e0 2023-10-14T09:02:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.931+0000 7f3d149a5700 1 -- 172.21.15.6:0/1782382417 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3d0000f7f0 con 0x7f3d101009e0 2023-10-14T09:02:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.931+0000 7f3d149a5700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3cfc0a1480 0x7f3cfc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d149a5700 1 -- 172.21.15.6:0/1782382417 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3d000cc930 con 0x7f3d101009e0 2023-10-14T09:02:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0effd700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3cfc0a1480 0x7f3cfc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 Processor -- start 2023-10-14T09:02:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 -- start start 2023-10-14T09:02:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0effd700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3cfc0a1480 0x7f3cfc0a3940 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800b2e0 tx=0x7f3cf8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e27850 0x559da5e27c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e28ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e290a0 0x559da5e29520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5d9cc10 con 0x559da5e27850 2023-10-14T09:02:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5d81c00 con 0x559da5e290a0 2023-10-14T09:02:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5d7f520 con 0x559da5e281b0 2023-10-14T09:02:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e28ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e27850 0x559da5e27c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e28ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32798/0 (socket says 172.21.15.6:32798) 2023-10-14T09:02:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e290a0 0x559da5e29520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.932+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/855509094 learned_addr learned my addr 172.21.15.6:0/855509094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/855509094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e290a0 msgr2=0x559da5e29520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e290a0 0x559da5e29520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/855509094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e27850 msgr2=0x559da5e27c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e27850 0x559da5e27c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/855509094 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da5d38390 con 0x559da5e281b0 2023-10-14T09:02:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e28ac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d00099be0 tx=0x7f3d00000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406e78d627c5b88c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d05ffb700 1 -- 172.21.15.6:0/855509094 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0009dda0 con 0x559da5e281b0 2023-10-14T09:02:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d05ffb700 1 -- 172.21.15.6:0/855509094 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d000a1fe0 con 0x559da5e281b0 2023-10-14T09:02:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.933+0000 7f3d05ffb700 1 -- 172.21.15.6:0/855509094 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00099380 con 0x559da5e281b0 2023-10-14T09:02:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 -- 172.21.15.6:0/855509094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 msgr2=0x559da5e28ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e28ac0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d00099be0 tx=0x7f3d00000bc0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 -- 172.21.15.6:0/855509094 shutdown_connections 2023-10-14T09:02:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e290a0 0x559da5e29520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e27850 0x559da5e27c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/855509094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e28ac0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 -- 172.21.15.6:0/855509094 >> 172.21.15.6:0/855509094 conn(0x559da5d55d70 msgr2=0x559da5e22c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 -- 172.21.15.6:0/855509094 shutdown_connections 2023-10-14T09:02:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 -- 172.21.15.6:0/855509094 wait complete. 2023-10-14T09:02:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.934+0000 7f3d21b91b80 1 -- start start 2023-10-14T09:02:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 Processor -- start 2023-10-14T09:02:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e27850 0x559da5e42700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 0x559da5e42c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e49c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5d7ae10 con 0x559da5e290a0 2023-10-14T09:02:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5d176b0 con 0x559da5e281b0 2023-10-14T09:02:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5d17350 con 0x559da5e27850 2023-10-14T09:02:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d21b91b80 10 client.0 _ll_register_callbacks cb 0x559da5b747a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 0x559da5e42c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 0x559da5e42c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34158/0 (socket says 172.21.15.6:34158) 2023-10-14T09:02:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.935+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/73393391 learned_addr learned my addr 172.21.15.6:0/73393391 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.936+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e27850 msgr2=0x559da5e42700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:02:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.936+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e27850 0x559da5e42700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.936+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/73393391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 msgr2=0x559da5e49c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.936+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e49c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.936+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/73393391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d101a13d0 con 0x559da5e281b0 2023-10-14T09:02:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.936+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 0x559da5e42c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3d00012040 tx=0x7f3d00099dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b6fd03325f608c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.937+0000 7f3ceeffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:02:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.937+0000 7f3ceeffd700 1 -- 172.21.15.6:0/73393391 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00099140 con 0x559da5e281b0 2023-10-14T09:02:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.937+0000 7f3ceeffd700 1 -- 172.21.15.6:0/73393391 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3d000992a0 con 0x559da5e281b0 2023-10-14T09:02:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.937+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559da5d7fe90 con 0x559da5e281b0 2023-10-14T09:02:44.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3ceeffd700 1 -- 172.21.15.6:0/73393391 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d000b2280 con 0x559da5e281b0 2023-10-14T09:02:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 10 client.25952 fetch_fsmap learned FSMap version 49 2023-10-14T09:02:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x559da5ba5d80 con 0x559da5e281b0 2023-10-14T09:02:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3ceeffd700 1 -- 172.21.15.6:0/73393391 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d0007c030 con 0x559da5e281b0 2023-10-14T09:02:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3ceeffd700 1 -- 172.21.15.6:0/73393391 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 49) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f3d00065260 con 0x559da5e281b0 2023-10-14T09:02:44.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 10 client.25952 fetch_fsmap finished waiting for FSMap version 49 2023-10-14T09:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 20 client.25952 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5e56ab0 0x559da5e58ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 4 client.25952 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:02:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.940+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559da5df7bb0 con 0x559da5e56ab0 2023-10-14T09:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.941+0000 7f3d0effd700 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5e56ab0 0x559da5e58ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.941+0000 7f3ceeffd700 10 client.25952 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.941+0000 7f3d0effd700 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5e56ab0 0x559da5e58ed0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cac4c28b4c70bda8 server_cookie=1c17d574d11ef14a in_seq=0 out_seq=0 2023-10-14T09:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3ceeffd700 1 -- 172.21.15.6:0/73393391 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559da5df7bb0 con 0x559da5e56ab0 2023-10-14T09:02:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3ceeffd700 10 client.25952 handle_command_reply: tid=0 2023-10-14T09:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 client.25952 shutdown 2023-10-14T09:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 msgr2=0x559da5e42c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 0x559da5e42c40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3d00012040 tx=0x7f3d00099dc0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 shutdown_connections 2023-10-14T09:02:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5e56ab0 0x559da5e58ed0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e49c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3ceeffd700 0 client.25952 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e27850 0x559da5e42700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/73393391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e281b0 0x559da5e42c40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 >> 172.21.15.6:0/73393391 conn(0x559da5d55d70 msgr2=0x559da5e227d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 shutdown_connections 2023-10-14T09:02:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 1 -- 172.21.15.6:0/73393391 wait complete. 2023-10-14T09:02:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.942+0000 7f3d21b91b80 20 client.25952 trim_cache size 0 max 16384 2023-10-14T09:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 Processor -- start 2023-10-14T09:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 -- start start 2023-10-14T09:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e2bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e49c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e2c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5bfb8c0 con 0x559da5e290a0 2023-10-14T09:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5e56610 con 0x559da5e27850 2023-10-14T09:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.963+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5e41bb0 con 0x559da5e281b0 2023-10-14T09:02:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e2c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e49c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e2c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35408/0 (socket says 172.21.15.6:35408) 2023-10-14T09:02:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e49c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32808/0 (socket says 172.21.15.6:32808) 2023-10-14T09:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0f7fe700 1 -- 172.21.15.6:0/114016690 learned_addr learned my addr 172.21.15.6:0/114016690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0effd700 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e2bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/114016690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 msgr2=0x559da5e2bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e2bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/114016690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 msgr2=0x559da5e2c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e2c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/114016690 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da5b8ec00 con 0x559da5e281b0 2023-10-14T09:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0f7fe700 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e2c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e49c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d00099be0 tx=0x7f3d000108c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b30be56cda39a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d067fc700 1 -- 172.21.15.6:0/114016690 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00098bb0 con 0x559da5e281b0 2023-10-14T09:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d067fc700 1 -- 172.21.15.6:0/114016690 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d0007c070 con 0x559da5e281b0 2023-10-14T09:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.964+0000 7f3d067fc700 1 -- 172.21.15.6:0/114016690 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00098da0 con 0x559da5e281b0 2023-10-14T09:02:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 -- 172.21.15.6:0/114016690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 msgr2=0x559da5e49c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e49c40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d00099be0 tx=0x7f3d000108c0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 -- 172.21.15.6:0/114016690 shutdown_connections 2023-10-14T09:02:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e290a0 0x559da5e2c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e2bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/114016690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e281b0 0x559da5e49c40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 -- 172.21.15.6:0/114016690 >> 172.21.15.6:0/114016690 conn(0x559da5d55d70 msgr2=0x559da5e226e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 -- 172.21.15.6:0/114016690 shutdown_connections 2023-10-14T09:02:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.965+0000 7f3d21b91b80 1 -- 172.21.15.6:0/114016690 wait complete. 2023-10-14T09:02:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 -- start start 2023-10-14T09:02:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 Processor -- start 2023-10-14T09:02:44.977 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e45c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 0x559da5e46160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e290a0 0x559da5e49180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5e496c0 con 0x559da5e281b0 2023-10-14T09:02:44.978 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5e49830 con 0x559da5e27850 2023-10-14T09:02:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da5e499f0 con 0x559da5e290a0 2023-10-14T09:02:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d21b91b80 10 client.0 _ll_register_callbacks cb 0x7f3cf800bbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 0x559da5e46160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d0effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e45c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.979 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d0f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e290a0 0x559da5e49180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 0x559da5e46160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35412/0 (socket says 172.21.15.6:35412) 2023-10-14T09:02:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.966+0000 7f3d0e7fc700 1 -- 172.21.15.6:0/2586830276 learned_addr learned my addr 172.21.15.6:0/2586830276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0effd700 1 -- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e290a0 msgr2=0x559da5e49180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0effd700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e290a0 0x559da5e49180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0effd700 1 -- 172.21.15.6:0/2586830276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 msgr2=0x559da5e46160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0effd700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 0x559da5e46160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0effd700 1 -- 172.21.15.6:0/2586830276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d08003b40 con 0x559da5e27850 2023-10-14T09:02:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 0x559da5e46160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0f7fe700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e290a0 0x559da5e49180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d0effd700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e45c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559da5e597b0 tx=0x7f3cf8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e7c23833610aa90 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3ceeffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:02:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3ceeffd700 1 -- 172.21.15.6:0/2586830276 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80352d0 con 0x559da5e27850 2023-10-14T09:02:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d000a1fe0 con 0x559da5e27850 2023-10-14T09:02:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3ceeffd700 1 -- 172.21.15.6:0/2586830276 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3cf8035430 con 0x559da5e27850 2023-10-14T09:02:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3ceeffd700 1 -- 172.21.15.6:0/2586830276 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cf8004500 con 0x559da5e27850 2023-10-14T09:02:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d21b91b80 10 client.25958 fetch_fsmap learned FSMap version 49 2023-10-14T09:02:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.967+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x559da5ba5d80 con 0x559da5e27850 2023-10-14T09:02:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3ceeffd700 1 -- 172.21.15.6:0/2586830276 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d000a1fe0 con 0x559da5e27850 2023-10-14T09:02:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3ceeffd700 1 -- 172.21.15.6:0/2586830276 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 49) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f3cf800f580 con 0x559da5e27850 2023-10-14T09:02:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d21b91b80 10 client.25958 fetch_fsmap finished waiting for FSMap version 49 2023-10-14T09:02:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d21b91b80 10 client.25958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d21b91b80 20 client.25958 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5eabba0 0x559da5eadfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d21b91b80 4 client.25958 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559da5d73df0 con 0x559da5eabba0 2023-10-14T09:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5eabba0 0x559da5eadfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3d0e7fc700 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5eabba0 0x559da5eadfc0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada2425eb8e04a1c server_cookie=8fd792afe462d5f7 in_seq=0 out_seq=0 2023-10-14T09:02:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.968+0000 7f3ceeffd700 10 client.25958 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3ceeffd700 1 -- 172.21.15.6:0/2586830276 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559da5d73df0 con 0x559da5eabba0 2023-10-14T09:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3ceeffd700 10 client.25958 handle_command_reply: tid=0 2023-10-14T09:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 client.25958 shutdown 2023-10-14T09:02:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 msgr2=0x559da5e45c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e45c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559da5e597b0 tx=0x7f3cf8009ca0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 shutdown_connections 2023-10-14T09:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x559da5eabba0 0x559da5eadfc0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559da5e290a0 0x559da5e49180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x559da5e27850 0x559da5e45c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3ceeffd700 0 client.25958 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 --2- 172.21.15.6:0/2586830276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559da5e281b0 0x559da5e46160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 >> 172.21.15.6:0/2586830276 conn(0x559da5d55d70 msgr2=0x559da5e2f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 shutdown_connections 2023-10-14T09:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 1 -- 172.21.15.6:0/2586830276 wait complete. 2023-10-14T09:02:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.981+0000 7f3d21b91b80 20 client.25958 trim_cache size 0 max 16384 2023-10-14T09:02:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:02:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:02:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:02:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:02:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3cfc0a1480 msgr2=0x7f3cfc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3cfc0a1480 0x7f3cfc0a3940 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800b2e0 tx=0x7f3cf8005fb0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d101009e0 msgr2=0x7f3d10199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d101009e0 0x7f3d10199360 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000d720 tx=0x7f3d0000da30 comp rx=0 tx=0).stop 2023-10-14T09:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 shutdown_connections 2023-10-14T09:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3cfc0a1480 0x7f3cfc0a3940 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d101013d0 0x7f3d101a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d10100020 0x7f3d10198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 --2- 172.21.15.6:0/1782382417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d101009e0 0x7f3d10199360 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 >> 172.21.15.6:0/1782382417 conn(0x7f3d100faaf0 msgr2=0x7f3d100fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 shutdown_connections 2023-10-14T09:02:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:44.982+0000 7f3d159a7700 1 -- 172.21.15.6:0/1782382417 wait complete. 2023-10-14T09:02:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:45 smithi006 ceph-mon[99452]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 702 op/s 2023-10-14T09:02:45.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:45 smithi178 ceph-mon[103612]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 702 op/s 2023-10-14T09:02:45.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:45 smithi057 ceph-mon[103313]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 702 op/s 2023-10-14T09:02:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 585.0 s, 1642.9 tps, lat 61.293 ms stddev 70.506 2023-10-14T09:02:47.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:47 smithi006 ceph-mon[99452]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 638 op/s 2023-10-14T09:02:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:47 smithi178 ceph-mon[103612]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 638 op/s 2023-10-14T09:02:47.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:47 smithi057 ceph-mon[103313]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 638 op/s 2023-10-14T09:02:49.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:49 smithi006 ceph-mon[99452]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 685 op/s 2023-10-14T09:02:49.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:49 smithi178 ceph-mon[103612]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 685 op/s 2023-10-14T09:02:49.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:49 smithi057 ceph-mon[103313]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 685 op/s 2023-10-14T09:02:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 590.0 s, 1696.8 tps, lat 58.411 ms stddev 72.448 2023-10-14T09:02:51.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:51 smithi178 ceph-mon[103612]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-10-14T09:02:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:51 smithi057 ceph-mon[103313]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-10-14T09:02:51.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:51 smithi006 ceph-mon[99452]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 771 op/s 2023-10-14T09:02:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:53 smithi178 ceph-mon[103612]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-10-14T09:02:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:53 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:53 smithi057 ceph-mon[103313]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-10-14T09:02:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:53 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:53.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:53 smithi006 ceph-mon[99452]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 752 op/s 2023-10-14T09:02:53.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:53 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:02:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:55 smithi178 ceph-mon[103612]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 765 op/s 2023-10-14T09:02:55.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:55 smithi057 ceph-mon[103313]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 765 op/s 2023-10-14T09:02:55.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 595.0 s, 1848.6 tps, lat 54.027 ms stddev 63.428 2023-10-14T09:02:55.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:55 smithi006 ceph-mon[99452]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 765 op/s 2023-10-14T09:02:57.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:57 smithi178 ceph-mon[103612]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.3 MiB/s wr, 664 op/s 2023-10-14T09:02:57.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:57 smithi057 ceph-mon[103313]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.3 MiB/s wr, 664 op/s 2023-10-14T09:02:57.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:57 smithi006 ceph-mon[99452]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.3 MiB/s wr, 664 op/s 2023-10-14T09:02:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 -- 172.21.15.6:0/3247801259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4100ff0 msgr2=0x7fe1f4101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/3247801259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4100ff0 0x7fe1f4101450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009990 tx=0x7fe1f0009ca0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 -- 172.21.15.6:0/3247801259 shutdown_connections 2023-10-14T09:02:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/3247801259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f4101990 0x7fe1f4108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/3247801259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f40ffe00 0x7fe1f4100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/3247801259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4100ff0 0x7fe1f4101450 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.134+0000 7fe1fb55f700 1 -- 172.21.15.6:0/3247801259 >> 172.21.15.6:0/3247801259 conn(0x7fe1f40fb390 msgr2=0x7fe1f40fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.136+0000 7fe1fb55f700 1 -- 172.21.15.6:0/3247801259 shutdown_connections 2023-10-14T09:02:58.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.136+0000 7fe1fb55f700 1 -- 172.21.15.6:0/3247801259 wait complete. 2023-10-14T09:02:58.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 Processor -- start 2023-10-14T09:02:58.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 -- start start 2023-10-14T09:02:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f4100ff0 0x7fe1f419d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f4101990 0x7fe1f419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f41a29a0 0x7fe1f41a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41a5360 con 0x7fe1f41a29a0 2023-10-14T09:02:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f410f270 con 0x7fe1f4101990 2023-10-14T09:02:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.137+0000 7fe1fb55f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f410f400 con 0x7fe1f4100ff0 2023-10-14T09:02:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f92fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f4100ff0 0x7fe1f419d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f8afa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f4101990 0x7fe1f419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f92fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f4100ff0 0x7fe1f419d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32826/0 (socket says 172.21.15.6:32826) 2023-10-14T09:02:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f92fb700 1 -- 172.21.15.6:0/2573754064 learned_addr learned my addr 172.21.15.6:0/2573754064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f41a29a0 0x7fe1f41a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2573754064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f4100ff0 msgr2=0x7fe1f419d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f4100ff0 0x7fe1f419d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2573754064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f4101990 msgr2=0x7fe1f419d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f4101990 0x7fe1f419d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.138+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2573754064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00095f0 con 0x7fe1f41a29a0 2023-10-14T09:02:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.139+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f41a29a0 0x7fe1f41a4d90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00efc0 tx=0x7fe1ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.139+0000 7fe1ea7fc700 1 -- 172.21.15.6:0/2573754064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec018070 con 0x7fe1f41a29a0 2023-10-14T09:02:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.139+0000 7fe1ea7fc700 1 -- 172.21.15.6:0/2573754064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ec00f040 con 0x7fe1f41a29a0 2023-10-14T09:02:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.139+0000 7fe1ea7fc700 1 -- 172.21.15.6:0/2573754064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00ce10 con 0x7fe1f41a29a0 2023-10-14T09:02:58.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.141+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f410f680 con 0x7fe1f41a29a0 2023-10-14T09:02:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.141+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f410fb90 con 0x7fe1f41a29a0 2023-10-14T09:02:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.143+0000 7fe1ea7fc700 1 -- 172.21.15.6:0/2573754064 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe1ec003a00 con 0x7fe1f41a29a0 2023-10-14T09:02:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.144+0000 7fe1ea7fc700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1e00a1600 0x7fe1e00a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.144+0000 7fe1ea7fc700 1 -- 172.21.15.6:0/2573754064 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1ec0cbfd0 con 0x7fe1f41a29a0 2023-10-14T09:02:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.145+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1e00a1600 0x7fe1e00a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.145+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1e00a1600 0x7fe1e00a3ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40099a0 tx=0x7fe1e4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 Processor -- start 2023-10-14T09:02:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 -- start start 2023-10-14T09:02:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee54195850 0x55ee54195c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee54196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee54197520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee5410ac10 con 0x55ee541961b0 2023-10-14T09:02:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee540efc00 con 0x55ee541970a0 2023-10-14T09:02:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.150+0000 7fe207749b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee540ed520 con 0x55ee54195850 2023-10-14T09:02:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f92fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee54195850 0x55ee54195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee54197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee54197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34192/0 (socket says 172.21.15.6:34192) 2023-10-14T09:02:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 -- 172.21.15.6:0/719872225 learned_addr learned my addr 172.21.15.6:0/719872225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f8afa700 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee54196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 -- 172.21.15.6:0/719872225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee54195850 msgr2=0x55ee54195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee54195850 0x55ee54195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 -- 172.21.15.6:0/719872225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 msgr2=0x55ee54196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee54196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 -- 172.21.15.6:0/719872225 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee540a6390 con 0x55ee541970a0 2023-10-14T09:02:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee54195850 0x55ee54195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:02:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.151+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee54197520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec095890 tx=0x7fe1ec0991e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc153137765312c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.152+0000 7fe1df7fe700 1 -- 172.21.15.6:0/719872225 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec01a2d0 con 0x55ee541970a0 2023-10-14T09:02:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.152+0000 7fe1df7fe700 1 -- 172.21.15.6:0/719872225 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ec099a90 con 0x55ee541970a0 2023-10-14T09:02:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.152+0000 7fe1df7fe700 1 -- 172.21.15.6:0/719872225 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec097730 con 0x55ee541970a0 2023-10-14T09:02:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 -- 172.21.15.6:0/719872225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 msgr2=0x55ee54197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee54197520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec095890 tx=0x7fe1ec0991e0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 -- 172.21.15.6:0/719872225 shutdown_connections 2023-10-14T09:02:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee54197520 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee54195850 0x55ee54195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 --2- 172.21.15.6:0/719872225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee54196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.153+0000 7fe207749b80 1 -- 172.21.15.6:0/719872225 >> 172.21.15.6:0/719872225 conn(0x55ee540c3d70 msgr2=0x55ee54190c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.155+0000 7fe207749b80 1 -- 172.21.15.6:0/719872225 shutdown_connections 2023-10-14T09:02:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.159+0000 7fe207749b80 1 -- 172.21.15.6:0/719872225 wait complete. 2023-10-14T09:02:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.159+0000 7fe207749b80 1 -- start start 2023-10-14T09:02:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 Processor -- start 2023-10-14T09:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 0x55ee5419f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee5419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541970a0 0x55ee541a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee540e8e10 con 0x55ee541961b0 2023-10-14T09:02:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee540856b0 con 0x55ee54195850 2023-10-14T09:02:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee54085350 con 0x55ee541970a0 2023-10-14T09:02:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe207749b80 10 client.0 _ll_register_callbacks cb 0x55ee53ee27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe1f92fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 0x55ee5419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe1f92fb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 0x55ee5419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34196/0 (socket says 172.21.15.6:34196) 2023-10-14T09:02:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.160+0000 7fe1f92fb700 1 -- 172.21.15.6:0/4245035125 learned_addr learned my addr 172.21.15.6:0/4245035125 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.161+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541970a0 0x55ee541a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.161+0000 7fe1f92fb700 1 -- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541970a0 msgr2=0x55ee541a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.161+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541970a0 0x55ee541a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.161+0000 7fe1f92fb700 1 -- 172.21.15.6:0/4245035125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 msgr2=0x55ee5419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.161+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee5419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.161+0000 7fe1f92fb700 1 -- 172.21.15.6:0/4245035125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e400e040 con 0x55ee54195850 2023-10-14T09:02:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.162+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 0x55ee5419f810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400de80 tx=0x7fe1e4004800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42bc3fd81f17477d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.162+0000 7fe1dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:02:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.163+0000 7fe1dcff9700 1 -- 172.21.15.6:0/4245035125 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400deb0 con 0x55ee54195850 2023-10-14T09:02:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.163+0000 7fe1dcff9700 1 -- 172.21.15.6:0/4245035125 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1e4014de0 con 0x55ee54195850 2023-10-14T09:02:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.163+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee540ede90 con 0x55ee54195850 2023-10-14T09:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.168+0000 7fe1dcff9700 1 -- 172.21.15.6:0/4245035125 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e40293f0 con 0x55ee54195850 2023-10-14T09:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.168+0000 7fe207749b80 10 client.25970 fetch_fsmap learned FSMap version 50 2023-10-14T09:02:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.168+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7fe1f410fb90 con 0x55ee54195850 2023-10-14T09:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.168+0000 7fe1dcff9700 1 -- 172.21.15.6:0/4245035125 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee540ede90 con 0x55ee54195850 2023-10-14T09:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe1dcff9700 1 -- 172.21.15.6:0/4245035125 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 50) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe1e401f070 con 0x55ee54195850 2023-10-14T09:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe207749b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 50 2023-10-14T09:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe207749b80 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe207749b80 20 client.25970 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe207749b80 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee541ab7c0 0x55ee541adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe207749b80 4 client.25970 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:02:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee54165bb0 con 0x55ee541ab7c0 2023-10-14T09:02:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe1f8afa700 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee541ab7c0 0x55ee541adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe1dcff9700 10 client.25970 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.169+0000 7fe1f8afa700 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee541ab7c0 0x55ee541adbe0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b245df51c97c47c2 server_cookie=df4c8a9937101269 in_seq=0 out_seq=0 2023-10-14T09:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe1dcff9700 1 -- 172.21.15.6:0/4245035125 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee54165bb0 con 0x55ee541ab7c0 2023-10-14T09:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe1dcff9700 10 client.25970 handle_command_reply: tid=0 2023-10-14T09:02:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 client.25970 shutdown 2023-10-14T09:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 msgr2=0x55ee5419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 0x55ee5419f810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400de80 tx=0x7fe1e4004800 comp rx=0 tx=0).stop 2023-10-14T09:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 shutdown_connections 2023-10-14T09:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee541ab7c0 0x55ee541adbe0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541970a0 0x55ee541a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee54195850 0x55ee5419f810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe1dcff9700 0 client.25970 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 --2- 172.21.15.6:0/4245035125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee541961b0 0x55ee5419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.170+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 >> 172.21.15.6:0/4245035125 conn(0x55ee540c3d70 msgr2=0x55ee541907d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.171+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 shutdown_connections 2023-10-14T09:02:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.171+0000 7fe207749b80 1 -- 172.21.15.6:0/4245035125 wait complete. 2023-10-14T09:02:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.171+0000 7fe207749b80 20 client.25970 trim_cache size 0 max 16384 2023-10-14T09:02:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.194+0000 7fe207749b80 1 Processor -- start 2023-10-14T09:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.194+0000 7fe207749b80 1 -- start start 2023-10-14T09:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe207749b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee5418f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe207749b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe207749b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee5419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe207749b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee53f698c0 con 0x55ee54195850 2023-10-14T09:02:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe207749b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee5418cea0 con 0x55ee541970a0 2023-10-14T09:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe207749b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee5418d400 con 0x55ee541961b0 2023-10-14T09:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe1f9afc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee5419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe1f9afc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee5419e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34206/0 (socket says 172.21.15.6:34206) 2023-10-14T09:02:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.195+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2861386380 learned_addr learned my addr 172.21.15.6:0/2861386380 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:58.201 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2861386380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 msgr2=0x55ee541a6d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:02:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a6d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2861386380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 msgr2=0x55ee5418f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee5418f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1f9afc700 1 -- 172.21.15.6:0/2861386380 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee53f13d80 con 0x55ee541970a0 2023-10-14T09:02:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee5419e3d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0090a0 tx=0x7fe1ec004e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6283dce6f4297b6c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1dffff700 1 -- 172.21.15.6:0/2861386380 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec01a2d0 con 0x55ee541970a0 2023-10-14T09:02:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1dffff700 1 -- 172.21.15.6:0/2861386380 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ec0a1720 con 0x55ee541970a0 2023-10-14T09:02:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.196+0000 7fe1dffff700 1 -- 172.21.15.6:0/2861386380 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec09d170 con 0x55ee541970a0 2023-10-14T09:02:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 -- 172.21.15.6:0/2861386380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 msgr2=0x55ee5419e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee5419e3d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0090a0 tx=0x7fe1ec004e60 comp rx=0 tx=0).stop 2023-10-14T09:02:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 -- 172.21.15.6:0/2861386380 shutdown_connections 2023-10-14T09:02:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee5419e3d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee5418f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 --2- 172.21.15.6:0/2861386380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 -- 172.21.15.6:0/2861386380 >> 172.21.15.6:0/2861386380 conn(0x55ee540c3d70 msgr2=0x55ee5418fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 -- 172.21.15.6:0/2861386380 shutdown_connections 2023-10-14T09:02:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.197+0000 7fe207749b80 1 -- 172.21.15.6:0/2861386380 wait complete. 2023-10-14T09:02:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 -- start start 2023-10-14T09:02:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 Processor -- start 2023-10-14T09:02:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee541a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee541a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee541a6050 con 0x55ee54195850 2023-10-14T09:02:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee541a61c0 con 0x55ee541970a0 2023-10-14T09:02:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee541a6380 con 0x55ee541961b0 2023-10-14T09:02:58.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.198+0000 7fe207749b80 10 client.0 _ll_register_callbacks cb 0x7fe1e400d820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:02:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee541a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee541a5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34212/0 (socket says 172.21.15.6:34212) 2023-10-14T09:02:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 -- 172.21.15.6:0/1103237685 learned_addr learned my addr 172.21.15.6:0/1103237685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:02:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f8afa700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee541a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 -- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 msgr2=0x55ee541a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 -- 172.21.15.6:0/1103237685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 msgr2=0x55ee541a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:02:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee541a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 -- 172.21.15.6:0/1103237685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee540a6390 con 0x55ee541970a0 2023-10-14T09:02:58.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1f9afc700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee541a5b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec095890 tx=0x7fe1ec009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c02b1ee59d49b472 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:02:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:02:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1dcff9700 1 -- 172.21.15.6:0/1103237685 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec09d4e0 con 0x55ee541970a0 2023-10-14T09:02:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe1dcff9700 1 -- 172.21.15.6:0/1103237685 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1ec099390 con 0x55ee541970a0 2023-10-14T09:02:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.199+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1ec099a90 con 0x55ee541970a0 2023-10-14T09:02:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe1dcff9700 1 -- 172.21.15.6:0/1103237685 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ec0995f0 con 0x55ee541970a0 2023-10-14T09:02:58.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 10 client.25976 fetch_fsmap learned FSMap version 50 2023-10-14T09:02:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55ee53efcc00 con 0x55ee541970a0 2023-10-14T09:02:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe1dcff9700 1 -- 172.21.15.6:0/1103237685 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ec099a90 con 0x55ee541970a0 2023-10-14T09:02:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe1dcff9700 1 -- 172.21.15.6:0/1103237685 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 50) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe1ec0982f0 con 0x55ee541970a0 2023-10-14T09:02:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 10 client.25976 fetch_fsmap finished waiting for FSMap version 50 2023-10-14T09:02:58.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 10 client.25976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:02:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 20 client.25976 populate_metadata read hostname 'smithi006' 2023-10-14T09:02:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee54210c80 0x55ee542130a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:02:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 4 client.25976 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:02:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee540e1df0 con 0x55ee54210c80 2023-10-14T09:02:58.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.200+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee54210c80 0x55ee542130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:02:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.201+0000 7fe1dcff9700 10 client.25976 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:58.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.201+0000 7fe1f92fb700 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee54210c80 0x55ee542130a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c55e92fa72a5d30 server_cookie=3543970ffbd7948f in_seq=0 out_seq=0 2023-10-14T09:02:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe1dcff9700 1 -- 172.21.15.6:0/1103237685 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee540e1df0 con 0x55ee54210c80 2023-10-14T09:02:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe1dcff9700 10 client.25976 handle_command_reply: tid=0 2023-10-14T09:02:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 client.25976 shutdown 2023-10-14T09:02:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 msgr2=0x55ee541a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee541a5b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec095890 tx=0x7fe1ec009ef0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 shutdown_connections 2023-10-14T09:02:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55ee54210c80 0x55ee542130a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55ee541970a0 0x55ee541a5b10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee54195850 0x55ee541a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 --2- 172.21.15.6:0/1103237685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee541961b0 0x55ee541a2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 >> 172.21.15.6:0/1103237685 conn(0x55ee540c3d70 msgr2=0x55ee5418f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe1dcff9700 0 client.25976 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:02:58.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 shutdown_connections 2023-10-14T09:02:58.219 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.213+0000 7fe207749b80 1 -- 172.21.15.6:0/1103237685 wait complete. 2023-10-14T09:02:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe207749b80 20 client.25976 trim_cache size 0 max 16384 2023-10-14T09:02:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:02:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:02:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:02:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:02:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1e00a1600 msgr2=0x7fe1e00a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1e00a1600 0x7fe1e00a3ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40099a0 tx=0x7fe1e4008040 comp rx=0 tx=0).stop 2023-10-14T09:02:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f41a29a0 msgr2=0x7fe1f41a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:02:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f41a29a0 0x7fe1f41a4d90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00efc0 tx=0x7fe1ec00c3a0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 shutdown_connections 2023-10-14T09:02:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f41a29a0 0x7fe1f41a4d90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f4100ff0 0x7fe1f419d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1e00a1600 0x7fe1e00a3ac0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 --2- 172.21.15.6:0/2573754064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f4101990 0x7fe1f419d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:02:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 >> 172.21.15.6:0/2573754064 conn(0x7fe1f40fb390 msgr2=0x7fe1f410d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:02:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.219+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 shutdown_connections 2023-10-14T09:02:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:02:58.220+0000 7fe1fb55f700 1 -- 172.21.15.6:0/2573754064 wait complete. 2023-10-14T09:02:59.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:02:59 smithi178 ceph-mon[103612]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 MiB/s wr, 771 op/s 2023-10-14T09:02:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:02:59 smithi057 ceph-mon[103313]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 MiB/s wr, 771 op/s 2023-10-14T09:02:59.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:02:59 smithi006 ceph-mon[99452]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 MiB/s wr, 771 op/s 2023-10-14T09:03:00.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:00 smithi178 ceph-mon[103612]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 768 op/s 2023-10-14T09:03:00.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:00 smithi057 ceph-mon[103313]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 768 op/s 2023-10-14T09:03:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 600.0 s, 1070.8 tps, lat 93.763 ms stddev 116.688 2023-10-14T09:03:00.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:00 smithi006 ceph-mon[99452]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 768 op/s 2023-10-14T09:03:03.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:03 smithi178 ceph-mon[103612]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 748 op/s 2023-10-14T09:03:03.697 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:03 smithi057 ceph-mon[103313]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 748 op/s 2023-10-14T09:03:03.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:03 smithi006 ceph-mon[99452]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 748 op/s 2023-10-14T09:03:05.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:05 smithi057 ceph-mon[103313]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 737 op/s 2023-10-14T09:03:05.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:05 smithi006 ceph-mon[99452]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 737 op/s 2023-10-14T09:03:05.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:05 smithi178 ceph-mon[103612]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 737 op/s 2023-10-14T09:03:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 605.0 s, 1487.0 tps, lat 66.952 ms stddev 75.799 2023-10-14T09:03:07.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:07 smithi057 ceph-mon[103313]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 758 op/s 2023-10-14T09:03:07.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:07 smithi006 ceph-mon[99452]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 758 op/s 2023-10-14T09:03:07.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:07 smithi178 ceph-mon[103612]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 758 op/s 2023-10-14T09:03:08.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:08 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:03:08.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:08 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:03:08.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:08 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:03:09.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:09 smithi006 ceph-mon[99452]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 796 op/s 2023-10-14T09:03:09.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:09 smithi178 ceph-mon[103612]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 796 op/s 2023-10-14T09:03:09.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:09 smithi057 ceph-mon[103313]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 MiB/s wr, 796 op/s 2023-10-14T09:03:10.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 610.0 s, 1470.0 tps, lat 68.732 ms stddev 71.779 2023-10-14T09:03:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 -- 172.21.15.6:0/4209760542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0ffe20 msgr2=0x7f72dc100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 --2- 172.21.15.6:0/4209760542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0ffe20 0x7f72dc100240 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009990 tx=0x7f72d8009ca0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 -- 172.21.15.6:0/4209760542 shutdown_connections 2023-10-14T09:03:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 --2- 172.21.15.6:0/4209760542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 0x7f72dc108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 --2- 172.21.15.6:0/4209760542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0ffe20 0x7f72dc100240 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 --2- 172.21.15.6:0/4209760542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72dc100f70 0x7f72dc1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.370+0000 7f72e3274700 1 -- 172.21.15.6:0/4209760542 >> 172.21.15.6:0/4209760542 conn(0x7f72dc0fb370 msgr2=0x7f72dc0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 -- 172.21.15.6:0/4209760542 shutdown_connections 2023-10-14T09:03:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 -- 172.21.15.6:0/4209760542 wait complete. 2023-10-14T09:03:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 Processor -- start 2023-10-14T09:03:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 -- start start 2023-10-14T09:03:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72dc0ffe20 0x7f72dc069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 0x7f72dc19dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.371+0000 7f72e3274700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 0x7f72dc1a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e3274700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1a0990 con 0x7f72dc100f70 2023-10-14T09:03:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e3274700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1a0b00 con 0x7f72dc101930 2023-10-14T09:03:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e3274700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1a0cc0 con 0x7f72dc0ffe20 2023-10-14T09:03:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 0x7f72dc19dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 0x7f72dc19dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35468/0 (socket says 172.21.15.6:35468) 2023-10-14T09:03:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 -- 172.21.15.6:0/837924852 learned_addr learned my addr 172.21.15.6:0/837924852 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e1811700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 0x7f72dc1a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e1010700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72dc0ffe20 0x7f72dc069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 -- 172.21.15.6:0/837924852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72dc0ffe20 msgr2=0x7f72dc069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72dc0ffe20 0x7f72dc069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 -- 172.21.15.6:0/837924852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 msgr2=0x7f72dc1a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 0x7f72dc1a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 -- 172.21.15.6:0/837924852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009c40 con 0x7f72dc100f70 2023-10-14T09:03:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e1811700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 0x7f72dc1a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:03:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72e080f700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 0x7f72dc19dd60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00e9a0 tx=0x7f72cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.372+0000 7f72d27fc700 1 -- 172.21.15.6:0/837924852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc009790 con 0x7f72dc100f70 2023-10-14T09:03:11.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.373+0000 7f72d27fc700 1 -- 172.21.15.6:0/837924852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72cc00cbd0 con 0x7f72dc100f70 2023-10-14T09:03:11.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.373+0000 7f72d27fc700 1 -- 172.21.15.6:0/837924852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc018680 con 0x7f72dc100f70 2023-10-14T09:03:11.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.373+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d80095f0 con 0x7f72dc100f70 2023-10-14T09:03:11.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.373+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc1a1240 con 0x7f72dc100f70 2023-10-14T09:03:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.379+0000 7f72ef45eb80 1 Processor -- start 2023-10-14T09:03:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 -- start start 2023-10-14T09:03:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea21890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e998c10 con 0x555b4ea21470 2023-10-14T09:03:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e97dc00 con 0x555b4ea21dd0 2023-10-14T09:03:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.381+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e97b520 con 0x555b4ea22c70 2023-10-14T09:03:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.382+0000 7f72e1811700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea21890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.382+0000 7f72e1811700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea21890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35472/0 (socket says 172.21.15.6:35472) 2023-10-14T09:03:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.382+0000 7f72e1811700 1 -- 172.21.15.6:0/3591369345 learned_addr learned my addr 172.21.15.6:0/3591369345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.383+0000 7f72e1811700 1 -- 172.21.15.6:0/3591369345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 msgr2=0x555b4ea230f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:03:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.383+0000 7f72e1811700 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea230f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.383+0000 7f72e1811700 1 -- 172.21.15.6:0/3591369345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 msgr2=0x555b4ea226e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:03:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.383+0000 7f72e1811700 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea226e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.383+0000 7f72e1811700 1 -- 172.21.15.6:0/3591369345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b4e934390 con 0x555b4ea21470 2023-10-14T09:03:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.384+0000 7f72e1811700 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea21890 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007630 tx=0x7f72d4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac6c1c972a191a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.385+0000 7f72d27fc700 1 -- 172.21.15.6:0/837924852 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f72cc00cd40 con 0x7f72dc100f70 2023-10-14T09:03:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.386+0000 7f72d27fc700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72c80a1580 0x7f72c80a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.387+0000 7f72d27fc700 1 -- 172.21.15.6:0/837924852 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72cc014070 con 0x7f72dc100f70 2023-10-14T09:03:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.387+0000 7f72c77fe700 1 -- 172.21.15.6:0/3591369345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4035560 con 0x555b4ea21470 2023-10-14T09:03:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.388+0000 7f72c77fe700 1 -- 172.21.15.6:0/3591369345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72d4030070 con 0x555b4ea21470 2023-10-14T09:03:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.388+0000 7f72c77fe700 1 -- 172.21.15.6:0/3591369345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4036ad0 con 0x555b4ea21470 2023-10-14T09:03:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.388+0000 7f72e1010700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72c80a1580 0x7f72c80a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3591369345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 msgr2=0x555b4ea21890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72e1010700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72c80a1580 0x7f72c80a3a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f72d800b2e0 tx=0x7f72d8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea21890 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007630 tx=0x7f72d4009920 comp rx=0 tx=0).stop 2023-10-14T09:03:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3591369345 shutdown_connections 2023-10-14T09:03:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea21890 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3591369345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.389+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3591369345 >> 172.21.15.6:0/3591369345 conn(0x555b4e951d70 msgr2=0x555b4ea1eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:11.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.394+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3591369345 shutdown_connections 2023-10-14T09:03:11.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.394+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3591369345 wait complete. 2023-10-14T09:03:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.395+0000 7f72ef45eb80 1 -- start start 2023-10-14T09:03:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.395+0000 7f72ef45eb80 1 Processor -- start 2023-10-14T09:03:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea2d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea2dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea34d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e976e10 con 0x555b4ea21470 2023-10-14T09:03:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e9136b0 con 0x555b4ea21dd0 2023-10-14T09:03:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e913350 con 0x555b4ea22c70 2023-10-14T09:03:11.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72ef45eb80 10 client.0 _ll_register_callbacks cb 0x555b4e7707a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:11.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72e1010700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea2d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72e1010700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea2d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35478/0 (socket says 172.21.15.6:35478) 2023-10-14T09:03:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.396+0000 7f72e1010700 1 -- 172.21.15.6:0/1855640541 learned_addr learned my addr 172.21.15.6:0/1855640541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.397+0000 7f72e1010700 1 -- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 msgr2=0x555b4ea34d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.397+0000 7f72e1010700 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea34d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.397+0000 7f72e1010700 1 -- 172.21.15.6:0/1855640541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 msgr2=0x555b4ea2dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.397+0000 7f72e1010700 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea2dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.397+0000 7f72e1010700 1 -- 172.21.15.6:0/1855640541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d40092e0 con 0x555b4ea21470 2023-10-14T09:03:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.398+0000 7f72e1010700 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea2d7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009990 tx=0x7f72d8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baefe8f04d8f33f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.398+0000 7f72c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:03:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.398+0000 7f72c4ff9700 1 -- 172.21.15.6:0/1855640541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8004e70 con 0x555b4ea21470 2023-10-14T09:03:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.398+0000 7f72c4ff9700 1 -- 172.21.15.6:0/1855640541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72d800f460 con 0x555b4ea21470 2023-10-14T09:03:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.398+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b4e97be90 con 0x555b4ea21470 2023-10-14T09:03:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72c4ff9700 1 -- 172.21.15.6:0/1855640541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72d800f620 con 0x555b4ea21470 2023-10-14T09:03:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72ef45eb80 10 client.16398 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x555b4e7a1d80 con 0x555b4ea21470 2023-10-14T09:03:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72c4ff9700 1 -- 172.21.15.6:0/1855640541 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555b4e97be90 con 0x555b4ea21470 2023-10-14T09:03:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72c4ff9700 1 -- 172.21.15.6:0/1855640541 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f72d8037070 con 0x555b4ea21470 2023-10-14T09:03:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72ef45eb80 10 client.16398 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.399+0000 7f72ef45eb80 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.400+0000 7f72ef45eb80 20 client.16398 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.400+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea4a750 0x555b4ea4cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.400+0000 7f72ef45eb80 4 client.16398 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:03:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.400+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b4e9f3bb0 con 0x555b4ea4a750 2023-10-14T09:03:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.404+0000 7f72e080f700 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea4a750 0x555b4ea4cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.407+0000 7f72c4ff9700 10 client.16398 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.407+0000 7f72e080f700 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea4a750 0x555b4ea4cb70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cd72f71b37cd541 server_cookie=553099427e7ab2b4 in_seq=0 out_seq=0 2023-10-14T09:03:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.409+0000 7f72c4ff9700 1 -- 172.21.15.6:0/1855640541 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555b4e9f3bb0 con 0x555b4ea4a750 2023-10-14T09:03:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.409+0000 7f72c4ff9700 10 client.16398 handle_command_reply: tid=0 2023-10-14T09:03:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.409+0000 7f72ef45eb80 1 client.16398 shutdown 2023-10-14T09:03:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 msgr2=0x555b4ea2d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea2d7b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009990 tx=0x7f72d8009ca0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 shutdown_connections 2023-10-14T09:03:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea4a750 0x555b4ea4cb70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea34d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea21470 0x555b4ea2d7b0 secure :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009990 tx=0x7f72d8009ca0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/1855640541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea2dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72c4ff9700 0 client.16398 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 >> 172.21.15.6:0/1855640541 conn(0x555b4e951d70 msgr2=0x555b4ea1e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.411+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 shutdown_connections 2023-10-14T09:03:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.412+0000 7f72ef45eb80 1 -- 172.21.15.6:0/1855640541 wait complete. 2023-10-14T09:03:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.412+0000 7f72ef45eb80 20 client.16398 trim_cache size 0 max 16384 2023-10-14T09:03:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 Processor -- start 2023-10-14T09:03:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 -- start start 2023-10-14T09:03:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea2dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea22c70 0x555b4ea34cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 0x555b4ea20720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4e7f78c0 con 0x555b4ea22c70 2023-10-14T09:03:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4ea4a2e0 con 0x555b4ea21dd0 2023-10-14T09:03:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.438+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4ea2d320 con 0x555b4ea51490 2023-10-14T09:03:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 0x555b4ea20720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 0x555b4ea20720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32890/0 (socket says 172.21.15.6:32890) 2023-10-14T09:03:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 -- 172.21.15.6:0/3580036857 learned_addr learned my addr 172.21.15.6:0/3580036857 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e080f700 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea22c70 0x555b4ea34cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 -- 172.21.15.6:0/3580036857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 msgr2=0x555b4ea2dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea2dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 -- 172.21.15.6:0/3580036857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea22c70 msgr2=0x555b4ea34cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea22c70 0x555b4ea34cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.439+0000 7f72e1811700 1 -- 172.21.15.6:0/3580036857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b4e78ac00 con 0x555b4ea51490 2023-10-14T09:03:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.440+0000 7f72e080f700 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea22c70 0x555b4ea34cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:03:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.440+0000 7f72e1811700 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 0x555b4ea20720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72d4005aa0 tx=0x7f72d4005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0f73f70ed0f492 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.440+0000 7f72c7fff700 1 -- 172.21.15.6:0/3580036857 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40357e0 con 0x555b4ea51490 2023-10-14T09:03:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.440+0000 7f72c7fff700 1 -- 172.21.15.6:0/3580036857 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72d4035e00 con 0x555b4ea51490 2023-10-14T09:03:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.440+0000 7f72c7fff700 1 -- 172.21.15.6:0/3580036857 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4048e90 con 0x555b4ea51490 2023-10-14T09:03:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3580036857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 msgr2=0x555b4ea20720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 0x555b4ea20720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72d4005aa0 tx=0x7f72d4005ad0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3580036857 shutdown_connections 2023-10-14T09:03:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea51490 0x555b4ea20720 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea2dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/3580036857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea22c70 0x555b4ea34cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3580036857 >> 172.21.15.6:0/3580036857 conn(0x555b4e951d70 msgr2=0x555b4ea2d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.441+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3580036857 shutdown_connections 2023-10-14T09:03:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.442+0000 7f72ef45eb80 1 -- 172.21.15.6:0/3580036857 wait complete. 2023-10-14T09:03:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.442+0000 7f72ef45eb80 1 -- start start 2023-10-14T09:03:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.442+0000 7f72ef45eb80 1 Processor -- start 2023-10-14T09:03:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea34690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea34bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea51490 0x555b4ea31130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4ea31820 con 0x555b4ea51490 2023-10-14T09:03:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4ea31990 con 0x555b4ea21dd0 2023-10-14T09:03:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b4ea31b50 con 0x555b4ea22c70 2023-10-14T09:03:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72ef45eb80 10 client.0 _ll_register_callbacks cb 0x7f72d800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea34690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea34690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34250/0 (socket says 172.21.15.6:34250) 2023-10-14T09:03:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 -- 172.21.15.6:0/2775340123 learned_addr learned my addr 172.21.15.6:0/2775340123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 -- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 msgr2=0x555b4ea34bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:03:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea34bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 -- 172.21.15.6:0/2775340123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea51490 msgr2=0x555b4ea31130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea51490 0x555b4ea31130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.443+0000 7f72e1010700 1 -- 172.21.15.6:0/2775340123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b4e934390 con 0x555b4ea21dd0 2023-10-14T09:03:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72e1010700 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea34690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f72d8027040 tx=0x7f72d80246c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add7eb65bde1bb59 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:03:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72c4ff9700 1 -- 172.21.15.6:0/2775340123 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d800f870 con 0x555b4ea21dd0 2023-10-14T09:03:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72c4ff9700 1 -- 172.21.15.6:0/2775340123 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f72d8024ce0 con 0x555b4ea21dd0 2023-10-14T09:03:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72d4030070 con 0x555b4ea21dd0 2023-10-14T09:03:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72c4ff9700 1 -- 172.21.15.6:0/2775340123 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72d800f9d0 con 0x555b4ea21dd0 2023-10-14T09:03:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72ef45eb80 10 client.25985 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x555b4e7c81f0 con 0x555b4ea21dd0 2023-10-14T09:03:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.444+0000 7f72c4ff9700 1 -- 172.21.15.6:0/2775340123 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72d4030070 con 0x555b4ea21dd0 2023-10-14T09:03:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72c4ff9700 1 -- 172.21.15.6:0/2775340123 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f72d8037070 con 0x555b4ea21dd0 2023-10-14T09:03:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72ef45eb80 10 client.25985 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72ef45eb80 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72ef45eb80 20 client.25985 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea9f7b0 0x555b4eaa1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72ef45eb80 4 client.25985 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:03:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555b4e96fdf0 con 0x555b4ea9f7b0 2023-10-14T09:03:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72e080f700 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea9f7b0 0x555b4eaa1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72e080f700 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea9f7b0 0x555b4eaa1bd0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20e5879276b98b3e server_cookie=dd8222821f4a34ed in_seq=0 out_seq=0 2023-10-14T09:03:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.445+0000 7f72c4ff9700 10 client.25985 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72c4ff9700 1 -- 172.21.15.6:0/2775340123 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555b4e96fdf0 con 0x555b4ea9f7b0 2023-10-14T09:03:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72c4ff9700 10 client.25985 handle_command_reply: tid=0 2023-10-14T09:03:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 client.25985 shutdown 2023-10-14T09:03:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 msgr2=0x555b4ea34690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea34690 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f72d8027040 tx=0x7f72d80246c0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 shutdown_connections 2023-10-14T09:03:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x555b4ea9f7b0 0x555b4eaa1bd0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555b4ea51490 0x555b4ea31130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x555b4ea21dd0 0x555b4ea34690 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 --2- 172.21.15.6:0/2775340123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b4ea22c70 0x555b4ea34bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72c4ff9700 0 client.25985 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 >> 172.21.15.6:0/2775340123 conn(0x555b4e951d70 msgr2=0x555b4ea2bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 shutdown_connections 2023-10-14T09:03:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 1 -- 172.21.15.6:0/2775340123 wait complete. 2023-10-14T09:03:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.457+0000 7f72ef45eb80 20 client.25985 trim_cache size 0 max 16384 2023-10-14T09:03:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:03:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:03:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:03:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:03:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72c80a1580 msgr2=0x7f72c80a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72c80a1580 0x7f72c80a3a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f72d800b2e0 tx=0x7f72d8005960 comp rx=0 tx=0).stop 2023-10-14T09:03:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 msgr2=0x7f72dc19dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 0x7f72dc19dd60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00e9a0 tx=0x7f72cc00ecb0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 shutdown_connections 2023-10-14T09:03:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f72c80a1580 0x7f72c80a3a40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72dc101930 0x7f72dc1a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72dc0ffe20 0x7f72dc069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 --2- 172.21.15.6:0/837924852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc100f70 0x7f72dc19dd60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 >> 172.21.15.6:0/837924852 conn(0x7f72dc0fb370 msgr2=0x7f72dc0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 shutdown_connections 2023-10-14T09:03:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:11.458+0000 7f72e3274700 1 -- 172.21.15.6:0/837924852 wait complete. 2023-10-14T09:03:11.738 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:11 smithi006 ceph-mon[99452]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 770 op/s 2023-10-14T09:03:11.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:11 smithi178 ceph-mon[103612]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 770 op/s 2023-10-14T09:03:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:11 smithi057 ceph-mon[103313]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 770 op/s 2023-10-14T09:03:13.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:13 smithi006 ceph-mon[99452]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 769 op/s 2023-10-14T09:03:13.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:13 smithi178 ceph-mon[103612]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 769 op/s 2023-10-14T09:03:13.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:13 smithi057 ceph-mon[103313]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 769 op/s 2023-10-14T09:03:15.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:15 smithi178 ceph-mon[103612]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 681 op/s 2023-10-14T09:03:15.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:15 smithi057 ceph-mon[103313]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 681 op/s 2023-10-14T09:03:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 615.0 s, 1251.2 tps, lat 78.354 ms stddev 82.374 2023-10-14T09:03:15.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:15 smithi006 ceph-mon[99452]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 681 op/s 2023-10-14T09:03:17.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:17 smithi178 ceph-mon[103612]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 699 op/s 2023-10-14T09:03:17.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:17 smithi057 ceph-mon[103313]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 699 op/s 2023-10-14T09:03:17.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:17 smithi006 ceph-mon[99452]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 699 op/s 2023-10-14T09:03:19.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:19 smithi178 ceph-mon[103612]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 692 op/s 2023-10-14T09:03:19.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:19 smithi057 ceph-mon[103313]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 692 op/s 2023-10-14T09:03:19.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:19 smithi006 ceph-mon[99452]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 692 op/s 2023-10-14T09:03:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 620.0 s, 1109.6 tps, lat 90.512 ms stddev 166.552 2023-10-14T09:03:21.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:21 smithi178 ceph-mon[103612]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-14T09:03:21.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:21 smithi057 ceph-mon[103313]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-14T09:03:21.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:21 smithi006 ceph-mon[99452]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 722 op/s 2023-10-14T09:03:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:23 smithi178 ceph-mon[103612]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 MiB/s wr, 1.33k op/s 2023-10-14T09:03:23.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:23 smithi057 ceph-mon[103313]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 MiB/s wr, 1.33k op/s 2023-10-14T09:03:23.989 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:23 smithi006 ceph-mon[99452]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 MiB/s wr, 1.33k op/s 2023-10-14T09:03:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 -- 172.21.15.6:0/4291435544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10100eb0 msgr2=0x7fca101012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 --2- 172.21.15.6:0/4291435544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10100eb0 0x7fca101012d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009990 tx=0x7fca0c009ca0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 -- 172.21.15.6:0/4291435544 shutdown_connections 2023-10-14T09:03:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 --2- 172.21.15.6:0/4291435544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10102a50 0x7fca10109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 --2- 172.21.15.6:0/4291435544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10100eb0 0x7fca101012d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 --2- 172.21.15.6:0/4291435544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca10102090 0x7fca10102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.615+0000 7fca18463700 1 -- 172.21.15.6:0/4291435544 >> 172.21.15.6:0/4291435544 conn(0x7fca100fc470 msgr2=0x7fca100fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.616+0000 7fca18463700 1 -- 172.21.15.6:0/4291435544 shutdown_connections 2023-10-14T09:03:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.616+0000 7fca18463700 1 -- 172.21.15.6:0/4291435544 wait complete. 2023-10-14T09:03:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.616+0000 7fca18463700 1 Processor -- start 2023-10-14T09:03:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.616+0000 7fca18463700 1 -- start start 2023-10-14T09:03:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca18463700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca10100eb0 0x7fca10196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca18463700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10102090 0x7fca10197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca18463700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 0x7fca1019e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca18463700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1019e940 con 0x7fca10102a50 2023-10-14T09:03:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca18463700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1019ea80 con 0x7fca10102090 2023-10-14T09:03:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca18463700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1019ec10 con 0x7fca10100eb0 2023-10-14T09:03:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 0x7fca1019e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 0x7fca1019e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35510/0 (socket says 172.21.15.6:35510) 2023-10-14T09:03:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 -- 172.21.15.6:0/1318770651 learned_addr learned my addr 172.21.15.6:0/1318770651 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca161ff700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca10100eb0 0x7fca10196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 -- 172.21.15.6:0/1318770651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca10100eb0 msgr2=0x7fca10196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca10100eb0 0x7fca10196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 -- 172.21.15.6:0/1318770651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10102090 msgr2=0x7fca10197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10102090 0x7fca10197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.617+0000 7fca16a00700 1 -- 172.21.15.6:0/1318770651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0095f0 con 0x7fca10102a50 2023-10-14T09:03:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.618+0000 7fca16a00700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 0x7fca1019e370 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fca0800b970 tx=0x7fca0800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.618+0000 7fca077fe700 1 -- 172.21.15.6:0/1318770651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800c9b0 con 0x7fca10102a50 2023-10-14T09:03:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.618+0000 7fca077fe700 1 -- 172.21.15.6:0/1318770651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca08014440 con 0x7fca10102a50 2023-10-14T09:03:24.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.618+0000 7fca077fe700 1 -- 172.21.15.6:0/1318770651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080075d0 con 0x7fca10102a50 2023-10-14T09:03:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.620+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1019eef0 con 0x7fca10102a50 2023-10-14T09:03:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.620+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1019f320 con 0x7fca10102a50 2023-10-14T09:03:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.623+0000 7fca077fe700 1 -- 172.21.15.6:0/1318770651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fca080145b0 con 0x7fca10102a50 2023-10-14T09:03:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.623+0000 7fca077fe700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9fc0a14d0 0x7fc9fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.624+0000 7fca161ff700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9fc0a14d0 0x7fc9fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.624+0000 7fca077fe700 1 -- 172.21.15.6:0/1318770651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fca08006e40 con 0x7fca10102a50 2023-10-14T09:03:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.624+0000 7fca2464db80 1 Processor -- start 2023-10-14T09:03:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.624+0000 7fca2464db80 1 -- start start 2023-10-14T09:03:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca2464db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076269c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca161ff700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9fc0a14d0 0x7fc9fc0a3990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fca0c006010 tx=0x7fca0c00b8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca161ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076269c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca2464db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x56207626aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca2464db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626b0a0 0x56207626b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca161ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076269c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32916/0 (socket says 172.21.15.6:32916) 2023-10-14T09:03:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca161ff700 1 -- 172.21.15.6:0/1891033128 learned_addr learned my addr 172.21.15.6:0/1891033128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620761dec10 con 0x56207626b0a0 2023-10-14T09:03:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620761c3c00 con 0x56207626a1b0 2023-10-14T09:03:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620761c1520 con 0x562076269850 2023-10-14T09:03:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.625+0000 7fca16a00700 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626b0a0 0x56207626b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca159fe700 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x56207626aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca16a00700 1 -- 172.21.15.6:0/1891033128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 msgr2=0x562076269c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca16a00700 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076269c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca16a00700 1 -- 172.21.15.6:0/1891033128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 msgr2=0x56207626aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca16a00700 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x56207626aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca16a00700 1 -- 172.21.15.6:0/1891033128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56207617a390 con 0x56207626b0a0 2023-10-14T09:03:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca16a00700 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626b0a0 0x56207626b520 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fca080c9d00 tx=0x7fca08099400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd171d299c9e0d5b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca04d82700 1 -- 172.21.15.6:0/1891033128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08095040 con 0x56207626b0a0 2023-10-14T09:03:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca04d82700 1 -- 172.21.15.6:0/1891033128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca08099520 con 0x56207626b0a0 2023-10-14T09:03:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.626+0000 7fca04d82700 1 -- 172.21.15.6:0/1891033128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08098a10 con 0x56207626b0a0 2023-10-14T09:03:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626b0a0 msgr2=0x56207626b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626b0a0 0x56207626b520 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fca080c9d00 tx=0x7fca08099400 comp rx=0 tx=0).stop 2023-10-14T09:03:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 shutdown_connections 2023-10-14T09:03:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626b0a0 0x56207626b520 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076269c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 --2- 172.21.15.6:0/1891033128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x56207626aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 >> 172.21.15.6:0/1891033128 conn(0x562076197d70 msgr2=0x562076264c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 shutdown_connections 2023-10-14T09:03:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.627+0000 7fca2464db80 1 -- 172.21.15.6:0/1891033128 wait complete. 2023-10-14T09:03:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 -- start start 2023-10-14T09:03:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 Processor -- start 2023-10-14T09:03:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 0x56207627acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620761bce10 con 0x56207626a1b0 2023-10-14T09:03:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620761596b0 con 0x56207626b0a0 2023-10-14T09:03:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562076159350 con 0x562076269850 2023-10-14T09:03:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.628+0000 7fca2464db80 10 client.0 _ll_register_callbacks cb 0x562075fb67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 0x56207627acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 0x56207627acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34282/0 (socket says 172.21.15.6:34282) 2023-10-14T09:03:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 -- 172.21.15.6:0/3119672841 learned_addr learned my addr 172.21.15.6:0/3119672841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 -- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 msgr2=0x562076273750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 -- 172.21.15.6:0/3119672841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626a1b0 msgr2=0x562076273c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 -- 172.21.15.6:0/3119672841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1019f320 con 0x56207626b0a0 2023-10-14T09:03:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca16a00700 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 0x56207627acd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca08099b80 tx=0x7fca08099d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c899994a974d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fc9f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:03:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3119672841 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080a1420 con 0x56207626b0a0 2023-10-14T09:03:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3119672841 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fca080a1580 con 0x56207626b0a0 2023-10-14T09:03:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.629+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620761c1e90 con 0x56207626b0a0 2023-10-14T09:03:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3119672841 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca08082b50 con 0x56207626b0a0 2023-10-14T09:03:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 10 client.25991 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x562075fe7d80 con 0x56207626b0a0 2023-10-14T09:03:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3119672841 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5620761c1e90 con 0x56207626b0a0 2023-10-14T09:03:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3119672841 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fca08095310 con 0x56207626b0a0 2023-10-14T09:03:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 10 client.25991 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 10 client.25991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 20 client.25991 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56207627f290 0x5620762816b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 4 client.25991 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:03:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.637+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562076239bb0 con 0x56207627f290 2023-10-14T09:03:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.638+0000 7fca161ff700 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56207627f290 0x5620762816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.638+0000 7fc9f9ffb700 10 client.25991 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.638+0000 7fca161ff700 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56207627f290 0x5620762816b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d6a3d72fe67220 server_cookie=f90583324dbe95ab in_seq=0 out_seq=0 2023-10-14T09:03:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3119672841 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562076239bb0 con 0x56207627f290 2023-10-14T09:03:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fc9f9ffb700 10 client.25991 handle_command_reply: tid=0 2023-10-14T09:03:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 client.25991 shutdown 2023-10-14T09:03:24.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 msgr2=0x56207627acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 0x56207627acd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca08099b80 tx=0x7fca08099d90 comp rx=0 tx=0).stop 2023-10-14T09:03:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 shutdown_connections 2023-10-14T09:03:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56207627f290 0x5620762816b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626b0a0 0x56207627acd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 --2- 172.21.15.6:0/3119672841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 >> 172.21.15.6:0/3119672841 conn(0x562076197d70 msgr2=0x562076264830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fc9f9ffb700 0 client.25991 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 shutdown_connections 2023-10-14T09:03:24.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 1 -- 172.21.15.6:0/3119672841 wait complete. 2023-10-14T09:03:24.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.639+0000 7fca2464db80 20 client.25991 trim_cache size 0 max 16384 2023-10-14T09:03:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 Processor -- start 2023-10-14T09:03:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 -- start start 2023-10-14T09:03:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207603d8c0 con 0x562076269850 2023-10-14T09:03:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207626af20 con 0x56207626a1b0 2023-10-14T09:03:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.659+0000 7fca2464db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562076272a50 con 0x56207626b0a0 2023-10-14T09:03:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35530/0 (socket says 172.21.15.6:35530) 2023-10-14T09:03:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 -- 172.21.15.6:0/1263633409 learned_addr learned my addr 172.21.15.6:0/1263633409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca159fe700 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca16a00700 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.664 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 -- 172.21.15.6:0/1263633409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 msgr2=0x56207627ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 -- 172.21.15.6:0/1263633409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 msgr2=0x562076273c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.660+0000 7fca161ff700 1 -- 172.21.15.6:0/1263633409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562075fd0c00 con 0x562076269850 2023-10-14T09:03:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.661+0000 7fca161ff700 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076273750 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fca10101c00 tx=0x7fca0c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98746272a007b62b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.661+0000 7fca05583700 1 -- 172.21.15.6:0/1263633409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c02b030 con 0x562076269850 2023-10-14T09:03:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.661+0000 7fca05583700 1 -- 172.21.15.6:0/1263633409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca0c02c040 con 0x562076269850 2023-10-14T09:03:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.661+0000 7fca05583700 1 -- 172.21.15.6:0/1263633409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c02f730 con 0x562076269850 2023-10-14T09:03:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 -- 172.21.15.6:0/1263633409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 msgr2=0x562076273750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076273750 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fca10101c00 tx=0x7fca0c01f000 comp rx=0 tx=0).stop 2023-10-14T09:03:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 -- 172.21.15.6:0/1263633409 shutdown_connections 2023-10-14T09:03:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076273750 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 --2- 172.21.15.6:0/1263633409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076273c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 -- 172.21.15.6:0/1263633409 >> 172.21.15.6:0/1263633409 conn(0x562076197d70 msgr2=0x562076271460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 -- 172.21.15.6:0/1263633409 shutdown_connections 2023-10-14T09:03:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 -- 172.21.15.6:0/1263633409 wait complete. 2023-10-14T09:03:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 -- start start 2023-10-14T09:03:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.662+0000 7fca2464db80 1 Processor -- start 2023-10-14T09:03:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076276cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076277230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207627a790 con 0x562076269850 2023-10-14T09:03:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207627a900 con 0x56207626a1b0 2023-10-14T09:03:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56207627aac0 con 0x56207626b0a0 2023-10-14T09:03:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca2464db80 10 client.0 _ll_register_callbacks cb 0x7fca00009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076276cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca159fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076277230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076276cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35534/0 (socket says 172.21.15.6:35534) 2023-10-14T09:03:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 -- 172.21.15.6:0/3886458725 learned_addr learned my addr 172.21.15.6:0/3886458725 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca159fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076277230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34294/0 (socket says 172.21.15.6:34294) 2023-10-14T09:03:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca16a00700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 -- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 msgr2=0x56207627a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 -- 172.21.15.6:0/3886458725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 msgr2=0x562076277230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076277230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 -- 172.21.15.6:0/3886458725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10109ca0 con 0x562076269850 2023-10-14T09:03:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca159fe700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076277230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:03:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca16a00700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:03:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fca161ff700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076276cf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fca0c005b40 tx=0x7fca0c02fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cee752662e0eff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fc9f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:03:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.663+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3886458725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c03c070 con 0x562076269850 2023-10-14T09:03:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3886458725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fca0c02f730 con 0x562076269850 2023-10-14T09:03:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca08099520 con 0x562076269850 2023-10-14T09:03:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3886458725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca0c02b040 con 0x562076269850 2023-10-14T09:03:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 10 client.16416 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56207600e1f0 con 0x562076269850 2023-10-14T09:03:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3886458725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca0c047020 con 0x562076269850 2023-10-14T09:03:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3886458725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fca0c03f020 con 0x562076269850 2023-10-14T09:03:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 10 client.16416 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 20 client.16416 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:24.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5620762d3f60 0x5620762d6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 4 client.16416 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:03:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5620761b5df0 con 0x5620762d3f60 2023-10-14T09:03:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.664+0000 7fca159fe700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5620762d3f60 0x5620762d6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.665+0000 7fca159fe700 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5620762d3f60 0x5620762d6380 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14849dc1cb1036c7 server_cookie=27fd5144afd0379e in_seq=0 out_seq=0 2023-10-14T09:03:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.665+0000 7fc9f9ffb700 10 client.16416 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.681+0000 7fc9f9ffb700 1 -- 172.21.15.6:0/3886458725 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5620761b5df0 con 0x5620762d3f60 2023-10-14T09:03:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.681+0000 7fc9f9ffb700 10 client.16416 handle_command_reply: tid=0 2023-10-14T09:03:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.681+0000 7fca2464db80 1 client.16416 shutdown 2023-10-14T09:03:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 msgr2=0x562076276cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076276cf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fca0c005b40 tx=0x7fca0c02fed0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 shutdown_connections 2023-10-14T09:03:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5620762d3f60 0x5620762d6380 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56207626b0a0 0x56207627a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562076269850 0x562076276cf0 secure :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fca0c005b40 tx=0x7fca0c02fed0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 --2- 172.21.15.6:0/3886458725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56207626a1b0 0x562076277230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 >> 172.21.15.6:0/3886458725 conn(0x562076197d70 msgr2=0x56207626df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fc9f9ffb700 0 client.16416 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 shutdown_connections 2023-10-14T09:03:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 1 -- 172.21.15.6:0/3886458725 wait complete. 2023-10-14T09:03:24.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.682+0000 7fca2464db80 20 client.16416 trim_cache size 0 max 16384 2023-10-14T09:03:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:03:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:03:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:03:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:03:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9fc0a14d0 msgr2=0x7fc9fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9fc0a14d0 0x7fc9fc0a3990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fca0c006010 tx=0x7fca0c00b8b0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 msgr2=0x7fca1019e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 0x7fca1019e370 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fca0800b970 tx=0x7fca0800bd30 comp rx=0 tx=0).stop 2023-10-14T09:03:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 shutdown_connections 2023-10-14T09:03:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca10102a50 0x7fca1019e370 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca10100eb0 0x7fca10196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc9fc0a14d0 0x7fc9fc0a3990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 --2- 172.21.15.6:0/1318770651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca10102090 0x7fca10197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 >> 172.21.15.6:0/1318770651 conn(0x7fca100fc470 msgr2=0x7fca10105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 shutdown_connections 2023-10-14T09:03:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:24.683+0000 7fca18463700 1 -- 172.21.15.6:0/1318770651 wait complete. 2023-10-14T09:03:24.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:24 smithi057 ceph-mon[103313]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.62k op/s 2023-10-14T09:03:24.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:24 smithi006 ceph-mon[99452]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.62k op/s 2023-10-14T09:03:25.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:24 smithi178 ceph-mon[103612]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.62k op/s 2023-10-14T09:03:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 625.0 s, 1438.4 tps, lat 70.370 ms stddev 74.701 2023-10-14T09:03:27.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:27 smithi057 ceph-mon[103313]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 32 MiB/s wr, 1.93k op/s 2023-10-14T09:03:27.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:27 smithi006 ceph-mon[99452]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 32 MiB/s wr, 1.93k op/s 2023-10-14T09:03:27.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:27 smithi178 ceph-mon[103612]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 32 MiB/s wr, 1.93k op/s 2023-10-14T09:03:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:29 smithi057 ceph-mon[103313]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.91k op/s 2023-10-14T09:03:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:29 smithi006 ceph-mon[99452]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.91k op/s 2023-10-14T09:03:29.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:29 smithi178 ceph-mon[103612]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.91k op/s 2023-10-14T09:03:30.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 630.0 s, 1529.1 tps, lat 65.547 ms stddev 77.947 2023-10-14T09:03:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:31 smithi006 ceph-mon[99452]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 1.89k op/s 2023-10-14T09:03:31.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:31 smithi178 ceph-mon[103612]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 1.89k op/s 2023-10-14T09:03:31.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:31 smithi057 ceph-mon[103313]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 1.89k op/s 2023-10-14T09:03:33.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:33 smithi006 ceph-mon[99452]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.87k op/s 2023-10-14T09:03:33.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:33 smithi178 ceph-mon[103612]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.87k op/s 2023-10-14T09:03:33.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:33 smithi057 ceph-mon[103313]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 MiB/s wr, 1.87k op/s 2023-10-14T09:03:35.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:35 smithi178 ceph-mon[103612]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 1.21k op/s 2023-10-14T09:03:35.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:35 smithi057 ceph-mon[103313]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 1.21k op/s 2023-10-14T09:03:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 635.0 s, 1804.4 tps, lat 55.395 ms stddev 62.268 2023-10-14T09:03:35.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:35 smithi006 ceph-mon[99452]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 1.21k op/s 2023-10-14T09:03:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 -- 172.21.15.6:0/3249178588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328100ff0 msgr2=0x7f4328101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 --2- 172.21.15.6:0/3249178588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328100ff0 0x7f4328101450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4314009920 tx=0x7f4314009c30 comp rx=0 tx=0).stop 2023-10-14T09:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 -- 172.21.15.6:0/3249178588 shutdown_connections 2023-10-14T09:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 --2- 172.21.15.6:0/3249178588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4328101990 0x7f4328108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 --2- 172.21.15.6:0/3249178588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43280ffe00 0x7f4328100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 --2- 172.21.15.6:0/3249178588 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328100ff0 0x7f4328101450 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 -- 172.21.15.6:0/3249178588 >> 172.21.15.6:0/3249178588 conn(0x7f43280fb390 msgr2=0x7f43280fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 -- 172.21.15.6:0/3249178588 shutdown_connections 2023-10-14T09:03:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.829+0000 7f432eb97700 1 -- 172.21.15.6:0/3249178588 wait complete. 2023-10-14T09:03:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 Processor -- start 2023-10-14T09:03:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 -- start start 2023-10-14T09:03:37.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 0x7f4328195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4328100ff0 0x7f4328196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4328101990 0x7f432819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432819d6d0 con 0x7f4328101990 2023-10-14T09:03:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432819d810 con 0x7f43280ffe00 2023-10-14T09:03:37.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.830+0000 7f432eb97700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432819d9a0 con 0x7f4328100ff0 2023-10-14T09:03:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 0x7f4328195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432d134700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4328101990 0x7f432819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 0x7f4328195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34306/0 (socket says 172.21.15.6:34306) 2023-10-14T09:03:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 -- 172.21.15.6:0/1691528334 learned_addr learned my addr 172.21.15.6:0/1691528334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 -- 172.21.15.6:0/1691528334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4328100ff0 msgr2=0x7f4328196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4328100ff0 0x7f4328196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 -- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4328101990 msgr2=0x7f432819d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4328101990 0x7f432819d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 -- 172.21.15.6:0/1691528334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009d00 con 0x7f43280ffe00 2023-10-14T09:03:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432c933700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 0x7f4328195b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f431c00e970 tx=0x7f431c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f4325ffb700 1 -- 172.21.15.6:0/1691528334 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c009790 con 0x7f43280ffe00 2023-10-14T09:03:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f4325ffb700 1 -- 172.21.15.6:0/1691528334 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f431c00eec0 con 0x7f43280ffe00 2023-10-14T09:03:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4314009520 con 0x7f43280ffe00 2023-10-14T09:03:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.831+0000 7f4325ffb700 1 -- 172.21.15.6:0/1691528334 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c003cf0 con 0x7f43280ffe00 2023-10-14T09:03:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.832+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432819e050 con 0x7f43280ffe00 2023-10-14T09:03:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.835+0000 7f4325ffb700 1 -- 172.21.15.6:0/1691528334 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f431c004020 con 0x7f43280ffe00 2023-10-14T09:03:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f4325ffb700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f43180a1500 0x7f43180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f433ad81b80 1 Processor -- start 2023-10-14T09:03:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f4325ffb700 1 -- 172.21.15.6:0/1691528334 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f431c014070 con 0x7f43280ffe00 2023-10-14T09:03:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f4327fff700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f43180a1500 0x7f43180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f433ad81b80 1 -- start start 2023-10-14T09:03:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca21c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.836+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca22ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca23520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f433ad81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc996c10 con 0x5607dca221b0 2023-10-14T09:03:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f433ad81b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc97bc00 con 0x5607dca230a0 2023-10-14T09:03:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f433ad81b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc979520 con 0x5607dca21850 2023-10-14T09:03:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca22ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f432d134700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca23520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca22ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35560/0 (socket says 172.21.15.6:35560) 2023-10-14T09:03:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 -- 172.21.15.6:0/1588107739 learned_addr learned my addr 172.21.15.6:0/1588107739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f432c933700 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca21c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f43180a1500 0x7f43180a39c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4314009230 tx=0x7f4314009fa0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 -- 172.21.15.6:0/1588107739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 msgr2=0x5607dca21c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.848 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca21c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 -- 172.21.15.6:0/1588107739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 msgr2=0x5607dca23520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca23520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 -- 172.21.15.6:0/1588107739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607dc932390 con 0x5607dca221b0 2023-10-14T09:03:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f432c933700 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca21c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:03:37.849 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4327fff700 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca22ac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4314016000 tx=0x7f4314023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c912759e91897a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.837+0000 7f4312ffd700 1 -- 172.21.15.6:0/1588107739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314020070 con 0x5607dca221b0 2023-10-14T09:03:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f4312ffd700 1 -- 172.21.15.6:0/1588107739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43140055b0 con 0x5607dca221b0 2023-10-14T09:03:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f4312ffd700 1 -- 172.21.15.6:0/1588107739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431401b810 con 0x5607dca221b0 2023-10-14T09:03:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 -- 172.21.15.6:0/1588107739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 msgr2=0x5607dca22ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.850 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca22ac0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4314016000 tx=0x7f4314023000 comp rx=0 tx=0).stop 2023-10-14T09:03:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 -- 172.21.15.6:0/1588107739 shutdown_connections 2023-10-14T09:03:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca23520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca21c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 --2- 172.21.15.6:0/1588107739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca22ac0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.851 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 -- 172.21.15.6:0/1588107739 >> 172.21.15.6:0/1588107739 conn(0x5607dc94fd70 msgr2=0x5607dca1cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 -- 172.21.15.6:0/1588107739 shutdown_connections 2023-10-14T09:03:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.838+0000 7f433ad81b80 1 -- 172.21.15.6:0/1588107739 wait complete. 2023-10-14T09:03:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 -- start start 2023-10-14T09:03:37.852 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 Processor -- start 2023-10-14T09:03:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca2b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca221b0 0x5607dca2bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 0x5607dca32d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc974e10 con 0x5607dca230a0 2023-10-14T09:03:37.853 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc9116b0 con 0x5607dca221b0 2023-10-14T09:03:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc911350 con 0x5607dca21850 2023-10-14T09:03:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.839+0000 7f433ad81b80 10 client.0 _ll_register_callbacks cb 0x5607dc76e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 0x5607dca32d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 0x5607dca32d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35566/0 (socket says 172.21.15.6:35566) 2023-10-14T09:03:37.854 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 -- 172.21.15.6:0/2687506027 learned_addr learned my addr 172.21.15.6:0/2687506027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f4327fff700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca221b0 0x5607dca2bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432c933700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca2b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 -- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 msgr2=0x5607dca2b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca2b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.855 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 -- 172.21.15.6:0/2687506027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca221b0 msgr2=0x5607dca2bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca221b0 0x5607dca2bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 -- 172.21.15.6:0/2687506027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431c0cae70 con 0x5607dca230a0 2023-10-14T09:03:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432c933700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca2b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:03:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f4327fff700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca221b0 0x5607dca2bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:03:37.856 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f432d134700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 0x5607dca32d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f43200042f0 tx=0x7f4320003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b809516bf7ca4c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.840+0000 7f4307fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:03:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.841+0000 7f4307fff700 1 -- 172.21.15.6:0/2687506027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000e030 con 0x5607dca230a0 2023-10-14T09:03:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.841+0000 7f4307fff700 1 -- 172.21.15.6:0/2687506027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4320007990 con 0x5607dca230a0 2023-10-14T09:03:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.841+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607dc979e90 con 0x5607dca230a0 2023-10-14T09:03:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.841+0000 7f4307fff700 1 -- 172.21.15.6:0/2687506027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4320007b50 con 0x5607dca230a0 2023-10-14T09:03:37.857 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.841+0000 7f433ad81b80 10 client.16428 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.841+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f4328108b90 con 0x5607dca230a0 2023-10-14T09:03:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f4307fff700 1 -- 172.21.15.6:0/2687506027 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5607dc979e90 con 0x5607dca230a0 2023-10-14T09:03:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f4307fff700 1 -- 172.21.15.6:0/2687506027 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f432001e3b0 con 0x5607dca230a0 2023-10-14T09:03:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f433ad81b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f433ad81b80 10 client.16428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f433ad81b80 20 client.16428 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca486b0 0x5607dca4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f433ad81b80 4 client.16428 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:03:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607dc9f1bb0 con 0x5607dca486b0 2023-10-14T09:03:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f432c933700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca486b0 0x5607dca4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.842+0000 7f4307fff700 10 client.16428 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:37.860 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.843+0000 7f432c933700 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca486b0 0x5607dca4aad0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafe9fa8d9506eda server_cookie=5f3a750570c90c5e in_seq=0 out_seq=0 2023-10-14T09:03:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.844+0000 7f4307fff700 1 -- 172.21.15.6:0/2687506027 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607dc9f1bb0 con 0x5607dca486b0 2023-10-14T09:03:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.844+0000 7f4307fff700 10 client.16428 handle_command_reply: tid=0 2023-10-14T09:03:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.844+0000 7f433ad81b80 1 client.16428 shutdown 2023-10-14T09:03:37.861 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.852+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 msgr2=0x5607dca32d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.852+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 0x5607dca32d00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f43200042f0 tx=0x7f4320003f90 comp rx=0 tx=0).stop 2023-10-14T09:03:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.854+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 shutdown_connections 2023-10-14T09:03:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.854+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca486b0 0x5607dca4aad0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.862 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.854+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca230a0 0x5607dca32d00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.854+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca2b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.854+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2687506027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca221b0 0x5607dca2bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.854+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 >> 172.21.15.6:0/2687506027 conn(0x5607dc94fd70 msgr2=0x5607dca1c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:37.863 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.855+0000 7f4307fff700 0 client.16428 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.864+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 shutdown_connections 2023-10-14T09:03:37.865 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.864+0000 7f433ad81b80 1 -- 172.21.15.6:0/2687506027 wait complete. 2023-10-14T09:03:37.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.868+0000 7f433ad81b80 20 client.16428 trim_cache size 0 max 16384 2023-10-14T09:03:37.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:37 smithi178 ceph-mon[103612]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 908 op/s 2023-10-14T09:03:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.908+0000 7f433ad81b80 1 Processor -- start 2023-10-14T09:03:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 -- start start 2023-10-14T09:03:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca21850 0x5607dca2a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca32c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca230a0 0x5607dca294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dca2b350 con 0x5607dca221b0 2023-10-14T09:03:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dc7f58c0 con 0x5607dca21850 2023-10-14T09:03:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f433ad81b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dca19040 con 0x5607dca230a0 2023-10-14T09:03:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f4327fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca32c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f4327fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca32c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35572/0 (socket says 172.21.15.6:35572) 2023-10-14T09:03:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f4327fff700 1 -- 172.21.15.6:0/2454984866 learned_addr learned my addr 172.21.15.6:0/2454984866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f432c933700 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca21850 0x5607dca2a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.911+0000 7f432d134700 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca230a0 0x5607dca294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f4327fff700 1 -- 172.21.15.6:0/2454984866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca230a0 msgr2=0x5607dca294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f4327fff700 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca230a0 0x5607dca294f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f4327fff700 1 -- 172.21.15.6:0/2454984866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca21850 msgr2=0x5607dca2a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f4327fff700 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca21850 0x5607dca2a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f4327fff700 1 -- 172.21.15.6:0/2454984866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607dc79fd80 con 0x5607dca221b0 2023-10-14T09:03:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f4327fff700 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca32c20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4314016000 tx=0x7f4314009400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6336b89bae4a9d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f43137fe700 1 -- 172.21.15.6:0/2454984866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314020040 con 0x5607dca221b0 2023-10-14T09:03:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f43137fe700 1 -- 172.21.15.6:0/2454984866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f431400b930 con 0x5607dca221b0 2023-10-14T09:03:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.912+0000 7f43137fe700 1 -- 172.21.15.6:0/2454984866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314003b00 con 0x5607dca221b0 2023-10-14T09:03:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 -- 172.21.15.6:0/2454984866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 msgr2=0x5607dca32c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca32c20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4314016000 tx=0x7f4314009400 comp rx=0 tx=0).stop 2023-10-14T09:03:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 -- 172.21.15.6:0/2454984866 shutdown_connections 2023-10-14T09:03:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca230a0 0x5607dca294f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca21850 0x5607dca2a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 --2- 172.21.15.6:0/2454984866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca32c20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 -- 172.21.15.6:0/2454984866 >> 172.21.15.6:0/2454984866 conn(0x5607dc94fd70 msgr2=0x5607dca4f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 -- 172.21.15.6:0/2454984866 shutdown_connections 2023-10-14T09:03:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.913+0000 7f433ad81b80 1 -- 172.21.15.6:0/2454984866 wait complete. 2023-10-14T09:03:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 -- start start 2023-10-14T09:03:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 Processor -- start 2023-10-14T09:03:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca301d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca30710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca31720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dca31c60 con 0x5607dca221b0 2023-10-14T09:03:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dca31dd0 con 0x5607dca230a0 2023-10-14T09:03:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607dca31f90 con 0x5607dca21850 2023-10-14T09:03:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.914+0000 7f433ad81b80 10 client.0 _ll_register_callbacks cb 0x7f4320003da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f432c933700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca301d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f432c933700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca301d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32978/0 (socket says 172.21.15.6:32978) 2023-10-14T09:03:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f432c933700 1 -- 172.21.15.6:0/3633988591 learned_addr learned my addr 172.21.15.6:0/3633988591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca30710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 -- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 msgr2=0x5607dca301d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca301d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 -- 172.21.15.6:0/3633988591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 msgr2=0x5607dca31720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca31720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 -- 172.21.15.6:0/3633988591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607dc932390 con 0x5607dca221b0 2023-10-14T09:03:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4327fff700 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca30710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f431400f740 tx=0x7f431400bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d640ff7131851c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.915+0000 7f4307fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:03:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f4307fff700 1 -- 172.21.15.6:0/3633988591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314020040 con 0x5607dca221b0 2023-10-14T09:03:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f4307fff700 1 -- 172.21.15.6:0/3633988591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f43140038a0 con 0x5607dca221b0 2023-10-14T09:03:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43140055b0 con 0x5607dca221b0 2023-10-14T09:03:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f4307fff700 1 -- 172.21.15.6:0/3633988591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4314003a60 con 0x5607dca221b0 2023-10-14T09:03:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f433ad81b80 10 client.16434 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x5607dc788c00 con 0x5607dca221b0 2023-10-14T09:03:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.916+0000 7f4307fff700 1 -- 172.21.15.6:0/3633988591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4314041080 con 0x5607dca221b0 2023-10-14T09:03:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.917+0000 7f4307fff700 1 -- 172.21.15.6:0/3633988591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f4314030450 con 0x5607dca221b0 2023-10-14T09:03:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.917+0000 7f433ad81b80 10 client.16434 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.917+0000 7f433ad81b80 10 client.16434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.917+0000 7f433ad81b80 20 client.16434 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.917+0000 7f433ad81b80 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca9c8a0 0x5607dca9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.918+0000 7f433ad81b80 4 client.16434 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:03:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.918+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5607dc96ddf0 con 0x5607dca9c8a0 2023-10-14T09:03:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.921+0000 7f432c933700 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca9c8a0 0x5607dca9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.922+0000 7f4307fff700 10 client.16434 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.922+0000 7f432c933700 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca9c8a0 0x5607dca9ecc0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a713e1edf85ed15e server_cookie=40dd475c7b7bfdb9 in_seq=0 out_seq=0 2023-10-14T09:03:37.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:37 smithi057 ceph-mon[103313]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 908 op/s 2023-10-14T09:03:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f4307fff700 1 -- 172.21.15.6:0/3633988591 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5607dc96ddf0 con 0x5607dca9c8a0 2023-10-14T09:03:37.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f4307fff700 10 client.16434 handle_command_reply: tid=0 2023-10-14T09:03:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 client.16434 shutdown 2023-10-14T09:03:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 msgr2=0x5607dca30710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca30710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f431400f740 tx=0x7f431400bb50 comp rx=0 tx=0).stop 2023-10-14T09:03:37.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 shutdown_connections 2023-10-14T09:03:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5607dca9c8a0 0x5607dca9ecc0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607dca230a0 0x5607dca31720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5607dca21850 0x5607dca301d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 --2- 172.21.15.6:0/3633988591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607dca221b0 0x5607dca30710 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 >> 172.21.15.6:0/3633988591 conn(0x5607dc94fd70 msgr2=0x5607dca2a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f4307fff700 0 client.16434 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 shutdown_connections 2023-10-14T09:03:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 1 -- 172.21.15.6:0/3633988591 wait complete. 2023-10-14T09:03:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.954+0000 7f433ad81b80 20 client.16434 trim_cache size 0 max 16384 2023-10-14T09:03:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:03:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:03:37.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:03:37.961 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:03:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f43180a1500 msgr2=0x7f43180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f43180a1500 0x7f43180a39c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4314009230 tx=0x7f4314009fa0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 msgr2=0x7f4328195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:37.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 0x7f4328195b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f431c00e970 tx=0x7f431c00ec80 comp rx=0 tx=0).stop 2023-10-14T09:03:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 shutdown_connections 2023-10-14T09:03:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4328101990 0x7f432819d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f43180a1500 0x7f43180a39c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43280ffe00 0x7f4328195b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.963 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 --2- 172.21.15.6:0/1691528334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4328100ff0 0x7f4328196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 >> 172.21.15.6:0/1691528334 conn(0x7f43280fb390 msgr2=0x7f43280fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 shutdown_connections 2023-10-14T09:03:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:37.955+0000 7f432eb97700 1 -- 172.21.15.6:0/1691528334 wait complete. 2023-10-14T09:03:37.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:37 smithi006 ceph-mon[99452]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 908 op/s 2023-10-14T09:03:39.894 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:39 smithi178 ceph-mon[103612]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 637 op/s 2023-10-14T09:03:39.894 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:39 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:03:39.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:39 smithi057 ceph-mon[103313]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 637 op/s 2023-10-14T09:03:39.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:39 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:03:39.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:39 smithi006 ceph-mon[99452]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 637 op/s 2023-10-14T09:03:39.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:39 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:03:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 640.0 s, 1542.4 tps, lat 64.320 ms stddev 73.865 2023-10-14T09:03:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:41 smithi178 ceph-mon[103612]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 652 op/s 2023-10-14T09:03:41.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:41 smithi057 ceph-mon[103313]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 652 op/s 2023-10-14T09:03:41.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:41 smithi006 ceph-mon[99452]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 652 op/s 2023-10-14T09:03:43.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 662 op/s 2023-10-14T09:03:43.487 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.488 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.488 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.488 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.488 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.488 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.489 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:03:43.489 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:03:43.489 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 662 op/s 2023-10-14T09:03:43.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.635 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:03:43.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:03:43.636 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.703 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 662 op/s 2023-10-14T09:03:43.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:43.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:03:43.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:03:43.705 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:03:45.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:45 smithi006 ceph-mon[99452]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 610 op/s 2023-10-14T09:03:45.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:45 smithi178 ceph-mon[103612]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 610 op/s 2023-10-14T09:03:45.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:45 smithi057 ceph-mon[103313]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 610 op/s 2023-10-14T09:03:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 645.0 s, 1405.2 tps, lat 71.371 ms stddev 82.810 2023-10-14T09:03:47.634 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:47 smithi178 ceph-mon[103612]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 682 op/s 2023-10-14T09:03:47.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:47 smithi057 ceph-mon[103313]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 682 op/s 2023-10-14T09:03:47.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:47 smithi006 ceph-mon[99452]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 682 op/s 2023-10-14T09:03:49.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:49 smithi006 ceph-mon[99452]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 703 op/s 2023-10-14T09:03:49.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:49 smithi178 ceph-mon[103612]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 703 op/s 2023-10-14T09:03:49.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:49 smithi057 ceph-mon[103313]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 703 op/s 2023-10-14T09:03:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 650.0 s, 1632.6 tps, lat 61.574 ms stddev 67.853 2023-10-14T09:03:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.102+0000 7f16fcf46700 1 -- 172.21.15.6:0/1881937486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8109900 msgr2=0x7f16f81101b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.102+0000 7f16fcf46700 1 --2- 172.21.15.6:0/1881937486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8109900 0x7f16f81101b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f16f000b0a0 tx=0x7f16f000b3b0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.102+0000 7f16fcf46700 1 -- 172.21.15.6:0/1881937486 shutdown_connections 2023-10-14T09:03:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 --2- 172.21.15.6:0/1881937486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8109900 0x7f16f81101b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 --2- 172.21.15.6:0/1881937486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8108300 0x7f16f8108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 --2- 172.21.15.6:0/1881937486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108f60 0x7f16f81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 -- 172.21.15.6:0/1881937486 >> 172.21.15.6:0/1881937486 conn(0x7f16f806e650 msgr2=0x7f16f8070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 -- 172.21.15.6:0/1881937486 shutdown_connections 2023-10-14T09:03:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 -- 172.21.15.6:0/1881937486 wait complete. 2023-10-14T09:03:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 Processor -- start 2023-10-14T09:03:51.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.103+0000 7f16fcf46700 1 -- start start 2023-10-14T09:03:51.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16fcf46700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108300 0x7f16f819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16fcf46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8108f60 0x7f16f819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16fcf46700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 0x7f16f81a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16fcf46700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81a4ee0 con 0x7f16f8108f60 2023-10-14T09:03:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16fcf46700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81a5020 con 0x7f16f8108300 2023-10-14T09:03:51.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16fcf46700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f81a51b0 con 0x7f16f8109900 2023-10-14T09:03:51.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 0x7f16f81a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108300 0x7f16f819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 0x7f16f81a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:32998/0 (socket says 172.21.15.6:32998) 2023-10-14T09:03:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108300 0x7f16f819d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34350/0 (socket says 172.21.15.6:34350) 2023-10-14T09:03:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 -- 172.21.15.6:0/4136716878 learned_addr learned my addr 172.21.15.6:0/4136716878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8108f60 0x7f16f819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 -- 172.21.15.6:0/4136716878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108300 msgr2=0x7f16f819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108300 0x7f16f819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 -- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8108f60 msgr2=0x7f16f819d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8108f60 0x7f16f819d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.104+0000 7f16f6d9d700 1 -- 172.21.15.6:0/4136716878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0009d00 con 0x7f16f8109900 2023-10-14T09:03:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.105+0000 7f16f6d9d700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 0x7f16f81a4910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009fd0 tx=0x7f16f0007930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.105+0000 7f16e77fe700 1 -- 172.21.15.6:0/4136716878 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f000e040 con 0x7f16f8109900 2023-10-14T09:03:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.105+0000 7f16e77fe700 1 -- 172.21.15.6:0/4136716878 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16f001ed90 con 0x7f16f8109900 2023-10-14T09:03:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.105+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f81a5430 con 0x7f16f8109900 2023-10-14T09:03:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.105+0000 7f16e77fe700 1 -- 172.21.15.6:0/4136716878 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00055a0 con 0x7f16f8109900 2023-10-14T09:03:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.105+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f81a58b0 con 0x7f16f8109900 2023-10-14T09:03:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.107+0000 7f16e77fe700 1 -- 172.21.15.6:0/4136716878 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f16f0004c50 con 0x7f16f8109900 2023-10-14T09:03:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.108+0000 7f16e77fe700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16e00a1500 0x7f16e00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.108+0000 7f16e77fe700 1 -- 172.21.15.6:0/4136716878 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f16f00d2230 con 0x7f16f8109900 2023-10-14T09:03:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.108+0000 7f16f659c700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16e00a1500 0x7f16e00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 Processor -- start 2023-10-14T09:03:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f16f659c700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16e00a1500 0x7f16e00a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f16f8072fd0 tx=0x7f16e8010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 -- start start 2023-10-14T09:03:51.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fbd3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fbd42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd48b0 0x55a22fbd4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fb3fc10 con 0x55a22fbd48b0 2023-10-14T09:03:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.109+0000 7f1709130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fb24c00 con 0x55a22fbd3060 2023-10-14T09:03:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f1709130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fb22520 con 0x55a22fbd39c0 2023-10-14T09:03:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fbd3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fbd3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34358/0 (socket says 172.21.15.6:34358) 2023-10-14T09:03:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 -- 172.21.15.6:0/2097902515 learned_addr learned my addr 172.21.15.6:0/2097902515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fbd42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 -- 172.21.15.6:0/2097902515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 msgr2=0x55a22fbd42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fbd42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 -- 172.21.15.6:0/2097902515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd48b0 msgr2=0x55a22fbd4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd48b0 0x55a22fbd4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 -- 172.21.15.6:0/2097902515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a22fadb390 con 0x55a22fbd3060 2023-10-14T09:03:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.110+0000 7f16f659c700 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fbd3480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16e800af60 tx=0x7f16e8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2b85d37411b246 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.111+0000 7f16e4ff9700 1 -- 172.21.15.6:0/2097902515 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8020070 con 0x55a22fbd3060 2023-10-14T09:03:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.111+0000 7f16e4ff9700 1 -- 172.21.15.6:0/2097902515 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e801b190 con 0x55a22fbd3060 2023-10-14T09:03:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.111+0000 7f16e4ff9700 1 -- 172.21.15.6:0/2097902515 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8013040 con 0x55a22fbd3060 2023-10-14T09:03:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 -- 172.21.15.6:0/2097902515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 msgr2=0x55a22fbd3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fbd3480 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16e800af60 tx=0x7f16e8014000 comp rx=0 tx=0).stop 2023-10-14T09:03:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 -- 172.21.15.6:0/2097902515 shutdown_connections 2023-10-14T09:03:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd48b0 0x55a22fbd4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fbd3480 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 --2- 172.21.15.6:0/2097902515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fbd42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 -- 172.21.15.6:0/2097902515 >> 172.21.15.6:0/2097902515 conn(0x55a22faf8d70 msgr2=0x55a22fbc5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 -- 172.21.15.6:0/2097902515 shutdown_connections 2023-10-14T09:03:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 -- 172.21.15.6:0/2097902515 wait complete. 2023-10-14T09:03:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 -- start start 2023-10-14T09:03:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 Processor -- start 2023-10-14T09:03:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 0x55a22fbcbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.112+0000 7f1709130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f1709130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fbd1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f1709130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fb1de10 con 0x55a22fbd39c0 2023-10-14T09:03:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f1709130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22faba6b0 con 0x55a22fbd48b0 2023-10-14T09:03:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f1709130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22faba350 con 0x55a22fbd3060 2023-10-14T09:03:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f1709130b80 10 client.0 _ll_register_callbacks cb 0x55a22f9177a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:51.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 0x55a22fbcbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 0x55a22fbcbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33008/0 (socket says 172.21.15.6:33008) 2023-10-14T09:03:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 -- 172.21.15.6:0/2759695465 learned_addr learned my addr 172.21.15.6:0/2759695465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f6d9d700 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fbd1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 -- 172.21.15.6:0/2759695465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 msgr2=0x55a22fbd1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fbd1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 -- 172.21.15.6:0/2759695465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 msgr2=0x55a22fbcc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.113+0000 7f16f659c700 1 -- 172.21.15.6:0/2759695465 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e800ecd0 con 0x55a22fbd3060 2023-10-14T09:03:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f16f659c700 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 0x55a22fbcbe90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f16e800eac0 tx=0x7f16e801bd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8065046ece7a22af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f16ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:03:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f16ddffb700 1 -- 172.21.15.6:0/2759695465 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8020040 con 0x55a22fbd3060 2023-10-14T09:03:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f16ddffb700 1 -- 172.21.15.6:0/2759695465 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f16e8024ca0 con 0x55a22fbd3060 2023-10-14T09:03:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a22fb22e90 con 0x55a22fbd3060 2023-10-14T09:03:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f16ddffb700 1 -- 172.21.15.6:0/2759695465 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e8013040 con 0x55a22fbd3060 2023-10-14T09:03:51.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f1709130b80 10 client.26059 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.114+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a22f948d80 con 0x55a22fbd3060 2023-10-14T09:03:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f16ddffb700 1 -- 172.21.15.6:0/2759695465 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a22fb22e90 con 0x55a22fbd3060 2023-10-14T09:03:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f16ddffb700 1 -- 172.21.15.6:0/2759695465 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f16e802b070 con 0x55a22fbd3060 2023-10-14T09:03:51.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f1709130b80 10 client.26059 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f1709130b80 10 client.26059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f1709130b80 20 client.26059 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f1709130b80 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fbf15c0 0x55a22fbf39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f1709130b80 4 client.26059 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:03:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a22fb9abb0 con 0x55a22fbf15c0 2023-10-14T09:03:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fbf15c0 0x55a22fbf39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fbf15c0 0x55a22fbf39e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b96f7663a5eab7 server_cookie=1cb9b02752d18109 in_seq=0 out_seq=0 2023-10-14T09:03:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.115+0000 7f16ddffb700 10 client.26059 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f16ddffb700 1 -- 172.21.15.6:0/2759695465 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a22fb9abb0 con 0x55a22fbf15c0 2023-10-14T09:03:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f16ddffb700 10 client.26059 handle_command_reply: tid=0 2023-10-14T09:03:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 client.26059 shutdown 2023-10-14T09:03:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 msgr2=0x55a22fbcbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 0x55a22fbcbe90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f16e800eac0 tx=0x7f16e801bd40 comp rx=0 tx=0).stop 2023-10-14T09:03:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 shutdown_connections 2023-10-14T09:03:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fbf15c0 0x55a22fbf39e0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fbd1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f16ddffb700 0 client.26059 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd3060 0x55a22fbcbe90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 --2- 172.21.15.6:0/2759695465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 >> 172.21.15.6:0/2759695465 conn(0x55a22faf8d70 msgr2=0x55a22fbc57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 shutdown_connections 2023-10-14T09:03:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 1 -- 172.21.15.6:0/2759695465 wait complete. 2023-10-14T09:03:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.116+0000 7f1709130b80 20 client.26059 trim_cache size 0 max 16384 2023-10-14T09:03:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 Processor -- start 2023-10-14T09:03:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 -- start start 2023-10-14T09:03:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fc01180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd48b0 0x55a22fbd7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22f99e8c0 con 0x55a22fbd39c0 2023-10-14T09:03:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fb9abb0 con 0x55a22fbd3060 2023-10-14T09:03:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f1709130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fb22e90 con 0x55a22fbd48b0 2023-10-14T09:03:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f16f5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f16f5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35616/0 (socket says 172.21.15.6:35616) 2023-10-14T09:03:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f16f5d9b700 1 -- 172.21.15.6:0/3607425717 learned_addr learned my addr 172.21.15.6:0/3607425717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f16f6d9d700 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd48b0 0x55a22fbd7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.135+0000 7f16f659c700 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fc01180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16f5d9b700 1 -- 172.21.15.6:0/3607425717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd48b0 msgr2=0x55a22fbd7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd48b0 0x55a22fbd7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16f5d9b700 1 -- 172.21.15.6:0/3607425717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 msgr2=0x55a22fc01180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fc01180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16f5d9b700 1 -- 172.21.15.6:0/3607425717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a22f931c00 con 0x55a22fbd39c0 2023-10-14T09:03:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcaa80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55a22fbf4280 tx=0x7f16ec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba816d08245b4fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16e57fa700 1 -- 172.21.15.6:0/3607425717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec017040 con 0x55a22fbd39c0 2023-10-14T09:03:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16e57fa700 1 -- 172.21.15.6:0/3607425717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16ec018040 con 0x55a22fbd39c0 2023-10-14T09:03:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.136+0000 7f16e57fa700 1 -- 172.21.15.6:0/3607425717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec003c90 con 0x55a22fbd39c0 2023-10-14T09:03:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- 172.21.15.6:0/3607425717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 msgr2=0x55a22fbcaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcaa80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55a22fbf4280 tx=0x7f16ec009260 comp rx=0 tx=0).stop 2023-10-14T09:03:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- 172.21.15.6:0/3607425717 shutdown_connections 2023-10-14T09:03:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd48b0 0x55a22fbd7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd3060 0x55a22fc01180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- 172.21.15.6:0/3607425717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd39c0 0x55a22fbcaa80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- 172.21.15.6:0/3607425717 >> 172.21.15.6:0/3607425717 conn(0x55a22faf8d70 msgr2=0x55a22fbc4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- 172.21.15.6:0/3607425717 shutdown_connections 2023-10-14T09:03:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- 172.21.15.6:0/3607425717 wait complete. 2023-10-14T09:03:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- start start 2023-10-14T09:03:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 Processor -- start 2023-10-14T09:03:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 0x55a22fc010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fc41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fc440b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fc44840 con 0x55a22fbd3060 2023-10-14T09:03:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fc449b0 con 0x55a22fbd48b0 2023-10-14T09:03:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a22fc44b70 con 0x55a22fbd39c0 2023-10-14T09:03:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.137+0000 7f1709130b80 10 client.0 _ll_register_callbacks cb 0x7f16ec009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:03:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 0x55a22fc010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 0x55a22fc010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35620/0 (socket says 172.21.15.6:35620) 2023-10-14T09:03:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 -- 172.21.15.6:0/2195795431 learned_addr learned my addr 172.21.15.6:0/2195795431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:03:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 -- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 msgr2=0x55a22fc41ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:03:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fc41ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 -- 172.21.15.6:0/2195795431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 msgr2=0x55a22fc440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:03:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fc440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.138+0000 7f16f659c700 1 -- 172.21.15.6:0/2195795431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a22f96f1f0 con 0x55a22fbd3060 2023-10-14T09:03:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.139+0000 7f16f659c700 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 0x55a22fc010d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005950 tx=0x7f16e8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41aee5ff7c418454 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:03:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.139+0000 7f16ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:03:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f16ddffb700 1 -- 172.21.15.6:0/2195795431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8013070 con 0x55a22fbd3060 2023-10-14T09:03:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f16ddffb700 1 -- 172.21.15.6:0/2195795431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f16e8004020 con 0x55a22fbd3060 2023-10-14T09:03:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16e801b190 con 0x55a22fbd3060 2023-10-14T09:03:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f16ddffb700 1 -- 172.21.15.6:0/2195795431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e8020070 con 0x55a22fbd3060 2023-10-14T09:03:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 10 client.16449 fetch_fsmap learned FSMap version 51 2023-10-14T09:03:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55a22f947250 con 0x55a22fbd3060 2023-10-14T09:03:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f16ddffb700 1 -- 172.21.15.6:0/2195795431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16e8046020 con 0x55a22fbd3060 2023-10-14T09:03:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f16ddffb700 1 -- 172.21.15.6:0/2195795431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f16e801b700 con 0x55a22fbd3060 2023-10-14T09:03:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 10 client.16449 fetch_fsmap finished waiting for FSMap version 51 2023-10-14T09:03:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:03:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 20 client.16449 populate_metadata read hostname 'smithi006' 2023-10-14T09:03:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fc462d0 0x55a22fc48710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:03:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 4 client.16449 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:03:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a22fb16df0 con 0x55a22fc462d0 2023-10-14T09:03:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.140+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fc462d0 0x55a22fc48710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:03:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.141+0000 7f16f5d9b700 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fc462d0 0x55a22fc48710 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27fb37551bef29e1 server_cookie=9e0dae4530245e42 in_seq=0 out_seq=0 2023-10-14T09:03:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.141+0000 7f16ddffb700 10 client.16449 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.155+0000 7f16ddffb700 1 -- 172.21.15.6:0/2195795431 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a22fb16df0 con 0x55a22fc462d0 2023-10-14T09:03:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.155+0000 7f16ddffb700 10 client.16449 handle_command_reply: tid=0 2023-10-14T09:03:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.155+0000 7f1709130b80 1 client.16449 shutdown 2023-10-14T09:03:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 msgr2=0x55a22fc010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 0x55a22fc010d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16e8005950 tx=0x7f16e8004b20 comp rx=0 tx=0).stop 2023-10-14T09:03:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 shutdown_connections 2023-10-14T09:03:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55a22fc462d0 0x55a22fc48710 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55a22fbd48b0 0x55a22fc440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16ddffb700 0 client.16449 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:03:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a22fbd3060 0x55a22fc010d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 --2- 172.21.15.6:0/2195795431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a22fbd39c0 0x55a22fc41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 >> 172.21.15.6:0/2195795431 conn(0x55a22faf8d70 msgr2=0x55a22fbcaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 shutdown_connections 2023-10-14T09:03:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 1 -- 172.21.15.6:0/2195795431 wait complete. 2023-10-14T09:03:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f1709130b80 20 client.16449 trim_cache size 0 max 16384 2023-10-14T09:03:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:03:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:03:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:03:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:03:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16e00a1500 msgr2=0x7f16e00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16e00a1500 0x7f16e00a39c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f16f8072fd0 tx=0x7f16e8010040 comp rx=0 tx=0).stop 2023-10-14T09:03:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 msgr2=0x7f16f81a4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:03:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 0x7f16f81a4910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009fd0 tx=0x7f16f0007930 comp rx=0 tx=0).stop 2023-10-14T09:03:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 shutdown_connections 2023-10-14T09:03:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16f8109900 0x7f16f81a4910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f16e00a1500 0x7f16e00a39c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16f8108300 0x7f16f819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 --2- 172.21.15.6:0/4136716878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16f8108f60 0x7f16f819d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:03:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.156+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 >> 172.21.15.6:0/4136716878 conn(0x7f16f806e650 msgr2=0x7f16f810c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:03:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.157+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 shutdown_connections 2023-10-14T09:03:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:03:51.157+0000 7f16fcf46700 1 -- 172.21.15.6:0/4136716878 wait complete. 2023-10-14T09:03:51.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:51 smithi006 ceph-mon[99452]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 696 op/s 2023-10-14T09:03:51.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:51 smithi178 ceph-mon[103612]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 696 op/s 2023-10-14T09:03:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:51 smithi057 ceph-mon[103313]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 696 op/s 2023-10-14T09:03:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:53 smithi006 ceph-mon[99452]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.7 MiB/s wr, 705 op/s 2023-10-14T09:03:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:53 smithi178 ceph-mon[103612]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.7 MiB/s wr, 705 op/s 2023-10-14T09:03:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:53 smithi057 ceph-mon[103313]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.7 MiB/s wr, 705 op/s 2023-10-14T09:03:55.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:55 smithi178 ceph-mon[103612]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 10 MiB/s wr, 744 op/s 2023-10-14T09:03:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:55 smithi057 ceph-mon[103313]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 10 MiB/s wr, 744 op/s 2023-10-14T09:03:55.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 655.0 s, 1724.7 tps, lat 57.983 ms stddev 65.180 2023-10-14T09:03:55.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:55 smithi006 ceph-mon[99452]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 10 MiB/s wr, 744 op/s 2023-10-14T09:03:56.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:56 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:03:56.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:56 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:03:56.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:56 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:03:57.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:57 smithi178 ceph-mon[103612]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 9.9 MiB/s wr, 757 op/s 2023-10-14T09:03:57.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:57 smithi057 ceph-mon[103313]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 9.9 MiB/s wr, 757 op/s 2023-10-14T09:03:57.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:57 smithi006 ceph-mon[99452]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 9.9 MiB/s wr, 757 op/s 2023-10-14T09:03:59.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:03:59 smithi178 ceph-mon[103612]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.4 MiB/s wr, 711 op/s 2023-10-14T09:03:59.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:03:59 smithi057 ceph-mon[103313]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.4 MiB/s wr, 711 op/s 2023-10-14T09:03:59.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:03:59 smithi006 ceph-mon[99452]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.4 MiB/s wr, 711 op/s 2023-10-14T09:04:00.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 660.0 s, 1642.6 tps, lat 60.576 ms stddev 67.681 2023-10-14T09:04:01.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:01 smithi178 ceph-mon[103612]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.5 MiB/s wr, 729 op/s 2023-10-14T09:04:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:01 smithi057 ceph-mon[103313]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.5 MiB/s wr, 729 op/s 2023-10-14T09:04:02.055 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:01 smithi006 ceph-mon[99452]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.5 MiB/s wr, 729 op/s 2023-10-14T09:04:03.892 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:03 smithi178 ceph-mon[103612]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 713 op/s 2023-10-14T09:04:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:03 smithi057 ceph-mon[103313]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 713 op/s 2023-10-14T09:04:03.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:03 smithi006 ceph-mon[99452]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 713 op/s 2023-10-14T09:04:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 -- 172.21.15.6:0/3907850378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f50108fc0 msgr2=0x7f9f5010b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 --2- 172.21.15.6:0/3907850378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f50108fc0 0x7f9f5010b3b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009990 tx=0x7f9f4c009ca0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.310 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 -- 172.21.15.6:0/3907850378 shutdown_connections 2023-10-14T09:04:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 --2- 172.21.15.6:0/3907850378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f5010e270 0x7f9f50110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 --2- 172.21.15.6:0/3907850378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f50108fc0 0x7f9f5010b3b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 --2- 172.21.15.6:0/3907850378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5010b8f0 0x7f9f5010dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 -- 172.21.15.6:0/3907850378 >> 172.21.15.6:0/3907850378 conn(0x7f9f5006dcf0 msgr2=0x7f9f50070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:04.311 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 -- 172.21.15.6:0/3907850378 shutdown_connections 2023-10-14T09:04:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.308+0000 7f9f57636700 1 -- 172.21.15.6:0/3907850378 wait complete. 2023-10-14T09:04:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 Processor -- start 2023-10-14T09:04:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 -- start start 2023-10-14T09:04:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f50108fc0 0x7f9f5019d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 0x7f9f5019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5010e270 0x7f9f501a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f501a4e00 con 0x7f9f5010b8f0 2023-10-14T09:04:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f501b5fe0 con 0x7f9f50108fc0 2023-10-14T09:04:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.309+0000 7f9f57636700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f501b6120 con 0x7f9f5010e270 2023-10-14T09:04:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 0x7f9f5019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 0x7f9f5019d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35634/0 (socket says 172.21.15.6:35634) 2023-10-14T09:04:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1485750354 learned_addr learned my addr 172.21.15.6:0/1485750354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f55bd3700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5010e270 0x7f9f501a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1485750354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5010e270 msgr2=0x7f9f501a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5010e270 0x7f9f501a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1485750354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f50108fc0 msgr2=0x7f9f5019d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f50108fc0 0x7f9f5019d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1485750354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0095f0 con 0x7f9f5010b8f0 2023-10-14T09:04:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 0x7f9f5019d7c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800ba50 tx=0x7f9f4800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f467fc700 1 -- 172.21.15.6:0/1485750354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800ca50 con 0x7f9f5010b8f0 2023-10-14T09:04:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f467fc700 1 -- 172.21.15.6:0/1485750354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f4800cbb0 con 0x7f9f5010b8f0 2023-10-14T09:04:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f467fc700 1 -- 172.21.15.6:0/1485750354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480075b0 con 0x7f9f5010b8f0 2023-10-14T09:04:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.310+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f501b63d0 con 0x7f9f5010b8f0 2023-10-14T09:04:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.311+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f501b6910 con 0x7f9f5010b8f0 2023-10-14T09:04:04.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.314+0000 7f9f467fc700 1 -- 172.21.15.6:0/1485750354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f9f48014440 con 0x7f9f5010b8f0 2023-10-14T09:04:04.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.314+0000 7f9f467fc700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9f3c0a1500 0x7f9f3c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.314+0000 7f9f467fc700 1 -- 172.21.15.6:0/1485750354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9f480cc420 con 0x7f9f5010b8f0 2023-10-14T09:04:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.314+0000 7f9f553d2700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9f3c0a1500 0x7f9f3c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.315+0000 7f9f553d2700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9f3c0a1500 0x7f9f3c0a39c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0098e0 tx=0x7f9f4c005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 Processor -- start 2023-10-14T09:04:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 -- start start 2023-10-14T09:04:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be0204850 0x560be0204c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0205ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0206520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be0179c10 con 0x560be02051b0 2023-10-14T09:04:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be015ec00 con 0x560be02060a0 2023-10-14T09:04:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.316+0000 7f9f63820b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be015c520 con 0x560be0204850 2023-10-14T09:04:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f553d2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be0204850 0x560be0204c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f553d2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be0204850 0x560be0204c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33042/0 (socket says 172.21.15.6:33042) 2023-10-14T09:04:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f553d2700 1 -- 172.21.15.6:0/1928701806 learned_addr learned my addr 172.21.15.6:0/1928701806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0205ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1928701806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be0204850 msgr2=0x560be0204c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be0204850 0x560be0204c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1928701806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 msgr2=0x560be0206520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:04:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0206520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1928701806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560be0115390 con 0x560be02051b0 2023-10-14T09:04:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.317+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0205ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9f480c9f20 tx=0x7f9f48099280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3cc8de5a5e462f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.318+0000 7f9f3b7fe700 1 -- 172.21.15.6:0/1928701806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48099e40 con 0x560be02051b0 2023-10-14T09:04:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.318+0000 7f9f3b7fe700 1 -- 172.21.15.6:0/1928701806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f4800cd20 con 0x560be02051b0 2023-10-14T09:04:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.318+0000 7f9f3b7fe700 1 -- 172.21.15.6:0/1928701806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48097b70 con 0x560be02051b0 2023-10-14T09:04:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 -- 172.21.15.6:0/1928701806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 msgr2=0x560be0205ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0205ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9f480c9f20 tx=0x7f9f48099280 comp rx=0 tx=0).stop 2023-10-14T09:04:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 -- 172.21.15.6:0/1928701806 shutdown_connections 2023-10-14T09:04:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0206520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be0204850 0x560be0204c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1928701806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0205ac0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 -- 172.21.15.6:0/1928701806 >> 172.21.15.6:0/1928701806 conn(0x560be0132d70 msgr2=0x560be01ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 -- 172.21.15.6:0/1928701806 shutdown_connections 2023-10-14T09:04:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 -- 172.21.15.6:0/1928701806 wait complete. 2023-10-14T09:04:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 -- start start 2023-10-14T09:04:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.319+0000 7f9f63820b80 1 Processor -- start 2023-10-14T09:04:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 0x560be020e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02051b0 0x560be020ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0215d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be0157e10 con 0x560be0204850 2023-10-14T09:04:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be00f46b0 con 0x560be02060a0 2023-10-14T09:04:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be00f4350 con 0x560be02051b0 2023-10-14T09:04:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f63820b80 10 client.0 _ll_register_callbacks cb 0x560bdff517a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 0x560be020e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 0x560be020e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35646/0 (socket says 172.21.15.6:35646) 2023-10-14T09:04:04.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 -- 172.21.15.6:0/2687651412 learned_addr learned my addr 172.21.15.6:0/2687651412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02051b0 0x560be020ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f55bd3700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0215d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 -- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02051b0 msgr2=0x560be020ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02051b0 0x560be020ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 -- 172.21.15.6:0/2687651412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 msgr2=0x560be0215d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0215d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 -- 172.21.15.6:0/2687651412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f501b6910 con 0x560be0204850 2023-10-14T09:04:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f553d2700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 0x560be020e780 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c006010 tx=0x7f9f4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c35d73f74e18ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.320+0000 7f9f38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:04:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f38ff9700 1 -- 172.21.15.6:0/2687651412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c02b040 con 0x560be0204850 2023-10-14T09:04:04.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f38ff9700 1 -- 172.21.15.6:0/2687651412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9f4c025630 con 0x560be0204850 2023-10-14T09:04:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560be015ce90 con 0x560be0204850 2023-10-14T09:04:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f38ff9700 1 -- 172.21.15.6:0/2687651412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f4c01d070 con 0x560be0204850 2023-10-14T09:04:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 10 client.16461 fetch_fsmap learned FSMap version 52 2023-10-14T09:04:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x560bdff82d80 con 0x560be0204850 2023-10-14T09:04:04.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f38ff9700 1 -- 172.21.15.6:0/2687651412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560be015ce90 con 0x560be0204850 2023-10-14T09:04:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f38ff9700 1 -- 172.21.15.6:0/2687651412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 52) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f9f4c017760 con 0x560be0204850 2023-10-14T09:04:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 10 client.16461 fetch_fsmap finished waiting for FSMap version 52 2023-10-14T09:04:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 20 client.16461 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:04.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be021a5d0 0x560be021c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 4 client.16461 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:04:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560be01d4bb0 con 0x560be021a5d0 2023-10-14T09:04:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.321+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be021a5d0 0x560be021c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.322+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be021a5d0 0x560be021c9f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c60f3ecc0d8de69e server_cookie=9eb658792ffe2df7 in_seq=0 out_seq=0 2023-10-14T09:04:04.337 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.322+0000 7f9f38ff9700 10 client.16461 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.324+0000 7f9f38ff9700 1 -- 172.21.15.6:0/2687651412 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560be01d4bb0 con 0x560be021a5d0 2023-10-14T09:04:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.324+0000 7f9f38ff9700 10 client.16461 handle_command_reply: tid=0 2023-10-14T09:04:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.324+0000 7f9f63820b80 1 client.16461 shutdown 2023-10-14T09:04:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.324+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 msgr2=0x560be020e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.338 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.324+0000 7f9f63820b80 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 0x560be020e780 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c006010 tx=0x7f9f4c000bc0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 shutdown_connections 2023-10-14T09:04:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be021a5d0 0x560be021c9f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be02060a0 0x560be0215d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be0204850 0x560be020e780 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.339 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 --2- 172.21.15.6:0/2687651412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02051b0 0x560be020ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 >> 172.21.15.6:0/2687651412 conn(0x560be0132d70 msgr2=0x560be01ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f38ff9700 0 client.16461 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 shutdown_connections 2023-10-14T09:04:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 1 -- 172.21.15.6:0/2687651412 wait complete. 2023-10-14T09:04:04.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.325+0000 7f9f63820b80 20 client.16461 trim_cache size 0 max 16384 2023-10-14T09:04:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 Processor -- start 2023-10-14T09:04:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 -- start start 2023-10-14T09:04:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be020d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0215cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0209010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdffd88c0 con 0x560be02051b0 2023-10-14T09:04:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be0205f20 con 0x560be0204850 2023-10-14T09:04:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f63820b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be020e2f0 con 0x560be02060a0 2023-10-14T09:04:04.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.342+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0215cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f553d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be020d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0215cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35656/0 (socket says 172.21.15.6:35656) 2023-10-14T09:04:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1242456866 learned_addr learned my addr 172.21.15.6:0/1242456866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f55bd3700 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0209010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1242456866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 msgr2=0x560be0209010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0209010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1242456866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 msgr2=0x560be020d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be020d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 -- 172.21.15.6:0/1242456866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bdff6bc00 con 0x560be02051b0 2023-10-14T09:04:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0215cc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9f480961b0 tx=0x7f9f48015fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7aafe3d178a84d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f3bfff700 1 -- 172.21.15.6:0/1242456866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48099280 con 0x560be02051b0 2023-10-14T09:04:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f3bfff700 1 -- 172.21.15.6:0/1242456866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f48099740 con 0x560be02051b0 2023-10-14T09:04:04.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.343+0000 7f9f3bfff700 1 -- 172.21.15.6:0/1242456866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480b73b0 con 0x560be02051b0 2023-10-14T09:04:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 -- 172.21.15.6:0/1242456866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 msgr2=0x560be0215cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0215cc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9f480961b0 tx=0x7f9f48015fc0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 -- 172.21.15.6:0/1242456866 shutdown_connections 2023-10-14T09:04:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0209010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be020d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 --2- 172.21.15.6:0/1242456866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0215cc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 -- 172.21.15.6:0/1242456866 >> 172.21.15.6:0/1242456866 conn(0x560be0132d70 msgr2=0x560be021c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.344+0000 7f9f63820b80 1 -- 172.21.15.6:0/1242456866 shutdown_connections 2023-10-14T09:04:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 -- 172.21.15.6:0/1242456866 wait complete. 2023-10-14T09:04:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 -- start start 2023-10-14T09:04:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 Processor -- start 2023-10-14T09:04:04.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be02135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0213b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0214b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be0215080 con 0x560be02051b0 2023-10-14T09:04:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be02151f0 con 0x560be0204850 2023-10-14T09:04:04.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.345+0000 7f9f63820b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560be02153b0 con 0x560be02060a0 2023-10-14T09:04:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f63820b80 10 client.0 _ll_register_callbacks cb 0x560bdff517a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0213b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0213b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35662/0 (socket says 172.21.15.6:35662) 2023-10-14T09:04:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 -- 172.21.15.6:0/4276301378 learned_addr learned my addr 172.21.15.6:0/4276301378 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:04.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f553d2700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be02135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f55bd3700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0214b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 -- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 msgr2=0x560be0214b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0214b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 -- 172.21.15.6:0/4276301378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 msgr2=0x560be02135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:04.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be02135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 -- 172.21.15.6:0/4276301378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560be0115390 con 0x560be02051b0 2023-10-14T09:04:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f54bd1700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0213b30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9f480a1c90 tx=0x7f9f480b91c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af372a8be0bab163 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:04:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f38ff9700 1 -- 172.21.15.6:0/4276301378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48099280 con 0x560be02051b0 2023-10-14T09:04:04.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f38ff9700 1 -- 172.21.15.6:0/4276301378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9f4809d890 con 0x560be02051b0 2023-10-14T09:04:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f4800cd20 con 0x560be02051b0 2023-10-14T09:04:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f38ff9700 1 -- 172.21.15.6:0/4276301378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f480840b0 con 0x560be02051b0 2023-10-14T09:04:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.346+0000 7f9f63820b80 10 client.16467 fetch_fsmap learned FSMap version 52 2023-10-14T09:04:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x560bdffa91f0 con 0x560be02051b0 2023-10-14T09:04:04.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f38ff9700 1 -- 172.21.15.6:0/4276301378 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f4800cd20 con 0x560be02051b0 2023-10-14T09:04:04.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f38ff9700 1 -- 172.21.15.6:0/4276301378 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 52) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f9f480aa080 con 0x560be02051b0 2023-10-14T09:04:04.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 10 client.16467 fetch_fsmap finished waiting for FSMap version 52 2023-10-14T09:04:04.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:04.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 20 client.16467 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:04.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be026eaa0 0x560be0270ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:04.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 4 client.16467 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:04:04.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560be0150df0 con 0x560be026eaa0 2023-10-14T09:04:04.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f553d2700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be026eaa0 0x560be0270ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:04.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f38ff9700 10 client.16467 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:04.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.347+0000 7f9f553d2700 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be026eaa0 0x560be0270ec0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c25269aa57ed854 server_cookie=654c7f54ed46fdb9 in_seq=0 out_seq=0 2023-10-14T09:04:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.362+0000 7f9f38ff9700 1 -- 172.21.15.6:0/4276301378 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560be0150df0 con 0x560be026eaa0 2023-10-14T09:04:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.362+0000 7f9f38ff9700 10 client.16467 handle_command_reply: tid=0 2023-10-14T09:04:04.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.362+0000 7f9f63820b80 1 client.16467 shutdown 2023-10-14T09:04:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 msgr2=0x560be0213b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0213b30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9f480a1c90 tx=0x7f9f480b91c0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 shutdown_connections 2023-10-14T09:04:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x560be026eaa0 0x560be0270ec0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560be02060a0 0x560be0214b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560be0204850 0x560be02135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f38ff9700 0 client.16467 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 --2- 172.21.15.6:0/4276301378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560be02051b0 0x560be0213b30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 >> 172.21.15.6:0/4276301378 conn(0x560be0132d70 msgr2=0x560be020d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 shutdown_connections 2023-10-14T09:04:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.363+0000 7f9f63820b80 1 -- 172.21.15.6:0/4276301378 wait complete. 2023-10-14T09:04:04.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f63820b80 20 client.16467 trim_cache size 0 max 16384 2023-10-14T09:04:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:04:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:04:04.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:04:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:04:04.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9f3c0a1500 msgr2=0x7f9f3c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9f3c0a1500 0x7f9f3c0a39c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0098e0 tx=0x7f9f4c005c00 comp rx=0 tx=0).stop 2023-10-14T09:04:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 msgr2=0x7f9f5019d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 0x7f9f5019d7c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800ba50 tx=0x7f9f4800be10 comp rx=0 tx=0).stop 2023-10-14T09:04:04.370 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 shutdown_connections 2023-10-14T09:04:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5010e270 0x7f9f501a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f9f3c0a1500 0x7f9f3c0a39c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f50108fc0 0x7f9f5019d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 --2- 172.21.15.6:0/1485750354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f5010b8f0 0x7f9f5019d7c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:04.371 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.364+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 >> 172.21.15.6:0/1485750354 conn(0x7f9f5006dcf0 msgr2=0x7f9f5010a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.365+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 shutdown_connections 2023-10-14T09:04:04.372 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:04.365+0000 7f9f57636700 1 -- 172.21.15.6:0/1485750354 wait complete. 2023-10-14T09:04:05.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:05 smithi178 ceph-mon[103612]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 688 op/s 2023-10-14T09:04:05.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:05 smithi057 ceph-mon[103313]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 688 op/s 2023-10-14T09:04:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 665.0 s, 1825.2 tps, lat 54.321 ms stddev 64.924 2023-10-14T09:04:05.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:05 smithi006 ceph-mon[99452]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.6 MiB/s wr, 688 op/s 2023-10-14T09:04:07.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:07 smithi178 ceph-mon[103612]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 642 op/s 2023-10-14T09:04:07.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:07 smithi057 ceph-mon[103313]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 642 op/s 2023-10-14T09:04:07.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:07 smithi006 ceph-mon[99452]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 642 op/s 2023-10-14T09:04:09.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:09 smithi178 ceph-mon[103612]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.2 MiB/s wr, 659 op/s 2023-10-14T09:04:09.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:09 smithi057 ceph-mon[103313]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.2 MiB/s wr, 659 op/s 2023-10-14T09:04:09.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:09 smithi006 ceph-mon[99452]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.2 MiB/s wr, 659 op/s 2023-10-14T09:04:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 670.0 s, 1067.9 tps, lat 93.387 ms stddev 101.768 2023-10-14T09:04:11.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:11 smithi178 ceph-mon[103612]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 700 op/s 2023-10-14T09:04:11.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:11 smithi057 ceph-mon[103313]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 700 op/s 2023-10-14T09:04:11.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:11 smithi006 ceph-mon[99452]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.2 MiB/s wr, 700 op/s 2023-10-14T09:04:13.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:13 smithi178 ceph-mon[103612]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 695 op/s 2023-10-14T09:04:13.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:13 smithi057 ceph-mon[103313]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 695 op/s 2023-10-14T09:04:13.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:13 smithi006 ceph-mon[99452]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 695 op/s 2023-10-14T09:04:15.650 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:15 smithi006 ceph-mon[99452]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 740 op/s 2023-10-14T09:04:15.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:15 smithi057 ceph-mon[103313]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 740 op/s 2023-10-14T09:04:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 675.0 s, 1420.4 tps, lat 71.808 ms stddev 87.911 2023-10-14T09:04:16.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:15 smithi178 ceph-mon[103612]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 740 op/s 2023-10-14T09:04:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 -- 172.21.15.6:0/3369148247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c941000d0 msgr2=0x7f4c94100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3369148247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c941000d0 0x7f4c94100550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009990 tx=0x7f4c80009ca0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 -- 172.21.15.6:0/3369148247 shutdown_connections 2023-10-14T09:04:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3369148247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c94100a90 0x7f4c94100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3369148247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940ff770 0x7f4c940ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3369148247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c941000d0 0x7f4c94100550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 -- 172.21.15.6:0/3369148247 >> 172.21.15.6:0/3369148247 conn(0x7f4c940fb390 msgr2=0x7f4c940fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 -- 172.21.15.6:0/3369148247 shutdown_connections 2023-10-14T09:04:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.539+0000 7f4c9b213700 1 -- 172.21.15.6:0/3369148247 wait complete. 2023-10-14T09:04:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 Processor -- start 2023-10-14T09:04:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 -- start start 2023-10-14T09:04:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940ff770 0x7f4c94198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 0x7f4c941993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94100a90 0x7f4c941a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941a09e0 con 0x7f4c941000d0 2023-10-14T09:04:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941a0b20 con 0x7f4c94100a90 2023-10-14T09:04:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c9b213700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941a0cb0 con 0x7f4c940ff770 2023-10-14T09:04:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c93fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 0x7f4c941993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c997b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94100a90 0x7f4c941a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c93fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 0x7f4c941993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35676/0 (socket says 172.21.15.6:35676) 2023-10-14T09:04:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c93fff700 1 -- 172.21.15.6:0/3071868903 learned_addr learned my addr 172.21.15.6:0/3071868903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c997b0700 1 -- 172.21.15.6:0/3071868903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940ff770 msgr2=0x7f4c94198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c997b0700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940ff770 0x7f4c94198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c997b0700 1 -- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 msgr2=0x7f4c941993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c997b0700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 0x7f4c941993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c997b0700 1 -- 172.21.15.6:0/3071868903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800095f0 con 0x7f4c94100a90 2023-10-14T09:04:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.540+0000 7f4c93fff700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 0x7f4c941993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:04:17.548 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.541+0000 7f4c997b0700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94100a90 0x7f4c941a0410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00be20 tx=0x7f4c8c009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.541+0000 7f4c91ffb700 1 -- 172.21.15.6:0/3071868903 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00cc10 con 0x7f4c94100a90 2023-10-14T09:04:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.541+0000 7f4c91ffb700 1 -- 172.21.15.6:0/3071868903 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c8c00cd70 con 0x7f4c94100a90 2023-10-14T09:04:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.541+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c941a0f90 con 0x7f4c94100a90 2023-10-14T09:04:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.541+0000 7f4c91ffb700 1 -- 172.21.15.6:0/3071868903 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0126c0 con 0x7f4c94100a90 2023-10-14T09:04:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.541+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c941a1490 con 0x7f4c94100a90 2023-10-14T09:04:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.544+0000 7f4c91ffb700 1 -- 172.21.15.6:0/3071868903 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f4c8c012880 con 0x7f4c94100a90 2023-10-14T09:04:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.545+0000 7f4c91ffb700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4c840a1580 0x7f4c840a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.545+0000 7f4c91ffb700 1 -- 172.21.15.6:0/3071868903 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4c8c006e40 con 0x7f4c94100a90 2023-10-14T09:04:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4c98faf700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4c840a1580 0x7f4c840a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 Processor -- start 2023-10-14T09:04:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 -- start start 2023-10-14T09:04:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 0x55958f629460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f6299a0 0x55958f62a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f62ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f595c10 con 0x55958f629040 2023-10-14T09:04:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.546+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f57ac00 con 0x55958f6299a0 2023-10-14T09:04:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f578520 con 0x55958f62a890 2023-10-14T09:04:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4c840a1580 0x7f4c840a3a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4c88005950 tx=0x7f4c880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 0x55958f629460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f6299a0 0x55958f62a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 0x55958f629460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35682/0 (socket says 172.21.15.6:35682) 2023-10-14T09:04:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 -- 172.21.15.6:0/1348048723 learned_addr learned my addr 172.21.15.6:0/1348048723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 -- 172.21.15.6:0/1348048723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 msgr2=0x55958f62ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f62ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 -- 172.21.15.6:0/1348048723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f6299a0 msgr2=0x55958f62a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f6299a0 0x55958f62a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 -- 172.21.15.6:0/1348048723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958f531390 con 0x55958f629040 2023-10-14T09:04:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c93fff700 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f6299a0 0x55958f62a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:04:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.547+0000 7f4c98faf700 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 0x55958f629460 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800ebb0 tx=0x7f4c88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0310cbf47dab91 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.548+0000 7f4c7effd700 1 -- 172.21.15.6:0/1348048723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88010ac0 con 0x55958f629040 2023-10-14T09:04:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.548+0000 7f4c7effd700 1 -- 172.21.15.6:0/1348048723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c88009820 con 0x55958f629040 2023-10-14T09:04:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.548+0000 7f4c7effd700 1 -- 172.21.15.6:0/1348048723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8801c680 con 0x55958f629040 2023-10-14T09:04:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1348048723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 msgr2=0x55958f629460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 0x55958f629460 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800ebb0 tx=0x7f4c88011000 comp rx=0 tx=0).stop 2023-10-14T09:04:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1348048723 shutdown_connections 2023-10-14T09:04:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f62ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f629040 0x55958f629460 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.558 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1348048723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f6299a0 0x55958f62a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1348048723 >> 172.21.15.6:0/1348048723 conn(0x55958f54ed70 msgr2=0x55958f61b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1348048723 shutdown_connections 2023-10-14T09:04:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1348048723 wait complete. 2023-10-14T09:04:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 -- start start 2023-10-14T09:04:17.559 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.549+0000 7f4ca73fdb80 1 Processor -- start 2023-10-14T09:04:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.560 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f6299a0 0x55958f633510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f62a890 0x55958f63a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f573e10 con 0x55958f62a890 2023-10-14T09:04:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f5106b0 con 0x55958f629040 2023-10-14T09:04:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f510350 con 0x55958f6299a0 2023-10-14T09:04:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.550+0000 7f4ca73fdb80 10 client.0 _ll_register_callbacks cb 0x55958f36d7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34446/0 (socket says 172.21.15.6:34446) 2023-10-14T09:04:17.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 -- 172.21.15.6:0/124992111 learned_addr learned my addr 172.21.15.6:0/124992111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:17.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c93fff700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f6299a0 0x55958f633510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c997b0700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f62a890 0x55958f63a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.565 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 -- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f6299a0 msgr2=0x55958f633510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f6299a0 0x55958f633510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 -- 172.21.15.6:0/124992111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f62a890 msgr2=0x55958f63a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f62a890 0x55958f63a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 -- 172.21.15.6:0/124992111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8800e890 con 0x55958f629040 2023-10-14T09:04:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c997b0700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f62a890 0x55958f63a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:04:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c98faf700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632fd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800a010 tx=0x7f4c88010af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff3e9494ce3d73d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.551+0000 7f4c73fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:04:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4c73fff700 1 -- 172.21.15.6:0/124992111 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8802b070 con 0x55958f629040 2023-10-14T09:04:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4c73fff700 1 -- 172.21.15.6:0/124992111 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4c88010dc0 con 0x55958f629040 2023-10-14T09:04:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55958f5f0bb0 con 0x55958f629040 2023-10-14T09:04:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4c73fff700 1 -- 172.21.15.6:0/124992111 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c880097e0 con 0x55958f629040 2023-10-14T09:04:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 10 client.26048 fetch_fsmap learned FSMap version 52 2023-10-14T09:04:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55958f39ed80 con 0x55958f629040 2023-10-14T09:04:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4c73fff700 1 -- 172.21.15.6:0/124992111 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55958f5f0bb0 con 0x55958f629040 2023-10-14T09:04:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4c73fff700 1 -- 172.21.15.6:0/124992111 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 52) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4c88018070 con 0x55958f629040 2023-10-14T09:04:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 10 client.26048 fetch_fsmap finished waiting for FSMap version 52 2023-10-14T09:04:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 10 client.26048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 20 client.26048 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f63ecb0 0x55958f6410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 4 client.26048 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:04:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.552+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55958f56cdf0 con 0x55958f63ecb0 2023-10-14T09:04:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.553+0000 7f4c93fff700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f63ecb0 0x55958f6410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.553+0000 7f4c73fff700 10 client.26048 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.553+0000 7f4c93fff700 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f63ecb0 0x55958f6410d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1495e27826373574 server_cookie=e77df6cf5fb9046c in_seq=0 out_seq=0 2023-10-14T09:04:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4c73fff700 1 -- 172.21.15.6:0/124992111 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55958f56cdf0 con 0x55958f63ecb0 2023-10-14T09:04:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4c73fff700 10 client.26048 handle_command_reply: tid=0 2023-10-14T09:04:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 client.26048 shutdown 2023-10-14T09:04:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 msgr2=0x55958f632fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632fd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800a010 tx=0x7f4c88010af0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 shutdown_connections 2023-10-14T09:04:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f63ecb0 0x55958f6410d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f62a890 0x55958f63a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632fd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4c73fff700 0 client.26048 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/124992111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f6299a0 0x55958f633510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 >> 172.21.15.6:0/124992111 conn(0x55958f54ed70 msgr2=0x55958f61b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 shutdown_connections 2023-10-14T09:04:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/124992111 wait complete. 2023-10-14T09:04:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.554+0000 7f4ca73fdb80 20 client.26048 trim_cache size 0 max 16384 2023-10-14T09:04:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 Processor -- start 2023-10-14T09:04:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 -- start start 2023-10-14T09:04:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.579 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 0x55958f63a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f6332c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f3f48c0 con 0x55958f6299a0 2023-10-14T09:04:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f632480 con 0x55958f629040 2023-10-14T09:04:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.576+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f632b70 con 0x55958f62a890 2023-10-14T09:04:17.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 0x55958f63a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 0x55958f63a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35698/0 (socket says 172.21.15.6:35698) 2023-10-14T09:04:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 -- 172.21.15.6:0/542918463 learned_addr learned my addr 172.21.15.6:0/542918463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c997b0700 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f6332c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 -- 172.21.15.6:0/542918463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 msgr2=0x55958f6332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f6332c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 -- 172.21.15.6:0/542918463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 msgr2=0x55958f632d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 -- 172.21.15.6:0/542918463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55958f387c00 con 0x55958f6299a0 2023-10-14T09:04:17.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c93fff700 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 0x55958f63a510 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55958f641970 tx=0x7f4c80005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1070f9fa109382c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:17.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c7f7fe700 1 -- 172.21.15.6:0/542918463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80027a10 con 0x55958f6299a0 2023-10-14T09:04:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.577+0000 7f4c7f7fe700 1 -- 172.21.15.6:0/542918463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c8001e040 con 0x55958f6299a0 2023-10-14T09:04:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.578+0000 7f4c7f7fe700 1 -- 172.21.15.6:0/542918463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80005470 con 0x55958f6299a0 2023-10-14T09:04:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.578+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/542918463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 msgr2=0x55958f63a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.578+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 0x55958f63a510 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55958f641970 tx=0x7f4c80005fb0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.579+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/542918463 shutdown_connections 2023-10-14T09:04:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.579+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f6332c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.579+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f632d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.579+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/542918463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f6299a0 0x55958f63a510 secure :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55958f641970 tx=0x7f4c80005fb0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.579+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/542918463 >> 172.21.15.6:0/542918463 conn(0x55958f54ed70 msgr2=0x55958f62d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.581+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/542918463 shutdown_connections 2023-10-14T09:04:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.581+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/542918463 wait complete. 2023-10-14T09:04:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.581+0000 7f4ca73fdb80 1 -- start start 2023-10-14T09:04:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.581+0000 7f4ca73fdb80 1 Processor -- start 2023-10-14T09:04:17.586 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f63a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f638800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f638d40 0x55958f6391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f63a860 con 0x55958f638d40 2023-10-14T09:04:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f692a90 con 0x55958f629040 2023-10-14T09:04:17.587 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55958f692bd0 con 0x55958f62a890 2023-10-14T09:04:17.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4ca73fdb80 10 client.0 _ll_register_callbacks cb 0x7f4c8800eab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:17.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f63a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4c98faf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f63a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34460/0 (socket says 172.21.15.6:34460) 2023-10-14T09:04:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4c98faf700 1 -- 172.21.15.6:0/1346719842 learned_addr learned my addr 172.21.15.6:0/1346719842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.582+0000 7f4c997b0700 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f638d40 0x55958f6391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c98faf700 1 -- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 msgr2=0x55958f638800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:04:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c98faf700 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f638800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c98faf700 1 -- 172.21.15.6:0/1346719842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f638d40 msgr2=0x55958f6391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c98faf700 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f638d40 0x55958f6391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c98faf700 1 -- 172.21.15.6:0/1346719842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9410bf00 con 0x55958f629040 2023-10-14T09:04:17.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c98faf700 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f63a1f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4c88005590 tx=0x7f4c88032ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56b9fbec3dae376c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.583+0000 7f4c73fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:04:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4c73fff700 1 -- 172.21.15.6:0/1346719842 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8802b040 con 0x55958f629040 2023-10-14T09:04:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4c73fff700 1 -- 172.21.15.6:0/1346719842 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f4c8801c420 con 0x55958f629040 2023-10-14T09:04:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55958f578e90 con 0x55958f629040 2023-10-14T09:04:17.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4c73fff700 1 -- 172.21.15.6:0/1346719842 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c88025a50 con 0x55958f629040 2023-10-14T09:04:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 10 client.26054 fetch_fsmap learned FSMap version 52 2023-10-14T09:04:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55958f3c51f0 con 0x55958f629040 2023-10-14T09:04:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4c73fff700 1 -- 172.21.15.6:0/1346719842 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55958f578e90 con 0x55958f629040 2023-10-14T09:04:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4c73fff700 1 -- 172.21.15.6:0/1346719842 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 52) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4c88042030 con 0x55958f629040 2023-10-14T09:04:17.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 10 client.26054 fetch_fsmap finished waiting for FSMap version 52 2023-10-14T09:04:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 10 client.26054 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 20 client.26054 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f6942e0 0x55958f696700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 4 client.26054 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:04:17.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.584+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55958f56cb10 con 0x55958f6942e0 2023-10-14T09:04:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.585+0000 7f4c93fff700 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f6942e0 0x55958f696700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.585+0000 7f4c73fff700 10 client.26054 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:17.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.585+0000 7f4c93fff700 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f6942e0 0x55958f696700 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5ea53861ec043 server_cookie=493c971dacd918bf in_seq=0 out_seq=0 2023-10-14T09:04:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.699+0000 7f4c73fff700 1 -- 172.21.15.6:0/1346719842 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55958f56cb10 con 0x55958f6942e0 2023-10-14T09:04:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.699+0000 7f4c73fff700 10 client.26054 handle_command_reply: tid=0 2023-10-14T09:04:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.699+0000 7f4ca73fdb80 1 client.26054 shutdown 2023-10-14T09:04:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 msgr2=0x55958f63a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f63a1f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4c88005590 tx=0x7f4c88032ea0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 shutdown_connections 2023-10-14T09:04:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55958f6942e0 0x55958f696700 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55958f638d40 0x55958f6391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4c73fff700 0 client.26054 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55958f629040 0x55958f63a1f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 --2- 172.21.15.6:0/1346719842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55958f62a890 0x55958f638800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 >> 172.21.15.6:0/1346719842 conn(0x55958f54ed70 msgr2=0x55958f632d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 shutdown_connections 2023-10-14T09:04:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.700+0000 7f4ca73fdb80 1 -- 172.21.15.6:0/1346719842 wait complete. 2023-10-14T09:04:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4ca73fdb80 20 client.26054 trim_cache size 0 max 16384 2023-10-14T09:04:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:04:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:04:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:04:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:04:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4c840a1580 msgr2=0x7f4c840a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4c840a1580 0x7f4c840a3a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4c88005950 tx=0x7f4c880058e0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94100a90 msgr2=0x7f4c941a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94100a90 0x7f4c941a0410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00be20 tx=0x7f4c8c009ed0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 shutdown_connections 2023-10-14T09:04:17.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f4c840a1580 0x7f4c840a3a40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94100a90 0x7f4c941a0410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940ff770 0x7f4c94198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 --2- 172.21.15.6:0/3071868903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c941000d0 0x7f4c941993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 >> 172.21.15.6:0/3071868903 conn(0x7f4c940fb390 msgr2=0x7f4c940fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 shutdown_connections 2023-10-14T09:04:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:17.701+0000 7f4c9b213700 1 -- 172.21.15.6:0/3071868903 wait complete. 2023-10-14T09:04:17.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:17 smithi057 ceph-mon[103313]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 775 op/s 2023-10-14T09:04:17.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:17 smithi006 ceph-mon[99452]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 775 op/s 2023-10-14T09:04:18.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:17 smithi178 ceph-mon[103612]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 775 op/s 2023-10-14T09:04:19.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:19 smithi057 ceph-mon[103313]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 795 op/s 2023-10-14T09:04:19.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:19 smithi006 ceph-mon[99452]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 795 op/s 2023-10-14T09:04:20.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:19 smithi178 ceph-mon[103612]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 795 op/s 2023-10-14T09:04:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 680.0 s, 1530.0 tps, lat 64.934 ms stddev 74.887 2023-10-14T09:04:21.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:20 smithi178 ceph-mon[103612]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 832 op/s 2023-10-14T09:04:21.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:20 smithi057 ceph-mon[103313]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 832 op/s 2023-10-14T09:04:21.246 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:20 smithi006 ceph-mon[99452]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 832 op/s 2023-10-14T09:04:23.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:22 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:23.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:22 smithi178 ceph-mon[103612]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 840 op/s 2023-10-14T09:04:23.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:22 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:23.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:22 smithi057 ceph-mon[103313]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 840 op/s 2023-10-14T09:04:23.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:22 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:23.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:22 smithi006 ceph-mon[99452]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 840 op/s 2023-10-14T09:04:25.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:24 smithi178 ceph-mon[103612]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 813 op/s 2023-10-14T09:04:25.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:24 smithi057 ceph-mon[103313]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 813 op/s 2023-10-14T09:04:25.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:24 smithi006 ceph-mon[99452]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 813 op/s 2023-10-14T09:04:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 685.0 s, 1526.6 tps, lat 65.058 ms stddev 74.006 2023-10-14T09:04:27.699 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:27 smithi057 ceph-mon[103313]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 794 op/s 2023-10-14T09:04:27.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:27 smithi006 ceph-mon[99452]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 794 op/s 2023-10-14T09:04:27.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:27 smithi178 ceph-mon[103612]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 794 op/s 2023-10-14T09:04:29.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:29 smithi057 ceph-mon[103313]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 745 op/s 2023-10-14T09:04:29.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:29 smithi006 ceph-mon[99452]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 745 op/s 2023-10-14T09:04:29.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:29 smithi178 ceph-mon[103612]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 745 op/s 2023-10-14T09:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.866+0000 7f53e024d700 1 -- 172.21.15.6:0/618614137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81020e0 msgr2=0x7f53d8104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.866+0000 7f53e024d700 1 --2- 172.21.15.6:0/618614137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81020e0 0x7f53d8104570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f53c80098f0 tx=0x7f53c8009c00 comp rx=0 tx=0).stop 2023-10-14T09:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.867+0000 7f53e024d700 1 -- 172.21.15.6:0/618614137 shutdown_connections 2023-10-14T09:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.867+0000 7f53e024d700 1 --2- 172.21.15.6:0/618614137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53d8104ab0 0x7f53d8104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.867+0000 7f53e024d700 1 --2- 172.21.15.6:0/618614137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d80ff770 0x7f53d8101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.867+0000 7f53e024d700 1 --2- 172.21.15.6:0/618614137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81020e0 0x7f53d8104570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.867+0000 7f53e024d700 1 -- 172.21.15.6:0/618614137 >> 172.21.15.6:0/618614137 conn(0x7f53d80fb390 msgr2=0x7f53d80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.870+0000 7f53e024d700 1 -- 172.21.15.6:0/618614137 shutdown_connections 2023-10-14T09:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.870+0000 7f53e024d700 1 -- 172.21.15.6:0/618614137 wait complete. 2023-10-14T09:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 Processor -- start 2023-10-14T09:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 -- start start 2023-10-14T09:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53d81020e0 0x7f53d810ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d8104ab0 0x7f53d810b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 0x7f53d81ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d810b920 con 0x7f53d8104ab0 2023-10-14T09:04:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81add70 con 0x7f53d81020e0 2023-10-14T09:04:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.871+0000 7f53e024d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d81adeb0 con 0x7f53d81ab440 2023-10-14T09:04:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 0x7f53d81ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 0x7f53d81ad830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33118/0 (socket says 172.21.15.6:33118) 2023-10-14T09:04:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 -- 172.21.15.6:0/1602525763 learned_addr learned my addr 172.21.15.6:0/1602525763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 -- 172.21.15.6:0/1602525763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53d81020e0 msgr2=0x7f53d810ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53d81020e0 0x7f53d810ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 -- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d8104ab0 msgr2=0x7f53d810b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d8104ab0 0x7f53d810b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.872+0000 7f53de7ea700 1 -- 172.21.15.6:0/1602525763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8009520 con 0x7f53d81ab440 2023-10-14T09:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.874+0000 7f53de7ea700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 0x7f53d81ad830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c110 tx=0x7f53d000c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.874+0000 7f53ceffd700 1 -- 172.21.15.6:0/1602525763 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0017070 con 0x7f53d81ab440 2023-10-14T09:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.874+0000 7f53ceffd700 1 -- 172.21.15.6:0/1602525763 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53d000e050 con 0x7f53d81ab440 2023-10-14T09:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.874+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d81ae0e0 con 0x7f53d81ab440 2023-10-14T09:04:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.874+0000 7f53ceffd700 1 -- 172.21.15.6:0/1602525763 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0007a00 con 0x7f53d81ab440 2023-10-14T09:04:30.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.874+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81ae5c0 con 0x7f53d81ab440 2023-10-14T09:04:30.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.878+0000 7f53ceffd700 1 -- 172.21.15.6:0/1602525763 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f53d0007c70 con 0x7f53d81ab440 2023-10-14T09:04:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 Processor -- start 2023-10-14T09:04:30.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 -- start start 2023-10-14T09:04:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca5dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca5eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca5f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc9d2c10 con 0x55fcfca5d850 2023-10-14T09:04:30.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc9b7c00 con 0x55fcfca5e1b0 2023-10-14T09:04:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.879+0000 7f53ec437b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc9b5520 con 0x55fcfca5f0a0 2023-10-14T09:04:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ceffd700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f53c40a1480 0x7f53c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca5eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53dd7e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca5dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53dd7e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca5dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35718/0 (socket says 172.21.15.6:35718) 2023-10-14T09:04:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca5eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34478/0 (socket says 172.21.15.6:34478) 2023-10-14T09:04:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53dd7e8700 1 -- 172.21.15.6:0/3030557215 learned_addr learned my addr 172.21.15.6:0/3030557215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:30.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53de7ea700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f53c40a1480 0x7f53c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca5f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ceffd700 1 -- 172.21.15.6:0/1602525763 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f53d00cc990 con 0x7f53d81ab440 2023-10-14T09:04:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3030557215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 msgr2=0x55fcfca5f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca5f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3030557215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 msgr2=0x55fcfca5dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca5dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3030557215 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcfc96e390 con 0x55fcfca5e1b0 2023-10-14T09:04:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca5dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:04:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.880+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca5eac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f53d8068520 tx=0x7f53d4009a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f747e24b478183 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:30.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.881+0000 7f53de7ea700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f53c40a1480 0x7f53c40a3940 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f53d0099c40 tx=0x7f53d0065060 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.881+0000 7f53c3fff700 1 -- 172.21.15.6:0/3030557215 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011830 con 0x55fcfca5e1b0 2023-10-14T09:04:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.881+0000 7f53c3fff700 1 -- 172.21.15.6:0/3030557215 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53d4011e50 con 0x55fcfca5e1b0 2023-10-14T09:04:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.881+0000 7f53c3fff700 1 -- 172.21.15.6:0/3030557215 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4010e10 con 0x55fcfca5e1b0 2023-10-14T09:04:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.881+0000 7f53ec437b80 1 -- 172.21.15.6:0/3030557215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 msgr2=0x55fcfca5eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.881+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca5eac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f53d8068520 tx=0x7f53d4009a50 comp rx=0 tx=0).stop 2023-10-14T09:04:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 -- 172.21.15.6:0/3030557215 shutdown_connections 2023-10-14T09:04:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca5f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca5dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3030557215 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca5eac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 -- 172.21.15.6:0/3030557215 >> 172.21.15.6:0/3030557215 conn(0x55fcfc98bd70 msgr2=0x55fcfca58c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 -- 172.21.15.6:0/3030557215 shutdown_connections 2023-10-14T09:04:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 -- 172.21.15.6:0/3030557215 wait complete. 2023-10-14T09:04:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.882+0000 7f53ec437b80 1 -- start start 2023-10-14T09:04:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 Processor -- start 2023-10-14T09:04:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca67700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 0x55fcfca67c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc9b0e10 con 0x55fcfca5d850 2023-10-14T09:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc94d6b0 con 0x55fcfca5f0a0 2023-10-14T09:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc94d350 con 0x55fcfca5e1b0 2023-10-14T09:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.883+0000 7f53ec437b80 10 client.0 _ll_register_callbacks cb 0x55fcfc7aa7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 0x55fcfca67c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 0x55fcfca67c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33130/0 (socket says 172.21.15.6:33130) 2023-10-14T09:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 -- 172.21.15.6:0/1569362935 learned_addr learned my addr 172.21.15.6:0/1569362935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 -- 172.21.15.6:0/1569362935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 msgr2=0x55fcfca6ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 -- 172.21.15.6:0/1569362935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 msgr2=0x55fcfca67700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca67700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 -- 172.21.15.6:0/1569362935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d8105a60 con 0x55fcfca5e1b0 2023-10-14T09:04:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 0x55fcfca67c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53d40105e0 tx=0x7f53d4010610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a29737cd6146bc39 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:04:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53c17fa700 1 -- 172.21.15.6:0/1569362935 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011630 con 0x55fcfca5e1b0 2023-10-14T09:04:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53c17fa700 1 -- 172.21.15.6:0/1569362935 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f53d4011790 con 0x55fcfca5e1b0 2023-10-14T09:04:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.884+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcfc9b5e90 con 0x55fcfca5e1b0 2023-10-14T09:04:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.885+0000 7f53c17fa700 1 -- 172.21.15.6:0/1569362935 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d4011950 con 0x55fcfca5e1b0 2023-10-14T09:04:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.885+0000 7f53ec437b80 10 client.26098 fetch_fsmap learned FSMap version 53 2023-10-14T09:04:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.885+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7f53d4009420 con 0x55fcfca5e1b0 2023-10-14T09:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.885+0000 7f53c17fa700 1 -- 172.21.15.6:0/1569362935 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fcfc9b5e90 con 0x55fcfca5e1b0 2023-10-14T09:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.885+0000 7f53c17fa700 1 -- 172.21.15.6:0/1569362935 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 53) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f53d401a420 con 0x55fcfca5e1b0 2023-10-14T09:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53ec437b80 10 client.26098 fetch_fsmap finished waiting for FSMap version 53 2023-10-14T09:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53ec437b80 10 client.26098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53ec437b80 20 client.26098 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53ec437b80 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfca733f0 0x55fcfca75810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53ec437b80 4 client.26098 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcfca2dbb0 con 0x55fcfca733f0 2023-10-14T09:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.886+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfca733f0 0x55fcfca75810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfca733f0 0x55fcfca75810 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9cbe59c0b71fedd server_cookie=18c04c908ec46e4f in_seq=0 out_seq=0 2023-10-14T09:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53c17fa700 10 client.26098 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53c17fa700 1 -- 172.21.15.6:0/1569362935 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fcfca2dbb0 con 0x55fcfca733f0 2023-10-14T09:04:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53c17fa700 10 client.26098 handle_command_reply: tid=0 2023-10-14T09:04:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53ec437b80 1 client.26098 shutdown 2023-10-14T09:04:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 msgr2=0x55fcfca67c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.887+0000 7f53ec437b80 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 0x55fcfca67c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53d40105e0 tx=0x7f53d4010610 comp rx=0 tx=0).stop 2023-10-14T09:04:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 shutdown_connections 2023-10-14T09:04:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfca733f0 0x55fcfca75810 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca67700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53c17fa700 0 client.26098 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 --2- 172.21.15.6:0/1569362935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5e1b0 0x55fcfca67c40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 >> 172.21.15.6:0/1569362935 conn(0x55fcfc98bd70 msgr2=0x55fcfca58830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 shutdown_connections 2023-10-14T09:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 1 -- 172.21.15.6:0/1569362935 wait complete. 2023-10-14T09:04:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.888+0000 7f53ec437b80 20 client.26098 trim_cache size 0 max 16384 2023-10-14T09:04:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.908+0000 7f53ec437b80 1 Processor -- start 2023-10-14T09:04:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.908+0000 7f53ec437b80 1 -- start start 2023-10-14T09:04:30.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.908+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca67c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ec437b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfc8318c0 con 0x55fcfca5d850 2023-10-14T09:04:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ec437b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfca5ef20 con 0x55fcfca5e1b0 2023-10-14T09:04:30.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ec437b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfca66bb0 con 0x55fcfca5f0a0 2023-10-14T09:04:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35734/0 (socket says 172.21.15.6:35734) 2023-10-14T09:04:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 -- 172.21.15.6:0/3977957342 learned_addr learned my addr 172.21.15.6:0/3977957342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca67c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 -- 172.21.15.6:0/3977957342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 msgr2=0x55fcfca67c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca67c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 -- 172.21.15.6:0/3977957342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 msgr2=0x55fcfca6ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 -- 172.21.15.6:0/3977957342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcfc7dbd80 con 0x55fcfca5d850 2023-10-14T09:04:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:04:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca676e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f53c80098f0 tx=0x7f53c800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3443254f77b74c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.909+0000 7f53ccff9700 1 -- 172.21.15.6:0/3977957342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c802ccd0 con 0x55fcfca5d850 2023-10-14T09:04:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ccff9700 1 -- 172.21.15.6:0/3977957342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53c802ce30 con 0x55fcfca5d850 2023-10-14T09:04:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ccff9700 1 -- 172.21.15.6:0/3977957342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c800b560 con 0x55fcfca5d850 2023-10-14T09:04:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 -- 172.21.15.6:0/3977957342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 msgr2=0x55fcfca676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca676e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f53c80098f0 tx=0x7f53c800bef0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 -- 172.21.15.6:0/3977957342 shutdown_connections 2023-10-14T09:04:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5f0a0 0x55fcfca67c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5d850 0x55fcfca676e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3977957342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 -- 172.21.15.6:0/3977957342 >> 172.21.15.6:0/3977957342 conn(0x55fcfc98bd70 msgr2=0x55fcfca62000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 -- 172.21.15.6:0/3977957342 shutdown_connections 2023-10-14T09:04:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.910+0000 7f53ec437b80 1 -- 172.21.15.6:0/3977957342 wait complete. 2023-10-14T09:04:30.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 -- start start 2023-10-14T09:04:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 Processor -- start 2023-10-14T09:04:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5d850 0x55fcfca6e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfca6d220 con 0x55fcfca5e1b0 2023-10-14T09:04:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfca6d390 con 0x55fcfca5f0a0 2023-10-14T09:04:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfca6d550 con 0x55fcfca5d850 2023-10-14T09:04:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ec437b80 10 client.0 _ll_register_callbacks cb 0x7f53c8009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ddfe9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53dd7e8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5d850 0x55fcfca6e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ddfe9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35742/0 (socket says 172.21.15.6:35742) 2023-10-14T09:04:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3797501516 learned_addr learned my addr 172.21.15.6:0/3797501516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.911+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5d850 msgr2=0x55fcfca6e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5d850 0x55fcfca6e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3797501516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 msgr2=0x55fcfca6cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ddfe9700 1 -- 172.21.15.6:0/3797501516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c802eaf0 con 0x55fcfca5e1b0 2023-10-14T09:04:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5d850 0x55fcfca6e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:04:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ddfe9700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ea70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009a90 tx=0x7f53d401a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755543170bfbea3f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:04:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53c17fa700 1 -- 172.21.15.6:0/3797501516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4033070 con 0x55fcfca5e1b0 2023-10-14T09:04:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53c17fa700 1 -- 172.21.15.6:0/3797501516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f53d4000e40 con 0x55fcfca5e1b0 2023-10-14T09:04:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53d4011e50 con 0x55fcfca5e1b0 2023-10-14T09:04:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53c17fa700 1 -- 172.21.15.6:0/3797501516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d40106d0 con 0x55fcfca5e1b0 2023-10-14T09:04:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ec437b80 10 client.16494 fetch_fsmap learned FSMap version 53 2023-10-14T09:04:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x55fcfc7c4c00 con 0x55fcfca5e1b0 2023-10-14T09:04:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.912+0000 7f53c17fa700 1 -- 172.21.15.6:0/3797501516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53d403d020 con 0x55fcfca5e1b0 2023-10-14T09:04:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53c17fa700 1 -- 172.21.15.6:0/3797501516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 53) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f53d4036030 con 0x55fcfca5e1b0 2023-10-14T09:04:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53ec437b80 10 client.16494 fetch_fsmap finished waiting for FSMap version 53 2023-10-14T09:04:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53ec437b80 10 client.16494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53ec437b80 20 client.16494 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:30.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfcac82b0 0x55fcfcaca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53ec437b80 4 client.16494 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:04:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fcfc9a9df0 con 0x55fcfcac82b0 2023-10-14T09:04:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.913+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfcac82b0 0x55fcfcaca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.914+0000 7f53c17fa700 10 client.16494 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:30.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.914+0000 7f53dd7e8700 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfcac82b0 0x55fcfcaca6d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6708e6d9d6b5b94d server_cookie=dccd10a8c2d0bed4 in_seq=0 out_seq=0 2023-10-14T09:04:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.928+0000 7f53c17fa700 1 -- 172.21.15.6:0/3797501516 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fcfc9a9df0 con 0x55fcfcac82b0 2023-10-14T09:04:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.928+0000 7f53c17fa700 10 client.16494 handle_command_reply: tid=0 2023-10-14T09:04:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.928+0000 7f53ec437b80 1 client.16494 shutdown 2023-10-14T09:04:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 msgr2=0x55fcfca6ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ea70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009a90 tx=0x7f53d401a650 comp rx=0 tx=0).stop 2023-10-14T09:04:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 shutdown_connections 2023-10-14T09:04:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55fcfcac82b0 0x55fcfcaca6d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fcfca5f0a0 0x55fcfca6cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcfca5d850 0x55fcfca6e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 --2- 172.21.15.6:0/3797501516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fcfca5e1b0 0x55fcfca6ea70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 >> 172.21.15.6:0/3797501516 conn(0x55fcfc98bd70 msgr2=0x55fcfca676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53c17fa700 0 client.16494 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 shutdown_connections 2023-10-14T09:04:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 1 -- 172.21.15.6:0/3797501516 wait complete. 2023-10-14T09:04:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53ec437b80 20 client.16494 trim_cache size 0 max 16384 2023-10-14T09:04:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:04:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:04:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:04:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:04:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f53c40a1480 msgr2=0x7f53c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f53c40a1480 0x7f53c40a3940 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f53d0099c40 tx=0x7f53d0065060 comp rx=0 tx=0).stop 2023-10-14T09:04:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 msgr2=0x7f53d81ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 0x7f53d81ad830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c110 tx=0x7f53d000c4d0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 shutdown_connections 2023-10-14T09:04:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d81ab440 0x7f53d81ad830 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f53c40a1480 0x7f53c40a3940 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53d81020e0 0x7f53d810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.929+0000 7f53e024d700 1 --2- 172.21.15.6:0/1602525763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53d8104ab0 0x7f53d810b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.930+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 >> 172.21.15.6:0/1602525763 conn(0x7f53d80fb390 msgr2=0x7f53d8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.930+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 shutdown_connections 2023-10-14T09:04:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:30.930+0000 7f53e024d700 1 -- 172.21.15.6:0/1602525763 wait complete. 2023-10-14T09:04:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 690.0 s, 1129.2 tps, lat 88.254 ms stddev 181.333 2023-10-14T09:04:31.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:31 smithi057 ceph-mon[103313]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.03k op/s 2023-10-14T09:04:31.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:31 smithi006 ceph-mon[99452]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.03k op/s 2023-10-14T09:04:31.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:31 smithi178 ceph-mon[103612]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.03k op/s 2023-10-14T09:04:33.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:33 smithi057 ceph-mon[103313]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 1.28k op/s 2023-10-14T09:04:33.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:33 smithi006 ceph-mon[99452]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 1.28k op/s 2023-10-14T09:04:33.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:33 smithi178 ceph-mon[103612]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 24 MiB/s wr, 1.28k op/s 2023-10-14T09:04:35.696 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:35 smithi057 ceph-mon[103313]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2023-10-14T09:04:35.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:35 smithi006 ceph-mon[99452]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2023-10-14T09:04:35.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:35 smithi178 ceph-mon[103612]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2023-10-14T09:04:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 695.0 s, 1669.4 tps, lat 60.388 ms stddev 84.083 2023-10-14T09:04:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:37 smithi057 ceph-mon[103313]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 1.90k op/s 2023-10-14T09:04:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:37 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:37.734 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:37 smithi006 ceph-mon[99452]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 1.90k op/s 2023-10-14T09:04:37.735 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:37 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:37 smithi178 ceph-mon[103612]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 MiB/s wr, 1.90k op/s 2023-10-14T09:04:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:37 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:39.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:39 smithi057 ceph-mon[103313]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 MiB/s wr, 1.83k op/s 2023-10-14T09:04:39.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:39 smithi006 ceph-mon[99452]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 MiB/s wr, 1.83k op/s 2023-10-14T09:04:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:39 smithi178 ceph-mon[103612]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 MiB/s wr, 1.83k op/s 2023-10-14T09:04:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 700.0 s, 1713.2 tps, lat 58.186 ms stddev 64.344 2023-10-14T09:04:41.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:41 smithi057 ceph-mon[103313]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.90k op/s 2023-10-14T09:04:41.754 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:41 smithi006 ceph-mon[99452]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.90k op/s 2023-10-14T09:04:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:41 smithi178 ceph-mon[103612]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.90k op/s 2023-10-14T09:04:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:43 smithi057 ceph-mon[103313]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 1.57k op/s 2023-10-14T09:04:43.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:43 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:04:43.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:43 smithi006 ceph-mon[99452]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 1.57k op/s 2023-10-14T09:04:43.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:43 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:04:43.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:43 smithi178 ceph-mon[103612]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 26 MiB/s wr, 1.57k op/s 2023-10-14T09:04:43.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:43 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:04:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/4052446186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 msgr2=0x7f2f88102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/4052446186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88102500 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009990 tx=0x7f2f7c009ca0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/4052446186 shutdown_connections 2023-10-14T09:04:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/4052446186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88102a40 0x7f2f88109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/4052446186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f88100ea0 0x7f2f881012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/4052446186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88102500 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/4052446186 >> 172.21.15.6:0/4052446186 conn(0x7f2f880fc460 msgr2=0x7f2f880fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/4052446186 shutdown_connections 2023-10-14T09:04:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.112+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/4052446186 wait complete. 2023-10-14T09:04:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.113+0000 7f2f8cf3e700 1 Processor -- start 2023-10-14T09:04:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 -- start start 2023-10-14T09:04:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88100ea0 0x7f2f88196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f88102a40 0x7f2f8819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8819e760 con 0x7f2f88102080 2023-10-14T09:04:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8819e8d0 con 0x7f2f88102a40 2023-10-14T09:04:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f8cf3e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8819ea90 con 0x7f2f88100ea0 2023-10-14T09:04:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35754/0 (socket says 172.21.15.6:35754) 2023-10-14T09:04:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f85d9b700 1 -- 172.21.15.6:0/2111620005 learned_addr learned my addr 172.21.15.6:0/2111620005 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.114+0000 7f2f86d9d700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f88102a40 0x7f2f8819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f85d9b700 1 -- 172.21.15.6:0/2111620005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88100ea0 msgr2=0x7f2f88196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f8659c700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88100ea0 0x7f2f88196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88100ea0 0x7f2f88196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f85d9b700 1 -- 172.21.15.6:0/2111620005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f88102a40 msgr2=0x7f2f8819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f88102a40 0x7f2f8819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f85d9b700 1 -- 172.21.15.6:0/2111620005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0095f0 con 0x7f2f88102080 2023-10-14T09:04:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88197160 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c000 tx=0x7f2f7c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f777fe700 1 -- 172.21.15.6:0/2111620005 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00fbf0 con 0x7f2f88102080 2023-10-14T09:04:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8806a8d0 con 0x7f2f88102080 2023-10-14T09:04:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f777fe700 1 -- 172.21.15.6:0/2111620005 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7c02e070 con 0x7f2f88102080 2023-10-14T09:04:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f777fe700 1 -- 172.21.15.6:0/2111620005 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c017650 con 0x7f2f88102080 2023-10-14T09:04:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.115+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8806ad80 con 0x7f2f88102080 2023-10-14T09:04:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.118+0000 7f2f777fe700 1 -- 172.21.15.6:0/2111620005 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2f7c030070 con 0x7f2f88102080 2023-10-14T09:04:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.119+0000 7f2f777fe700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f700a1480 0x7f2f700a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.119+0000 7f2f777fe700 1 -- 172.21.15.6:0/2111620005 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2f7c0df0e0 con 0x7f2f88102080 2023-10-14T09:04:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.119+0000 7f2f8659c700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f700a1480 0x7f2f700a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.119+0000 7f2f8659c700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f700a1480 0x7f2f700a3940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2f881980f0 tx=0x7f2f78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.120+0000 7f2f99128b80 1 Processor -- start 2023-10-14T09:04:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 -- start start 2023-10-14T09:04:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da2e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da2eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da2f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d99ec10 con 0x56551da2f4b0 2023-10-14T09:04:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d983c00 con 0x56551da2e5c0 2023-10-14T09:04:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f99128b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d981520 con 0x56551da2dc60 2023-10-14T09:04:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da2eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da2e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f86d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da2f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da2e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33162/0 (socket says 172.21.15.6:33162) 2023-10-14T09:04:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.121+0000 7f2f8659c700 1 -- 172.21.15.6:0/45878780 learned_addr learned my addr 172.21.15.6:0/45878780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f8659c700 1 -- 172.21.15.6:0/45878780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 msgr2=0x56551da2eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f8659c700 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da2eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f8659c700 1 -- 172.21.15.6:0/45878780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 msgr2=0x56551da2f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f8659c700 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da2f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f8659c700 1 -- 172.21.15.6:0/45878780 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56551d93a390 con 0x56551da2dc60 2023-10-14T09:04:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f8659c700 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da2e080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f78010c00 tx=0x7f2f78009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9447c46e16457570 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.122+0000 7f2f74ff9700 1 -- 172.21.15.6:0/45878780 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78012ac0 con 0x56551da2dc60 2023-10-14T09:04:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f74ff9700 1 -- 172.21.15.6:0/45878780 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f78012c20 con 0x56551da2dc60 2023-10-14T09:04:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f74ff9700 1 -- 172.21.15.6:0/45878780 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7801e610 con 0x56551da2dc60 2023-10-14T09:04:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 -- 172.21.15.6:0/45878780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 msgr2=0x56551da2e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da2e080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f78010c00 tx=0x7f2f78009f90 comp rx=0 tx=0).stop 2023-10-14T09:04:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 -- 172.21.15.6:0/45878780 shutdown_connections 2023-10-14T09:04:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da2f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da2e080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 --2- 172.21.15.6:0/45878780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da2eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 -- 172.21.15.6:0/45878780 >> 172.21.15.6:0/45878780 conn(0x56551d957d70 msgr2=0x56551da24c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.123+0000 7f2f99128b80 1 -- 172.21.15.6:0/45878780 shutdown_connections 2023-10-14T09:04:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 -- 172.21.15.6:0/45878780 wait complete. 2023-10-14T09:04:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 -- start start 2023-10-14T09:04:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 Processor -- start 2023-10-14T09:04:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da37bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da38110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da3f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d97ce10 con 0x56551da2f4b0 2023-10-14T09:04:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d9196b0 con 0x56551da2e5c0 2023-10-14T09:04:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d919350 con 0x56551da2dc60 2023-10-14T09:04:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f99128b80 10 client.0 _ll_register_callbacks cb 0x56551d7767a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da37bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da38110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da38110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34526/0 (socket says 172.21.15.6:34526) 2023-10-14T09:04:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da37bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33168/0 (socket says 172.21.15.6:33168) 2023-10-14T09:04:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.124+0000 7f2f85d9b700 1 -- 172.21.15.6:0/1215021423 learned_addr learned my addr 172.21.15.6:0/1215021423 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f86d9d700 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da3f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f85d9b700 1 -- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 msgr2=0x56551da37bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da37bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f85d9b700 1 -- 172.21.15.6:0/1215021423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 msgr2=0x56551da3f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da3f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f85d9b700 1 -- 172.21.15.6:0/1215021423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f780108b0 con 0x56551da2e5c0 2023-10-14T09:04:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da38110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0ac420 tx=0x7f2f7c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1c2d1cf53b92f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:04:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f6dffb700 1 -- 172.21.15.6:0/1215021423 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0b4500 con 0x56551da2e5c0 2023-10-14T09:04:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f6dffb700 1 -- 172.21.15.6:0/1215021423 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2f7c0acb90 con 0x56551da2e5c0 2023-10-14T09:04:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56551d981e90 con 0x56551da2e5c0 2023-10-14T09:04:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f6dffb700 1 -- 172.21.15.6:0/1215021423 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7c0abdf0 con 0x56551da2e5c0 2023-10-14T09:04:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f99128b80 10 client.26078 fetch_fsmap learned FSMap version 54 2023-10-14T09:04:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.125+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x56551d7a7d80 con 0x56551da2e5c0 2023-10-14T09:04:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f6dffb700 1 -- 172.21.15.6:0/1215021423 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56551d981e90 con 0x56551da2e5c0 2023-10-14T09:04:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f6dffb700 1 -- 172.21.15.6:0/1215021423 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 54) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2f7c0a8280 con 0x56551da2e5c0 2023-10-14T09:04:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f99128b80 10 client.26078 fetch_fsmap finished waiting for FSMap version 54 2023-10-14T09:04:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f99128b80 10 client.26078 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f99128b80 20 client.26078 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f99128b80 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da43660 0x56551da45a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f99128b80 4 client.26078 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:04:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56551d9f9bb0 con 0x56551da43660 2023-10-14T09:04:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f8659c700 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da43660 0x56551da45a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f6dffb700 10 client.26078 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.126+0000 7f2f8659c700 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da43660 0x56551da45a80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44df20be1679624 server_cookie=440af59546d80bd in_seq=0 out_seq=0 2023-10-14T09:04:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f6dffb700 1 -- 172.21.15.6:0/1215021423 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56551d9f9bb0 con 0x56551da43660 2023-10-14T09:04:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f6dffb700 10 client.26078 handle_command_reply: tid=0 2023-10-14T09:04:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 client.26078 shutdown 2023-10-14T09:04:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 msgr2=0x56551da38110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da38110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0ac420 tx=0x7f2f7c009ca0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 shutdown_connections 2023-10-14T09:04:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da43660 0x56551da45a80 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2f4b0 0x56551da3f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f6dffb700 0 client.26078 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da37bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 --2- 172.21.15.6:0/1215021423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2e5c0 0x56551da38110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 >> 172.21.15.6:0/1215021423 conn(0x56551d957d70 msgr2=0x56551da24830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 shutdown_connections 2023-10-14T09:04:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 1 -- 172.21.15.6:0/1215021423 wait complete. 2023-10-14T09:04:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.127+0000 7f2f99128b80 20 client.26078 trim_cache size 0 max 16384 2023-10-14T09:04:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 Processor -- start 2023-10-14T09:04:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 -- start start 2023-10-14T09:04:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 0x56551da3f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2e5c0 0x56551da3f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da32490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551d7fd8c0 con 0x56551da2dc60 2023-10-14T09:04:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551da2ed60 con 0x56551da2f4b0 2023-10-14T09:04:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f99128b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551da244b0 con 0x56551da2e5c0 2023-10-14T09:04:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 0x56551da3f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2e5c0 0x56551da3f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f8659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 0x56551da3f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35774/0 (socket says 172.21.15.6:35774) 2023-10-14T09:04:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.149+0000 7f2f8659c700 1 -- 172.21.15.6:0/523405193 learned_addr learned my addr 172.21.15.6:0/523405193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f86d9d700 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da32490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f85d9b700 1 -- 172.21.15.6:0/523405193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 msgr2=0x56551da32490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da32490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f85d9b700 1 -- 172.21.15.6:0/523405193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 msgr2=0x56551da3f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 0x56551da3f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f85d9b700 1 -- 172.21.15.6:0/523405193 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56551d790c00 con 0x56551da2e5c0 2023-10-14T09:04:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f8659c700 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 0x56551da3f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:04:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2e5c0 0x56551da3f110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0ac190 tx=0x7f2f7c0aaa40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5900995d08a8d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f757fa700 1 -- 172.21.15.6:0/523405193 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0a8480 con 0x56551da2e5c0 2023-10-14T09:04:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f757fa700 1 -- 172.21.15.6:0/523405193 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7c0abdf0 con 0x56551da2e5c0 2023-10-14T09:04:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.150+0000 7f2f757fa700 1 -- 172.21.15.6:0/523405193 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0b4540 con 0x56551da2e5c0 2023-10-14T09:04:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 -- 172.21.15.6:0/523405193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2e5c0 msgr2=0x56551da3f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2e5c0 0x56551da3f110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0ac190 tx=0x7f2f7c0aaa40 comp rx=0 tx=0).stop 2023-10-14T09:04:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 -- 172.21.15.6:0/523405193 shutdown_connections 2023-10-14T09:04:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da32490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2dc60 0x56551da3f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 --2- 172.21.15.6:0/523405193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2e5c0 0x56551da3f110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 -- 172.21.15.6:0/523405193 >> 172.21.15.6:0/523405193 conn(0x56551d957d70 msgr2=0x56551da367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 -- 172.21.15.6:0/523405193 shutdown_connections 2023-10-14T09:04:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.151+0000 7f2f99128b80 1 -- 172.21.15.6:0/523405193 wait complete. 2023-10-14T09:04:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 -- start start 2023-10-14T09:04:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 Processor -- start 2023-10-14T09:04:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da3c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 0x56551da3cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da3def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551da3e430 con 0x56551da2e5c0 2023-10-14T09:04:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551da3e5a0 con 0x56551da2f4b0 2023-10-14T09:04:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551da3e760 con 0x56551da2dc60 2023-10-14T09:04:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.152+0000 7f2f99128b80 10 client.0 _ll_register_callbacks cb 0x7f2f7c0a88a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 0x56551da3cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 0x56551da3cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35782/0 (socket says 172.21.15.6:35782) 2023-10-14T09:04:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 -- 172.21.15.6:0/4212689946 learned_addr learned my addr 172.21.15.6:0/4212689946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 -- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 msgr2=0x56551da3c9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:04:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da3c9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 -- 172.21.15.6:0/4212689946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 msgr2=0x56551da3def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da3def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.153+0000 7f2f85d9b700 1 -- 172.21.15.6:0/4212689946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56551d93a390 con 0x56551da2e5c0 2023-10-14T09:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f85d9b700 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 0x56551da3cee0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0aa7e0 tx=0x7f2f7c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103483648e6abad3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f6dffb700 1 -- 172.21.15.6:0/4212689946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0ac490 con 0x56551da2e5c0 2023-10-14T09:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f6dffb700 1 -- 172.21.15.6:0/4212689946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2f7c0ca020 con 0x56551da2e5c0 2023-10-14T09:04:44.164 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f78012c20 con 0x56551da2e5c0 2023-10-14T09:04:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f6dffb700 1 -- 172.21.15.6:0/4212689946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7c0acb90 con 0x56551da2e5c0 2023-10-14T09:04:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f99128b80 10 client.16512 fetch_fsmap learned FSMap version 54 2023-10-14T09:04:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x56551d7a7d80 con 0x56551da2e5c0 2023-10-14T09:04:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.154+0000 7f2f6dffb700 1 -- 172.21.15.6:0/4212689946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f78012c20 con 0x56551da2e5c0 2023-10-14T09:04:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f6dffb700 1 -- 172.21.15.6:0/4212689946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 54) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2f7c0ab3f0 con 0x56551da2e5c0 2023-10-14T09:04:44.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f99128b80 10 client.16512 fetch_fsmap finished waiting for FSMap version 54 2023-10-14T09:04:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f99128b80 10 client.16512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f99128b80 20 client.16512 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f99128b80 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da97840 0x56551da99c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f99128b80 4 client.16512 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:04:44.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56551d975df0 con 0x56551da97840 2023-10-14T09:04:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f8659c700 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da97840 0x56551da99c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f6dffb700 10 client.16512 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:44.167 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.155+0000 7f2f8659c700 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da97840 0x56551da99c30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0aa9c759f6899c server_cookie=7cd5e29608c809a7 in_seq=0 out_seq=0 2023-10-14T09:04:44.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f6dffb700 1 -- 172.21.15.6:0/4212689946 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56551d975df0 con 0x56551da97840 2023-10-14T09:04:44.228 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f6dffb700 10 client.16512 handle_command_reply: tid=0 2023-10-14T09:04:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 client.16512 shutdown 2023-10-14T09:04:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 msgr2=0x56551da3cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 0x56551da3cee0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0aa7e0 tx=0x7f2f7c009310 comp rx=0 tx=0).stop 2023-10-14T09:04:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 shutdown_connections 2023-10-14T09:04:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x56551da97840 0x56551da99c30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56551da2f4b0 0x56551da3def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56551da2dc60 0x56551da3c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 --2- 172.21.15.6:0/4212689946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56551da2e5c0 0x56551da3cee0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 >> 172.21.15.6:0/4212689946 conn(0x56551d957d70 msgr2=0x56551da3f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f6dffb700 0 client.16512 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:44.231 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 shutdown_connections 2023-10-14T09:04:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 1 -- 172.21.15.6:0/4212689946 wait complete. 2023-10-14T09:04:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.227+0000 7f2f99128b80 20 client.16512 trim_cache size 0 max 16384 2023-10-14T09:04:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:04:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:04:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:04:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:04:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f700a1480 msgr2=0x7f2f700a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f700a1480 0x7f2f700a3940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2f881980f0 tx=0x7f2f78009260 comp rx=0 tx=0).stop 2023-10-14T09:04:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 msgr2=0x7f2f88197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88197160 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c000 tx=0x7f2f7c009580 comp rx=0 tx=0).stop 2023-10-14T09:04:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 shutdown_connections 2023-10-14T09:04:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2f700a1480 0x7f2f700a3940 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f88102a40 0x7f2f8819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88100ea0 0x7f2f88196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 --2- 172.21.15.6:0/2111620005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f88102080 0x7f2f88197160 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 >> 172.21.15.6:0/2111620005 conn(0x7f2f880fc460 msgr2=0x7f2f88105670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 shutdown_connections 2023-10-14T09:04:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:44.228+0000 7f2f8cf3e700 1 -- 172.21.15.6:0/2111620005 wait complete. 2023-10-14T09:04:44.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:44 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:04:44.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:44 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:04:44.695 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:44 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:04:44.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:44 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:04:44.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:44 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:04:44.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:44 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:04:44.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:44 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:04:44.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:44 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:04:44.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:44 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:04:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:45 smithi006 ceph-mon[99452]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 1.28k op/s 2023-10-14T09:04:45.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:45 smithi178 ceph-mon[103612]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 1.28k op/s 2023-10-14T09:04:45.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:45 smithi057 ceph-mon[103313]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 MiB/s wr, 1.28k op/s 2023-10-14T09:04:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 705.0 s, 1518.6 tps, lat 66.603 ms stddev 72.764 2023-10-14T09:04:47.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:47 smithi006 ceph-mon[99452]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 843 op/s 2023-10-14T09:04:47.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:47 smithi178 ceph-mon[103612]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 843 op/s 2023-10-14T09:04:47.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:47 smithi057 ceph-mon[103313]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 843 op/s 2023-10-14T09:04:49.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:49 smithi006 ceph-mon[99452]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 605 op/s 2023-10-14T09:04:49.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:49 smithi178 ceph-mon[103612]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 605 op/s 2023-10-14T09:04:49.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:49 smithi057 ceph-mon[103313]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.8 MiB/s wr, 605 op/s 2023-10-14T09:04:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 710.0 s, 1684.8 tps, lat 58.608 ms stddev 67.111 2023-10-14T09:04:51.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:51 smithi178 ceph-mon[103612]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 774 op/s 2023-10-14T09:04:51.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:51 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:51 smithi057 ceph-mon[103313]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 774 op/s 2023-10-14T09:04:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:51 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:51.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:51 smithi006 ceph-mon[99452]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 774 op/s 2023-10-14T09:04:51.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:51 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:04:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:53 smithi178 ceph-mon[103612]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 699 op/s 2023-10-14T09:04:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:53 smithi057 ceph-mon[103313]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 699 op/s 2023-10-14T09:04:53.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:53 smithi006 ceph-mon[99452]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 699 op/s 2023-10-14T09:04:55.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:55 smithi178 ceph-mon[103612]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 758 op/s 2023-10-14T09:04:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:55 smithi057 ceph-mon[103313]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 758 op/s 2023-10-14T09:04:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 715.0 s, 1855.4 tps, lat 54.212 ms stddev 62.188 2023-10-14T09:04:55.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:55 smithi006 ceph-mon[99452]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 758 op/s 2023-10-14T09:04:57.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 -- 172.21.15.6:0/3922509641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c10f730 msgr2=0x7f3c2c111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 --2- 172.21.15.6:0/3922509641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c10f730 0x7f3c2c111b20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0098f0 tx=0x7f3c1c009c00 comp rx=0 tx=0).stop 2023-10-14T09:04:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 -- 172.21.15.6:0/3922509641 shutdown_connections 2023-10-14T09:04:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 --2- 172.21.15.6:0/3922509641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c10f730 0x7f3c2c111b20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 --2- 172.21.15.6:0/3922509641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c2c107eb0 0x7f3c2c1082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 --2- 172.21.15.6:0/3922509641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 -- 172.21.15.6:0/3922509641 >> 172.21.15.6:0/3922509641 conn(0x7f3c2c06dcf0 msgr2=0x7f3c2c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 -- 172.21.15.6:0/3922509641 shutdown_connections 2023-10-14T09:04:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.389+0000 7f3c337e3700 1 -- 172.21.15.6:0/3922509641 wait complete. 2023-10-14T09:04:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 Processor -- start 2023-10-14T09:04:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 -- start start 2023-10-14T09:04:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c107eb0 0x7f3c2c19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c2c10f730 0x7f3c2c1a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1a6ef0 con 0x7f3c2c108810 2023-10-14T09:04:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1a7030 con 0x7f3c2c107eb0 2023-10-14T09:04:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c337e3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1a71c0 con 0x7f3c2c10f730 2023-10-14T09:04:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c3157f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c107eb0 0x7f3c2c19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c31d80700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c2c10f730 0x7f3c2c1a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35796/0 (socket says 172.21.15.6:35796) 2023-10-14T09:04:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c3157f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c107eb0 0x7f3c2c19f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34552/0 (socket says 172.21.15.6:34552) 2023-10-14T09:04:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2219779223 learned_addr learned my addr 172.21.15.6:0/2219779223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2219779223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c2c10f730 msgr2=0x7f3c2c1a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c2c10f730 0x7f3c2c1a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2219779223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c107eb0 msgr2=0x7f3c2c19f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c107eb0 0x7f3c2c19f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.390+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2219779223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009520 con 0x7f3c2c108810 2023-10-14T09:04:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.391+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c19f8b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800e9c0 tx=0x7f3c2800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.391+0000 7f3c227fc700 1 -- 172.21.15.6:0/2219779223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28004a30 con 0x7f3c2c108810 2023-10-14T09:04:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.391+0000 7f3c227fc700 1 -- 172.21.15.6:0/2219779223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c2800cc80 con 0x7f3c2c108810 2023-10-14T09:04:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.391+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c109020 con 0x7f3c2c108810 2023-10-14T09:04:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.391+0000 7f3c227fc700 1 -- 172.21.15.6:0/2219779223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280054e0 con 0x7f3c2c108810 2023-10-14T09:04:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.391+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c109530 con 0x7f3c2c108810 2023-10-14T09:04:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.394+0000 7f3c227fc700 1 -- 172.21.15.6:0/2219779223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3c28004b90 con 0x7f3c2c108810 2023-10-14T09:04:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.395+0000 7f3c227fc700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3c180a1480 0x7f3c180a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.395+0000 7f3c227fc700 1 -- 172.21.15.6:0/2219779223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3c28014070 con 0x7f3c2c108810 2023-10-14T09:04:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.395+0000 7f3c3157f700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3c180a1480 0x7f3c180a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 Processor -- start 2023-10-14T09:04:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3157f700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3c180a1480 0x7f3c180a3940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c071fa0 tx=0x7f3c24012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 -- start start 2023-10-14T09:04:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a05c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a06ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a07520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc297ac10 con 0x562dc2a05850 2023-10-14T09:04:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc295fc00 con 0x562dc2a070a0 2023-10-14T09:04:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc295d520 con 0x562dc2a061b0 2023-10-14T09:04:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3157f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a05c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3157f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a05c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35802/0 (socket says 172.21.15.6:35802) 2023-10-14T09:04:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c3157f700 1 -- 172.21.15.6:0/2635617895 learned_addr learned my addr 172.21.15.6:0/2635617895 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a06ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.396+0000 7f3c31d80700 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a07520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2635617895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 msgr2=0x562dc2a07520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a07520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2635617895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 msgr2=0x562dc2a05c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a05c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2635617895 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc2916390 con 0x562dc2a061b0 2023-10-14T09:04:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c3157f700 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a05c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:04:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a06ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c28005950 tx=0x7f3c28099aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139c3da61eb619c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c177fe700 1 -- 172.21.15.6:0/2635617895 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280adea0 con 0x562dc2a061b0 2023-10-14T09:04:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c177fe700 1 -- 172.21.15.6:0/2635617895 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c2809a0c0 con 0x562dc2a061b0 2023-10-14T09:04:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.397+0000 7f3c177fe700 1 -- 172.21.15.6:0/2635617895 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2809a580 con 0x562dc2a061b0 2023-10-14T09:04:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2635617895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 msgr2=0x562dc2a06ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a06ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c28005950 tx=0x7f3c28099aa0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2635617895 shutdown_connections 2023-10-14T09:04:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a07520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a05c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2635617895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a06ac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2635617895 >> 172.21.15.6:0/2635617895 conn(0x562dc2933d70 msgr2=0x562dc2a00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2635617895 shutdown_connections 2023-10-14T09:04:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2635617895 wait complete. 2023-10-14T09:04:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 -- start start 2023-10-14T09:04:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.398+0000 7f3c3f9cdb80 1 Processor -- start 2023-10-14T09:04:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a17f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a184d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a1f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc2958e10 con 0x562dc2a05850 2023-10-14T09:04:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc28f56b0 con 0x562dc2a070a0 2023-10-14T09:04:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc28f5350 con 0x562dc2a061b0 2023-10-14T09:04:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3f9cdb80 10 client.0 _ll_register_callbacks cb 0x562dc27527a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a17f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a17f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35808/0 (socket says 172.21.15.6:35808) 2023-10-14T09:04:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 -- 172.21.15.6:0/431297011 learned_addr learned my addr 172.21.15.6:0/431297011 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c31d80700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a1f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 -- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 msgr2=0x562dc2a184d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a184d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 -- 172.21.15.6:0/431297011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 msgr2=0x562dc2a1f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a1f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.399+0000 7f3c3157f700 1 -- 172.21.15.6:0/431297011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2401c500 con 0x562dc2a05850 2023-10-14T09:04:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c3157f700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a17f90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3c2401a640 tx=0x7f3c2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89873925f382a63 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:04:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c14ff9700 1 -- 172.21.15.6:0/431297011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400e050 con 0x562dc2a05850 2023-10-14T09:04:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c14ff9700 1 -- 172.21.15.6:0/431297011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3c2401ade0 con 0x562dc2a05850 2023-10-14T09:04:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562dc295de90 con 0x562dc2a05850 2023-10-14T09:04:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c14ff9700 1 -- 172.21.15.6:0/431297011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c24021070 con 0x562dc2a05850 2023-10-14T09:04:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c3f9cdb80 10 client.16524 fetch_fsmap learned FSMap version 55 2023-10-14T09:04:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f3c2c109530 con 0x562dc2a05850 2023-10-14T09:04:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c14ff9700 1 -- 172.21.15.6:0/431297011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562dc295de90 con 0x562dc2a05850 2023-10-14T09:04:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.400+0000 7f3c14ff9700 1 -- 172.21.15.6:0/431297011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3c24031390 con 0x562dc2a05850 2023-10-14T09:04:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c3f9cdb80 10 client.16524 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:04:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c3f9cdb80 10 client.16524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c3f9cdb80 20 client.16524 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a23df0 0x562dc2a26210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c3f9cdb80 4 client.16524 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:04:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dc29d5bb0 con 0x562dc2a23df0 2023-10-14T09:04:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a23df0 0x562dc2a26210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c14ff9700 10 client.16524 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.401+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a23df0 0x562dc2a26210 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5570962a4f648606 server_cookie=3e01b9f44ea8a114 in_seq=0 out_seq=0 2023-10-14T09:04:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c14ff9700 1 -- 172.21.15.6:0/431297011 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562dc29d5bb0 con 0x562dc2a23df0 2023-10-14T09:04:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c14ff9700 10 client.16524 handle_command_reply: tid=0 2023-10-14T09:04:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 client.16524 shutdown 2023-10-14T09:04:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 msgr2=0x562dc2a17f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a17f90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3c2401a640 tx=0x7f3c2400b040 comp rx=0 tx=0).stop 2023-10-14T09:04:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 shutdown_connections 2023-10-14T09:04:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a23df0 0x562dc2a26210 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a070a0 0x562dc2a1f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a05850 0x562dc2a17f90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c14ff9700 0 client.16524 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/431297011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 >> 172.21.15.6:0/431297011 conn(0x562dc2933d70 msgr2=0x562dc2a00830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 shutdown_connections 2023-10-14T09:04:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/431297011 wait complete. 2023-10-14T09:04:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.402+0000 7f3c3f9cdb80 20 client.16524 trim_cache size 0 max 16384 2023-10-14T09:04:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.421+0000 7f3c3f9cdb80 1 Processor -- start 2023-10-14T09:04:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.421+0000 7f3c3f9cdb80 1 -- start start 2023-10-14T09:04:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a05c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 0x562dc2a1f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a070a0 0x562dc2a02780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc27d98c0 con 0x562dc2a061b0 2023-10-14T09:04:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc2a21200 con 0x562dc2a05850 2023-10-14T09:04:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc2a17440 con 0x562dc2a070a0 2023-10-14T09:04:57.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 0x562dc2a1f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 0x562dc2a1f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35816/0 (socket says 172.21.15.6:35816) 2023-10-14T09:04:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 -- 172.21.15.6:0/3107836505 learned_addr learned my addr 172.21.15.6:0/3107836505 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c3157f700 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a05c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c31d80700 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a070a0 0x562dc2a02780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 -- 172.21.15.6:0/3107836505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a070a0 msgr2=0x562dc2a02780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a070a0 0x562dc2a02780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 -- 172.21.15.6:0/3107836505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 msgr2=0x562dc2a05c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a05c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 -- 172.21.15.6:0/3107836505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc2783d80 con 0x562dc2a061b0 2023-10-14T09:04:57.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 0x562dc2a1f4d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3c28020000 tx=0x7f3c280cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95976be93a0012fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c17fff700 1 -- 172.21.15.6:0/3107836505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280adea0 con 0x562dc2a061b0 2023-10-14T09:04:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c17fff700 1 -- 172.21.15.6:0/3107836505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c2805fe90 con 0x562dc2a061b0 2023-10-14T09:04:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.422+0000 7f3c17fff700 1 -- 172.21.15.6:0/3107836505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280995b0 con 0x562dc2a061b0 2023-10-14T09:04:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/3107836505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 msgr2=0x562dc2a1f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 0x562dc2a1f4d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3c28020000 tx=0x7f3c280cc040 comp rx=0 tx=0).stop 2023-10-14T09:04:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/3107836505 shutdown_connections 2023-10-14T09:04:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a070a0 0x562dc2a02780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a05c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/3107836505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a061b0 0x562dc2a1f4d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.423+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/3107836505 >> 172.21.15.6:0/3107836505 conn(0x562dc2933d70 msgr2=0x562dc29ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:57.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.425+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/3107836505 shutdown_connections 2023-10-14T09:04:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.425+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/3107836505 wait complete. 2023-10-14T09:04:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.425+0000 7f3c3f9cdb80 1 -- start start 2023-10-14T09:04:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.425+0000 7f3c3f9cdb80 1 Processor -- start 2023-10-14T09:04:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a1d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 0x562dc2a1e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc2a1e830 con 0x562dc2a070a0 2023-10-14T09:04:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc2a1e9a0 con 0x562dc2a05850 2023-10-14T09:04:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc2a1eb60 con 0x562dc2a061b0 2023-10-14T09:04:57.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3f9cdb80 10 client.0 _ll_register_callbacks cb 0x7f3c2401cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:04:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c31d80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 0x562dc2a1e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c31d80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 0x562dc2a1e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35820/0 (socket says 172.21.15.6:35820) 2023-10-14T09:04:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c30d7e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a1d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c31d80700 1 -- 172.21.15.6:0/2483305133 learned_addr learned my addr 172.21.15.6:0/2483305133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:04:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c3157f700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a1cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2483305133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 msgr2=0x562dc2a1cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a1cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2483305133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 msgr2=0x562dc2a1e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:04:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 0x562dc2a1e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c30d7e700 1 -- 172.21.15.6:0/2483305133 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dc2916390 con 0x562dc2a061b0 2023-10-14T09:04:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.426+0000 7f3c31d80700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 0x562dc2a1e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:04:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c30d7e700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a1d2e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c28096b30 tx=0x7f3c2809e330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d96d33a1bb2198b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:04:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:04:57.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c14ff9700 1 -- 172.21.15.6:0/2483305133 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280adea0 con 0x562dc2a061b0 2023-10-14T09:04:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c14ff9700 1 -- 172.21.15.6:0/2483305133 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3c280b8030 con 0x562dc2a061b0 2023-10-14T09:04:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c2809a0c0 con 0x562dc2a061b0 2023-10-14T09:04:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c14ff9700 1 -- 172.21.15.6:0/2483305133 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c28005640 con 0x562dc2a061b0 2023-10-14T09:04:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 10 client.26134 fetch_fsmap learned FSMap version 55 2023-10-14T09:04:57.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x562dc276cc00 con 0x562dc2a061b0 2023-10-14T09:04:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c14ff9700 1 -- 172.21.15.6:0/2483305133 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c280a6080 con 0x562dc2a061b0 2023-10-14T09:04:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c14ff9700 1 -- 172.21.15.6:0/2483305133 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3c2809a3b0 con 0x562dc2a061b0 2023-10-14T09:04:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 10 client.26134 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:04:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 10 client.26134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:04:57.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 20 client.26134 populate_metadata read hostname 'smithi006' 2023-10-14T09:04:57.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a782f0 0x562dc2a7a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:04:57.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 4 client.26134 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:04:57.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562dc2951df0 con 0x562dc2a782f0 2023-10-14T09:04:57.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.427+0000 7f3c3157f700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a782f0 0x562dc2a7a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:04:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.429+0000 7f3c14ff9700 10 client.26134 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.429+0000 7f3c3157f700 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a782f0 0x562dc2a7a710 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635fefdd517b1b0f server_cookie=65c058c257069eb1 in_seq=0 out_seq=0 2023-10-14T09:04:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.441+0000 7f3c14ff9700 1 -- 172.21.15.6:0/2483305133 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562dc2951df0 con 0x562dc2a782f0 2023-10-14T09:04:57.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.441+0000 7f3c14ff9700 10 client.26134 handle_command_reply: tid=0 2023-10-14T09:04:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.441+0000 7f3c3f9cdb80 1 client.26134 shutdown 2023-10-14T09:04:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.441+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 msgr2=0x562dc2a1d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.441+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a1d2e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c28096b30 tx=0x7f3c2809e330 comp rx=0 tx=0).stop 2023-10-14T09:04:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 shutdown_connections 2023-10-14T09:04:57.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562dc2a782f0 0x562dc2a7a710 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562dc2a070a0 0x562dc2a1e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562dc2a05850 0x562dc2a1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c14ff9700 0 client.26134 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:04:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 --2- 172.21.15.6:0/2483305133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562dc2a061b0 0x562dc2a1d2e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 >> 172.21.15.6:0/2483305133 conn(0x562dc2933d70 msgr2=0x562dc2a0d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 shutdown_connections 2023-10-14T09:04:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 1 -- 172.21.15.6:0/2483305133 wait complete. 2023-10-14T09:04:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c3f9cdb80 20 client.26134 trim_cache size 0 max 16384 2023-10-14T09:04:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:04:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:04:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:04:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:04:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3c180a1480 msgr2=0x7f3c180a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3c180a1480 0x7f3c180a3940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c071fa0 tx=0x7f3c24012040 comp rx=0 tx=0).stop 2023-10-14T09:04:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 msgr2=0x7f3c2c19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:04:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c19f8b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800e9c0 tx=0x7f3c2800ecd0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 shutdown_connections 2023-10-14T09:04:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c2c10f730 0x7f3c2c1a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3c180a1480 0x7f3c180a3940 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c107eb0 0x7f3c2c19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 --2- 172.21.15.6:0/2219779223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c2c108810 0x7f3c2c19f8b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:04:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.442+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 >> 172.21.15.6:0/2219779223 conn(0x7f3c2c06dcf0 msgr2=0x7f3c2c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:04:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.443+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 shutdown_connections 2023-10-14T09:04:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:04:57.443+0000 7f3c337e3700 1 -- 172.21.15.6:0/2219779223 wait complete. 2023-10-14T09:04:57.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:57 smithi178 ceph-mon[103612]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 792 op/s 2023-10-14T09:04:57.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:57 smithi057 ceph-mon[103313]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 792 op/s 2023-10-14T09:04:57.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:57 smithi006 ceph-mon[99452]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 792 op/s 2023-10-14T09:04:59.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:04:59 smithi178 ceph-mon[103612]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 720 op/s 2023-10-14T09:04:59.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:04:59 smithi057 ceph-mon[103313]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 720 op/s 2023-10-14T09:04:59.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:04:59 smithi006 ceph-mon[99452]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 720 op/s 2023-10-14T09:05:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 720.0 s, 1599.0 tps, lat 62.390 ms stddev 79.252 2023-10-14T09:05:01.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:01 smithi178 ceph-mon[103612]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-14T09:05:01.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:01 smithi057 ceph-mon[103313]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-14T09:05:01.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:01 smithi006 ceph-mon[99452]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 829 op/s 2023-10-14T09:05:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:03 smithi178 ceph-mon[103612]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 MiB/s wr, 674 op/s 2023-10-14T09:05:03.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:03 smithi057 ceph-mon[103313]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 MiB/s wr, 674 op/s 2023-10-14T09:05:03.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:03 smithi006 ceph-mon[99452]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 MiB/s wr, 674 op/s 2023-10-14T09:05:05.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:05 smithi178 ceph-mon[103612]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 686 op/s 2023-10-14T09:05:05.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:05 smithi057 ceph-mon[103313]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 686 op/s 2023-10-14T09:05:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 725.0 s, 1670.6 tps, lat 59.792 ms stddev 70.370 2023-10-14T09:05:05.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:05 smithi006 ceph-mon[99452]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 686 op/s 2023-10-14T09:05:07.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:07 smithi178 ceph-mon[103612]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 707 op/s 2023-10-14T09:05:07.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:07 smithi057 ceph-mon[103313]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 707 op/s 2023-10-14T09:05:07.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:07 smithi006 ceph-mon[99452]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 707 op/s 2023-10-14T09:05:09.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:09 smithi178 ceph-mon[103612]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 613 op/s 2023-10-14T09:05:09.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:09 smithi057 ceph-mon[103313]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 613 op/s 2023-10-14T09:05:09.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:09 smithi006 ceph-mon[99452]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.9 MiB/s wr, 613 op/s 2023-10-14T09:05:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 -- 172.21.15.6:0/2098244117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60280ffe10 msgr2=0x7f6028100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 --2- 172.21.15.6:0/2098244117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60280ffe10 0x7f6028100230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60180098f0 tx=0x7f6018009c00 comp rx=0 tx=0).stop 2023-10-14T09:05:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 -- 172.21.15.6:0/2098244117 shutdown_connections 2023-10-14T09:05:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 --2- 172.21.15.6:0/2098244117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028101920 0x7f6028108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 --2- 172.21.15.6:0/2098244117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60280ffe10 0x7f6028100230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 --2- 172.21.15.6:0/2098244117 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6028100f60 0x7f60281013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 -- 172.21.15.6:0/2098244117 >> 172.21.15.6:0/2098244117 conn(0x7f60280fb380 msgr2=0x7f60280fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 -- 172.21.15.6:0/2098244117 shutdown_connections 2023-10-14T09:05:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.593+0000 7f602cb95700 1 -- 172.21.15.6:0/2098244117 wait complete. 2023-10-14T09:05:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.594+0000 7f602cb95700 1 Processor -- start 2023-10-14T09:05:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.594+0000 7f602cb95700 1 -- start start 2023-10-14T09:05:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.594+0000 7f602cb95700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60280ffe10 0x7f602819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.594+0000 7f602cb95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 0x7f602819dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f602cb95700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6028101920 0x7f60281a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f602cb95700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60281a4d40 con 0x7f6028100f60 2023-10-14T09:05:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f602cb95700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60281a4eb0 con 0x7f60280ffe10 2023-10-14T09:05:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f602cb95700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60281a5070 con 0x7f6028101920 2023-10-14T09:05:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 0x7f602819dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 0x7f602819dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35834/0 (socket says 172.21.15.6:35834) 2023-10-14T09:05:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6025d9b700 1 -- 172.21.15.6:0/3727039831 learned_addr learned my addr 172.21.15.6:0/3727039831 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f602659c700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60280ffe10 0x7f602819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6028101920 0x7f60281a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 -- 172.21.15.6:0/3727039831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60280ffe10 msgr2=0x7f602819d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60280ffe10 0x7f602819d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 -- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 msgr2=0x7f602819dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 0x7f602819dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 -- 172.21.15.6:0/3727039831 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009520 con 0x7f6028101920 2023-10-14T09:05:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6025d9b700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 0x7f602819dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f602659c700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60280ffe10 0x7f602819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f6026d9d700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6028101920 0x7f60281a4770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f602000efc0 tx=0x7f602000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.595+0000 7f60177fe700 1 -- 172.21.15.6:0/3727039831 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020018070 con 0x7f6028101920 2023-10-14T09:05:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.596+0000 7f60177fe700 1 -- 172.21.15.6:0/3727039831 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f602000f040 con 0x7f6028101920 2023-10-14T09:05:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.596+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60281a52f0 con 0x7f6028101920 2023-10-14T09:05:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.596+0000 7f60177fe700 1 -- 172.21.15.6:0/3727039831 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602000ccb0 con 0x7f6028101920 2023-10-14T09:05:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.596+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60281a5800 con 0x7f6028101920 2023-10-14T09:05:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.600+0000 7f6038d7fb80 1 Processor -- start 2023-10-14T09:05:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.600+0000 7f60177fe700 1 -- 172.21.15.6:0/3727039831 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f6020003a00 con 0x7f6028101920 2023-10-14T09:05:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 -- start start 2023-10-14T09:05:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbc850 0x561ae0cbcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 0x561ae0cbdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbe0a0 0x561ae0cbe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0c31c10 con 0x561ae0cbe0a0 2023-10-14T09:05:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0c16c00 con 0x561ae0cbd1b0 2023-10-14T09:05:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0c14520 con 0x561ae0cbc850 2023-10-14T09:05:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f602659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 0x561ae0cbdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f602659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 0x561ae0cbdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34596/0 (socket says 172.21.15.6:34596) 2023-10-14T09:05:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f602659c700 1 -- 172.21.15.6:0/1084504955 learned_addr learned my addr 172.21.15.6:0/1084504955 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.601+0000 7f60177fe700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f60100a1580 0x7f60100a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f602659c700 1 -- 172.21.15.6:0/1084504955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbc850 msgr2=0x561ae0cbcc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:05:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f602659c700 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbc850 0x561ae0cbcc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f602659c700 1 -- 172.21.15.6:0/1084504955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbe0a0 msgr2=0x561ae0cbe520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:05:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f602659c700 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbe0a0 0x561ae0cbe520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f602659c700 1 -- 172.21.15.6:0/1084504955 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae0bcd390 con 0x561ae0cbd1b0 2023-10-14T09:05:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f6026d9d700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f60100a1580 0x7f60100a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f60177fe700 1 -- 172.21.15.6:0/3727039831 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f60200cc700 con 0x7f6028101920 2023-10-14T09:05:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f602659c700 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 0x561ae0cbdac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6018009230 tx=0x7f6018005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d956b0723218db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f6014ff9700 1 -- 172.21.15.6:0/1084504955 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601801d070 con 0x561ae0cbd1b0 2023-10-14T09:05:10.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f6014ff9700 1 -- 172.21.15.6:0/1084504955 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f601800ba20 con 0x561ae0cbd1b0 2023-10-14T09:05:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.602+0000 7f6014ff9700 1 -- 172.21.15.6:0/1084504955 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018005570 con 0x561ae0cbd1b0 2023-10-14T09:05:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 -- 172.21.15.6:0/1084504955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 msgr2=0x561ae0cbdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 0x561ae0cbdac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6018009230 tx=0x7f6018005b80 comp rx=0 tx=0).stop 2023-10-14T09:05:10.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6026d9d700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f60100a1580 0x7f60100a3a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6020095f70 tx=0x7f602008f230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 -- 172.21.15.6:0/1084504955 shutdown_connections 2023-10-14T09:05:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbe0a0 0x561ae0cbe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbc850 0x561ae0cbcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.615 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/1084504955 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cbd1b0 0x561ae0cbdac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.603+0000 7f6038d7fb80 1 -- 172.21.15.6:0/1084504955 >> 172.21.15.6:0/1084504955 conn(0x561ae0bead70 msgr2=0x561ae0cb7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 -- 172.21.15.6:0/1084504955 shutdown_connections 2023-10-14T09:05:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 -- 172.21.15.6:0/1084504955 wait complete. 2023-10-14T09:05:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 -- start start 2023-10-14T09:05:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 Processor -- start 2023-10-14T09:05:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 0x561ae0cc6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cc6d50 0x561ae0ccbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0cce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0c0fe10 con 0x561ae0cbd1b0 2023-10-14T09:05:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0bac6b0 con 0x561ae0cc71d0 2023-10-14T09:05:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0bac350 con 0x561ae0cc6d50 2023-10-14T09:05:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6038d7fb80 10 client.0 _ll_register_callbacks cb 0x561ae0a097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 0x561ae0cc6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 0x561ae0cc6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35842/0 (socket says 172.21.15.6:35842) 2023-10-14T09:05:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f6025d9b700 1 -- 172.21.15.6:0/786860567 learned_addr learned my addr 172.21.15.6:0/786860567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0cce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.604+0000 7f602659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cc6d50 0x561ae0ccbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 -- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cc6d50 msgr2=0x561ae0ccbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cc6d50 0x561ae0ccbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 -- 172.21.15.6:0/786860567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 msgr2=0x561ae0cce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0cce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 -- 172.21.15.6:0/786860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028108b70 con 0x561ae0cbd1b0 2023-10-14T09:05:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f6025d9b700 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 0x561ae0cc6810 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x561ae0cbd670 tx=0x7f601c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1ff417ef283adc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f600dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:05:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.605+0000 7f600dffb700 1 -- 172.21.15.6:0/786860567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00fdc0 con 0x561ae0cbd1b0 2023-10-14T09:05:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f600dffb700 1 -- 172.21.15.6:0/786860567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f601c0131b0 con 0x561ae0cbd1b0 2023-10-14T09:05:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ae0c14e90 con 0x561ae0cbd1b0 2023-10-14T09:05:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f600dffb700 1 -- 172.21.15.6:0/786860567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601c013370 con 0x561ae0cbd1b0 2023-10-14T09:05:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 10 client.16539 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x561ae0a3ad80 con 0x561ae0cbd1b0 2023-10-14T09:05:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f600dffb700 1 -- 172.21.15.6:0/786860567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561ae0c14e90 con 0x561ae0cbd1b0 2023-10-14T09:05:10.622 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f600dffb700 1 -- 172.21.15.6:0/786860567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f601c003b00 con 0x561ae0cbd1b0 2023-10-14T09:05:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 10 client.16539 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 20 client.16539 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0cd2da0 0x561ae0cd51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 4 client.16539 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:05:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ae0c8cbb0 con 0x561ae0cd2da0 2023-10-14T09:05:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.606+0000 7f602659c700 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0cd2da0 0x561ae0cd51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.607+0000 7f600dffb700 10 client.16539 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.607+0000 7f602659c700 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0cd2da0 0x561ae0cd51c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136b73b41944e39a server_cookie=ed090983247e8e24 in_seq=0 out_seq=0 2023-10-14T09:05:10.624 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.607+0000 7f600dffb700 1 -- 172.21.15.6:0/786860567 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ae0c8cbb0 con 0x561ae0cd2da0 2023-10-14T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.607+0000 7f600dffb700 10 client.16539 handle_command_reply: tid=0 2023-10-14T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.608+0000 7f6038d7fb80 1 client.16539 shutdown 2023-10-14T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.608+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 msgr2=0x561ae0cc6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.608+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 0x561ae0cc6810 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x561ae0cbd670 tx=0x7f601c005b00 comp rx=0 tx=0).stop 2023-10-14T09:05:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 shutdown_connections 2023-10-14T09:05:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0cd2da0 0x561ae0cd51c0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0cce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f600dffb700 0 client.16539 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cbd1b0 0x561ae0cc6810 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/786860567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cc6d50 0x561ae0ccbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 >> 172.21.15.6:0/786860567 conn(0x561ae0bead70 msgr2=0x561ae0cb7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 shutdown_connections 2023-10-14T09:05:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 1 -- 172.21.15.6:0/786860567 wait complete. 2023-10-14T09:05:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.609+0000 7f6038d7fb80 20 client.16539 trim_cache size 0 max 16384 2023-10-14T09:05:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.627+0000 7f6038d7fb80 1 Processor -- start 2023-10-14T09:05:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 -- start start 2023-10-14T09:05:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0ce29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc6d50 0x561ae0cb6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 0x561ae0cced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0a908c0 con 0x561ae0cc71d0 2023-10-14T09:05:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0cc5cf0 con 0x561ae0cc6d50 2023-10-14T09:05:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0cbc490 con 0x561ae0cbd1b0 2023-10-14T09:05:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 0x561ae0cced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f602659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc6d50 0x561ae0cb6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6025d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 0x561ae0cced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35854/0 (socket says 172.21.15.6:35854) 2023-10-14T09:05:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6025d9b700 1 -- 172.21.15.6:0/966697569 learned_addr learned my addr 172.21.15.6:0/966697569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6025d9b700 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0ce29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f602659c700 1 -- 172.21.15.6:0/966697569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 msgr2=0x561ae0ce29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f602659c700 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0ce29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f602659c700 1 -- 172.21.15.6:0/966697569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 msgr2=0x561ae0cced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f602659c700 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 0x561ae0cced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f602659c700 1 -- 172.21.15.6:0/966697569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ae0a23c00 con 0x561ae0cc6d50 2023-10-14T09:05:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.628+0000 7f6025d9b700 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 0x561ae0cced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.629+0000 7f602659c700 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc6d50 0x561ae0cb6e30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6018005bf0 tx=0x7f6018005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f5a58b62b9aafb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.629+0000 7f60157fa700 1 -- 172.21.15.6:0/966697569 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601801d040 con 0x561ae0cc6d50 2023-10-14T09:05:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.629+0000 7f60157fa700 1 -- 172.21.15.6:0/966697569 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6018005680 con 0x561ae0cc6d50 2023-10-14T09:05:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.629+0000 7f60157fa700 1 -- 172.21.15.6:0/966697569 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601802a5d0 con 0x561ae0cc6d50 2023-10-14T09:05:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- 172.21.15.6:0/966697569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc6d50 msgr2=0x561ae0cb6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc6d50 0x561ae0cb6e30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6018005bf0 tx=0x7f6018005040 comp rx=0 tx=0).stop 2023-10-14T09:05:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- 172.21.15.6:0/966697569 shutdown_connections 2023-10-14T09:05:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc71d0 0x561ae0cced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0ce29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/966697569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc6d50 0x561ae0cb6e30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- 172.21.15.6:0/966697569 >> 172.21.15.6:0/966697569 conn(0x561ae0bead70 msgr2=0x561ae0cc65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- 172.21.15.6:0/966697569 shutdown_connections 2023-10-14T09:05:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- 172.21.15.6:0/966697569 wait complete. 2023-10-14T09:05:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- start start 2023-10-14T09:05:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 Processor -- start 2023-10-14T09:05:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0cdfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 0x561ae0ce0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0ce11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0ce1700 con 0x561ae0cc6d50 2023-10-14T09:05:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0ce1870 con 0x561ae0cc71d0 2023-10-14T09:05:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ae0ce1a30 con 0x561ae0cbd1b0 2023-10-14T09:05:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6038d7fb80 10 client.0 _ll_register_callbacks cb 0x7f601c013c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f602659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 0x561ae0ce0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f602659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 0x561ae0ce0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35858/0 (socket says 172.21.15.6:35858) 2023-10-14T09:05:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f602659c700 1 -- 172.21.15.6:0/3561892745 learned_addr learned my addr 172.21.15.6:0/3561892745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.630+0000 7f6025d9b700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0cdfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f6025d9b700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0ce11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f602659c700 1 -- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 msgr2=0x561ae0cdfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f602659c700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0cdfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f602659c700 1 -- 172.21.15.6:0/3561892745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 msgr2=0x561ae0ce11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f602659c700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0ce11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f602659c700 1 -- 172.21.15.6:0/3561892745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ae0a3ad80 con 0x561ae0cc6d50 2023-10-14T09:05:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f6025d9b700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0cdfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f602659c700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 0x561ae0ce0200 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6018005e90 tx=0x7f601800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a96e7b228398d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f600dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:05:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f600dffb700 1 -- 172.21.15.6:0/3561892745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018036070 con 0x561ae0cc6d50 2023-10-14T09:05:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f600dffb700 1 -- 172.21.15.6:0/3561892745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f601802a560 con 0x561ae0cc6d50 2023-10-14T09:05:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f601800ba20 con 0x561ae0cc6d50 2023-10-14T09:05:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f600dffb700 1 -- 172.21.15.6:0/3561892745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601801d040 con 0x561ae0cc6d50 2023-10-14T09:05:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f6038d7fb80 10 client.16545 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.631+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x561ae0bcd390 con 0x561ae0cc6d50 2023-10-14T09:05:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f600dffb700 1 -- 172.21.15.6:0/3561892745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6018041020 con 0x561ae0cc6d50 2023-10-14T09:05:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f600dffb700 1 -- 172.21.15.6:0/3561892745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6018039020 con 0x561ae0cc6d50 2023-10-14T09:05:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6038d7fb80 10 client.16545 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6038d7fb80 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6038d7fb80 20 client.16545 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0d27320 0x561ae0d29710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6038d7fb80 4 client.16545 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:05:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561ae0c08df0 con 0x561ae0d27320 2023-10-14T09:05:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6025d9b700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0d27320 0x561ae0d29710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f600dffb700 10 client.16545 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.632+0000 7f6025d9b700 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0d27320 0x561ae0d29710 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13dfc3e8bfef3264 server_cookie=72bf34da8352d49b in_seq=0 out_seq=0 2023-10-14T09:05:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.642+0000 7f600dffb700 1 -- 172.21.15.6:0/3561892745 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561ae0c08df0 con 0x561ae0d27320 2023-10-14T09:05:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.642+0000 7f600dffb700 10 client.16545 handle_command_reply: tid=0 2023-10-14T09:05:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.642+0000 7f6038d7fb80 1 client.16545 shutdown 2023-10-14T09:05:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 msgr2=0x561ae0ce0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 0x561ae0ce0200 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6018005e90 tx=0x7f601800bef0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 shutdown_connections 2023-10-14T09:05:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x561ae0d27320 0x561ae0d29710 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ae0cc71d0 0x561ae0ce11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f600dffb700 0 client.16545 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae0cbd1b0 0x561ae0cdfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 --2- 172.21.15.6:0/3561892745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ae0cc6d50 0x561ae0ce0200 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 >> 172.21.15.6:0/3561892745 conn(0x561ae0bead70 msgr2=0x561ae0cb6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 shutdown_connections 2023-10-14T09:05:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 1 -- 172.21.15.6:0/3561892745 wait complete. 2023-10-14T09:05:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f6038d7fb80 20 client.16545 trim_cache size 0 max 16384 2023-10-14T09:05:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:05:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:05:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:05:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:05:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f60100a1580 msgr2=0x7f60100a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f602cb95700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f60100a1580 0x7f60100a3a40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6020095f70 tx=0x7f602008f230 comp rx=0 tx=0).stop 2023-10-14T09:05:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6028101920 msgr2=0x7f60281a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f602cb95700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6028101920 0x7f60281a4770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f602000efc0 tx=0x7f602000c3a0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 shutdown_connections 2023-10-14T09:05:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.643+0000 7f602cb95700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6028101920 0x7f60281a4770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.644+0000 7f602cb95700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f60100a1580 0x7f60100a3a40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.644+0000 7f602cb95700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60280ffe10 0x7f602819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.644+0000 7f602cb95700 1 --2- 172.21.15.6:0/3727039831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6028100f60 0x7f602819dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.644+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 >> 172.21.15.6:0/3727039831 conn(0x7f60280fb380 msgr2=0x7f602810d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.644+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 shutdown_connections 2023-10-14T09:05:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:10.644+0000 7f602cb95700 1 -- 172.21.15.6:0/3727039831 wait complete. 2023-10-14T09:05:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 730.0 s, 1338.6 tps, lat 74.135 ms stddev 87.181 2023-10-14T09:05:11.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:11 smithi178 ceph-mon[103612]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 700 op/s 2023-10-14T09:05:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:11 smithi057 ceph-mon[103313]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 700 op/s 2023-10-14T09:05:11.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:11 smithi006 ceph-mon[99452]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 700 op/s 2023-10-14T09:05:13.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:13 smithi057 ceph-mon[103313]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 592 op/s 2023-10-14T09:05:13.993 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:13 smithi006 ceph-mon[99452]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 592 op/s 2023-10-14T09:05:14.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:13 smithi178 ceph-mon[103612]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 592 op/s 2023-10-14T09:05:15.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:15 smithi057 ceph-mon[103313]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 638 op/s 2023-10-14T09:05:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 735.0 s, 1582.5 tps, lat 63.806 ms stddev 79.091 2023-10-14T09:05:15.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:15 smithi006 ceph-mon[99452]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 638 op/s 2023-10-14T09:05:16.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:15 smithi178 ceph-mon[103612]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 638 op/s 2023-10-14T09:05:17.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:17 smithi057 ceph-mon[103313]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 668 op/s 2023-10-14T09:05:17.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:17 smithi006 ceph-mon[99452]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 668 op/s 2023-10-14T09:05:18.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:17 smithi178 ceph-mon[103612]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 668 op/s 2023-10-14T09:05:19.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:19 smithi057 ceph-mon[103313]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 627 op/s 2023-10-14T09:05:19.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:19 smithi006 ceph-mon[99452]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 627 op/s 2023-10-14T09:05:20.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:19 smithi178 ceph-mon[103612]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 627 op/s 2023-10-14T09:05:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 740.0 s, 966.4 tps, lat 101.928 ms stddev 124.269 2023-10-14T09:05:21.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:21 smithi006 ceph-mon[99452]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 771 op/s 2023-10-14T09:05:22.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:21 smithi178 ceph-mon[103612]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 771 op/s 2023-10-14T09:05:22.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:21 smithi057 ceph-mon[103313]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 771 op/s 2023-10-14T09:05:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 -- 172.21.15.6:0/1864223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40101970 msgr2=0x7f8b40108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 --2- 172.21.15.6:0/1864223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40101970 0x7f8b40108220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800b0d0 tx=0x7f8b3800b3e0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 -- 172.21.15.6:0/1864223811 shutdown_connections 2023-10-14T09:05:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 --2- 172.21.15.6:0/1864223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40101970 0x7f8b40108220 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 --2- 172.21.15.6:0/1864223811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 0x7f8b40100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 --2- 172.21.15.6:0/1864223811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b40100fd0 0x7f8b40101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 -- 172.21.15.6:0/1864223811 >> 172.21.15.6:0/1864223811 conn(0x7f8b400fb370 msgr2=0x7f8b400fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 -- 172.21.15.6:0/1864223811 shutdown_connections 2023-10-14T09:05:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.802+0000 7f8b45b13700 1 -- 172.21.15.6:0/1864223811 wait complete. 2023-10-14T09:05:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 Processor -- start 2023-10-14T09:05:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 -- start start 2023-10-14T09:05:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 0x7f8b40195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40100fd0 0x7f8b40196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b40101970 0x7f8b4019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4019d770 con 0x7f8b40100fd0 2023-10-14T09:05:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4019d8b0 con 0x7f8b400ffde0 2023-10-14T09:05:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.803+0000 7f8b45b13700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4019da40 con 0x7f8b40101970 2023-10-14T09:05:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40100fd0 0x7f8b40196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b40101970 0x7f8b4019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40100fd0 0x7f8b40196130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35872/0 (socket says 172.21.15.6:35872) 2023-10-14T09:05:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3effd700 1 -- 172.21.15.6:0/3861722149 learned_addr learned my addr 172.21.15.6:0/3861722149 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 0x7f8b40195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/3861722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b40101970 msgr2=0x7f8b4019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b40101970 0x7f8b4019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40100fd0 msgr2=0x7f8b40196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40100fd0 0x7f8b40196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/3861722149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38009d00 con 0x7f8b400ffde0 2023-10-14T09:05:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 0x7f8b40195bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000e9c0 tx=0x7f8b3000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.804+0000 7f8b3cff9700 1 -- 172.21.15.6:0/3861722149 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30004220 con 0x7f8b400ffde0 2023-10-14T09:05:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.805+0000 7f8b3cff9700 1 -- 172.21.15.6:0/3861722149 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b30004380 con 0x7f8b400ffde0 2023-10-14T09:05:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.805+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b400693b0 con 0x7f8b400ffde0 2023-10-14T09:05:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.805+0000 7f8b3cff9700 1 -- 172.21.15.6:0/3861722149 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30003be0 con 0x7f8b400ffde0 2023-10-14T09:05:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.805+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b400698c0 con 0x7f8b400ffde0 2023-10-14T09:05:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.807+0000 7f8b3cff9700 1 -- 172.21.15.6:0/3861722149 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8b30003d40 con 0x7f8b400ffde0 2023-10-14T09:05:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.808+0000 7f8b3cff9700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8b280a1500 0x7f8b280a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.808+0000 7f8b3cff9700 1 -- 172.21.15.6:0/3861722149 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8b30014070 con 0x7f8b400ffde0 2023-10-14T09:05:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.809+0000 7f8b51cfdb80 1 Processor -- start 2023-10-14T09:05:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.809+0000 7f8b3effd700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8b280a1500 0x7f8b280a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 -- start start 2023-10-14T09:05:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571184800 0x557571184c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 0x557571185ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571186050 0x5575711864d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575710f9c10 con 0x557571184800 2023-10-14T09:05:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575710dec00 con 0x557571185160 2023-10-14T09:05:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575710dc520 con 0x557571186050 2023-10-14T09:05:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b3effd700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8b280a1500 0x7f8b280a39c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b34007c90 tx=0x7f8b34011040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 0x557571185ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 0x557571185ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34636/0 (socket says 172.21.15.6:34636) 2023-10-14T09:05:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b3effd700 1 -- 172.21.15.6:0/2031087903 learned_addr learned my addr 172.21.15.6:0/2031087903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.810+0000 7f8b3ffff700 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571186050 0x5575711864d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b3effd700 1 -- 172.21.15.6:0/2031087903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571186050 msgr2=0x5575711864d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:23.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b3effd700 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571186050 0x5575711864d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b3effd700 1 -- 172.21.15.6:0/2031087903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571184800 msgr2=0x557571184c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:05:23.820 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b3effd700 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571184800 0x557571184c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b3effd700 1 -- 172.21.15.6:0/2031087903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557571095390 con 0x557571185160 2023-10-14T09:05:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b3effd700 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 0x557571185ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400eef0 tx=0x7f8b34013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2887dbfabcd772c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b25ffb700 1 -- 172.21.15.6:0/2031087903 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34007940 con 0x557571185160 2023-10-14T09:05:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b25ffb700 1 -- 172.21.15.6:0/2031087903 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b34007e80 con 0x557571185160 2023-10-14T09:05:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.811+0000 7f8b25ffb700 1 -- 172.21.15.6:0/2031087903 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34024640 con 0x557571185160 2023-10-14T09:05:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/2031087903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 msgr2=0x557571185ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 0x557571185ac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400eef0 tx=0x7f8b34013000 comp rx=0 tx=0).stop 2023-10-14T09:05:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/2031087903 shutdown_connections 2023-10-14T09:05:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571186050 0x5575711864d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571184800 0x557571184c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/2031087903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571185160 0x557571185ac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.812+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/2031087903 >> 172.21.15.6:0/2031087903 conn(0x5575710b2d70 msgr2=0x55757117fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.814+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/2031087903 shutdown_connections 2023-10-14T09:05:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.814+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/2031087903 wait complete. 2023-10-14T09:05:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.814+0000 7f8b51cfdb80 1 -- start start 2023-10-14T09:05:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.814+0000 7f8b51cfdb80 1 Processor -- start 2023-10-14T09:05:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x557571197140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571186050 0x557571197680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x55757119eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575710d7e10 con 0x55757119c6b0 2023-10-14T09:05:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575710746b0 con 0x557571186050 2023-10-14T09:05:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557571074350 con 0x557571185160 2023-10-14T09:05:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b51cfdb80 10 client.0 _ll_register_callbacks cb 0x557570ed17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x557571197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x557571197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33284/0 (socket says 172.21.15.6:33284) 2023-10-14T09:05:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/88241934 learned_addr learned my addr 172.21.15.6:0/88241934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.816+0000 7f8b3ffff700 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x55757119eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/88241934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571186050 msgr2=0x557571197680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:05:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571186050 0x557571197680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/88241934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 msgr2=0x55757119eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x55757119eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/88241934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3400ebd0 con 0x557571185160 2023-10-14T09:05:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x557571197140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b30099fd0 tx=0x7f8b30099cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a73956c4ae11a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b1effd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:05:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b1effd700 1 -- 172.21.15.6:0/88241934 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3009a2d0 con 0x557571185160 2023-10-14T09:05:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b1effd700 1 -- 172.21.15.6:0/88241934 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8b3009e420 con 0x557571185160 2023-10-14T09:05:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.817+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575710dce90 con 0x557571185160 2023-10-14T09:05:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.819+0000 7f8b1effd700 1 -- 172.21.15.6:0/88241934 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b300a2660 con 0x557571185160 2023-10-14T09:05:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.819+0000 7f8b51cfdb80 10 client.26161 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.819+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x557570f02d80 con 0x557571185160 2023-10-14T09:05:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b1effd700 1 -- 172.21.15.6:0/88241934 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5575710dce90 con 0x557571185160 2023-10-14T09:05:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b1effd700 1 -- 172.21.15.6:0/88241934 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8b300a21d0 con 0x557571185160 2023-10-14T09:05:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b51cfdb80 10 client.26161 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b51cfdb80 10 client.26161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b51cfdb80 20 client.26161 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55757118cbf0 0x55757118efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b51cfdb80 4 client.26161 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:05:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.820+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557571154bb0 con 0x55757118cbf0 2023-10-14T09:05:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.821+0000 7f8b3effd700 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55757118cbf0 0x55757118efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.821+0000 7f8b1effd700 10 client.26161 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.821+0000 7f8b3effd700 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55757118cbf0 0x55757118efe0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=525f00216c888946 server_cookie=fc475b44f05885db in_seq=0 out_seq=0 2023-10-14T09:05:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b1effd700 1 -- 172.21.15.6:0/88241934 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557571154bb0 con 0x55757118cbf0 2023-10-14T09:05:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b1effd700 10 client.26161 handle_command_reply: tid=0 2023-10-14T09:05:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 client.26161 shutdown 2023-10-14T09:05:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 msgr2=0x557571197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x557571197140 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8b30099fd0 tx=0x7f8b30099cb0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 shutdown_connections 2023-10-14T09:05:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55757118cbf0 0x55757118efe0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x55757119eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x557571197140 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/88241934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557571186050 0x557571197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 >> 172.21.15.6:0/88241934 conn(0x5575710b2d70 msgr2=0x55757117f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b1effd700 0 client.26161 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.822+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 shutdown_connections 2023-10-14T09:05:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.823+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/88241934 wait complete. 2023-10-14T09:05:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.823+0000 7f8b51cfdb80 20 client.26161 trim_cache size 0 max 16384 2023-10-14T09:05:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.853+0000 7f8b51cfdb80 1 Processor -- start 2023-10-14T09:05:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 -- start start 2023-10-14T09:05:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x5575711a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571186050 0x557571196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55757119c6b0 0x557571197430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557570f588c0 con 0x557571186050 2023-10-14T09:05:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557571196ce0 con 0x55757119c6b0 2023-10-14T09:05:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.857+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55757117c450 con 0x557571185160 2023-10-14T09:05:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.860+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x5575711a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.860+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x5575711a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33292/0 (socket says 172.21.15.6:33292) 2023-10-14T09:05:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.860+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/414799881 learned_addr learned my addr 172.21.15.6:0/414799881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.871+0000 7f8b3effd700 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571186050 0x557571196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.871+0000 7f8b3effd700 1 -- 172.21.15.6:0/414799881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 msgr2=0x5575711a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.871+0000 7f8b3effd700 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x5575711a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.871+0000 7f8b3effd700 1 -- 172.21.15.6:0/414799881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55757119c6b0 msgr2=0x557571197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.871+0000 7f8b3effd700 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55757119c6b0 0x557571197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.871+0000 7f8b3effd700 1 -- 172.21.15.6:0/414799881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557570eebc00 con 0x557571186050 2023-10-14T09:05:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.872+0000 7f8b3effd700 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571186050 0x557571196ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400e9c0 tx=0x7f8b340076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53487fcc2c88d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:23.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.872+0000 7f8b267fc700 1 -- 172.21.15.6:0/414799881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3401cb90 con 0x557571186050 2023-10-14T09:05:23.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.872+0000 7f8b267fc700 1 -- 172.21.15.6:0/414799881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b3401ccf0 con 0x557571186050 2023-10-14T09:05:23.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.872+0000 7f8b267fc700 1 -- 172.21.15.6:0/414799881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34005280 con 0x557571186050 2023-10-14T09:05:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/414799881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571186050 msgr2=0x557571196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571186050 0x557571196ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400e9c0 tx=0x7f8b340076e0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/414799881 shutdown_connections 2023-10-14T09:05:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55757119c6b0 0x557571197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557571185160 0x5575711a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/414799881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557571186050 0x557571196ef0 secure :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400e9c0 tx=0x7f8b340076e0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.873+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/414799881 >> 172.21.15.6:0/414799881 conn(0x5575710b2d70 msgr2=0x557571191f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.878+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/414799881 shutdown_connections 2023-10-14T09:05:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.878+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/414799881 wait complete. 2023-10-14T09:05:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.878+0000 7f8b51cfdb80 1 -- start start 2023-10-14T09:05:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 Processor -- start 2023-10-14T09:05:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x5575711eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575711eafa0 0x5575711a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575711eb420 0x5575711ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575711ff6f0 con 0x55757119c6b0 2023-10-14T09:05:23.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575711ff860 con 0x5575711eafa0 2023-10-14T09:05:23.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575711ffa20 con 0x5575711eb420 2023-10-14T09:05:23.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.879+0000 7f8b51cfdb80 10 client.0 _ll_register_callbacks cb 0x7f8b3009a0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:23.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x5575711eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x5575711eaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35896/0 (socket says 172.21.15.6:35896) 2023-10-14T09:05:23.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/4238834482 learned_addr learned my addr 172.21.15.6:0/4238834482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:23.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575711eb420 msgr2=0x5575711ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575711eb420 0x5575711ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/4238834482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575711eafa0 msgr2=0x5575711a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575711eafa0 0x5575711a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 -- 172.21.15.6:0/4238834482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b34029040 con 0x55757119c6b0 2023-10-14T09:05:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b3f7fe700 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x5575711eaa60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8b3009a260 tx=0x7f8b30099400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed057a3c51261040 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b1effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:05:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b1effd700 1 -- 172.21.15.6:0/4238834482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3009e420 con 0x55757119c6b0 2023-10-14T09:05:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b34007e80 con 0x55757119c6b0 2023-10-14T09:05:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.880+0000 7f8b1effd700 1 -- 172.21.15.6:0/4238834482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f8b3009a2d0 con 0x55757119c6b0 2023-10-14T09:05:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b1effd700 1 -- 172.21.15.6:0/4238834482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b300a2660 con 0x55757119c6b0 2023-10-14T09:05:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 10 client.16560 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x557570f291f0 con 0x55757119c6b0 2023-10-14T09:05:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b1effd700 1 -- 172.21.15.6:0/4238834482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b30083080 con 0x55757119c6b0 2023-10-14T09:05:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b1effd700 1 -- 172.21.15.6:0/4238834482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8b3007d030 con 0x55757119c6b0 2023-10-14T09:05:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 10 client.16560 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 10 client.16560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 20 client.16560 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x557571201020 0x557571203440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 4 client.16560 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:05:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.881+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5575710d0df0 con 0x557571201020 2023-10-14T09:05:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.883+0000 7f8b3effd700 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x557571201020 0x557571203440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.886+0000 7f8b1effd700 10 client.16560 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:23.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.886+0000 7f8b3effd700 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x557571201020 0x557571203440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=468a60a4b3756c01 server_cookie=3ab3774e4dee67b4 in_seq=0 out_seq=0 2023-10-14T09:05:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b1effd700 1 -- 172.21.15.6:0/4238834482 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5575710d0df0 con 0x557571201020 2023-10-14T09:05:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b1effd700 10 client.16560 handle_command_reply: tid=0 2023-10-14T09:05:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 client.16560 shutdown 2023-10-14T09:05:23.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 msgr2=0x5575711eaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x5575711eaa60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8b3009a260 tx=0x7f8b30099400 comp rx=0 tx=0).stop 2023-10-14T09:05:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 shutdown_connections 2023-10-14T09:05:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x557571201020 0x557571203440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5575711eb420 0x5575711ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b1effd700 0 client.16560 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55757119c6b0 0x5575711eaa60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 --2- 172.21.15.6:0/4238834482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5575711eafa0 0x5575711a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 >> 172.21.15.6:0/4238834482 conn(0x5575710b2d70 msgr2=0x557571196ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:23.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 shutdown_connections 2023-10-14T09:05:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 1 -- 172.21.15.6:0/4238834482 wait complete. 2023-10-14T09:05:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.903+0000 7f8b51cfdb80 20 client.16560 trim_cache size 0 max 16384 2023-10-14T09:05:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:05:23.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:05:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:05:23.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:05:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8b280a1500 msgr2=0x7f8b280a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8b280a1500 0x7f8b280a39c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8b34007c90 tx=0x7f8b34011040 comp rx=0 tx=0).stop 2023-10-14T09:05:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 msgr2=0x7f8b40195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:23.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 0x7f8b40195bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000e9c0 tx=0x7f8b3000ecd0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 shutdown_connections 2023-10-14T09:05:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b40101970 0x7f8b4019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f8b280a1500 0x7f8b280a39c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b400ffde0 0x7f8b40195bf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 --2- 172.21.15.6:0/3861722149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b40100fd0 0x7f8b40196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 >> 172.21.15.6:0/3861722149 conn(0x7f8b400fb370 msgr2=0x7f8b40104470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 shutdown_connections 2023-10-14T09:05:23.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:23.904+0000 7f8b45b13700 1 -- 172.21.15.6:0/3861722149 wait complete. 2023-10-14T09:05:23.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:23 smithi006 ceph-mon[99452]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 743 op/s 2023-10-14T09:05:24.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:23 smithi178 ceph-mon[103612]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 743 op/s 2023-10-14T09:05:24.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:23 smithi057 ceph-mon[103313]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 743 op/s 2023-10-14T09:05:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 745.0 s, 1204.4 tps, lat 83.808 ms stddev 95.414 2023-10-14T09:05:25.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:25 smithi006 ceph-mon[99452]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-14T09:05:26.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:25 smithi178 ceph-mon[103612]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-14T09:05:26.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:25 smithi057 ceph-mon[103313]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 838 op/s 2023-10-14T09:05:28.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:27 smithi178 ceph-mon[103612]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 879 op/s 2023-10-14T09:05:28.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:27 smithi057 ceph-mon[103313]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 879 op/s 2023-10-14T09:05:28.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:27 smithi006 ceph-mon[99452]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 879 op/s 2023-10-14T09:05:29.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:28 smithi178 ceph-mon[103612]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 827 op/s 2023-10-14T09:05:29.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:28 smithi057 ceph-mon[103313]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 827 op/s 2023-10-14T09:05:29.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:28 smithi006 ceph-mon[99452]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 827 op/s 2023-10-14T09:05:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 750.0 s, 1473.6 tps, lat 67.396 ms stddev 77.515 2023-10-14T09:05:31.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:30 smithi178 ceph-mon[103612]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 865 op/s 2023-10-14T09:05:31.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:30 smithi057 ceph-mon[103313]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 865 op/s 2023-10-14T09:05:31.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:30 smithi006 ceph-mon[99452]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 865 op/s 2023-10-14T09:05:33.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:33 smithi057 ceph-mon[103313]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 745 op/s 2023-10-14T09:05:33.736 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:33 smithi006 ceph-mon[99452]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 745 op/s 2023-10-14T09:05:33.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:33 smithi178 ceph-mon[103612]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 745 op/s 2023-10-14T09:05:35.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:35 smithi057 ceph-mon[103313]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 754 op/s 2023-10-14T09:05:35.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:35 smithi006 ceph-mon[99452]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 754 op/s 2023-10-14T09:05:35.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:35 smithi178 ceph-mon[103612]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 754 op/s 2023-10-14T09:05:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 755.0 s, 1469.2 tps, lat 68.784 ms stddev 72.290 2023-10-14T09:05:37.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.063+0000 7fa14da10700 1 -- 172.21.15.6:0/588391307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa148101920 msgr2=0x7fa148108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.063+0000 7fa14da10700 1 --2- 172.21.15.6:0/588391307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa148101920 0x7fa148108240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa140009990 tx=0x7fa140009ca0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 -- 172.21.15.6:0/588391307 shutdown_connections 2023-10-14T09:05:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 --2- 172.21.15.6:0/588391307 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa148101920 0x7fa148108240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 --2- 172.21.15.6:0/588391307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1480ffe10 0x7fa148100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 --2- 172.21.15.6:0/588391307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa1481013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 -- 172.21.15.6:0/588391307 >> 172.21.15.6:0/588391307 conn(0x7fa1480fb3c0 msgr2=0x7fa1480fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 -- 172.21.15.6:0/588391307 shutdown_connections 2023-10-14T09:05:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 -- 172.21.15.6:0/588391307 wait complete. 2023-10-14T09:05:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.064+0000 7fa14da10700 1 Processor -- start 2023-10-14T09:05:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 -- start start 2023-10-14T09:05:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1480ffe10 0x7fa14810a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa148108d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148101920 0x7fa148109270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148109a10 con 0x7fa148100f60 2023-10-14T09:05:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148109b80 con 0x7fa1480ffe10 2023-10-14T09:05:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa14da10700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1481a0bf0 con 0x7fa148101920 2023-10-14T09:05:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa1467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa148108d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1480ffe10 0x7fa14810a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa1467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa148108d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35912/0 (socket says 172.21.15.6:35912) 2023-10-14T09:05:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa1467fc700 1 -- 172.21.15.6:0/3908534434 learned_addr learned my addr 172.21.15.6:0/3908534434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.065+0000 7fa1477fe700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148101920 0x7fa148109270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa146ffd700 1 -- 172.21.15.6:0/3908534434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148101920 msgr2=0x7fa148109270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa146ffd700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148101920 0x7fa148109270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa146ffd700 1 -- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 msgr2=0x7fa148108d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa146ffd700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa148108d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa146ffd700 1 -- 172.21.15.6:0/3908534434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c009520 con 0x7fa1480ffe10 2023-10-14T09:05:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa1467fc700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa148108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa146ffd700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1480ffe10 0x7fa14810a6f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa138007ec0 tx=0x7fa13800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa14ca0e700 1 -- 172.21.15.6:0/3908534434 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138004db0 con 0x7fa1480ffe10 2023-10-14T09:05:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa14ca0e700 1 -- 172.21.15.6:0/3908534434 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa13800f040 con 0x7fa1480ffe10 2023-10-14T09:05:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1400095f0 con 0x7fa1480ffe10 2023-10-14T09:05:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa14ca0e700 1 -- 172.21.15.6:0/3908534434 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380058e0 con 0x7fa1480ffe10 2023-10-14T09:05:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.066+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1481a11e0 con 0x7fa1480ffe10 2023-10-14T09:05:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.068+0000 7fa14ca0e700 1 -- 172.21.15.6:0/3908534434 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa13800db20 con 0x7fa1480ffe10 2023-10-14T09:05:37.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.069+0000 7fa14ca0e700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa1300a1500 0x7fa1300a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.069+0000 7fa14ca0e700 1 -- 172.21.15.6:0/3908534434 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa1380cc550 con 0x7fa1480ffe10 2023-10-14T09:05:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.070+0000 7fa159bfab80 1 Processor -- start 2023-10-14T09:05:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.070+0000 7fa159bfab80 1 -- start start 2023-10-14T09:05:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.070+0000 7fa1467fc700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa1300a1500 0x7fa1300a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 0x55f6282a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a70a0 0x55f6282a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa159bfab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62821ac10 con 0x55f6282a5850 2023-10-14T09:05:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa159bfab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6281ffc00 con 0x55f6282a61b0 2023-10-14T09:05:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa159bfab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6281fd520 con 0x55f6282a70a0 2023-10-14T09:05:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 0x55f6282a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 0x55f6282a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35918/0 (socket says 172.21.15.6:35918) 2023-10-14T09:05:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 -- 172.21.15.6:0/2817669912 learned_addr learned my addr 172.21.15.6:0/2817669912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa1467fc700 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa1477fe700 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a70a0 0x55f6282a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 -- 172.21.15.6:0/2817669912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a70a0 msgr2=0x55f6282a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a70a0 0x55f6282a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 -- 172.21.15.6:0/2817669912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 msgr2=0x55f6282a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa146ffd700 1 -- 172.21.15.6:0/2817669912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6281b6390 con 0x55f6282a5850 2023-10-14T09:05:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.071+0000 7fa1467fc700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa1300a1500 0x7fa1300a39c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa13c011bd0 tx=0x7fa13c011f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.072+0000 7fa146ffd700 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 0x55f6282a5c70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa138099800 tx=0x7fa1380994b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b67993f113b75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.072+0000 7fa12dffb700 1 -- 172.21.15.6:0/2817669912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138082ea0 con 0x55f6282a5850 2023-10-14T09:05:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.072+0000 7fa12dffb700 1 -- 172.21.15.6:0/2817669912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa13809d9c0 con 0x55f6282a5850 2023-10-14T09:05:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.072+0000 7fa12dffb700 1 -- 172.21.15.6:0/2817669912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380050d0 con 0x55f6282a5850 2023-10-14T09:05:37.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.072+0000 7fa159bfab80 1 -- 172.21.15.6:0/2817669912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 msgr2=0x55f6282a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.072+0000 7fa159bfab80 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 0x55f6282a5c70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa138099800 tx=0x7fa1380994b0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 -- 172.21.15.6:0/2817669912 shutdown_connections 2023-10-14T09:05:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a70a0 0x55f6282a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a5850 0x55f6282a5c70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 --2- 172.21.15.6:0/2817669912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 -- 172.21.15.6:0/2817669912 >> 172.21.15.6:0/2817669912 conn(0x55f6281d3d70 msgr2=0x55f6282a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 -- 172.21.15.6:0/2817669912 shutdown_connections 2023-10-14T09:05:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 -- 172.21.15.6:0/2817669912 wait complete. 2023-10-14T09:05:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 -- start start 2023-10-14T09:05:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.073+0000 7fa159bfab80 1 Processor -- start 2023-10-14T09:05:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a5850 0x55f6282af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6281f8e10 con 0x55f6282a70a0 2023-10-14T09:05:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6281956b0 con 0x55f6282a61b0 2023-10-14T09:05:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f628195350 con 0x55f6282a5850 2023-10-14T09:05:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa159bfab80 10 client.0 _ll_register_callbacks cb 0x55f627ff27a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa1467fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa1467fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34684/0 (socket says 172.21.15.6:34684) 2023-10-14T09:05:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa1467fc700 1 -- 172.21.15.6:0/1911465491 learned_addr learned my addr 172.21.15.6:0/1911465491 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a5850 0x55f6282af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa146ffd700 1 -- 172.21.15.6:0/1911465491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 msgr2=0x55f6282afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa146ffd700 1 -- 172.21.15.6:0/1911465491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 msgr2=0x55f6282b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa146ffd700 1 -- 172.21.15.6:0/1911465491 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1481a11e0 con 0x55f6282a5850 2023-10-14T09:05:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.074+0000 7fa1467fc700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a5850 0x55f6282af6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa13800d700 tx=0x7fa138099930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8a15b6a506e64cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa126ffd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:05:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa126ffd700 1 -- 172.21.15.6:0/1911465491 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138082ea0 con 0x55f6282a5850 2023-10-14T09:05:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa126ffd700 1 -- 172.21.15.6:0/1911465491 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa138005070 con 0x55f6282a5850 2023-10-14T09:05:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6281fde90 con 0x55f6282a5850 2023-10-14T09:05:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa126ffd700 1 -- 172.21.15.6:0/1911465491 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa138099ad0 con 0x55f6282a5850 2023-10-14T09:05:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa159bfab80 10 client.26176 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55f628023d80 con 0x55f6282a5850 2023-10-14T09:05:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa126ffd700 1 -- 172.21.15.6:0/1911465491 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1380a5080 con 0x55f6282a5850 2023-10-14T09:05:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa126ffd700 1 -- 172.21.15.6:0/1911465491 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa1380a1770 con 0x55f6282a5850 2023-10-14T09:05:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.075+0000 7fa159bfab80 10 client.26176 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa159bfab80 10 client.26176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa159bfab80 20 client.26176 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f6282bb1b0 0x55f6282bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa159bfab80 4 client.26176 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:05:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f628275bb0 con 0x55f6282bb1b0 2023-10-14T09:05:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa1467fc700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f6282bb1b0 0x55f6282bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa1467fc700 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f6282bb1b0 0x55f6282bd5d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92a8aea0b6554e3 server_cookie=dc78e1b19672c618 in_seq=0 out_seq=0 2023-10-14T09:05:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.076+0000 7fa126ffd700 10 client.26176 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.079+0000 7fa126ffd700 1 -- 172.21.15.6:0/1911465491 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f628275bb0 con 0x55f6282bb1b0 2023-10-14T09:05:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.079+0000 7fa126ffd700 10 client.26176 handle_command_reply: tid=0 2023-10-14T09:05:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.079+0000 7fa159bfab80 1 client.26176 shutdown 2023-10-14T09:05:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.079+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a5850 msgr2=0x55f6282af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.079+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a5850 0x55f6282af6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa13800d700 tx=0x7fa138099930 comp rx=0 tx=0).stop 2023-10-14T09:05:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 shutdown_connections 2023-10-14T09:05:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f6282bb1b0 0x55f6282bd5d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a5850 0x55f6282af6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa126ffd700 0 client.26176 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1911465491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a61b0 0x55f6282afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 >> 172.21.15.6:0/1911465491 conn(0x55f6281d3d70 msgr2=0x55f6282a0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 shutdown_connections 2023-10-14T09:05:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 1 -- 172.21.15.6:0/1911465491 wait complete. 2023-10-14T09:05:37.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.081+0000 7fa159bfab80 20 client.26176 trim_cache size 0 max 16384 2023-10-14T09:05:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 Processor -- start 2023-10-14T09:05:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 -- start start 2023-10-14T09:05:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6280798c0 con 0x55f6282a70a0 2023-10-14T09:05:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6282bad60 con 0x55f6282a5850 2023-10-14T09:05:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa159bfab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6282a6930 con 0x55f6282a61b0 2023-10-14T09:05:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa1477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa1477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35936/0 (socket says 172.21.15.6:35936) 2023-10-14T09:05:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa1477fe700 1 -- 172.21.15.6:0/724217498 learned_addr learned my addr 172.21.15.6:0/724217498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa1467fc700 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.101+0000 7fa146ffd700 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa1477fe700 1 -- 172.21.15.6:0/724217498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 msgr2=0x55f6282b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa1477fe700 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa1477fe700 1 -- 172.21.15.6:0/724217498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 msgr2=0x55f6282ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa1477fe700 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa1477fe700 1 -- 172.21.15.6:0/724217498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f62800cc00 con 0x55f6282a70a0 2023-10-14T09:05:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa146ffd700 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa1477fe700 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282ad4b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa140009990 tx=0x7fa1400050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71379e643022b148 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa12e7fc700 1 -- 172.21.15.6:0/724217498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14001d070 con 0x55f6282a70a0 2023-10-14T09:05:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa12e7fc700 1 -- 172.21.15.6:0/724217498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14001e040 con 0x55f6282a70a0 2023-10-14T09:05:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.102+0000 7fa12e7fc700 1 -- 172.21.15.6:0/724217498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140004be0 con 0x55f6282a70a0 2023-10-14T09:05:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.103+0000 7fa159bfab80 1 -- 172.21.15.6:0/724217498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 msgr2=0x55f6282ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.103+0000 7fa159bfab80 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282ad4b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa140009990 tx=0x7fa1400050f0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 -- 172.21.15.6:0/724217498 shutdown_connections 2023-10-14T09:05:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282ad4b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 --2- 172.21.15.6:0/724217498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 -- 172.21.15.6:0/724217498 >> 172.21.15.6:0/724217498 conn(0x55f6281d3d70 msgr2=0x55f6282c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 -- 172.21.15.6:0/724217498 shutdown_connections 2023-10-14T09:05:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 -- 172.21.15.6:0/724217498 wait complete. 2023-10-14T09:05:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 -- start start 2023-10-14T09:05:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.105+0000 7fa159bfab80 1 Processor -- start 2023-10-14T09:05:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6282b65c0 con 0x55f6282a70a0 2023-10-14T09:05:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6282b6730 con 0x55f6282a5850 2023-10-14T09:05:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6282b68f0 con 0x55f6282a61b0 2023-10-14T09:05:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa159bfab80 10 client.0 _ll_register_callbacks cb 0x7fa13c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35942/0 (socket says 172.21.15.6:35942) 2023-10-14T09:05:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 -- 172.21.15.6:0/1351795248 learned_addr learned my addr 172.21.15.6:0/1351795248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1467fc700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 -- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 msgr2=0x55f6282b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 -- 172.21.15.6:0/1351795248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 msgr2=0x55f6282b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 -- 172.21.15.6:0/1351795248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f628023d80 con 0x55f6282a70a0 2023-10-14T09:05:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa1477fe700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6080 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098e0 tx=0x7fa1400046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158843d8f41bff77 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa126ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:05:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.106+0000 7fa126ffd700 1 -- 172.21.15.6:0/1351795248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14001d040 con 0x55f6282a70a0 2023-10-14T09:05:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.107+0000 7fa126ffd700 1 -- 172.21.15.6:0/1351795248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa14000b7f0 con 0x55f6282a70a0 2023-10-14T09:05:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.107+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa13809d9c0 con 0x55f6282a70a0 2023-10-14T09:05:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.107+0000 7fa126ffd700 1 -- 172.21.15.6:0/1351795248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14000b9f0 con 0x55f6282a70a0 2023-10-14T09:05:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.108+0000 7fa159bfab80 10 client.16575 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.108+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7fa1480693b0 con 0x55f6282a70a0 2023-10-14T09:05:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa126ffd700 1 -- 172.21.15.6:0/1351795248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa13809d9c0 con 0x55f6282a70a0 2023-10-14T09:05:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa126ffd700 1 -- 172.21.15.6:0/1351795248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa14000f460 con 0x55f6282a70a0 2023-10-14T09:05:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa159bfab80 10 client.16575 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa159bfab80 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa159bfab80 20 client.16575 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f62830fe20 0x55f628312240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa159bfab80 4 client.16575 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:05:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f6281f1df0 con 0x55f62830fe20 2023-10-14T09:05:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f62830fe20 0x55f628312240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa126ffd700 10 client.16575 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.109+0000 7fa146ffd700 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f62830fe20 0x55f628312240 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1fae9c8582cf7ce server_cookie=fa864feca5bd349f in_seq=0 out_seq=0 2023-10-14T09:05:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.123+0000 7fa126ffd700 1 -- 172.21.15.6:0/1351795248 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f6281f1df0 con 0x55f62830fe20 2023-10-14T09:05:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.123+0000 7fa126ffd700 10 client.16575 handle_command_reply: tid=0 2023-10-14T09:05:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.123+0000 7fa159bfab80 1 client.16575 shutdown 2023-10-14T09:05:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.123+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 msgr2=0x55f6282b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.123+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6080 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098e0 tx=0x7fa1400046a0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 shutdown_connections 2023-10-14T09:05:37.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f62830fe20 0x55f628312240 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f6282a70a0 0x55f6282b6080 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f6282a5850 0x55f6282b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa126ffd700 0 client.16575 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:37.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 --2- 172.21.15.6:0/1351795248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f6282a61b0 0x55f6282b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 >> 172.21.15.6:0/1351795248 conn(0x55f6281d3d70 msgr2=0x55f6282ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:37.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 shutdown_connections 2023-10-14T09:05:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 1 -- 172.21.15.6:0/1351795248 wait complete. 2023-10-14T09:05:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa159bfab80 20 client.16575 trim_cache size 0 max 16384 2023-10-14T09:05:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:05:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:05:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:05:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:05:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa1300a1500 msgr2=0x7fa1300a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa1300a1500 0x7fa1300a39c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa13c011bd0 tx=0x7fa13c011f90 comp rx=0 tx=0).stop 2023-10-14T09:05:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1480ffe10 msgr2=0x7fa14810a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1480ffe10 0x7fa14810a6f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa138007ec0 tx=0x7fa13800d3b0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 shutdown_connections 2023-10-14T09:05:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148101920 0x7fa148109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa1300a1500 0x7fa1300a39c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1480ffe10 0x7fa14810a6f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 --2- 172.21.15.6:0/3908534434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa148100f60 0x7fa148108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 >> 172.21.15.6:0/3908534434 conn(0x7fa1480fb3c0 msgr2=0x7fa1480fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 shutdown_connections 2023-10-14T09:05:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:37.124+0000 7fa14da10700 1 -- 172.21.15.6:0/3908534434 wait complete. 2023-10-14T09:05:37.694 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:37 smithi057 ceph-mon[103313]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 702 op/s 2023-10-14T09:05:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:37 smithi006 ceph-mon[99452]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 702 op/s 2023-10-14T09:05:37.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:37 smithi178 ceph-mon[103612]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 702 op/s 2023-10-14T09:05:39.704 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:39 smithi057 ceph-mon[103313]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 596 op/s 2023-10-14T09:05:39.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:39 smithi006 ceph-mon[99452]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 596 op/s 2023-10-14T09:05:39.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:39 smithi178 ceph-mon[103612]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 596 op/s 2023-10-14T09:05:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 760.0 s, 982.6 tps, lat 101.548 ms stddev 185.264 2023-10-14T09:05:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:41 smithi006 ceph-mon[99452]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 617 op/s 2023-10-14T09:05:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:41 smithi178 ceph-mon[103612]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 617 op/s 2023-10-14T09:05:41.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:41 smithi057 ceph-mon[103313]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 617 op/s 2023-10-14T09:05:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:43 smithi006 ceph-mon[99452]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.21k op/s 2023-10-14T09:05:43.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:43 smithi178 ceph-mon[103612]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.21k op/s 2023-10-14T09:05:43.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:43 smithi057 ceph-mon[103313]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.21k op/s 2023-10-14T09:05:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:45 smithi006 ceph-mon[99452]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 1.63k op/s 2023-10-14T09:05:45.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:05:45.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.733 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:45 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:45 smithi178 ceph-mon[103612]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 1.63k op/s 2023-10-14T09:05:45.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:05:45.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:45 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:45 smithi057 ceph-mon[103313]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 1.63k op/s 2023-10-14T09:05:45.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:05:45.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:45 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:45.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 765.0 s, 1199.9 tps, lat 83.380 ms stddev 92.750 2023-10-14T09:05:46.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:05:46.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:05:46.732 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:05:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:05:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:05:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:05:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:05:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:47 smithi178 ceph-mon[103612]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 1.83k op/s 2023-10-14T09:05:47.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:47 smithi057 ceph-mon[103313]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 1.83k op/s 2023-10-14T09:05:47.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:47 smithi006 ceph-mon[99452]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 33 MiB/s wr, 1.83k op/s 2023-10-14T09:05:49.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:49 smithi178 ceph-mon[103612]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.78k op/s 2023-10-14T09:05:49.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:49 smithi057 ceph-mon[103313]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.78k op/s 2023-10-14T09:05:49.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:49 smithi006 ceph-mon[99452]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 1.78k op/s 2023-10-14T09:05:50.294 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 -- 172.21.15.6:0/414320196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0548106c00 msgr2=0x7f0548109070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 --2- 172.21.15.6:0/414320196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0548106c00 0x7f0548109070 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f054000b0a0 tx=0x7f054000b3b0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 -- 172.21.15.6:0/414320196 shutdown_connections 2023-10-14T09:05:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 --2- 172.21.15.6:0/414320196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0548106c00 0x7f0548109070 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.295 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 --2- 172.21.15.6:0/414320196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05481019a0 0x7f0548103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 --2- 172.21.15.6:0/414320196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05481042d0 0x7f05481066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 -- 172.21.15.6:0/414320196 >> 172.21.15.6:0/414320196 conn(0x7f05480fb370 msgr2=0x7f05480fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 -- 172.21.15.6:0/414320196 shutdown_connections 2023-10-14T09:05:50.296 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.292+0000 7f054d86f700 1 -- 172.21.15.6:0/414320196 wait complete. 2023-10-14T09:05:50.297 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 Processor -- start 2023-10-14T09:05:50.298 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 -- start start 2023-10-14T09:05:50.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05481019a0 0x7f0548196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 0x7f05481971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0548106c00 0x7f054819e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.299 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054819e810 con 0x7f05481042d0 2023-10-14T09:05:50.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054819e980 con 0x7f05481019a0 2023-10-14T09:05:50.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f054d86f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054819eb40 con 0x7f0548106c00 2023-10-14T09:05:50.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f05467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 0x7f05481971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f05467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 0x7f05481971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35954/0 (socket says 172.21.15.6:35954) 2023-10-14T09:05:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f05467fc700 1 -- 172.21.15.6:0/1458739847 learned_addr learned my addr 172.21.15.6:0/1458739847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.293+0000 7f05477fe700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0548106c00 0x7f054819e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.295+0000 7f05467fc700 1 -- 172.21.15.6:0/1458739847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0548106c00 msgr2=0x7f054819e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.295+0000 7f05467fc700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0548106c00 0x7f054819e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.295+0000 7f05467fc700 1 -- 172.21.15.6:0/1458739847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05481019a0 msgr2=0x7f0548196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.295+0000 7f05467fc700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05481019a0 0x7f0548196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.295+0000 7f05467fc700 1 -- 172.21.15.6:0/1458739847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c009520 con 0x7f05481042d0 2023-10-14T09:05:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.297+0000 7f05467fc700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 0x7f05481971e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f053c009f60 tx=0x7f053c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.297+0000 7f054c86d700 1 -- 172.21.15.6:0/1458739847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c013be0 con 0x7f05481042d0 2023-10-14T09:05:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.297+0000 7f054c86d700 1 -- 172.21.15.6:0/1458739847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f053c0044e0 con 0x7f05481042d0 2023-10-14T09:05:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.297+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540009d00 con 0x7f05481042d0 2023-10-14T09:05:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.297+0000 7f054c86d700 1 -- 172.21.15.6:0/1458739847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c003680 con 0x7f05481042d0 2023-10-14T09:05:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.297+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480ffb70 con 0x7f05481042d0 2023-10-14T09:05:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.300+0000 7f054c86d700 1 -- 172.21.15.6:0/1458739847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f053c01b440 con 0x7f05481042d0 2023-10-14T09:05:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.301+0000 7f054c86d700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05300a1480 0x7f05300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.301+0000 7f0546ffd700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05300a1480 0x7f05300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.301+0000 7f054c86d700 1 -- 172.21.15.6:0/1458739847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f053c0d11f0 con 0x7f05481042d0 2023-10-14T09:05:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.301+0000 7f0546ffd700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05300a1480 0x7f05300a3940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0538005950 tx=0x7f05380058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 Processor -- start 2023-10-14T09:05:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 -- start start 2023-10-14T09:05:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fae850 0x5586c9faec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9faf1b0 0x5586c9fafac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 0x5586c9fb0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9f23c10 con 0x5586c9fb00a0 2023-10-14T09:05:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9f08c00 con 0x5586c9fae850 2023-10-14T09:05:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0559a59b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9f06520 con 0x5586c9faf1b0 2023-10-14T09:05:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 0x5586c9fb0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 0x5586c9fb0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35964/0 (socket says 172.21.15.6:35964) 2023-10-14T09:05:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 -- 172.21.15.6:0/2587025989 learned_addr learned my addr 172.21.15.6:0/2587025989 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f0546ffd700 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fae850 0x5586c9faec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05467fc700 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9faf1b0 0x5586c9fafac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 -- 172.21.15.6:0/2587025989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9faf1b0 msgr2=0x5586c9fafac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9faf1b0 0x5586c9fafac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 -- 172.21.15.6:0/2587025989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fae850 msgr2=0x5586c9faec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fae850 0x5586c9faec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.302+0000 7f05477fe700 1 -- 172.21.15.6:0/2587025989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586c9ebf390 con 0x5586c9fb00a0 2023-10-14T09:05:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.303+0000 7f05477fe700 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 0x5586c9fb0520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f054000b0a0 tx=0x7f0540009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d081b68ca8977a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.303+0000 7f052dffb700 1 -- 172.21.15.6:0/2587025989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000e040 con 0x5586c9fb00a0 2023-10-14T09:05:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.303+0000 7f052dffb700 1 -- 172.21.15.6:0/2587025989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05400076e0 con 0x5586c9fb00a0 2023-10-14T09:05:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.303+0000 7f052dffb700 1 -- 172.21.15.6:0/2587025989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054001c680 con 0x5586c9fb00a0 2023-10-14T09:05:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 -- 172.21.15.6:0/2587025989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 msgr2=0x5586c9fb0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 0x5586c9fb0520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f054000b0a0 tx=0x7f0540009c20 comp rx=0 tx=0).stop 2023-10-14T09:05:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 -- 172.21.15.6:0/2587025989 shutdown_connections 2023-10-14T09:05:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9fb00a0 0x5586c9fb0520 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fae850 0x5586c9faec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 --2- 172.21.15.6:0/2587025989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9faf1b0 0x5586c9fafac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 -- 172.21.15.6:0/2587025989 >> 172.21.15.6:0/2587025989 conn(0x5586c9edcd70 msgr2=0x5586c9fa9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 -- 172.21.15.6:0/2587025989 shutdown_connections 2023-10-14T09:05:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 -- 172.21.15.6:0/2587025989 wait complete. 2023-10-14T09:05:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 -- start start 2023-10-14T09:05:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.304+0000 7f0559a59b80 1 Processor -- start 2023-10-14T09:05:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fb86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fb8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9f01e10 con 0x5586c9faf1b0 2023-10-14T09:05:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9e9e6b0 con 0x5586c9fb00a0 2023-10-14T09:05:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9e9e350 con 0x5586c9fae850 2023-10-14T09:05:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0559a59b80 10 client.0 _ll_register_callbacks cb 0x5586c9cfb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fb86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fb86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33368/0 (socket says 172.21.15.6:33368) 2023-10-14T09:05:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.305+0000 7f0546ffd700 1 -- 172.21.15.6:0/835835567 learned_addr learned my addr 172.21.15.6:0/835835567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0546ffd700 1 -- 172.21.15.6:0/835835567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 msgr2=0x5586c9fbfc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:05:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0546ffd700 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbfc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0546ffd700 1 -- 172.21.15.6:0/835835567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 msgr2=0x5586c9fb8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0546ffd700 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fb8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0546ffd700 1 -- 172.21.15.6:0/835835567 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0548109c60 con 0x5586c9fae850 2023-10-14T09:05:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0546ffd700 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fb86e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f053801d6e0 tx=0x7f0538004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3e94ff84579a18 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0526ffd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:05:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0526ffd700 1 -- 172.21.15.6:0/835835567 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800eee0 con 0x5586c9fae850 2023-10-14T09:05:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586c9f06e90 con 0x5586c9fae850 2023-10-14T09:05:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.306+0000 7f0526ffd700 1 -- 172.21.15.6:0/835835567 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0538004830 con 0x5586c9fae850 2023-10-14T09:05:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.307+0000 7f0526ffd700 1 -- 172.21.15.6:0/835835567 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05380049f0 con 0x5586c9fae850 2023-10-14T09:05:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 10 client.26194 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5586c9d2cd80 con 0x5586c9fae850 2023-10-14T09:05:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0526ffd700 1 -- 172.21.15.6:0/835835567 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5586c9f06e90 con 0x5586c9fae850 2023-10-14T09:05:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0526ffd700 1 -- 172.21.15.6:0/835835567 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0538018070 con 0x5586c9fae850 2023-10-14T09:05:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 10 client.26194 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 10 client.26194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 20 client.26194 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586c9fd5670 0x5586c9fd7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 4 client.26194 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:05:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.308+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586c9f7ebb0 con 0x5586c9fd5670 2023-10-14T09:05:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.309+0000 7f05467fc700 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586c9fd5670 0x5586c9fd7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.309+0000 7f0526ffd700 10 client.26194 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.309+0000 7f05467fc700 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586c9fd5670 0x5586c9fd7a90 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5151d9b364112266 server_cookie=ad366cd3eb6eb025 in_seq=0 out_seq=0 2023-10-14T09:05:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0526ffd700 1 -- 172.21.15.6:0/835835567 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5586c9f7ebb0 con 0x5586c9fd5670 2023-10-14T09:05:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0526ffd700 10 client.26194 handle_command_reply: tid=0 2023-10-14T09:05:50.331 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 client.26194 shutdown 2023-10-14T09:05:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 msgr2=0x5586c9fb86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fb86e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f053801d6e0 tx=0x7f0538004750 comp rx=0 tx=0).stop 2023-10-14T09:05:50.332 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 shutdown_connections 2023-10-14T09:05:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586c9fd5670 0x5586c9fd7a90 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fb86e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.333 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0526ffd700 0 client.26194 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 --2- 172.21.15.6:0/835835567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fb8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 >> 172.21.15.6:0/835835567 conn(0x5586c9edcd70 msgr2=0x5586c9fa9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:50.334 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 shutdown_connections 2023-10-14T09:05:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 1 -- 172.21.15.6:0/835835567 wait complete. 2023-10-14T09:05:50.335 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.310+0000 7f0559a59b80 20 client.26194 trim_cache size 0 max 16384 2023-10-14T09:05:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 Processor -- start 2023-10-14T09:05:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 -- start start 2023-10-14T09:05:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9faec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fb64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9d828c0 con 0x5586c9faf1b0 2023-10-14T09:05:50.341 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9fb9590 con 0x5586c9fb00a0 2023-10-14T09:05:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0559a59b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9fb7b90 con 0x5586c9fae850 2023-10-14T09:05:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f05467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f05467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35972/0 (socket says 172.21.15.6:35972) 2023-10-14T09:05:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f0546ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9faec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f05477fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fb64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.329+0000 7f05467fc700 1 -- 172.21.15.6:0/398711925 learned_addr learned my addr 172.21.15.6:0/398711925 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f0546ffd700 1 -- 172.21.15.6:0/398711925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 msgr2=0x5586c9fb64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f0546ffd700 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fb64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f0546ffd700 1 -- 172.21.15.6:0/398711925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 msgr2=0x5586c9fbfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f0546ffd700 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f0546ffd700 1 -- 172.21.15.6:0/398711925 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586c9d15c00 con 0x5586c9fae850 2023-10-14T09:05:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f05467fc700 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f0546ffd700 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9faec30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05380094f0 tx=0x7f0538025ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd7890d7f6fc3c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f052e7fc700 1 -- 172.21.15.6:0/398711925 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538025c50 con 0x5586c9fae850 2023-10-14T09:05:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f052e7fc700 1 -- 172.21.15.6:0/398711925 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0538004830 con 0x5586c9fae850 2023-10-14T09:05:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.330+0000 7f052e7fc700 1 -- 172.21.15.6:0/398711925 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538005200 con 0x5586c9fae850 2023-10-14T09:05:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 -- 172.21.15.6:0/398711925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 msgr2=0x5586c9faec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9faec30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05380094f0 tx=0x7f0538025ad0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 -- 172.21.15.6:0/398711925 shutdown_connections 2023-10-14T09:05:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fb64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9faec30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 --2- 172.21.15.6:0/398711925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 -- 172.21.15.6:0/398711925 >> 172.21.15.6:0/398711925 conn(0x5586c9edcd70 msgr2=0x5586c9fa8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 -- 172.21.15.6:0/398711925 shutdown_connections 2023-10-14T09:05:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 -- 172.21.15.6:0/398711925 wait complete. 2023-10-14T09:05:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 -- start start 2023-10-14T09:05:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.331+0000 7f0559a59b80 1 Processor -- start 2023-10-14T09:05:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fbd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9fbf180 con 0x5586c9faf1b0 2023-10-14T09:05:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9fbf2f0 con 0x5586c9fb00a0 2023-10-14T09:05:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586c9fbf4b0 con 0x5586c9fae850 2023-10-14T09:05:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0559a59b80 10 client.0 _ll_register_callbacks cb 0x7f053800ed40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:05:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f05467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f05467fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35980/0 (socket says 172.21.15.6:35980) 2023-10-14T09:05:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f05467fc700 1 -- 172.21.15.6:0/88940796 learned_addr learned my addr 172.21.15.6:0/88940796 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:05:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0546ffd700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fbd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f05477fe700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0546ffd700 1 -- 172.21.15.6:0/88940796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 msgr2=0x5586c9fbec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0546ffd700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0546ffd700 1 -- 172.21.15.6:0/88940796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 msgr2=0x5586c9fbdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:05:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0546ffd700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f0546ffd700 1 -- 172.21.15.6:0/88940796 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480ffb70 con 0x5586c9fae850 2023-10-14T09:05:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.332+0000 7f05467fc700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:05:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0546ffd700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fbd6f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0538013040 tx=0x7f0538025620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65ed94148974fc39 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:05:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0526ffd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:05:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0526ffd700 1 -- 172.21.15.6:0/88940796 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538004bb0 con 0x5586c9fae850 2023-10-14T09:05:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0526ffd700 1 -- 172.21.15.6:0/88940796 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0538004d10 con 0x5586c9fae850 2023-10-14T09:05:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05400076e0 con 0x5586c9fae850 2023-10-14T09:05:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0526ffd700 1 -- 172.21.15.6:0/88940796 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0538005100 con 0x5586c9fae850 2023-10-14T09:05:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0559a59b80 10 client.26200 fetch_fsmap learned FSMap version 55 2023-10-14T09:05:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.333+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5586c9d2cd80 con 0x5586c9fae850 2023-10-14T09:05:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0526ffd700 1 -- 172.21.15.6:0/88940796 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05400076e0 con 0x5586c9fae850 2023-10-14T09:05:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0526ffd700 1 -- 172.21.15.6:0/88940796 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0538018070 con 0x5586c9fae850 2023-10-14T09:05:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0559a59b80 10 client.26200 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:05:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0559a59b80 10 client.26200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:05:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0559a59b80 20 client.26200 populate_metadata read hostname 'smithi006' 2023-10-14T09:05:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0559a59b80 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586ca029e90 0x5586ca02c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:05:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0559a59b80 4 client.26200 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:05:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5586c9efadf0 con 0x5586ca029e90 2023-10-14T09:05:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.334+0000 7f05467fc700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586ca029e90 0x5586ca02c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:05:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.336+0000 7f0526ffd700 10 client.26200 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.336+0000 7f05467fc700 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586ca029e90 0x5586ca02c2b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b425b819601f09d9 server_cookie=ef11dea5c01cd3b3 in_seq=0 out_seq=0 2023-10-14T09:05:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.347+0000 7f0526ffd700 1 -- 172.21.15.6:0/88940796 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5586c9efadf0 con 0x5586ca029e90 2023-10-14T09:05:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.347+0000 7f0526ffd700 10 client.26200 handle_command_reply: tid=0 2023-10-14T09:05:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 client.26200 shutdown 2023-10-14T09:05:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 msgr2=0x5586c9fbd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fbd6f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0538013040 tx=0x7f0538025620 comp rx=0 tx=0).stop 2023-10-14T09:05:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 shutdown_connections 2023-10-14T09:05:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5586ca029e90 0x5586ca02c2b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5586c9fb00a0 0x5586c9fbec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5586c9fae850 0x5586c9fbd6f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0526ffd700 0 client.26200 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:05:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 --2- 172.21.15.6:0/88940796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5586c9faf1b0 0x5586c9fbdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 >> 172.21.15.6:0/88940796 conn(0x5586c9edcd70 msgr2=0x5586c9fb64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 shutdown_connections 2023-10-14T09:05:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.348+0000 7f0559a59b80 1 -- 172.21.15.6:0/88940796 wait complete. 2023-10-14T09:05:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f0559a59b80 20 client.26200 trim_cache size 0 max 16384 2023-10-14T09:05:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:05:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:05:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:05:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:05:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05300a1480 msgr2=0x7f05300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05300a1480 0x7f05300a3940 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0538005950 tx=0x7f05380058e0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 msgr2=0x7f05481971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:05:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 0x7f05481971e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f053c009f60 tx=0x7f053c009f90 comp rx=0 tx=0).stop 2023-10-14T09:05:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 shutdown_connections 2023-10-14T09:05:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0548106c00 0x7f054819e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f05300a1480 0x7f05300a3940 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05481019a0 0x7f0548196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 --2- 172.21.15.6:0/1458739847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05481042d0 0x7f05481971e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:05:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 >> 172.21.15.6:0/1458739847 conn(0x7f05480fb370 msgr2=0x7f0548102610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:05:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 shutdown_connections 2023-10-14T09:05:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:05:50.350+0000 7f054d86f700 1 -- 172.21.15.6:0/1458739847 wait complete. 2023-10-14T09:05:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 770.0 s, 1386.0 tps, lat 72.728 ms stddev 89.152 2023-10-14T09:05:51.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:51 smithi178 ceph-mon[103612]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 MiB/s wr, 1.83k op/s 2023-10-14T09:05:51.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:51 smithi057 ceph-mon[103313]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 MiB/s wr, 1.83k op/s 2023-10-14T09:05:51.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:51 smithi006 ceph-mon[99452]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 MiB/s wr, 1.83k op/s 2023-10-14T09:05:53.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:53 smithi178 ceph-mon[103612]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 MiB/s wr, 2.00k op/s 2023-10-14T09:05:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:53 smithi057 ceph-mon[103313]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 MiB/s wr, 2.00k op/s 2023-10-14T09:05:53.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:53 smithi006 ceph-mon[99452]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 MiB/s wr, 2.00k op/s 2023-10-14T09:05:55.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:55 smithi178 ceph-mon[103612]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 1.35k op/s 2023-10-14T09:05:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:55 smithi057 ceph-mon[103313]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 1.35k op/s 2023-10-14T09:05:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 775.0 s, 1383.4 tps, lat 71.977 ms stddev 77.611 2023-10-14T09:05:55.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:55 smithi006 ceph-mon[99452]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 1.35k op/s 2023-10-14T09:05:57.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:57 smithi178 ceph-mon[103612]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 1.01k op/s 2023-10-14T09:05:57.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:57 smithi057 ceph-mon[103313]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 1.01k op/s 2023-10-14T09:05:57.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:57 smithi006 ceph-mon[99452]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 16 MiB/s wr, 1.01k op/s 2023-10-14T09:05:59.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:05:59 smithi178 ceph-mon[103612]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 723 op/s 2023-10-14T09:05:59.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:05:59 smithi057 ceph-mon[103313]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 723 op/s 2023-10-14T09:05:59.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:05:59 smithi006 ceph-mon[99452]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 723 op/s 2023-10-14T09:06:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 780.0 s, 1593.6 tps, lat 62.552 ms stddev 72.087 2023-10-14T09:06:01.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:01 smithi178 ceph-mon[103612]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 739 op/s 2023-10-14T09:06:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:01 smithi057 ceph-mon[103313]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 739 op/s 2023-10-14T09:06:01.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:01 smithi006 ceph-mon[99452]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 739 op/s 2023-10-14T09:06:03.483 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.481+0000 7ff98f526700 1 -- 172.21.15.6:0/1999627036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff988102b30 msgr2=0x7ff9881093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.481+0000 7ff98f526700 1 --2- 172.21.15.6:0/1999627036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff988102b30 0x7ff9881093e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff98000b0a0 tx=0x7ff98000b3b0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 -- 172.21.15.6:0/1999627036 shutdown_connections 2023-10-14T09:06:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 --2- 172.21.15.6:0/1999627036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff988102b30 0x7ff9881093e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 --2- 172.21.15.6:0/1999627036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9880ff1c0 0x7ff9880ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 --2- 172.21.15.6:0/1999627036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff9881025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 -- 172.21.15.6:0/1999627036 >> 172.21.15.6:0/1999627036 conn(0x7ff9880faaf0 msgr2=0x7ff9880fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 -- 172.21.15.6:0/1999627036 shutdown_connections 2023-10-14T09:06:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.483+0000 7ff98f526700 1 -- 172.21.15.6:0/1999627036 wait complete. 2023-10-14T09:06:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 Processor -- start 2023-10-14T09:06:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 -- start start 2023-10-14T09:06:03.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9880ff1c0 0x7ff988194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff988194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff988102b30 0x7ff9881ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98819a0e0 con 0x7ff9880ff1c0 2023-10-14T09:06:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98819a250 con 0x7ff988102b30 2023-10-14T09:06:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.484+0000 7ff98f526700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98819a410 con 0x7ff988102190 2023-10-14T09:06:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9880ff1c0 0x7ff988194ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff988194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9880ff1c0 0x7ff988194ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35996/0 (socket says 172.21.15.6:35996) 2023-10-14T09:06:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff988194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33400/0 (socket says 172.21.15.6:33400) 2023-10-14T09:06:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98d2c2700 1 -- 172.21.15.6:0/1788629876 learned_addr learned my addr 172.21.15.6:0/1788629876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff988102b30 0x7ff9881ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 -- 172.21.15.6:0/1788629876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff988102b30 msgr2=0x7ff9881ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff988102b30 0x7ff9881ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.491 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 -- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9880ff1c0 msgr2=0x7ff988194ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9880ff1c0 0x7ff988194ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 -- 172.21.15.6:0/1788629876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980009d00 con 0x7ff988102190 2023-10-14T09:06:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98cac1700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff988194ff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00e9f0 tx=0x7ff97c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff97a7fc700 1 -- 172.21.15.6:0/1788629876 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00c9c0 con 0x7ff988102190 2023-10-14T09:06:03.492 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9881adbb0 con 0x7ff988102190 2023-10-14T09:06:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff97a7fc700 1 -- 172.21.15.6:0/1788629876 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff97c010430 con 0x7ff988102190 2023-10-14T09:06:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff97a7fc700 1 -- 172.21.15.6:0/1788629876 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c018680 con 0x7ff988102190 2023-10-14T09:06:03.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.485+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9881ae060 con 0x7ff988102190 2023-10-14T09:06:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 Processor -- start 2023-10-14T09:06:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 -- start start 2023-10-14T09:06:03.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0654c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0655ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06560a0 0x562bc0656520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc05c9c10 con 0x562bc0654850 2023-10-14T09:06:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc05aec00 con 0x562bc06560a0 2023-10-14T09:06:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.490+0000 7ff99b710b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc05ac520 con 0x562bc06551b0 2023-10-14T09:06:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.498+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0655ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.498+0000 7ff98dac3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0654c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.498+0000 7ff98dac3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0654c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36002/0 (socket says 172.21.15.6:36002) 2023-10-14T09:06:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.498+0000 7ff98dac3700 1 -- 172.21.15.6:0/1490517245 learned_addr learned my addr 172.21.15.6:0/1490517245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.499+0000 7ff98dac3700 1 -- 172.21.15.6:0/1490517245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 msgr2=0x562bc0655ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.499+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0655ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.499+0000 7ff98dac3700 1 -- 172.21.15.6:0/1490517245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06560a0 msgr2=0x562bc0656520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:06:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.499+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06560a0 0x562bc0656520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.499+0000 7ff98dac3700 1 -- 172.21.15.6:0/1490517245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bc0565390 con 0x562bc0654850 2023-10-14T09:06:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.501+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0654c70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff980009c40 tx=0x7ff980009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed889b9f913c81f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.502+0000 7ff97a7fc700 1 -- 172.21.15.6:0/1788629876 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7ff97c010860 con 0x7ff988102190 2023-10-14T09:06:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.503+0000 7ff97a7fc700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff9740a1500 0x7ff9740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.503+0000 7ff97a7fc700 1 -- 172.21.15.6:0/1788629876 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff97c014070 con 0x7ff988102190 2023-10-14T09:06:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.507+0000 7ff9737fe700 1 -- 172.21.15.6:0/1490517245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000e040 con 0x562bc0654850 2023-10-14T09:06:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.507+0000 7ff9737fe700 1 -- 172.21.15.6:0/1490517245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9800060a0 con 0x562bc0654850 2023-10-14T09:06:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.507+0000 7ff9737fe700 1 -- 172.21.15.6:0/1490517245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98001c6a0 con 0x562bc0654850 2023-10-14T09:06:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.509+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff9740a1500 0x7ff9740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.510+0000 7ff99b710b80 1 -- 172.21.15.6:0/1490517245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 msgr2=0x562bc0654c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.511+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0654c70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff980009c40 tx=0x7ff980009c70 comp rx=0 tx=0).stop 2023-10-14T09:06:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.511+0000 7ff99b710b80 1 -- 172.21.15.6:0/1490517245 shutdown_connections 2023-10-14T09:06:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.511+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06560a0 0x562bc0656520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.511+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0654c70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.511+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1490517245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0655ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.511+0000 7ff99b710b80 1 -- 172.21.15.6:0/1490517245 >> 172.21.15.6:0/1490517245 conn(0x562bc0582d70 msgr2=0x562bc064fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.512+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff9740a1500 0x7ff9740a39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x562bc0650a20 tx=0x7ff984009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.512+0000 7ff99b710b80 1 -- 172.21.15.6:0/1490517245 shutdown_connections 2023-10-14T09:06:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.513+0000 7ff99b710b80 1 -- 172.21.15.6:0/1490517245 wait complete. 2023-10-14T09:06:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.513+0000 7ff99b710b80 1 -- start start 2023-10-14T09:06:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.513+0000 7ff99b710b80 1 Processor -- start 2023-10-14T09:06:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc065e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc065ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc0665d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc05a7e10 con 0x562bc0654850 2023-10-14T09:06:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc05446b0 con 0x562bc06551b0 2023-10-14T09:06:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc0544350 con 0x562bc06560a0 2023-10-14T09:06:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff99b710b80 10 client.0 _ll_register_callbacks cb 0x562bc03a17a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc065e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc065e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36008/0 (socket says 172.21.15.6:36008) 2023-10-14T09:06:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.520+0000 7ff98d2c2700 1 -- 172.21.15.6:0/1265780680 learned_addr learned my addr 172.21.15.6:0/1265780680 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.521+0000 7ff98d2c2700 1 -- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 msgr2=0x562bc0665d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:06:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.521+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc0665d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.521+0000 7ff98d2c2700 1 -- 172.21.15.6:0/1265780680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 msgr2=0x562bc065ed20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:06:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.521+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc065ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.521+0000 7ff98d2c2700 1 -- 172.21.15.6:0/1265780680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff988109ce0 con 0x562bc0654850 2023-10-14T09:06:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.521+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc065e7e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff984003930 tx=0x7ff984004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f3554764ff26c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.524+0000 7ff970ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.524+0000 7ff970ff9700 1 -- 172.21.15.6:0/1265780680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984011b00 con 0x562bc0654850 2023-10-14T09:06:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.524+0000 7ff970ff9700 1 -- 172.21.15.6:0/1265780680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff984011c60 con 0x562bc0654850 2023-10-14T09:06:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.524+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bc05ace90 con 0x562bc0654850 2023-10-14T09:06:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.530+0000 7ff970ff9700 1 -- 172.21.15.6:0/1265780680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff984011e60 con 0x562bc0654850 2023-10-14T09:06:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.538+0000 7ff99b710b80 10 client.16602 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.538+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x562bc03d2d80 con 0x562bc0654850 2023-10-14T09:06:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff970ff9700 1 -- 172.21.15.6:0/1265780680 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562bc05ace90 con 0x562bc0654850 2023-10-14T09:06:03.545 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff970ff9700 1 -- 172.21.15.6:0/1265780680 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff9840315c0 con 0x562bc0654850 2023-10-14T09:06:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff99b710b80 10 client.16602 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff99b710b80 10 client.16602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff99b710b80 20 client.16602 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc067b680 0x562bc067daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.546 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff99b710b80 4 client.16602 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:06:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.544+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bc0624bb0 con 0x562bc067b680 2023-10-14T09:06:03.547 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.546+0000 7ff98cac1700 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc067b680 0x562bc067daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.553+0000 7ff970ff9700 10 client.16602 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.553+0000 7ff98cac1700 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc067b680 0x562bc067daa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f03a4da246986106 server_cookie=68a21853314f3490 in_seq=0 out_seq=0 2023-10-14T09:06:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.557+0000 7ff970ff9700 1 -- 172.21.15.6:0/1265780680 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562bc0624bb0 con 0x562bc067b680 2023-10-14T09:06:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.557+0000 7ff970ff9700 10 client.16602 handle_command_reply: tid=0 2023-10-14T09:06:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.557+0000 7ff99b710b80 1 client.16602 shutdown 2023-10-14T09:06:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.557+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 msgr2=0x562bc065e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.557+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc065e7e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff984003930 tx=0x7ff984004750 comp rx=0 tx=0).stop 2023-10-14T09:06:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 shutdown_connections 2023-10-14T09:06:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc067b680 0x562bc067daa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc0665d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc065e7e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1265780680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc065ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 >> 172.21.15.6:0/1265780680 conn(0x562bc0582d70 msgr2=0x562bc064f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff970ff9700 0 client.16602 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 shutdown_connections 2023-10-14T09:06:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 1 -- 172.21.15.6:0/1265780680 wait complete. 2023-10-14T09:06:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.558+0000 7ff99b710b80 20 client.16602 trim_cache size 0 max 16384 2023-10-14T09:06:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.577+0000 7ff99b710b80 1 Processor -- start 2023-10-14T09:06:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 -- start start 2023-10-14T09:06:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0659080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc0665cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc06595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc04288c0 con 0x562bc0654850 2023-10-14T09:06:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc0655f20 con 0x562bc06551b0 2023-10-14T09:06:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff99b710b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc065e350 con 0x562bc06560a0 2023-10-14T09:06:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0659080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0659080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36012/0 (socket says 172.21.15.6:36012) 2023-10-14T09:06:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 -- 172.21.15.6:0/4259737903 learned_addr learned my addr 172.21.15.6:0/4259737903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98dac3700 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc06595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98cac1700 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc0665cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 -- 172.21.15.6:0/4259737903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 msgr2=0x562bc06595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:03.583 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc06595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 -- 172.21.15.6:0/4259737903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 msgr2=0x562bc0665cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc0665cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 -- 172.21.15.6:0/4259737903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bc03bbc00 con 0x562bc0654850 2023-10-14T09:06:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.578+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0659080 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff984009c40 tx=0x7ff984000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afba4ca7a116a05c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:03.584 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff973fff700 1 -- 172.21.15.6:0/4259737903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984031420 con 0x562bc0654850 2023-10-14T09:06:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff973fff700 1 -- 172.21.15.6:0/4259737903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff984011d40 con 0x562bc0654850 2023-10-14T09:06:03.585 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff973fff700 1 -- 172.21.15.6:0/4259737903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984005510 con 0x562bc0654850 2023-10-14T09:06:03.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 -- 172.21.15.6:0/4259737903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 msgr2=0x562bc0659080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0659080 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff984009c40 tx=0x7ff984000bc0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.588 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 -- 172.21.15.6:0/4259737903 shutdown_connections 2023-10-14T09:06:03.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06560a0 0x562bc06595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc0654850 0x562bc0659080 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 --2- 172.21.15.6:0/4259737903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc06551b0 0x562bc0665cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 -- 172.21.15.6:0/4259737903 >> 172.21.15.6:0/4259737903 conn(0x562bc0582d70 msgr2=0x562bc065d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:03.589 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 -- 172.21.15.6:0/4259737903 shutdown_connections 2023-10-14T09:06:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.579+0000 7ff99b710b80 1 -- 172.21.15.6:0/4259737903 wait complete. 2023-10-14T09:06:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 -- start start 2023-10-14T09:06:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 Processor -- start 2023-10-14T09:06:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc0654850 0x562bc0663910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.590 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0663e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc06560a0 0x562bc0664e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc06653a0 con 0x562bc06560a0 2023-10-14T09:06:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc0665510 con 0x562bc0654850 2023-10-14T09:06:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc06656d0 con 0x562bc06551b0 2023-10-14T09:06:03.591 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff99b710b80 10 client.0 _ll_register_callbacks cb 0x7ff984004430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff98cac1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0663e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff98cac1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0663e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33422/0 (socket says 172.21.15.6:33422) 2023-10-14T09:06:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff98cac1700 1 -- 172.21.15.6:0/1230561906 learned_addr learned my addr 172.21.15.6:0/1230561906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.580+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc06560a0 0x562bc0664e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.592 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff98dac3700 1 -- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 msgr2=0x562bc0663e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0663e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff98dac3700 1 -- 172.21.15.6:0/1230561906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc0654850 msgr2=0x562bc0663910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc0654850 0x562bc0663910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff98dac3700 1 -- 172.21.15.6:0/1230561906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bc03d2d80 con 0x562bc06560a0 2023-10-14T09:06:03.593 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff98dac3700 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc06560a0 0x562bc0664e60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff980007a60 tx=0x7ff9800078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb1fd1069f5680a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff970ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff970ff9700 1 -- 172.21.15.6:0/1230561906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000e040 con 0x562bc06560a0 2023-10-14T09:06:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9800060a0 con 0x562bc06560a0 2023-10-14T09:06:03.594 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff970ff9700 1 -- 172.21.15.6:0/1230561906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7ff98001c640 con 0x562bc06560a0 2023-10-14T09:06:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff970ff9700 1 -- 172.21.15.6:0/1230561906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff98001c800 con 0x562bc06560a0 2023-10-14T09:06:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff99b710b80 10 client.16608 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x562bc03f91f0 con 0x562bc06560a0 2023-10-14T09:06:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.581+0000 7ff970ff9700 1 -- 172.21.15.6:0/1230561906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9800060a0 con 0x562bc06560a0 2023-10-14T09:06:03.595 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff970ff9700 1 -- 172.21.15.6:0/1230561906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff980019030 con 0x562bc06560a0 2023-10-14T09:06:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff99b710b80 10 client.16608 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff99b710b80 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff99b710b80 20 client.16608 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc06cfd80 0x562bc06d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:03.596 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff99b710b80 4 client.16608 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:06:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562bc05a0df0 con 0x562bc06cfd80 2023-10-14T09:06:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc06cfd80 0x562bc06d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff970ff9700 10 client.16608 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:03.597 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.582+0000 7ff98d2c2700 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc06cfd80 0x562bc06d21a0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ce9a86d2cbc3ef server_cookie=17d1bae73544d781 in_seq=0 out_seq=0 2023-10-14T09:06:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff970ff9700 1 -- 172.21.15.6:0/1230561906 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562bc05a0df0 con 0x562bc06cfd80 2023-10-14T09:06:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff970ff9700 10 client.16608 handle_command_reply: tid=0 2023-10-14T09:06:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 client.16608 shutdown 2023-10-14T09:06:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc06560a0 msgr2=0x562bc0664e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc06560a0 0x562bc0664e60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff980007a60 tx=0x7ff9800078c0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 shutdown_connections 2023-10-14T09:06:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x562bc06cfd80 0x562bc06d21a0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bc06560a0 0x562bc0664e60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff970ff9700 0 client.16608 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562bc0654850 0x562bc0663910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 --2- 172.21.15.6:0/1230561906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562bc06551b0 0x562bc0663e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 >> 172.21.15.6:0/1230561906 conn(0x562bc0582d70 msgr2=0x562bc0659080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 shutdown_connections 2023-10-14T09:06:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 1 -- 172.21.15.6:0/1230561906 wait complete. 2023-10-14T09:06:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.605+0000 7ff99b710b80 20 client.16608 trim_cache size 0 max 16384 2023-10-14T09:06:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:06:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:06:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:06:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:06:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff9740a1500 msgr2=0x7ff9740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff9740a1500 0x7ff9740a39c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x562bc0650a20 tx=0x7ff984009260 comp rx=0 tx=0).stop 2023-10-14T09:06:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 msgr2=0x7ff988194ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff988194ff0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00e9f0 tx=0x7ff97c00ed00 comp rx=0 tx=0).stop 2023-10-14T09:06:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 shutdown_connections 2023-10-14T09:06:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7ff9740a1500 0x7ff9740a39c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff988102b30 0x7ff9881ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9880ff1c0 0x7ff988194ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 --2- 172.21.15.6:0/1788629876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988102190 0x7ff988194ff0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:03.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 >> 172.21.15.6:0/1788629876 conn(0x7ff9880faaf0 msgr2=0x7ff9880fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:03.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 shutdown_connections 2023-10-14T09:06:03.614 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:03.606+0000 7ff98f526700 1 -- 172.21.15.6:0/1788629876 wait complete. 2023-10-14T09:06:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:03 smithi178 ceph-mon[103612]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 808 op/s 2023-10-14T09:06:03.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:03 smithi057 ceph-mon[103313]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 808 op/s 2023-10-14T09:06:03.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:03 smithi006 ceph-mon[99452]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 808 op/s 2023-10-14T09:06:05.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:05 smithi178 ceph-mon[103612]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 648 op/s 2023-10-14T09:06:05.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:05 smithi057 ceph-mon[103313]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 648 op/s 2023-10-14T09:06:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 785.0 s, 1357.2 tps, lat 73.691 ms stddev 77.554 2023-10-14T09:06:05.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:05 smithi006 ceph-mon[99452]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 648 op/s 2023-10-14T09:06:07.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:07 smithi178 ceph-mon[103612]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 671 op/s 2023-10-14T09:06:07.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:07 smithi057 ceph-mon[103313]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 671 op/s 2023-10-14T09:06:07.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:07 smithi006 ceph-mon[99452]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 671 op/s 2023-10-14T09:06:09.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:09 smithi178 ceph-mon[103612]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.0 MiB/s wr, 569 op/s 2023-10-14T09:06:09.954 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:09 smithi057 ceph-mon[103313]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.0 MiB/s wr, 569 op/s 2023-10-14T09:06:09.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:09 smithi006 ceph-mon[99452]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.0 MiB/s wr, 569 op/s 2023-10-14T09:06:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 790.0 s, 1450.6 tps, lat 68.929 ms stddev 78.923 2023-10-14T09:06:11.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:11 smithi178 ceph-mon[103612]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 598 op/s 2023-10-14T09:06:11.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:11 smithi057 ceph-mon[103313]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 598 op/s 2023-10-14T09:06:11.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:11 smithi006 ceph-mon[99452]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 598 op/s 2023-10-14T09:06:13.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:13 smithi057 ceph-mon[103313]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 693 op/s 2023-10-14T09:06:13.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:13 smithi006 ceph-mon[99452]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 693 op/s 2023-10-14T09:06:14.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:13 smithi178 ceph-mon[103612]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 693 op/s 2023-10-14T09:06:15.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:15 smithi057 ceph-mon[103313]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 617 op/s 2023-10-14T09:06:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 795.0 s, 1312.0 tps, lat 76.832 ms stddev 81.385 2023-10-14T09:06:15.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:15 smithi006 ceph-mon[99452]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 617 op/s 2023-10-14T09:06:16.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:15 smithi178 ceph-mon[103612]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 617 op/s 2023-10-14T09:06:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.768+0000 7fee32733700 1 -- 172.21.15.6:0/3510523567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0ffe00 msgr2=0x7fee2c100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.768+0000 7fee32733700 1 --2- 172.21.15.6:0/3510523567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0ffe00 0x7fee2c100220 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0099c0 tx=0x7fee1c009cd0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 -- 172.21.15.6:0/3510523567 shutdown_connections 2023-10-14T09:06:16.771 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 --2- 172.21.15.6:0/3510523567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c101990 0x7fee2c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 --2- 172.21.15.6:0/3510523567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0ffe00 0x7fee2c100220 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 --2- 172.21.15.6:0/3510523567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 -- 172.21.15.6:0/3510523567 >> 172.21.15.6:0/3510523567 conn(0x7fee2c0fb390 msgr2=0x7fee2c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:16.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 -- 172.21.15.6:0/3510523567 shutdown_connections 2023-10-14T09:06:16.772 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.769+0000 7fee32733700 1 -- 172.21.15.6:0/3510523567 wait complete. 2023-10-14T09:06:16.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 Processor -- start 2023-10-14T09:06:16.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 -- start start 2023-10-14T09:06:16.774 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0ffe00 0x7fee2c198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c101990 0x7fee2c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c1a0b40 con 0x7fee2c101990 2023-10-14T09:06:16.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c1a0c80 con 0x7fee2c100ff0 2023-10-14T09:06:16.775 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee32733700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c1a0e10 con 0x7fee2c0ffe00 2023-10-14T09:06:16.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.770+0000 7fee30cd0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c101990 0x7fee2c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34794/0 (socket says 172.21.15.6:34794) 2023-10-14T09:06:16.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee2b7fe700 1 -- 172.21.15.6:0/1250291793 learned_addr learned my addr 172.21.15.6:0/1250291793 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:16.776 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee30cd0700 1 -- 172.21.15.6:0/1250291793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0ffe00 msgr2=0x7fee2c198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee30cd0700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0ffe00 0x7fee2c198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee30cd0700 1 -- 172.21.15.6:0/1250291793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 msgr2=0x7fee2c199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee30cd0700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee30cd0700 1 -- 172.21.15.6:0/1250291793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0095f0 con 0x7fee2c101990 2023-10-14T09:06:16.777 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee2b7fe700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee30cd0700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c101990 0x7fee2c1a0570 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fee2400bb00 tx=0x7fee2400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.771+0000 7fee297fa700 1 -- 172.21.15.6:0/1250291793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2400ca30 con 0x7fee2c101990 2023-10-14T09:06:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.772+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c1a10f0 con 0x7fee2c101990 2023-10-14T09:06:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.772+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c1a1680 con 0x7fee2c101990 2023-10-14T09:06:16.778 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.772+0000 7fee297fa700 1 -- 172.21.15.6:0/1250291793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee2400cb90 con 0x7fee2c101990 2023-10-14T09:06:16.779 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.772+0000 7fee297fa700 1 -- 172.21.15.6:0/1250291793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240125a0 con 0x7fee2c101990 2023-10-14T09:06:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.776+0000 7fee297fa700 1 -- 172.21.15.6:0/1250291793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fee24012700 con 0x7fee2c101990 2023-10-14T09:06:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.777+0000 7fee297fa700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fee140a1550 0x7fee140a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.777+0000 7fee3e91db80 1 Processor -- start 2023-10-14T09:06:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 -- start start 2023-10-14T09:06:16.780 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee297fa700 1 -- 172.21.15.6:0/1250291793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fee240cc370 con 0x7fee2c101990 2023-10-14T09:06:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fa850 0x556ead3fac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 0x556ead3fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead3fc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead36fc10 con 0x556ead3fa850 2023-10-14T09:06:16.781 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead354c00 con 0x556ead3fb1b0 2023-10-14T09:06:16.782 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee3e91db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead352520 con 0x556ead3fc0a0 2023-10-14T09:06:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 0x556ead3fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 0x556ead3fbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34800/0 (socket says 172.21.15.6:34800) 2023-10-14T09:06:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.778+0000 7fee2b7fe700 1 -- 172.21.15.6:0/1677096943 learned_addr learned my addr 172.21.15.6:0/1677096943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:16.783 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.779+0000 7fee2b7fe700 1 -- 172.21.15.6:0/1677096943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 msgr2=0x556ead3fc520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:06:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.779+0000 7fee2b7fe700 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead3fc520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.779+0000 7fee2b7fe700 1 -- 172.21.15.6:0/1677096943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fa850 msgr2=0x556ead3fac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:06:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.779+0000 7fee2b7fe700 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fa850 0x556ead3fac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.779+0000 7fee2b7fe700 1 -- 172.21.15.6:0/1677096943 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ead30b390 con 0x556ead3fb1b0 2023-10-14T09:06:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.779+0000 7fee2b7fe700 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 0x556ead3fbac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee20009fb0 tx=0x7fee2000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae05f40b59a396c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.780+0000 7fee127fc700 1 -- 172.21.15.6:0/1677096943 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000edf0 con 0x556ead3fb1b0 2023-10-14T09:06:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.780+0000 7fee127fc700 1 -- 172.21.15.6:0/1677096943 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee20013930 con 0x556ead3fb1b0 2023-10-14T09:06:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.780+0000 7fee127fc700 1 -- 172.21.15.6:0/1677096943 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20012930 con 0x556ead3fb1b0 2023-10-14T09:06:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 -- 172.21.15.6:0/1677096943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 msgr2=0x556ead3fbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 0x556ead3fbac0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee20009fb0 tx=0x7fee2000e4b0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 -- 172.21.15.6:0/1677096943 shutdown_connections 2023-10-14T09:06:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead3fc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fa850 0x556ead3fac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1677096943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fb1b0 0x556ead3fbac0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.786 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.781+0000 7fee3e91db80 1 -- 172.21.15.6:0/1677096943 >> 172.21.15.6:0/1677096943 conn(0x556ead328d70 msgr2=0x556ead3f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.783+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fee140a1550 0x7fee140a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.783+0000 7fee3e91db80 1 -- 172.21.15.6:0/1677096943 shutdown_connections 2023-10-14T09:06:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.783+0000 7fee3e91db80 1 -- 172.21.15.6:0/1677096943 wait complete. 2023-10-14T09:06:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.783+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fee140a1550 0x7fee140a3a10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fee1c006010 tx=0x7fee1c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.783+0000 7fee3e91db80 1 -- start start 2023-10-14T09:06:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 Processor -- start 2023-10-14T09:06:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fb1b0 0x556ead40d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 0x556ead40d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 0x556ead4149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead34de10 con 0x556ead412600 2023-10-14T09:06:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead2ea6b0 con 0x556ead3fc0a0 2023-10-14T09:06:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead2ea350 con 0x556ead3fb1b0 2023-10-14T09:06:16.790 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.784+0000 7fee3e91db80 10 client.0 _ll_register_callbacks cb 0x556ead1477a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.785+0000 7fee30cd0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 0x556ead4149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.785+0000 7fee30cd0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 0x556ead4149f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36046/0 (socket says 172.21.15.6:36046) 2023-10-14T09:06:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.785+0000 7fee30cd0700 1 -- 172.21.15.6:0/1457245948 learned_addr learned my addr 172.21.15.6:0/1457245948 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee30cd0700 1 -- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fb1b0 msgr2=0x556ead40d090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:06:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee30cd0700 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fb1b0 0x556ead40d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.794 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee30cd0700 1 -- 172.21.15.6:0/1457245948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 msgr2=0x556ead40d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee30cd0700 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 0x556ead40d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee30cd0700 1 -- 172.21.15.6:0/1457245948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee20009be0 con 0x556ead412600 2023-10-14T09:06:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee30cd0700 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 0x556ead4149f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fee24096100 tx=0x7fee24099690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466292414956d895 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee0b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee0b7fe700 1 -- 172.21.15.6:0/1457245948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240b9070 con 0x556ead412600 2023-10-14T09:06:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee0b7fe700 1 -- 172.21.15.6:0/1457245948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fee2408be80 con 0x556ead412600 2023-10-14T09:06:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.786+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ead352e90 con 0x556ead412600 2023-10-14T09:06:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee0b7fe700 1 -- 172.21.15.6:0/1457245948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee2408c040 con 0x556ead412600 2023-10-14T09:06:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 10 client.16617 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x556ead178d80 con 0x556ead412600 2023-10-14T09:06:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee0b7fe700 1 -- 172.21.15.6:0/1457245948 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556ead352e90 con 0x556ead412600 2023-10-14T09:06:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee0b7fe700 1 -- 172.21.15.6:0/1457245948 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fee240a1590 con 0x556ead412600 2023-10-14T09:06:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 10 client.16617 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 10 client.16617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:16.797 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 20 client.16617 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead406040 0x556ead4084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 4 client.16617 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:06:16.798 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.787+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ead3cabb0 con 0x556ead406040 2023-10-14T09:06:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.797+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead406040 0x556ead4084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.815+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead406040 0x556ead4084e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1c80ee263754a96 server_cookie=c832c8d35b7563d5 in_seq=0 out_seq=0 2023-10-14T09:06:16.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.817+0000 7fee0b7fe700 10 client.16617 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:16.818 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.817+0000 7fee0b7fe700 1 -- 172.21.15.6:0/1457245948 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556ead3cabb0 con 0x556ead406040 2023-10-14T09:06:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.817+0000 7fee0b7fe700 10 client.16617 handle_command_reply: tid=0 2023-10-14T09:06:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.817+0000 7fee3e91db80 1 client.16617 shutdown 2023-10-14T09:06:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.817+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 msgr2=0x556ead4149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.817+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 0x556ead4149f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fee24096100 tx=0x7fee24099690 comp rx=0 tx=0).stop 2023-10-14T09:06:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.820+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 shutdown_connections 2023-10-14T09:06:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.820+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead406040 0x556ead4084e0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.820+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead412600 0x556ead4149f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.820+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fb1b0 0x556ead40d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.820+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1457245948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 0x556ead40d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.820+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 >> 172.21.15.6:0/1457245948 conn(0x556ead328d70 msgr2=0x556ead3f5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.826+0000 7fee0b7fe700 0 client.16617 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:16.828 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.827+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 shutdown_connections 2023-10-14T09:06:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.836+0000 7fee3e91db80 1 -- 172.21.15.6:0/1457245948 wait complete. 2023-10-14T09:06:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.841+0000 7fee3e91db80 20 client.16617 trim_cache size 0 max 16384 2023-10-14T09:06:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 Processor -- start 2023-10-14T09:06:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 -- start start 2023-10-14T09:06:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 0x556ead408050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead412600 0x556ead3fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead40cc60 con 0x556ead3fb1b0 2023-10-14T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead1ce8c0 con 0x556ead3fc0a0 2023-10-14T09:06:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee3e91db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead40e280 con 0x556ead412600 2023-10-14T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36054/0 (socket says 172.21.15.6:36054) 2023-10-14T09:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.873+0000 7fee2bfff700 1 -- 172.21.15.6:0/1327929229 learned_addr learned my addr 172.21.15.6:0/1327929229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee2bfff700 1 -- 172.21.15.6:0/1327929229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead412600 msgr2=0x556ead3fefb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead412600 0x556ead3fefb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee2bfff700 1 -- 172.21.15.6:0/1327929229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 msgr2=0x556ead408050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 0x556ead408050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee2bfff700 1 -- 172.21.15.6:0/1327929229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ead161c00 con 0x556ead3fb1b0 2023-10-14T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee2bfff700 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a710 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fee2c100e50 tx=0x7fee1c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5765382e0f2a222 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee12ffd700 1 -- 172.21.15.6:0/1327929229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c01d070 con 0x556ead3fb1b0 2023-10-14T09:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee12ffd700 1 -- 172.21.15.6:0/1327929229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee1c00bcd0 con 0x556ead3fb1b0 2023-10-14T09:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.874+0000 7fee12ffd700 1 -- 172.21.15.6:0/1327929229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c003c90 con 0x556ead3fb1b0 2023-10-14T09:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.875+0000 7fee3e91db80 1 -- 172.21.15.6:0/1327929229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 msgr2=0x556ead41a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.875+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a710 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fee2c100e50 tx=0x7fee1c020000 comp rx=0 tx=0).stop 2023-10-14T09:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 -- 172.21.15.6:0/1327929229 shutdown_connections 2023-10-14T09:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead412600 0x556ead3fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a710 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 --2- 172.21.15.6:0/1327929229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead3fc0a0 0x556ead408050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 -- 172.21.15.6:0/1327929229 >> 172.21.15.6:0/1327929229 conn(0x556ead328d70 msgr2=0x556ead402520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 -- 172.21.15.6:0/1327929229 shutdown_connections 2023-10-14T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 -- 172.21.15.6:0/1327929229 wait complete. 2023-10-14T09:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.879+0000 7fee3e91db80 1 -- start start 2023-10-14T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 Processor -- start 2023-10-14T09:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead417340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead412600 0x556ead4178a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead417fb0 con 0x556ead3fb1b0 2023-10-14T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead463880 con 0x556ead412600 2023-10-14T09:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ead463a40 con 0x556ead3fc0a0 2023-10-14T09:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee3e91db80 10 client.0 _ll_register_callbacks cb 0x7fee240991d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee2bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36056/0 (socket says 172.21.15.6:36056) 2023-10-14T09:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead417340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.880+0000 7fee2bfff700 1 -- 172.21.15.6:0/231665980 learned_addr learned my addr 172.21.15.6:0/231665980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee2bfff700 1 -- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 msgr2=0x556ead417340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee2bfff700 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead417340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee2bfff700 1 -- 172.21.15.6:0/231665980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead412600 msgr2=0x556ead4178a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee2bfff700 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead412600 0x556ead4178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee2bfff700 1 -- 172.21.15.6:0/231665980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c108b90 con 0x556ead3fb1b0 2023-10-14T09:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee2bfff700 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a8a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0099c0 tx=0x7fee1c00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f388aec15a7c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee0b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee0b7fe700 1 -- 172.21.15.6:0/231665980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c029070 con 0x556ead3fb1b0 2023-10-14T09:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee0b7fe700 1 -- 172.21.15.6:0/231665980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fee1c02b050 con 0x556ead3fb1b0 2023-10-14T09:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee20013930 con 0x556ead3fb1b0 2023-10-14T09:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee0b7fe700 1 -- 172.21.15.6:0/231665980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee1c01d050 con 0x556ead3fb1b0 2023-10-14T09:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee3e91db80 10 client.16623 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.881+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x556ead19f1f0 con 0x556ead3fb1b0 2023-10-14T09:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee0b7fe700 1 -- 172.21.15.6:0/231665980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee1c048020 con 0x556ead3fb1b0 2023-10-14T09:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee0b7fe700 1 -- 172.21.15.6:0/231665980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fee1c00f580 con 0x556ead3fb1b0 2023-10-14T09:06:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee3e91db80 10 client.16623 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee3e91db80 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee3e91db80 20 client.16623 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee3e91db80 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead465180 0x556ead4675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee3e91db80 4 client.16623 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:06:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556ead346df0 con 0x556ead465180 2023-10-14T09:06:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.882+0000 7fee2b7fe700 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead465180 0x556ead4675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.886+0000 7fee0b7fe700 10 client.16623 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.886+0000 7fee2b7fe700 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead465180 0x556ead4675a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5492ca1592df7c server_cookie=335d22d701c0cf22 in_seq=0 out_seq=0 2023-10-14T09:06:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.916+0000 7fee0b7fe700 1 -- 172.21.15.6:0/231665980 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556ead346df0 con 0x556ead465180 2023-10-14T09:06:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.916+0000 7fee0b7fe700 10 client.16623 handle_command_reply: tid=0 2023-10-14T09:06:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 client.16623 shutdown 2023-10-14T09:06:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 msgr2=0x556ead41a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a8a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0099c0 tx=0x7fee1c00b5d0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 shutdown_connections 2023-10-14T09:06:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x556ead465180 0x556ead4675a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556ead412600 0x556ead4178a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556ead3fb1b0 0x556ead41a8a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee0b7fe700 0 client.16623 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 --2- 172.21.15.6:0/231665980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ead3fc0a0 0x556ead417340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 >> 172.21.15.6:0/231665980 conn(0x556ead328d70 msgr2=0x556ead408050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 shutdown_connections 2023-10-14T09:06:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 1 -- 172.21.15.6:0/231665980 wait complete. 2023-10-14T09:06:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.918+0000 7fee3e91db80 20 client.16623 trim_cache size 0 max 16384 2023-10-14T09:06:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:06:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:06:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:06:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:06:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fee140a1550 msgr2=0x7fee140a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fee140a1550 0x7fee140a3a10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fee1c006010 tx=0x7fee1c000bc0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c101990 msgr2=0x7fee2c1a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c101990 0x7fee2c1a0570 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fee2400bb00 tx=0x7fee2400be10 comp rx=0 tx=0).stop 2023-10-14T09:06:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 shutdown_connections 2023-10-14T09:06:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c101990 0x7fee2c1a0570 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0ffe00 0x7fee2c198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fee140a1550 0x7fee140a3a10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 --2- 172.21.15.6:0/1250291793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee2c100ff0 0x7fee2c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 >> 172.21.15.6:0/1250291793 conn(0x7fee2c0fb390 msgr2=0x7fee2c0fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 shutdown_connections 2023-10-14T09:06:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:16.919+0000 7fee32733700 1 -- 172.21.15.6:0/1250291793 wait complete. 2023-10-14T09:06:17.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:17 smithi006 ceph-mon[99452]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.8 MiB/s wr, 616 op/s 2023-10-14T09:06:18.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:17 smithi178 ceph-mon[103612]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.8 MiB/s wr, 616 op/s 2023-10-14T09:06:18.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:17 smithi057 ceph-mon[103313]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.8 MiB/s wr, 616 op/s 2023-10-14T09:06:19.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:19 smithi006 ceph-mon[99452]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-14T09:06:20.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:19 smithi178 ceph-mon[103612]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-14T09:06:20.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:19 smithi057 ceph-mon[103313]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 569 op/s 2023-10-14T09:06:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 800.0 s, 1428.0 tps, lat 69.071 ms stddev 74.678 2023-10-14T09:06:21.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:21 smithi006 ceph-mon[99452]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.3 MiB/s wr, 588 op/s 2023-10-14T09:06:22.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:21 smithi178 ceph-mon[103612]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.3 MiB/s wr, 588 op/s 2023-10-14T09:06:22.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:21 smithi057 ceph-mon[103313]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.3 MiB/s wr, 588 op/s 2023-10-14T09:06:23.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:23 smithi006 ceph-mon[99452]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 704 op/s 2023-10-14T09:06:24.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:23 smithi178 ceph-mon[103612]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 704 op/s 2023-10-14T09:06:24.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:23 smithi057 ceph-mon[103313]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 704 op/s 2023-10-14T09:06:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 805.0 s, 1279.0 tps, lat 77.734 ms stddev 87.489 2023-10-14T09:06:26.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:25 smithi178 ceph-mon[103612]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.8 MiB/s wr, 669 op/s 2023-10-14T09:06:26.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:25 smithi057 ceph-mon[103313]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.8 MiB/s wr, 669 op/s 2023-10-14T09:06:26.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:25 smithi006 ceph-mon[99452]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.8 MiB/s wr, 669 op/s 2023-10-14T09:06:28.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:27 smithi178 ceph-mon[103612]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 729 op/s 2023-10-14T09:06:28.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:27 smithi057 ceph-mon[103313]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 729 op/s 2023-10-14T09:06:28.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:27 smithi006 ceph-mon[99452]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 729 op/s 2023-10-14T09:06:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 -- 172.21.15.6:0/62760035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 msgr2=0x7f2d70102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.062 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 --2- 172.21.15.6:0/62760035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d70102500 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009990 tx=0x7f2d58009ca0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 -- 172.21.15.6:0/62760035 shutdown_connections 2023-10-14T09:06:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 --2- 172.21.15.6:0/62760035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d70102a40 0x7f2d70109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 --2- 172.21.15.6:0/62760035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70100ea0 0x7f2d701012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 --2- 172.21.15.6:0/62760035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d70102500 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.063 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 -- 172.21.15.6:0/62760035 >> 172.21.15.6:0/62760035 conn(0x7f2d700fc460 msgr2=0x7f2d700fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 -- 172.21.15.6:0/62760035 shutdown_connections 2023-10-14T09:06:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.058+0000 7f2d76988700 1 -- 172.21.15.6:0/62760035 wait complete. 2023-10-14T09:06:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 Processor -- start 2023-10-14T09:06:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 -- start start 2023-10-14T09:06:30.064 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d70100ea0 0x7f2d70074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d700732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70102a40 0x7f2d700737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d70073f80 con 0x7f2d70102080 2023-10-14T09:06:30.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700740f0 con 0x7f2d70102a40 2023-10-14T09:06:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d76988700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701a0c90 con 0x7f2d70100ea0 2023-10-14T09:06:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d700732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d700732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36080/0 (socket says 172.21.15.6:36080) 2023-10-14T09:06:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/3871923460 learned_addr learned my addr 172.21.15.6:0/3871923460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:30.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d70100ea0 0x7f2d70074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.059+0000 7f2d74f25700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70102a40 0x7f2d700737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/3871923460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d70100ea0 msgr2=0x7f2d70074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d70100ea0 0x7f2d70074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/3871923460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70102a40 msgr2=0x7f2d700737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70102a40 0x7f2d700737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/3871923460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580095f0 con 0x7f2d70102080 2023-10-14T09:06:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d74f25700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70102a40 0x7f2d700737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:06:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d700732a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b680 tx=0x7f2d58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6d7fa700 1 -- 172.21.15.6:0/3871923460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5801d070 con 0x7f2d70102080 2023-10-14T09:06:30.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6d7fa700 1 -- 172.21.15.6:0/3871923460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d580054f0 con 0x7f2d70102080 2023-10-14T09:06:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d701a0f10 con 0x7f2d70102080 2023-10-14T09:06:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d6d7fa700 1 -- 172.21.15.6:0/3871923460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58004ca0 con 0x7f2d70102080 2023-10-14T09:06:30.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.060+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a1280 con 0x7f2d70102080 2023-10-14T09:06:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.062+0000 7f2d6d7fa700 1 -- 172.21.15.6:0/3871923460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f2d5800fc70 con 0x7f2d70102080 2023-10-14T09:06:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.063+0000 7f2d6d7fa700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2d5c0a1480 0x7f2d5c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.063+0000 7f2d6d7fa700 1 -- 172.21.15.6:0/3871923460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2d580ce090 con 0x7f2d70102080 2023-10-14T09:06:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.063+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2d5c0a1480 0x7f2d5c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 Processor -- start 2023-10-14T09:06:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2d5c0a1480 0x7f2d5c0a3940 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2d70101bf0 tx=0x7f2d6000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 -- start start 2023-10-14T09:06:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x560632399c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239a1b0 0x56063239aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239b0a0 0x56063239b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063230ec10 con 0x560632399850 2023-10-14T09:06:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606322f3c00 con 0x56063239b0a0 2023-10-14T09:06:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606322f1520 con 0x56063239a1b0 2023-10-14T09:06:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x560632399c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x560632399c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36086/0 (socket says 172.21.15.6:36086) 2023-10-14T09:06:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6ffff700 1 -- 172.21.15.6:0/162116597 learned_addr learned my addr 172.21.15.6:0/162116597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239a1b0 0x56063239aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d74f25700 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239b0a0 0x56063239b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/162116597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239b0a0 msgr2=0x56063239b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239b0a0 0x56063239b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/162116597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 msgr2=0x560632399c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x560632399c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/162116597 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606322aa390 con 0x56063239a1b0 2023-10-14T09:06:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.064+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x560632399c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.065+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239a1b0 0x56063239aac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c00 tx=0x7f2d58005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdbad0d270dfeabf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.065+0000 7f2d667fc700 1 -- 172.21.15.6:0/162116597 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5809bb00 con 0x56063239a1b0 2023-10-14T09:06:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.065+0000 7f2d667fc700 1 -- 172.21.15.6:0/162116597 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d5809b400 con 0x56063239a1b0 2023-10-14T09:06:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.065+0000 7f2d667fc700 1 -- 172.21.15.6:0/162116597 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5809a8f0 con 0x56063239a1b0 2023-10-14T09:06:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 -- 172.21.15.6:0/162116597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239a1b0 msgr2=0x56063239aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239a1b0 0x56063239aac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c00 tx=0x7f2d58005a90 comp rx=0 tx=0).stop 2023-10-14T09:06:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 -- 172.21.15.6:0/162116597 shutdown_connections 2023-10-14T09:06:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239b0a0 0x56063239b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x560632399c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/162116597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239a1b0 0x56063239aac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 -- 172.21.15.6:0/162116597 >> 172.21.15.6:0/162116597 conn(0x5606322c7d70 msgr2=0x560632394c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 -- 172.21.15.6:0/162116597 shutdown_connections 2023-10-14T09:06:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 -- 172.21.15.6:0/162116597 wait complete. 2023-10-14T09:06:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 -- start start 2023-10-14T09:06:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.066+0000 7f2d82b72b80 1 Processor -- start 2023-10-14T09:06:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 0x5606323a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239b0a0 0x5606323aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606322ece10 con 0x56063239b0a0 2023-10-14T09:06:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606322896b0 con 0x56063239a1b0 2023-10-14T09:06:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560632289350 con 0x560632399850 2023-10-14T09:06:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d82b72b80 10 client.0 _ll_register_callbacks cb 0x5606320e67a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 0x5606323a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 0x5606323a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33494/0 (socket says 172.21.15.6:33494) 2023-10-14T09:06:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 -- 172.21.15.6:0/1999034228 learned_addr learned my addr 172.21.15.6:0/1999034228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d74f25700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239b0a0 0x5606323aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 -- 172.21.15.6:0/1999034228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 msgr2=0x5606323a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 -- 172.21.15.6:0/1999034228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239b0a0 msgr2=0x5606323aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239b0a0 0x5606323aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 -- 172.21.15.6:0/1999034228 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6000fa60 con 0x560632399850 2023-10-14T09:06:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d74f25700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239b0a0 0x5606323aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:06:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 0x5606323a33c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d6001de30 tx=0x7f2d600047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=102e6b896e72c47f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.067+0000 7f2d4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-10-14T09:06:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/1999034228 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60010ac0 con 0x560632399850 2023-10-14T09:06:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/1999034228 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2d60010c20 con 0x560632399850 2023-10-14T09:06:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606322f1e90 con 0x560632399850 2023-10-14T09:06:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/1999034228 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d60010e20 con 0x560632399850 2023-10-14T09:06:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d82b72b80 10 client.26227 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f2d701a1280 con 0x560632399850 2023-10-14T09:06:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/1999034228 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5606322f1e90 con 0x560632399850 2023-10-14T09:06:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.068+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/1999034228 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d6002d070 con 0x560632399850 2023-10-14T09:06:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d82b72b80 10 client.26227 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d82b72b80 10 client.26227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d82b72b80 20 client.26227 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x5606323b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d82b72b80 4 client.26227 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:06:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560632369bb0 con 0x5606323af220 2023-10-14T09:06:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x5606323b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d4f7fe700 10 client.26227 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.069+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x5606323b1640 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c698cdf9999657d server_cookie=ac9337b9381484af in_seq=0 out_seq=0 2023-10-14T09:06:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/1999034228 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560632369bb0 con 0x5606323af220 2023-10-14T09:06:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d4f7fe700 10 client.26227 handle_command_reply: tid=0 2023-10-14T09:06:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 client.26227 shutdown 2023-10-14T09:06:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 msgr2=0x5606323a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 0x5606323a33c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d6001de30 tx=0x7f2d600047c0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 shutdown_connections 2023-10-14T09:06:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x5606323b1640 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239b0a0 0x5606323aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560632399850 0x5606323a33c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d4f7fe700 0 client.26227 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/1999034228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 >> 172.21.15.6:0/1999034228 conn(0x5606322c7d70 msgr2=0x560632394830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 shutdown_connections 2023-10-14T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 1 -- 172.21.15.6:0/1999034228 wait complete. 2023-10-14T09:06:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.070+0000 7f2d82b72b80 20 client.26227 trim_cache size 0 max 16384 2023-10-14T09:06:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 Processor -- start 2023-10-14T09:06:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 -- start start 2023-10-14T09:06:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560632399850 0x560632399c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 0x5606323aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063216d8c0 con 0x56063239a1b0 2023-10-14T09:06:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606323a4540 con 0x560632399850 2023-10-14T09:06:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.089+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606323a2870 con 0x56063239b0a0 2023-10-14T09:06:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 0x5606323aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560632399850 0x560632399c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 0x5606323aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36100/0 (socket says 172.21.15.6:36100) 2023-10-14T09:06:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/2370758220 learned_addr learned my addr 172.21.15.6:0/2370758220 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d74f25700 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/2370758220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 msgr2=0x5606323ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/2370758220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560632399850 msgr2=0x560632399c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560632399850 0x560632399c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 -- 172.21.15.6:0/2370758220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560632117d80 con 0x56063239a1b0 2023-10-14T09:06:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560632399850 0x560632399c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 0x5606323aa8d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2d58097900 tx=0x7f2d5809b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137ac6b3f52be1aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d66ffd700 1 -- 172.21.15.6:0/2370758220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580a3700 con 0x56063239a1b0 2023-10-14T09:06:30.105 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d66ffd700 1 -- 172.21.15.6:0/2370758220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d580997a0 con 0x56063239a1b0 2023-10-14T09:06:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.090+0000 7f2d66ffd700 1 -- 172.21.15.6:0/2370758220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580a3270 con 0x56063239a1b0 2023-10-14T09:06:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2370758220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 msgr2=0x5606323aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 0x5606323aa8d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2d58097900 tx=0x7f2d5809b1d0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2370758220 shutdown_connections 2023-10-14T09:06:30.106 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560632399850 0x560632399c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2370758220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063239a1b0 0x5606323aa8d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2370758220 >> 172.21.15.6:0/2370758220 conn(0x5606322c7d70 msgr2=0x5606323a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2370758220 shutdown_connections 2023-10-14T09:06:30.107 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2370758220 wait complete. 2023-10-14T09:06:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.091+0000 7f2d82b72b80 1 -- start start 2023-10-14T09:06:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.092+0000 7f2d82b72b80 1 Processor -- start 2023-10-14T09:06:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x5606323a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.108 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606323a9c40 con 0x560632399850 2023-10-14T09:06:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606323a9db0 con 0x56063239a1b0 2023-10-14T09:06:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606323a9f70 con 0x56063239b0a0 2023-10-14T09:06:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d82b72b80 10 client.0 _ll_register_callbacks cb 0x7f2d6001d7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:30.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x5606323a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x5606323a81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36106/0 (socket says 172.21.15.6:36106) 2023-10-14T09:06:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 -- 172.21.15.6:0/2487672600 learned_addr learned my addr 172.21.15.6:0/2487672600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 -- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 msgr2=0x5606323a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 -- 172.21.15.6:0/2487672600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 msgr2=0x5606323a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6ffff700 1 -- 172.21.15.6:0/2487672600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d701a1280 con 0x560632399850 2023-10-14T09:06:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.093+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d6ffff700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x5606323a81b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000a460 tx=0x7f2d6002ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce06976eed72324 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d4f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/2487672600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d60005d90 con 0x560632399850 2023-10-14T09:06:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/2487672600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f2d60010b20 con 0x560632399850 2023-10-14T09:06:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d5809b400 con 0x560632399850 2023-10-14T09:06:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/2487672600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d60010d20 con 0x560632399850 2023-10-14T09:06:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 10 client.16641 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5606322aa390 con 0x560632399850 2023-10-14T09:06:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/2487672600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d5809b400 con 0x560632399850 2023-10-14T09:06:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/2487672600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d60018040 con 0x560632399850 2023-10-14T09:06:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 10 client.16641 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 20 client.16641 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x560632405b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 4 client.16641 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:06:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.094+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5606322e5df0 con 0x5606323af220 2023-10-14T09:06:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.095+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x560632405b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.095+0000 7f2d4f7fe700 10 client.16641 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.095+0000 7f2d6f7fe700 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x560632405b00 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9fd88110026038 server_cookie=6cbe48844e1e7b97 in_seq=0 out_seq=0 2023-10-14T09:06:30.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:29 smithi178 ceph-mon[103612]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 721 op/s 2023-10-14T09:06:30.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:29 smithi057 ceph-mon[103313]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 721 op/s 2023-10-14T09:06:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d4f7fe700 1 -- 172.21.15.6:0/2487672600 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5606322e5df0 con 0x5606323af220 2023-10-14T09:06:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d4f7fe700 10 client.16641 handle_command_reply: tid=0 2023-10-14T09:06:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 client.16641 shutdown 2023-10-14T09:06:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 msgr2=0x5606323a81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x5606323a81b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000a460 tx=0x7f2d6002ed70 comp rx=0 tx=0).stop 2023-10-14T09:06:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 shutdown_connections 2023-10-14T09:06:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5606323af220 0x560632405b00 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56063239b0a0 0x5606323a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560632399850 0x5606323a81b0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 --2- 172.21.15.6:0/2487672600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56063239a1b0 0x5606323a86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 >> 172.21.15.6:0/2487672600 conn(0x5606322c7d70 msgr2=0x5606323ab170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.208+0000 7f2d4f7fe700 0 client.16641 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.209+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 shutdown_connections 2023-10-14T09:06:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.209+0000 7f2d82b72b80 1 -- 172.21.15.6:0/2487672600 wait complete. 2023-10-14T09:06:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.209+0000 7f2d82b72b80 20 client.16641 trim_cache size 0 max 16384 2023-10-14T09:06:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:06:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:06:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:06:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:06:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2d5c0a1480 msgr2=0x7f2d5c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2d5c0a1480 0x7f2d5c0a3940 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2d70101bf0 tx=0x7f2d6000a380 comp rx=0 tx=0).stop 2023-10-14T09:06:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 msgr2=0x7f2d700732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d700732a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b680 tx=0x7f2d58004730 comp rx=0 tx=0).stop 2023-10-14T09:06:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 shutdown_connections 2023-10-14T09:06:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f2d5c0a1480 0x7f2d5c0a3940 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d70102a40 0x7f2d700737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d70100ea0 0x7f2d70074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 --2- 172.21.15.6:0/3871923460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d70102080 0x7f2d700732a0 secure :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b680 tx=0x7f2d58004730 comp rx=0 tx=0).stop 2023-10-14T09:06:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.210+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 >> 172.21.15.6:0/3871923460 conn(0x7f2d700fc460 msgr2=0x7f2d70105690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.214+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 shutdown_connections 2023-10-14T09:06:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:30.214+0000 7f2d76988700 1 -- 172.21.15.6:0/3871923460 wait complete. 2023-10-14T09:06:30.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:29 smithi006 ceph-mon[99452]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 721 op/s 2023-10-14T09:06:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 810.0 s, 965.6 tps, lat 103.668 ms stddev 116.732 2023-10-14T09:06:32.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:31 smithi178 ceph-mon[103612]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 731 op/s 2023-10-14T09:06:32.198 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:31 smithi057 ceph-mon[103313]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 731 op/s 2023-10-14T09:06:32.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:31 smithi006 ceph-mon[99452]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 MiB/s wr, 731 op/s 2023-10-14T09:06:34.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:33 smithi178 ceph-mon[103612]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 846 op/s 2023-10-14T09:06:34.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:33 smithi057 ceph-mon[103313]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 846 op/s 2023-10-14T09:06:34.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:33 smithi006 ceph-mon[99452]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 846 op/s 2023-10-14T09:06:35.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:34 smithi178 ceph-mon[103612]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 804 op/s 2023-10-14T09:06:35.197 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:34 smithi057 ceph-mon[103313]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 804 op/s 2023-10-14T09:06:35.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:34 smithi006 ceph-mon[99452]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 804 op/s 2023-10-14T09:06:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 815.0 s, 1388.4 tps, lat 72.762 ms stddev 82.958 2023-10-14T09:06:37.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:37 smithi006 ceph-mon[99452]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 776 op/s 2023-10-14T09:06:37.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:37 smithi178 ceph-mon[103612]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 776 op/s 2023-10-14T09:06:37.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:37 smithi057 ceph-mon[103313]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 776 op/s 2023-10-14T09:06:39.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:39 smithi006 ceph-mon[99452]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 691 op/s 2023-10-14T09:06:39.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:39 smithi178 ceph-mon[103612]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 691 op/s 2023-10-14T09:06:39.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:39 smithi057 ceph-mon[103313]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 691 op/s 2023-10-14T09:06:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 820.0 s, 1353.0 tps, lat 74.037 ms stddev 91.412 2023-10-14T09:06:41.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:41 smithi006 ceph-mon[99452]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 667 op/s 2023-10-14T09:06:41.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:41 smithi178 ceph-mon[103612]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 667 op/s 2023-10-14T09:06:41.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:41 smithi057 ceph-mon[103313]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 667 op/s 2023-10-14T09:06:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 -- 172.21.15.6:0/228286446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072890 msgr2=0x7f61601094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 --2- 172.21.15.6:0/228286446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072890 0x7f61601094a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6150009990 tx=0x7f6150009ca0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 -- 172.21.15.6:0/228286446 shutdown_connections 2023-10-14T09:06:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 --2- 172.21.15.6:0/228286446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072890 0x7f61601094a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 --2- 172.21.15.6:0/228286446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6160108250 0x7f6160108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 --2- 172.21.15.6:0/228286446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072410 0x7f6160108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 -- 172.21.15.6:0/228286446 >> 172.21.15.6:0/228286446 conn(0x7f616006dcf0 msgr2=0x7f6160070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 -- 172.21.15.6:0/228286446 shutdown_connections 2023-10-14T09:06:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.371+0000 7f6166179700 1 -- 172.21.15.6:0/228286446 wait complete. 2023-10-14T09:06:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 Processor -- start 2023-10-14T09:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 -- start start 2023-10-14T09:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 0x7f6160112e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 0x7f6160111480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.377 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6160108250 0x7f61601119c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6160112160 con 0x7f6160072410 2023-10-14T09:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61601122d0 con 0x7f6160072890 2023-10-14T09:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f6166179700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61601a93f0 con 0x7f6160108250 2023-10-14T09:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 0x7f6160112e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.378 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f615effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 0x7f6160111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 0x7f6160112e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36120/0 (socket says 172.21.15.6:36120) 2023-10-14T09:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f615f7fe700 1 -- 172.21.15.6:0/3923417691 learned_addr learned my addr 172.21.15.6:0/3923417691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.372+0000 7f615effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 0x7f6160111480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34880/0 (socket says 172.21.15.6:34880) 2023-10-14T09:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615ffff700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6160108250 0x7f61601119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.379 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615effd700 1 -- 172.21.15.6:0/3923417691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6160108250 msgr2=0x7f61601119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615effd700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6160108250 0x7f61601119c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615effd700 1 -- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 msgr2=0x7f6160112e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615effd700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 0x7f6160112e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615effd700 1 -- 172.21.15.6:0/3923417691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154009520 con 0x7f6160072890 2023-10-14T09:06:43.380 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615f7fe700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 0x7f6160112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615effd700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 0x7f6160111480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f615400e9f0 tx=0x7f615400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615cff9700 1 -- 172.21.15.6:0/3923417691 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400cb70 con 0x7f6160072890 2023-10-14T09:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615cff9700 1 -- 172.21.15.6:0/3923417691 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f615400ee90 con 0x7f6160072890 2023-10-14T09:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61500095f0 con 0x7f6160072890 2023-10-14T09:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f615cff9700 1 -- 172.21.15.6:0/3923417691 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154003cf0 con 0x7f6160072890 2023-10-14T09:06:43.381 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.373+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61601a9a20 con 0x7f6160072890 2023-10-14T09:06:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.376+0000 7f615cff9700 1 -- 172.21.15.6:0/3923417691 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f615400ccd0 con 0x7f6160072890 2023-10-14T09:06:43.383 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 Processor -- start 2023-10-14T09:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 -- start start 2023-10-14T09:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015941c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015942ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159430a0 0x558015943520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.384 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580158b6c10 con 0x558015941850 2023-10-14T09:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55801589bc00 con 0x5580159430a0 2023-10-14T09:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f6172363b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558015899520 con 0x5580159421b0 2023-10-14T09:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f615cff9700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61480a1480 0x7f61480a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.378+0000 7f615ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015941c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159430a0 0x558015943520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015941c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36126/0 (socket says 172.21.15.6:36126) 2023-10-14T09:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015942ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615ffff700 1 -- 172.21.15.6:0/3480891280 learned_addr learned my addr 172.21.15.6:0/3480891280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615cff9700 1 -- 172.21.15.6:0/3923417691 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6154014070 con 0x7f6160072890 2023-10-14T09:06:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 -- 172.21.15.6:0/3480891280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159430a0 msgr2=0x558015943520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159430a0 0x558015943520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 -- 172.21.15.6:0/3480891280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 msgr2=0x558015941c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015941c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 -- 172.21.15.6:0/3480891280 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558015852390 con 0x5580159421b0 2023-10-14T09:06:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615ffff700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61480a1480 0x7f61480a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.379+0000 7f615f7fe700 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015942ac0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f61580078a0 tx=0x7f61580092b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7976d01a68d77bff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.380+0000 7f6145ffb700 1 -- 172.21.15.6:0/3480891280 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004db0 con 0x5580159421b0 2023-10-14T09:06:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.380+0000 7f6145ffb700 1 -- 172.21.15.6:0/3480891280 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f615800f040 con 0x5580159421b0 2023-10-14T09:06:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.380+0000 7f615ffff700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61480a1480 0x7f61480a3940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f615000b2e0 tx=0x7f6150009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.380+0000 7f6145ffb700 1 -- 172.21.15.6:0/3480891280 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158004290 con 0x5580159421b0 2023-10-14T09:06:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.381+0000 7f6172363b80 1 -- 172.21.15.6:0/3480891280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 msgr2=0x558015942ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.381+0000 7f6172363b80 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015942ac0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f61580078a0 tx=0x7f61580092b0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.401+0000 7f6172363b80 1 -- 172.21.15.6:0/3480891280 shutdown_connections 2023-10-14T09:06:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.401+0000 7f6172363b80 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159430a0 0x558015943520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.401+0000 7f6172363b80 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015941c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.401+0000 7f6172363b80 1 --2- 172.21.15.6:0/3480891280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015942ac0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.401+0000 7f6172363b80 1 -- 172.21.15.6:0/3480891280 >> 172.21.15.6:0/3480891280 conn(0x55801586fd70 msgr2=0x55801593cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.417+0000 7f6172363b80 1 -- 172.21.15.6:0/3480891280 shutdown_connections 2023-10-14T09:06:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.428+0000 7f6172363b80 1 -- 172.21.15.6:0/3480891280 wait complete. 2023-10-14T09:06:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.428+0000 7f6172363b80 1 -- start start 2023-10-14T09:06:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.428+0000 7f6172363b80 1 Processor -- start 2023-10-14T09:06:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558015941850 0x558015953ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015954410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580159430a0 0x55801595b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558015894e10 con 0x5580159430a0 2023-10-14T09:06:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580158316b0 con 0x558015941850 2023-10-14T09:06:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558015831350 con 0x5580159421b0 2023-10-14T09:06:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f6172363b80 10 client.0 _ll_register_callbacks cb 0x55801568e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558015941850 0x558015953ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.429+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558015941850 0x558015953ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34892/0 (socket says 172.21.15.6:34892) 2023-10-14T09:06:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615f7fe700 1 -- 172.21.15.6:0/3948413004 learned_addr learned my addr 172.21.15.6:0/3948413004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615ffff700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580159430a0 0x55801595b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615effd700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015954410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615ffff700 1 -- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 msgr2=0x558015954410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615ffff700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015954410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615ffff700 1 -- 172.21.15.6:0/3948413004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558015941850 msgr2=0x558015953ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615ffff700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558015941850 0x558015953ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.430+0000 7f615ffff700 1 -- 172.21.15.6:0/3948413004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6158007500 con 0x5580159430a0 2023-10-14T09:06:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.431+0000 7f615ffff700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580159430a0 0x55801595b450 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f61500059d0 tx=0x7f6150009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cff2cc875aef172 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.431+0000 7f613effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.431+0000 7f613effd700 1 -- 172.21.15.6:0/3948413004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150004c30 con 0x5580159430a0 2023-10-14T09:06:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.431+0000 7f613effd700 1 -- 172.21.15.6:0/3948413004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6150004d90 con 0x5580159430a0 2023-10-14T09:06:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.431+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558015899e90 con 0x5580159430a0 2023-10-14T09:06:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.432+0000 7f613effd700 1 -- 172.21.15.6:0/3948413004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f615000f460 con 0x5580159430a0 2023-10-14T09:06:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.432+0000 7f6172363b80 10 client.16653 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.432+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5580156bfd80 con 0x5580159430a0 2023-10-14T09:06:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.432+0000 7f613effd700 1 -- 172.21.15.6:0/3948413004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558015899e90 con 0x5580159430a0 2023-10-14T09:06:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.432+0000 7f613effd700 1 -- 172.21.15.6:0/3948413004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6150037070 con 0x5580159430a0 2023-10-14T09:06:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.433+0000 7f6172363b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.433+0000 7f6172363b80 10 client.16653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.433+0000 7f6172363b80 20 client.16653 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.433+0000 7f6172363b80 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55801595fc50 0x558015962070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.433+0000 7f6172363b80 4 client.16653 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:06:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.433+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558015911bb0 con 0x55801595fc50 2023-10-14T09:06:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.445+0000 7f615f7fe700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55801595fc50 0x558015962070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.455+0000 7f613effd700 10 client.16653 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.455+0000 7f615f7fe700 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55801595fc50 0x558015962070 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0c4c8a32bb1709 server_cookie=90b1efb3e11ac5ff in_seq=0 out_seq=0 2023-10-14T09:06:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f613effd700 1 -- 172.21.15.6:0/3948413004 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558015911bb0 con 0x55801595fc50 2023-10-14T09:06:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f613effd700 10 client.16653 handle_command_reply: tid=0 2023-10-14T09:06:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 client.16653 shutdown 2023-10-14T09:06:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580159430a0 msgr2=0x55801595b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580159430a0 0x55801595b450 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f61500059d0 tx=0x7f6150009ca0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 shutdown_connections 2023-10-14T09:06:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55801595fc50 0x558015962070 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580159430a0 0x55801595b450 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558015941850 0x558015953ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f613effd700 0 client.16653 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 --2- 172.21.15.6:0/3948413004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159421b0 0x558015954410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.456+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 >> 172.21.15.6:0/3948413004 conn(0x55801586fd70 msgr2=0x55801593c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.458+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 shutdown_connections 2023-10-14T09:06:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.459+0000 7f6172363b80 1 -- 172.21.15.6:0/3948413004 wait complete. 2023-10-14T09:06:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.459+0000 7f6172363b80 20 client.16653 trim_cache size 0 max 16384 2023-10-14T09:06:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 Processor -- start 2023-10-14T09:06:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 -- start start 2023-10-14T09:06:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x55801593be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x55801595b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x558015949410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580157158c0 con 0x558015941850 2023-10-14T09:06:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558015941490 con 0x5580159421b0 2023-10-14T09:06:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.482+0000 7f6172363b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558015939400 con 0x5580159430a0 2023-10-14T09:06:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x55801593be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x55801593be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36144/0 (socket says 172.21.15.6:36144) 2023-10-14T09:06:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 -- 172.21.15.6:0/2054699182 learned_addr learned my addr 172.21.15.6:0/2054699182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615ffff700 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x558015949410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 -- 172.21.15.6:0/2054699182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 msgr2=0x558015949410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x558015949410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.488 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 -- 172.21.15.6:0/2054699182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 msgr2=0x55801595b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x55801595b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 -- 172.21.15.6:0/2054699182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580156a8c00 con 0x558015941850 2023-10-14T09:06:43.489 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.483+0000 7f615f7fe700 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x55801593be30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f615800b010 tx=0x7f615800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65762cbecd4c1ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.484+0000 7f61467fc700 1 -- 172.21.15.6:0/2054699182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580254f0 con 0x558015941850 2023-10-14T09:06:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.484+0000 7f61467fc700 1 -- 172.21.15.6:0/2054699182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6158015710 con 0x558015941850 2023-10-14T09:06:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.484+0000 7f61467fc700 1 -- 172.21.15.6:0/2054699182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158005040 con 0x558015941850 2023-10-14T09:06:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 -- 172.21.15.6:0/2054699182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 msgr2=0x55801593be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x55801593be30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f615800b010 tx=0x7f615800b040 comp rx=0 tx=0).stop 2023-10-14T09:06:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 -- 172.21.15.6:0/2054699182 shutdown_connections 2023-10-14T09:06:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x558015949410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x55801593be30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 --2- 172.21.15.6:0/2054699182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x55801595b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 -- 172.21.15.6:0/2054699182 >> 172.21.15.6:0/2054699182 conn(0x55801586fd70 msgr2=0x5580159669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 -- 172.21.15.6:0/2054699182 shutdown_connections 2023-10-14T09:06:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.485+0000 7f6172363b80 1 -- 172.21.15.6:0/2054699182 wait complete. 2023-10-14T09:06:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 -- start start 2023-10-14T09:06:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 Processor -- start 2023-10-14T09:06:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015957520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x558015957a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x55801595aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55801595afc0 con 0x558015941850 2023-10-14T09:06:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55801595b130 con 0x5580159421b0 2023-10-14T09:06:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55801595b2f0 con 0x5580159430a0 2023-10-14T09:06:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f6172363b80 10 client.0 _ll_register_callbacks cb 0x7f6150005360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015957520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015957520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36148/0 (socket says 172.21.15.6:36148) 2023-10-14T09:06:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f615f7fe700 1 -- 172.21.15.6:0/2529334672 learned_addr learned my addr 172.21.15.6:0/2529334672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.486+0000 7f615effd700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x558015957a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615ffff700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x55801595aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615f7fe700 1 -- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 msgr2=0x55801595aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615f7fe700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x55801595aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615f7fe700 1 -- 172.21.15.6:0/2529334672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 msgr2=0x558015957a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615f7fe700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x558015957a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615f7fe700 1 -- 172.21.15.6:0/2529334672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558015852390 con 0x558015941850 2023-10-14T09:06:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615ffff700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x55801595aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:06:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f615f7fe700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015957520 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f61580158a0 tx=0x7f6158015c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f44e96c2d601bb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f613effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:06:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f613effd700 1 -- 172.21.15.6:0/2529334672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580252f0 con 0x558015941850 2023-10-14T09:06:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f613effd700 1 -- 172.21.15.6:0/2529334672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f6158025450 con 0x558015941850 2023-10-14T09:06:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f615800f040 con 0x558015941850 2023-10-14T09:06:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f613effd700 1 -- 172.21.15.6:0/2529334672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6158025610 con 0x558015941850 2023-10-14T09:06:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f6172363b80 10 client.16659 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.487+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x5580156e61f0 con 0x558015941850 2023-10-14T09:06:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f613effd700 1 -- 172.21.15.6:0/2529334672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f615800f040 con 0x558015941850 2023-10-14T09:06:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f613effd700 1 -- 172.21.15.6:0/2529334672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f615802c030 con 0x558015941850 2023-10-14T09:06:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f6172363b80 10 client.16659 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f6172363b80 10 client.16659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f6172363b80 20 client.16659 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f6172363b80 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5580159b4960 0x5580159b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f6172363b80 4 client.16659 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:06:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55801588ddf0 con 0x5580159b4960 2023-10-14T09:06:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f615effd700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5580159b4960 0x5580159b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.488+0000 7f613effd700 10 client.16659 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.489+0000 7f615effd700 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5580159b4960 0x5580159b6d50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190e324401d3af02 server_cookie=d9ee22915a89e297 in_seq=0 out_seq=0 2023-10-14T09:06:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f613effd700 1 -- 172.21.15.6:0/2529334672 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55801588ddf0 con 0x5580159b4960 2023-10-14T09:06:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f613effd700 10 client.16659 handle_command_reply: tid=0 2023-10-14T09:06:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 client.16659 shutdown 2023-10-14T09:06:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 msgr2=0x558015957520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015957520 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f61580158a0 tx=0x7f6158015c60 comp rx=0 tx=0).stop 2023-10-14T09:06:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 shutdown_connections 2023-10-14T09:06:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x5580159b4960 0x5580159b6d50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580159430a0 0x55801595aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558015941850 0x558015957520 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f613effd700 0 client.16659 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 --2- 172.21.15.6:0/2529334672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5580159421b0 0x558015957a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.504+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 >> 172.21.15.6:0/2529334672 conn(0x55801586fd70 msgr2=0x55801593be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 shutdown_connections 2023-10-14T09:06:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6172363b80 1 -- 172.21.15.6:0/2529334672 wait complete. 2023-10-14T09:06:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6172363b80 20 client.16659 trim_cache size 0 max 16384 2023-10-14T09:06:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:06:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:06:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:06:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:06:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61480a1480 msgr2=0x7f61480a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61480a1480 0x7f61480a3940 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f615000b2e0 tx=0x7f6150009310 comp rx=0 tx=0).stop 2023-10-14T09:06:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 msgr2=0x7f6160111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 0x7f6160111480 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f615400e9f0 tx=0x7f615400ed00 comp rx=0 tx=0).stop 2023-10-14T09:06:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 shutdown_connections 2023-10-14T09:06:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6160108250 0x7f61601119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160072410 0x7f6160112e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f61480a1480 0x7f61480a3940 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 --2- 172.21.15.6:0/3923417691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6160072890 0x7f6160111480 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 >> 172.21.15.6:0/3923417691 conn(0x7f616006dcf0 msgr2=0x7f61600700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 shutdown_connections 2023-10-14T09:06:43.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:43.505+0000 7f6166179700 1 -- 172.21.15.6:0/3923417691 wait complete. 2023-10-14T09:06:43.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:43 smithi006 ceph-mon[99452]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 744 op/s 2023-10-14T09:06:43.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:43 smithi178 ceph-mon[103612]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 744 op/s 2023-10-14T09:06:43.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:43 smithi057 ceph-mon[103313]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 744 op/s 2023-10-14T09:06:45.896 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:45 smithi178 ceph-mon[103612]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 693 op/s 2023-10-14T09:06:45.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:45 smithi057 ceph-mon[103313]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 693 op/s 2023-10-14T09:06:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 825.0 s, 1231.4 tps, lat 80.687 ms stddev 87.246 2023-10-14T09:06:45.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:45 smithi006 ceph-mon[99452]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 693 op/s 2023-10-14T09:06:46.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:46 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:06:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:46 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:06:46.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:46 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:06:48.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:47 smithi178 ceph-mon[103612]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 665 op/s 2023-10-14T09:06:48.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:48.141 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:47 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:48.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:47 smithi057 ceph-mon[103313]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 665 op/s 2023-10-14T09:06:48.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:48.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:47 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:48.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:47 smithi006 ceph-mon[99452]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 665 op/s 2023-10-14T09:06:48.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:48.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:47 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:49.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:06:49.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:06:49.136 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:49.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:06:49.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:06:49.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:49.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:06:49.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:06:49.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:06:50.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:49 smithi178 ceph-mon[103612]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 665 op/s 2023-10-14T09:06:50.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:49 smithi057 ceph-mon[103313]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 665 op/s 2023-10-14T09:06:50.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:49 smithi006 ceph-mon[99452]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 665 op/s 2023-10-14T09:06:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 830.0 s, 1021.4 tps, lat 98.099 ms stddev 197.332 2023-10-14T09:06:51.140 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:50 smithi178 ceph-mon[103612]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 1.01k op/s 2023-10-14T09:06:51.194 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:50 smithi057 ceph-mon[103313]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 1.01k op/s 2023-10-14T09:06:51.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:50 smithi006 ceph-mon[99452]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 1.01k op/s 2023-10-14T09:06:53.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:53 smithi006 ceph-mon[99452]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 32 MiB/s wr, 1.80k op/s 2023-10-14T09:06:53.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:53 smithi178 ceph-mon[103612]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 32 MiB/s wr, 1.80k op/s 2023-10-14T09:06:53.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:53 smithi057 ceph-mon[103313]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 32 MiB/s wr, 1.80k op/s 2023-10-14T09:06:55.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:55 smithi006 ceph-mon[99452]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 1.91k op/s 2023-10-14T09:06:55.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:55 smithi178 ceph-mon[103612]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 1.91k op/s 2023-10-14T09:06:55.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:55 smithi057 ceph-mon[103313]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 1.91k op/s 2023-10-14T09:06:55.968 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 835.0 s, 1623.4 tps, lat 62.064 ms stddev 75.398 2023-10-14T09:06:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.665+0000 7f7aed1f1700 1 -- 172.21.15.6:0/2455027518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 msgr2=0x7f7ae8100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/2455027518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8100200 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80099c0 tx=0x7f7ad8009cd0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 -- 172.21.15.6:0/2455027518 shutdown_connections 2023-10-14T09:06:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/2455027518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 0x7f7ae8108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/2455027518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8100200 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/2455027518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 -- 172.21.15.6:0/2455027518 >> 172.21.15.6:0/2455027518 conn(0x7f7ae80fb3b0 msgr2=0x7f7ae80fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 -- 172.21.15.6:0/2455027518 shutdown_connections 2023-10-14T09:06:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 -- 172.21.15.6:0/2455027518 wait complete. 2023-10-14T09:06:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.666+0000 7f7aed1f1700 1 Processor -- start 2023-10-14T09:06:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 -- start start 2023-10-14T09:06:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 0x7f7ae819dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819e760 con 0x7f7ae80ffde0 2023-10-14T09:06:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819e8d0 con 0x7f7ae8100fd0 2023-10-14T09:06:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7aed1f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae819ea90 con 0x7f7ae8101970 2023-10-14T09:06:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34922/0 (socket says 172.21.15.6:34922) 2023-10-14T09:06:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 -- 172.21.15.6:0/3583718284 learned_addr learned my addr 172.21.15.6:0/3583718284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae759e700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 0x7f7ae819dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 -- 172.21.15.6:0/3583718284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 msgr2=0x7f7ae819dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 0x7f7ae819dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 -- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 msgr2=0x7f7ae8069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8069f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae659c700 1 -- 172.21.15.6:0/3583718284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80095f0 con 0x7f7ae8100fd0 2023-10-14T09:06:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae759e700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 0x7f7ae819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.667+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.668+0000 7f7ae659c700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae819b980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00d980 tx=0x7f7adc00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:56.675 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.668+0000 7f7acffff700 1 -- 172.21.15.6:0/3583718284 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc004220 con 0x7f7ae8100fd0 2023-10-14T09:06:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.668+0000 7f7acffff700 1 -- 172.21.15.6:0/3583718284 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7adc007640 con 0x7f7ae8100fd0 2023-10-14T09:06:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.668+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae819ed70 con 0x7f7ae8100fd0 2023-10-14T09:06:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.668+0000 7f7acffff700 1 -- 172.21.15.6:0/3583718284 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc005690 con 0x7f7ae8100fd0 2023-10-14T09:06:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.668+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae819f220 con 0x7f7ae8100fd0 2023-10-14T09:06:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.670+0000 7f7acffff700 1 -- 172.21.15.6:0/3583718284 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7adc004750 con 0x7f7ae8100fd0 2023-10-14T09:06:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.671+0000 7f7acffff700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7ad00a1480 0x7f7ad00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.671+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7ad00a1480 0x7f7ad00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.671+0000 7f7acffff700 1 -- 172.21.15.6:0/3583718284 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7adc0ccb50 con 0x7f7ae8100fd0 2023-10-14T09:06:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.672+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7ad00a1480 0x7f7ad00a3940 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009990 tx=0x7f7ad801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.672+0000 7f7af93dbb80 1 Processor -- start 2023-10-14T09:06:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 -- start start 2023-10-14T09:06:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed561b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed561c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed5629cc0 0x55aed562c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed5590c10 con 0x55aed561cf60 2023-10-14T09:06:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed5575c00 con 0x55aed5629cc0 2023-10-14T09:06:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.675+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed5573520 con 0x55aed561bcd0 2023-10-14T09:06:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed561b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed561b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36170/0 (socket says 172.21.15.6:36170) 2023-10-14T09:06:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/3256987110 learned_addr learned my addr 172.21.15.6:0/3256987110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed5629cc0 0x55aed562c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae659c700 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed561c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 -- 172.21.15.6:0/3256987110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 msgr2=0x55aed561c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed561c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 -- 172.21.15.6:0/3256987110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 msgr2=0x55aed561b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed561b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 -- 172.21.15.6:0/3256987110 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed552c390 con 0x55aed5629cc0 2023-10-14T09:06:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.676+0000 7f7ae759e700 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed5629cc0 0x55aed562c0b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0003db0 tx=0x7f7ae0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efadaedca8b32939 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.677+0000 7f7acd7fa700 1 -- 172.21.15.6:0/3256987110 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0004bb0 con 0x55aed5629cc0 2023-10-14T09:06:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.677+0000 7f7acd7fa700 1 -- 172.21.15.6:0/3256987110 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ae000f040 con 0x55aed5629cc0 2023-10-14T09:06:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.677+0000 7f7acd7fa700 1 -- 172.21.15.6:0/3256987110 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0007c20 con 0x55aed5629cc0 2023-10-14T09:06:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.677+0000 7f7af93dbb80 1 -- 172.21.15.6:0/3256987110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed5629cc0 msgr2=0x55aed562c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.677+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed5629cc0 0x55aed562c0b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0003db0 tx=0x7f7ae0009920 comp rx=0 tx=0).stop 2023-10-14T09:06:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 -- 172.21.15.6:0/3256987110 shutdown_connections 2023-10-14T09:06:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed5629cc0 0x55aed562c0b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed561b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/3256987110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed561c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 -- 172.21.15.6:0/3256987110 >> 172.21.15.6:0/3256987110 conn(0x55aed5549d70 msgr2=0x55aed56169a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 -- 172.21.15.6:0/3256987110 shutdown_connections 2023-10-14T09:06:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 -- 172.21.15.6:0/3256987110 wait complete. 2023-10-14T09:06:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 -- start start 2023-10-14T09:06:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.678+0000 7f7af93dbb80 1 Processor -- start 2023-10-14T09:06:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 0x55aed562dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed562e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed5629cc0 0x55aed5635420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed556ee10 con 0x55aed561cf60 2023-10-14T09:06:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed550b6b0 con 0x55aed561bcd0 2023-10-14T09:06:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed550b350 con 0x55aed5629cc0 2023-10-14T09:06:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7af93dbb80 10 client.0 _ll_register_callbacks cb 0x55aed53687a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 0x55aed562dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 0x55aed562dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34934/0 (socket says 172.21.15.6:34934) 2023-10-14T09:06:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed5629cc0 0x55aed5635420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/327221205 learned_addr learned my addr 172.21.15.6:0/327221205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae659c700 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed562e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed5629cc0 msgr2=0x55aed5635420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed5629cc0 0x55aed5635420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/327221205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 msgr2=0x55aed562e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed562e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.679+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/327221205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0003a60 con 0x55aed561bcd0 2023-10-14T09:06:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 0x55aed562dea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80098e0 tx=0x7f7ad8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3d8550bb020e8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7acaff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:06:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7acaff5700 1 -- 172.21.15.6:0/327221205 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad802a070 con 0x55aed561bcd0 2023-10-14T09:06:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7acaff5700 1 -- 172.21.15.6:0/327221205 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7ad8004e40 con 0x55aed561bcd0 2023-10-14T09:06:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aed5573e90 con 0x55aed561bcd0 2023-10-14T09:06:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7acaff5700 1 -- 172.21.15.6:0/327221205 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ad800f460 con 0x55aed561bcd0 2023-10-14T09:06:56.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7af93dbb80 10 client.26213 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.680+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55aed5399d80 con 0x55aed561bcd0 2023-10-14T09:06:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7acaff5700 1 -- 172.21.15.6:0/327221205 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ad803e020 con 0x55aed561bcd0 2023-10-14T09:06:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7acaff5700 1 -- 172.21.15.6:0/327221205 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7ad8024750 con 0x55aed561bcd0 2023-10-14T09:06:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7af93dbb80 10 client.26213 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7af93dbb80 10 client.26213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7af93dbb80 20 client.26213 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed564d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7af93dbb80 4 client.26213 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:06:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aed55ebbb0 con 0x55aed564ad50 2023-10-14T09:06:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7ae659c700 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed564d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7acaff5700 10 client.26213 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.681+0000 7f7ae659c700 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed564d170 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ea21a33ce469d4b server_cookie=859424316b5ba95 in_seq=0 out_seq=0 2023-10-14T09:06:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7acaff5700 1 -- 172.21.15.6:0/327221205 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aed55ebbb0 con 0x55aed564ad50 2023-10-14T09:06:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7acaff5700 10 client.26213 handle_command_reply: tid=0 2023-10-14T09:06:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 client.26213 shutdown 2023-10-14T09:06:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 msgr2=0x55aed562dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 0x55aed562dea0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80098e0 tx=0x7f7ad8009310 comp rx=0 tx=0).stop 2023-10-14T09:06:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 shutdown_connections 2023-10-14T09:06:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed564d170 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed5629cc0 0x55aed5635420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7acaff5700 0 client.26213 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561bcd0 0x55aed562dea0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/327221205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed561cf60 0x55aed562e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 >> 172.21.15.6:0/327221205 conn(0x55aed5549d70 msgr2=0x55aed56165c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 shutdown_connections 2023-10-14T09:06:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.682+0000 7f7af93dbb80 1 -- 172.21.15.6:0/327221205 wait complete. 2023-10-14T09:06:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.683+0000 7f7af93dbb80 20 client.26213 trim_cache size 0 max 16384 2023-10-14T09:06:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 Processor -- start 2023-10-14T09:06:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 -- start start 2023-10-14T09:06:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed562dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed56353e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed562e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed53ef8c0 con 0x55aed5629cc0 2023-10-14T09:06:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed562f090 con 0x55aed561cf60 2023-10-14T09:06:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.701+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed562ca20 con 0x55aed561bcd0 2023-10-14T09:06:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.702+0000 7f7ae759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed562e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.702+0000 7f7ae759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed562e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36186/0 (socket says 172.21.15.6:36186) 2023-10-14T09:06:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.702+0000 7f7ae759e700 1 -- 172.21.15.6:0/1120688770 learned_addr learned my addr 172.21.15.6:0/1120688770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.702+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed562dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae659c700 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed56353e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/1120688770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 msgr2=0x55aed56353e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed56353e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/1120688770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 msgr2=0x55aed562e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed562e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae6d9d700 1 -- 172.21.15.6:0/1120688770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aed5382c00 con 0x55aed561bcd0 2023-10-14T09:06:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed562dc50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8024a80 tx=0x7f7ad8005320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2200e619ca02360c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:56.707 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.703+0000 7f7acdffb700 1 -- 172.21.15.6:0/1120688770 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad802a070 con 0x55aed561bcd0 2023-10-14T09:06:56.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7acdffb700 1 -- 172.21.15.6:0/1120688770 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ad803e040 con 0x55aed561bcd0 2023-10-14T09:06:56.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7acdffb700 1 -- 172.21.15.6:0/1120688770 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800f8c0 con 0x55aed561bcd0 2023-10-14T09:06:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 -- 172.21.15.6:0/1120688770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 msgr2=0x55aed562dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed562dc50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8024a80 tx=0x7f7ad8005320 comp rx=0 tx=0).stop 2023-10-14T09:06:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 -- 172.21.15.6:0/1120688770 shutdown_connections 2023-10-14T09:06:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed562e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed562dc50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/1120688770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed56353e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.704+0000 7f7af93dbb80 1 -- 172.21.15.6:0/1120688770 >> 172.21.15.6:0/1120688770 conn(0x55aed5549d70 msgr2=0x55aed56292e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:56.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 -- 172.21.15.6:0/1120688770 shutdown_connections 2023-10-14T09:06:56.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 -- 172.21.15.6:0/1120688770 wait complete. 2023-10-14T09:06:56.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 -- start start 2023-10-14T09:06:56.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 Processor -- start 2023-10-14T09:06:56.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed5633010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed5633550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed5634560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed5634aa0 con 0x55aed5629cc0 2023-10-14T09:06:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed5634c10 con 0x55aed561cf60 2023-10-14T09:06:56.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aed5634dd0 con 0x55aed561bcd0 2023-10-14T09:06:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7af93dbb80 10 client.0 _ll_register_callbacks cb 0x55aed53687a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:06:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.705+0000 7f7ae659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed5633550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed5633550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34948/0 (socket says 172.21.15.6:34948) 2023-10-14T09:06:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 -- 172.21.15.6:0/769183282 learned_addr learned my addr 172.21.15.6:0/769183282 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:06:56.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed5633010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae759e700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed5634560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 -- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 msgr2=0x55aed5633010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed5633010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 -- 172.21.15.6:0/769183282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 msgr2=0x55aed5634560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:06:56.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed5634560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 -- 172.21.15.6:0/769183282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aed5399d80 con 0x55aed561cf60 2023-10-14T09:06:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed5633010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:06:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7ae659c700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed5633550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7adc007e80 tx=0x7f7adc09df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b00b2d509b6fd82 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:06:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7acaff5700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:06:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7acaff5700 1 -- 172.21.15.6:0/769183282 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0b2070 con 0x55aed561cf60 2023-10-14T09:06:56.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ae000f040 con 0x55aed561cf60 2023-10-14T09:06:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.706+0000 7f7acaff5700 1 -- 172.21.15.6:0/769183282 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7adc004380 con 0x55aed561cf60 2023-10-14T09:06:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7acaff5700 1 -- 172.21.15.6:0/769183282 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7adc0b8120 con 0x55aed561cf60 2023-10-14T09:06:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 10 client.26219 fetch_fsmap learned FSMap version 55 2023-10-14T09:06:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55aed53c01f0 con 0x55aed561cf60 2023-10-14T09:06:56.718 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7acaff5700 1 -- 172.21.15.6:0/769183282 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ae000f040 con 0x55aed561cf60 2023-10-14T09:06:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7acaff5700 1 -- 172.21.15.6:0/769183282 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7adc0caad0 con 0x55aed561cf60 2023-10-14T09:06:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 10 client.26219 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:06:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 10 client.26219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:06:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 20 client.26219 populate_metadata read hostname 'smithi006' 2023-10-14T09:06:56.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed56a1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:06:56.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 4 client.26219 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:06:56.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aed5567df0 con 0x55aed564ad50 2023-10-14T09:06:56.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.707+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed56a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:06:56.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.708+0000 7f7ae6d9d700 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed56a1960 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c52fa59062d7fe server_cookie=c0bdf1c6e9a3cd12 in_seq=0 out_seq=0 2023-10-14T09:06:56.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.708+0000 7f7acaff5700 10 client.26219 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7acaff5700 1 -- 172.21.15.6:0/769183282 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aed5567df0 con 0x55aed564ad50 2023-10-14T09:06:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7acaff5700 10 client.26219 handle_command_reply: tid=0 2023-10-14T09:06:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 client.26219 shutdown 2023-10-14T09:06:56.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 msgr2=0x55aed5633550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed5633550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7adc007e80 tx=0x7f7adc09df80 comp rx=0 tx=0).stop 2023-10-14T09:06:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 shutdown_connections 2023-10-14T09:06:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55aed564ad50 0x55aed56a1960 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aed5629cc0 0x55aed5634560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.727 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55aed561bcd0 0x55aed5633010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7acaff5700 0 client.26219 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:06:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 --2- 172.21.15.6:0/769183282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55aed561cf60 0x55aed5633550 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 >> 172.21.15.6:0/769183282 conn(0x55aed5549d70 msgr2=0x55aed562dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 shutdown_connections 2023-10-14T09:06:56.728 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 1 -- 172.21.15.6:0/769183282 wait complete. 2023-10-14T09:06:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.724+0000 7f7af93dbb80 20 client.26219 trim_cache size 0 max 16384 2023-10-14T09:06:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:06:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:06:56.729 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:06:56.730 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:06:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7ad00a1480 msgr2=0x7f7ad00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7ad00a1480 0x7f7ad00a3940 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009990 tx=0x7f7ad801a040 comp rx=0 tx=0).stop 2023-10-14T09:06:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 msgr2=0x7f7ae819b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:06:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae819b980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00d980 tx=0x7f7adc00dc90 comp rx=0 tx=0).stop 2023-10-14T09:06:56.731 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 shutdown_connections 2023-10-14T09:06:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae8101970 0x7f7ae819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ae80ffde0 0x7f7ae8069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7ad00a1480 0x7f7ad00a3940 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 --2- 172.21.15.6:0/3583718284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae8100fd0 0x7f7ae819b980 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:06:56.732 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 >> 172.21.15.6:0/3583718284 conn(0x7f7ae80fb3b0 msgr2=0x7f7ae8104520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:06:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 shutdown_connections 2023-10-14T09:06:56.733 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:06:56.725+0000 7f7aed1f1700 1 -- 172.21.15.6:0/3583718284 wait complete. 2023-10-14T09:06:57.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:57 smithi178 ceph-mon[103612]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 MiB/s wr, 1.88k op/s 2023-10-14T09:06:57.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:57 smithi057 ceph-mon[103313]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 MiB/s wr, 1.88k op/s 2023-10-14T09:06:57.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:57 smithi006 ceph-mon[99452]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 MiB/s wr, 1.88k op/s 2023-10-14T09:06:59.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:06:59 smithi178 ceph-mon[103612]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 32 MiB/s wr, 1.86k op/s 2023-10-14T09:06:59.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:06:59 smithi057 ceph-mon[103313]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 32 MiB/s wr, 1.86k op/s 2023-10-14T09:06:59.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:06:59 smithi006 ceph-mon[99452]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 32 MiB/s wr, 1.86k op/s 2023-10-14T09:07:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 840.0 s, 1439.6 tps, lat 69.377 ms stddev 75.880 2023-10-14T09:07:01.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:01 smithi178 ceph-mon[103612]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-14T09:07:01.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:01 smithi057 ceph-mon[103313]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-14T09:07:01.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:01 smithi006 ceph-mon[99452]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 32 MiB/s wr, 1.83k op/s 2023-10-14T09:07:03.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:03 smithi178 ceph-mon[103612]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 27 MiB/s wr, 1.56k op/s 2023-10-14T09:07:03.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:03 smithi057 ceph-mon[103313]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 27 MiB/s wr, 1.56k op/s 2023-10-14T09:07:03.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:03 smithi006 ceph-mon[99452]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 27 MiB/s wr, 1.56k op/s 2023-10-14T09:07:05.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:05 smithi178 ceph-mon[103612]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 815 op/s 2023-10-14T09:07:05.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:05 smithi057 ceph-mon[103313]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 815 op/s 2023-10-14T09:07:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 845.0 s, 1557.4 tps, lat 64.141 ms stddev 77.723 2023-10-14T09:07:05.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:05 smithi006 ceph-mon[99452]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 815 op/s 2023-10-14T09:07:07.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:07 smithi178 ceph-mon[103612]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 656 op/s 2023-10-14T09:07:07.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:07 smithi057 ceph-mon[103313]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 656 op/s 2023-10-14T09:07:07.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:07 smithi006 ceph-mon[99452]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 656 op/s 2023-10-14T09:07:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/3787269465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 msgr2=0x7fe1f410a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/3787269465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f410a2e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009990 tx=0x7fe1e4009ca0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/3787269465 shutdown_connections 2023-10-14T09:07:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/3787269465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f410d1f0 0x7fe1f410d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/3787269465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f410a2e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/3787269465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f410a820 0x7fe1f410ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.879+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/3787269465 >> 172.21.15.6:0/3787269465 conn(0x7fe1f406dcf0 msgr2=0x7fe1f4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.880+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/3787269465 shutdown_connections 2023-10-14T09:07:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.880+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/3787269465 wait complete. 2023-10-14T09:07:09.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:09 smithi178 ceph-mon[103612]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 629 op/s 2023-10-14T09:07:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 Processor -- start 2023-10-14T09:07:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 -- start start 2023-10-14T09:07:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f41a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f410a820 0x7fe1f41a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f410d1f0 0x7fe1f41ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41ad610 con 0x7fe1f4107eb0 2023-10-14T09:07:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41ad750 con 0x7fe1f410d1f0 2023-10-14T09:07:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f8a7f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f41ad8e0 con 0x7fe1f410a820 2023-10-14T09:07:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f41a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f41a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36202/0 (socket says 172.21.15.6:36202) 2023-10-14T09:07:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f259c700 1 -- 172.21.15.6:0/2734760846 learned_addr learned my addr 172.21.15.6:0/2734760846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.881+0000 7fe1f259c700 1 -- 172.21.15.6:0/2734760846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f410a820 msgr2=0x7fe1f41a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f259c700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f410a820 0x7fe1f41a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f259c700 1 -- 172.21.15.6:0/2734760846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f410d1f0 msgr2=0x7fe1f41ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f259c700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f410d1f0 0x7fe1f41ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f259c700 1 -- 172.21.15.6:0/2734760846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40095f0 con 0x7fe1f4107eb0 2023-10-14T09:07:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f259c700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f41a5a90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400f730 tx=0x7fe1e400f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1e37fe700 1 -- 172.21.15.6:0/2734760846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e401d070 con 0x7fe1f4107eb0 2023-10-14T09:07:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1e37fe700 1 -- 172.21.15.6:0/2734760846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e400fd30 con 0x7fe1f4107eb0 2023-10-14T09:07:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1e37fe700 1 -- 172.21.15.6:0/2734760846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4005710 con 0x7fe1f4107eb0 2023-10-14T09:07:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f41adb60 con 0x7fe1f4107eb0 2023-10-14T09:07:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.882+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f41adfb0 con 0x7fe1f4107eb0 2023-10-14T09:07:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.888+0000 7fe204c69b80 1 Processor -- start 2023-10-14T09:07:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.888+0000 7fe1e37fe700 1 -- 172.21.15.6:0/2734760846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe1e40047e0 con 0x7fe1f4107eb0 2023-10-14T09:07:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.889+0000 7fe1e37fe700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1dc0a1500 0x7fe1dc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.889+0000 7fe1e37fe700 1 -- 172.21.15.6:0/2734760846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1e40ce0a0 con 0x7fe1f4107eb0 2023-10-14T09:07:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.889+0000 7fe204c69b80 1 -- start start 2023-10-14T09:07:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fb9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fbaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fbb0a0 0x55de60fbb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe204c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60f2ec10 con 0x55de60fba1b0 2023-10-14T09:07:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe204c69b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60f13c00 con 0x55de60fb9850 2023-10-14T09:07:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe204c69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60f11520 con 0x55de60fbb0a0 2023-10-14T09:07:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f2d9d700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1dc0a1500 0x7fe1dc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fb9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f2d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fbb0a0 0x55de60fbb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fb9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34968/0 (socket says 172.21.15.6:34968) 2023-10-14T09:07:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 -- 172.21.15.6:0/366867062 learned_addr learned my addr 172.21.15.6:0/366867062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:09.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 -- 172.21.15.6:0/366867062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fbb0a0 msgr2=0x55de60fbb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.899 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f2d9d700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1dc0a1500 0x7fe1dc0a39c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00af30 tx=0x7fe1ec00e7a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fbb0a0 0x55de60fbb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 -- 172.21.15.6:0/366867062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 msgr2=0x55de60fbaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fbaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.890+0000 7fe1f259c700 1 -- 172.21.15.6:0/366867062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de60eca390 con 0x55de60fb9850 2023-10-14T09:07:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.891+0000 7fe1f259c700 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fb9c70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40a31e0 tx=0x7fe1e4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c7564122c3e168 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.891+0000 7fe1e0ff9700 1 -- 172.21.15.6:0/366867062 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e409b410 con 0x55de60fb9850 2023-10-14T09:07:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.891+0000 7fe1e0ff9700 1 -- 172.21.15.6:0/366867062 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e409f560 con 0x55de60fb9850 2023-10-14T09:07:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.891+0000 7fe1e0ff9700 1 -- 172.21.15.6:0/366867062 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e409a900 con 0x55de60fb9850 2023-10-14T09:07:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.891+0000 7fe204c69b80 1 -- 172.21.15.6:0/366867062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 msgr2=0x55de60fb9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.891+0000 7fe204c69b80 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fb9c70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40a31e0 tx=0x7fe1e4009ca0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- 172.21.15.6:0/366867062 shutdown_connections 2023-10-14T09:07:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fbb0a0 0x55de60fbb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fb9c70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.902 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 --2- 172.21.15.6:0/366867062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fbaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- 172.21.15.6:0/366867062 >> 172.21.15.6:0/366867062 conn(0x55de60ee7d70 msgr2=0x55de60fb4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- 172.21.15.6:0/366867062 shutdown_connections 2023-10-14T09:07:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- 172.21.15.6:0/366867062 wait complete. 2023-10-14T09:07:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- start start 2023-10-14T09:07:09.903 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 Processor -- start 2023-10-14T09:07:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fb9850 0x55de60fc3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fc3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fbb0a0 0x55de60fcaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60f0ce10 con 0x55de60fba1b0 2023-10-14T09:07:09.904 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60ea96b0 con 0x55de60fbb0a0 2023-10-14T09:07:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60ea9350 con 0x55de60fb9850 2023-10-14T09:07:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.892+0000 7fe204c69b80 10 client.0 _ll_register_callbacks cb 0x55de60d067a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fb9850 0x55de60fc3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fc3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.905 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fb9850 0x55de60fc3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33618/0 (socket says 172.21.15.6:33618) 2023-10-14T09:07:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fbb0a0 0x55de60fcaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f259c700 1 -- 172.21.15.6:0/2210194499 learned_addr learned my addr 172.21.15.6:0/2210194499 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 -- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fb9850 msgr2=0x55de60fc3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fb9850 0x55de60fc3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 -- 172.21.15.6:0/2210194499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fbb0a0 msgr2=0x55de60fcaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fbb0a0 0x55de60fcaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 -- 172.21.15.6:0/2210194499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f41adfb0 con 0x55de60fba1b0 2023-10-14T09:07:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1f1d9b700 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fc3a60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40727a0 tx=0x7fe1e800b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b94de3fa6c569a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/2210194499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800bde0 con 0x55de60fba1b0 2023-10-14T09:07:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de60f11e90 con 0x55de60fba1b0 2023-10-14T09:07:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.893+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/2210194499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1e8011420 con 0x55de60fba1b0 2023-10-14T09:07:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/2210194499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e80115e0 con 0x55de60fba1b0 2023-10-14T09:07:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 10 client.16686 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55de60d37d80 con 0x55de60fba1b0 2023-10-14T09:07:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/2210194499 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55de60f11e90 con 0x55de60fba1b0 2023-10-14T09:07:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/2210194499 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe1e801c730 con 0x55de60fba1b0 2023-10-14T09:07:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 10 client.16686 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 10 client.16686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 20 client.16686 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de60fcf470 0x55de60fd1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 4 client.16686 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:07:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.894+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de60f89bb0 con 0x55de60fcf470 2023-10-14T09:07:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.895+0000 7fe1f259c700 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de60fcf470 0x55de60fd1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.910 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.895+0000 7fe1f259c700 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de60fcf470 0x55de60fd1890 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78d6e03062d763b7 server_cookie=f99238a77745e90d in_seq=0 out_seq=0 2023-10-14T09:07:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.895+0000 7fe1d9ffb700 10 client.16686 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/2210194499 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55de60f89bb0 con 0x55de60fcf470 2023-10-14T09:07:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe1d9ffb700 10 client.16686 handle_command_reply: tid=0 2023-10-14T09:07:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 client.16686 shutdown 2023-10-14T09:07:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 msgr2=0x55de60fc3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fc3a60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40727a0 tx=0x7fe1e800b3c0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 shutdown_connections 2023-10-14T09:07:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de60fcf470 0x55de60fd1890 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fbb0a0 0x55de60fcaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fb9850 0x55de60fc3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 --2- 172.21.15.6:0/2210194499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fba1b0 0x55de60fc3a60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 >> 172.21.15.6:0/2210194499 conn(0x55de60ee7d70 msgr2=0x55de60fb4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe1d9ffb700 0 client.16686 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 shutdown_connections 2023-10-14T09:07:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 1 -- 172.21.15.6:0/2210194499 wait complete. 2023-10-14T09:07:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.896+0000 7fe204c69b80 20 client.16686 trim_cache size 0 max 16384 2023-10-14T09:07:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.912+0000 7fe204c69b80 1 Processor -- start 2023-10-14T09:07:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 -- start start 2023-10-14T09:07:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fd1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fcaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fcb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60d8d8c0 con 0x55de60fbb0a0 2023-10-14T09:07:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60fc29d0 con 0x55de60fb9850 2023-10-14T09:07:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe204c69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60fba6d0 con 0x55de60fba1b0 2023-10-14T09:07:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fcb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fd1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fcb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36228/0 (socket says 172.21.15.6:36228) 2023-10-14T09:07:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fd1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:34982/0 (socket says 172.21.15.6:34982) 2023-10-14T09:07:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f1d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fcaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 -- 172.21.15.6:0/421991737 learned_addr learned my addr 172.21.15.6:0/421991737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 -- 172.21.15.6:0/421991737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 msgr2=0x55de60fcaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fcaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 -- 172.21.15.6:0/421991737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 msgr2=0x55de60fcb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fcb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 -- 172.21.15.6:0/421991737 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de60d20c00 con 0x55de60fb9850 2023-10-14T09:07:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f2d9d700 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fcb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:07:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.913+0000 7fe1f259c700 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fd1480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009fd0 tx=0x7fe1e4009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2720f7a32e74f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.914+0000 7fe1e17fa700 1 -- 172.21.15.6:0/421991737 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40cbc70 con 0x55de60fb9850 2023-10-14T09:07:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.914+0000 7fe1e17fa700 1 -- 172.21.15.6:0/421991737 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e409b410 con 0x55de60fb9850 2023-10-14T09:07:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.914+0000 7fe1e17fa700 1 -- 172.21.15.6:0/421991737 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e409ab60 con 0x55de60fb9850 2023-10-14T09:07:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 -- 172.21.15.6:0/421991737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 msgr2=0x55de60fd1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fd1480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009fd0 tx=0x7fe1e4009ca0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 -- 172.21.15.6:0/421991737 shutdown_connections 2023-10-14T09:07:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fcb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fd1480 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 --2- 172.21.15.6:0/421991737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fcaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 -- 172.21.15.6:0/421991737 >> 172.21.15.6:0/421991737 conn(0x55de60ee7d70 msgr2=0x55de60fb3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 -- 172.21.15.6:0/421991737 shutdown_connections 2023-10-14T09:07:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.915+0000 7fe204c69b80 1 -- 172.21.15.6:0/421991737 wait complete. 2023-10-14T09:07:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 -- start start 2023-10-14T09:07:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 Processor -- start 2023-10-14T09:07:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fc7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fc8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fc91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60fc96e0 con 0x55de60fbb0a0 2023-10-14T09:07:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60fc9850 con 0x55de60fb9850 2023-10-14T09:07:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de60fc9a10 con 0x55de60fba1b0 2023-10-14T09:07:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe204c69b80 10 client.0 _ll_register_callbacks cb 0x55de60d067a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fc91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fc91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36234/0 (socket says 172.21.15.6:36234) 2023-10-14T09:07:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f1d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fc8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 -- 172.21.15.6:0/3958829216 learned_addr learned my addr 172.21.15.6:0/3958829216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f259c700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fc7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 -- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 msgr2=0x55de60fc8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fc8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 -- 172.21.15.6:0/3958829216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 msgr2=0x55de60fc7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fc7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f2d9d700 1 -- 172.21.15.6:0/3958829216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec00b4c0 con 0x55de60fbb0a0 2023-10-14T09:07:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.916+0000 7fe1f1d9b700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fc8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:07:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1f2d9d700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fc91a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec01b6b0 tx=0x7fe1ec004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0856d9a8dc0f0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/3958829216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec013040 con 0x55de60fbb0a0 2023-10-14T09:07:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1e409f560 con 0x55de60fbb0a0 2023-10-14T09:07:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/3958829216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe1ec003c00 con 0x55de60fbb0a0 2023-10-14T09:07:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/3958829216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ec003dc0 con 0x55de60fbb0a0 2023-10-14T09:07:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 10 client.16692 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55de60eca390 con 0x55de60fbb0a0 2023-10-14T09:07:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/3958829216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e409f560 con 0x55de60fbb0a0 2023-10-14T09:07:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/3958829216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe1ec030500 con 0x55de60fbb0a0 2023-10-14T09:07:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 10 client.16692 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 20 client.16692 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de61023770 0x55de61025b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 4 client.16692 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:07:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.917+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55de60f05df0 con 0x55de61023770 2023-10-14T09:07:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.918+0000 7fe1f259c700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de61023770 0x55de61025b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.918+0000 7fe1d9ffb700 10 client.16692 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.918+0000 7fe1f259c700 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de61023770 0x55de61025b90 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8853fad4e1a3d7f4 server_cookie=ab45113359c71042 in_seq=0 out_seq=0 2023-10-14T09:07:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe1d9ffb700 1 -- 172.21.15.6:0/3958829216 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55de60f05df0 con 0x55de61023770 2023-10-14T09:07:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe1d9ffb700 10 client.16692 handle_command_reply: tid=0 2023-10-14T09:07:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 client.16692 shutdown 2023-10-14T09:07:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 msgr2=0x55de60fc91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fc91a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec01b6b0 tx=0x7fe1ec004ca0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 shutdown_connections 2023-10-14T09:07:09.938 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55de61023770 0x55de61025b90 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55de60fbb0a0 0x55de60fc91a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55de60fb9850 0x55de60fc7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe1d9ffb700 0 client.16692 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 --2- 172.21.15.6:0/3958829216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de60fba1b0 0x55de60fc8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.939 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 >> 172.21.15.6:0/3958829216 conn(0x55de60ee7d70 msgr2=0x55de60fd1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 shutdown_connections 2023-10-14T09:07:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 1 -- 172.21.15.6:0/3958829216 wait complete. 2023-10-14T09:07:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.935+0000 7fe204c69b80 20 client.16692 trim_cache size 0 max 16384 2023-10-14T09:07:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:07:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:07:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:07:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:07:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1dc0a1500 msgr2=0x7fe1dc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1dc0a1500 0x7fe1dc0a39c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00af30 tx=0x7fe1ec00e7a0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 msgr2=0x7fe1f41a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f41a5a90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400f730 tx=0x7fe1e400f810 comp rx=0 tx=0).stop 2023-10-14T09:07:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 shutdown_connections 2023-10-14T09:07:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe1dc0a1500 0x7fe1dc0a39c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1f410d1f0 0x7fe1f41ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1f4107eb0 0x7fe1f41a5a90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 --2- 172.21.15.6:0/2734760846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f410a820 0x7fe1f41a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 >> 172.21.15.6:0/2734760846 conn(0x7fe1f406dcf0 msgr2=0x7fe1f410b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 shutdown_connections 2023-10-14T09:07:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:09.936+0000 7fe1f8a7f700 1 -- 172.21.15.6:0/2734760846 wait complete. 2023-10-14T09:07:09.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:09 smithi057 ceph-mon[103313]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 629 op/s 2023-10-14T09:07:09.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:09 smithi006 ceph-mon[99452]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 629 op/s 2023-10-14T09:07:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 850.0 s, 1533.8 tps, lat 65.329 ms stddev 76.587 2023-10-14T09:07:11.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:11 smithi178 ceph-mon[103612]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 604 op/s 2023-10-14T09:07:11.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:11 smithi057 ceph-mon[103313]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 604 op/s 2023-10-14T09:07:11.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:11 smithi006 ceph-mon[99452]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 604 op/s 2023-10-14T09:07:13.891 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:13 smithi178 ceph-mon[103612]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 688 op/s 2023-10-14T09:07:13.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:13 smithi057 ceph-mon[103313]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 688 op/s 2023-10-14T09:07:13.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:13 smithi006 ceph-mon[99452]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 688 op/s 2023-10-14T09:07:15.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:15 smithi178 ceph-mon[103612]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.7 MiB/s wr, 610 op/s 2023-10-14T09:07:15.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:15 smithi057 ceph-mon[103313]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.7 MiB/s wr, 610 op/s 2023-10-14T09:07:15.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 855.0 s, 1527.2 tps, lat 65.277 ms stddev 74.215 2023-10-14T09:07:15.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:15 smithi006 ceph-mon[99452]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.7 MiB/s wr, 610 op/s 2023-10-14T09:07:17.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:17 smithi178 ceph-mon[103612]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.1 MiB/s wr, 626 op/s 2023-10-14T09:07:17.954 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:17 smithi057 ceph-mon[103313]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.1 MiB/s wr, 626 op/s 2023-10-14T09:07:17.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:17 smithi006 ceph-mon[99452]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.1 MiB/s wr, 626 op/s 2023-10-14T09:07:19.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:19 smithi178 ceph-mon[103612]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.8 MiB/s wr, 606 op/s 2023-10-14T09:07:19.956 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:19 smithi057 ceph-mon[103313]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.8 MiB/s wr, 606 op/s 2023-10-14T09:07:19.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:19 smithi006 ceph-mon[99452]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.8 MiB/s wr, 606 op/s 2023-10-14T09:07:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 860.0 s, 1454.2 tps, lat 68.457 ms stddev 81.332 2023-10-14T09:07:21.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:21 smithi178 ceph-mon[103612]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 603 op/s 2023-10-14T09:07:21.956 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:21 smithi057 ceph-mon[103313]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 603 op/s 2023-10-14T09:07:21.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:21 smithi006 ceph-mon[99452]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.5 MiB/s wr, 603 op/s 2023-10-14T09:07:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 -- 172.21.15.6:0/3697854101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b8106b80 msgr2=0x7f59b8109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 --2- 172.21.15.6:0/3697854101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b8106b80 0x7f59b8109020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009f90 tx=0x7f59b000b330 comp rx=0 tx=0).stop 2023-10-14T09:07:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 -- 172.21.15.6:0/3697854101 shutdown_connections 2023-10-14T09:07:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 --2- 172.21.15.6:0/3697854101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b8106b80 0x7f59b8109020 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 --2- 172.21.15.6:0/3697854101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b80fec50 0x7f59b80ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 --2- 172.21.15.6:0/3697854101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b80ff5b0 0x7f59b81065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 -- 172.21.15.6:0/3697854101 >> 172.21.15.6:0/3697854101 conn(0x7f59b80fa6c0 msgr2=0x7f59b80fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 -- 172.21.15.6:0/3697854101 shutdown_connections 2023-10-14T09:07:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.107+0000 7f59be704700 1 -- 172.21.15.6:0/3697854101 wait complete. 2023-10-14T09:07:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.108+0000 7f59be704700 1 Processor -- start 2023-10-14T09:07:23.112 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.108+0000 7f59be704700 1 -- start start 2023-10-14T09:07:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.108+0000 7f59be704700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b80fec50 0x7f59b8101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59be704700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 0x7f59b8100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59be704700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b8106b80 0x7f59b8100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59be704700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8101220 con 0x7f59b80fec50 2023-10-14T09:07:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59be704700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8101390 con 0x7f59b80ff5b0 2023-10-14T09:07:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59be704700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81a0d60 con 0x7f59b8106b80 2023-10-14T09:07:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 0x7f59b8100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 0x7f59b8100540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35002/0 (socket says 172.21.15.6:35002) 2023-10-14T09:07:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 -- 172.21.15.6:0/2420413122 learned_addr learned my addr 172.21.15.6:0/2420413122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b7fff700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b80fec50 0x7f59b8101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 -- 172.21.15.6:0/2420413122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b8106b80 msgr2=0x7f59b8100a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T09:07:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b8106b80 0x7f59b8100a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 -- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b80fec50 msgr2=0x7f59b8101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b80fec50 0x7f59b8101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.109+0000 7f59b77fe700 1 -- 172.21.15.6:0/2420413122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009c40 con 0x7f59b80ff5b0 2023-10-14T09:07:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.110+0000 7f59b77fe700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 0x7f59b8100540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00d980 tx=0x7f59ac00dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.110+0000 7f59b57fa700 1 -- 172.21.15.6:0/2420413122 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac009b40 con 0x7f59b80ff5b0 2023-10-14T09:07:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.110+0000 7f59b57fa700 1 -- 172.21.15.6:0/2420413122 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59ac00de60 con 0x7f59b80ff5b0 2023-10-14T09:07:23.116 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.110+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b81a0fe0 con 0x7f59b80ff5b0 2023-10-14T09:07:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.110+0000 7f59b57fa700 1 -- 172.21.15.6:0/2420413122 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00f620 con 0x7f59b80ff5b0 2023-10-14T09:07:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.110+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b81a1510 con 0x7f59b80ff5b0 2023-10-14T09:07:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.113+0000 7f59b57fa700 1 -- 172.21.15.6:0/2420413122 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f59ac010460 con 0x7f59b80ff5b0 2023-10-14T09:07:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.114+0000 7f59b57fa700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59a00a1500 0x7f59a00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.114+0000 7f59b57fa700 1 -- 172.21.15.6:0/2420413122 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f59ac0cc860 con 0x7f59b80ff5b0 2023-10-14T09:07:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.114+0000 7f59b7fff700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59a00a1500 0x7f59a00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.114+0000 7f59ca8eeb80 1 Processor -- start 2023-10-14T09:07:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.114+0000 7f59ca8eeb80 1 -- start start 2023-10-14T09:07:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4120 0x55f9a7fb4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59b7fff700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59a00a1500 0x7f59a00a39c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005fd0 tx=0x7f59a8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fb5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 0x55f9a7fb5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7f20c10 con 0x55f9a7fb5920 2023-10-14T09:07:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7f05c00 con 0x55f9a7fb4a80 2023-10-14T09:07:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7f03520 con 0x55f9a7fb4120 2023-10-14T09:07:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59b77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fb5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 0x55f9a7fb5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59b77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fb5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35010/0 (socket says 172.21.15.6:35010) 2023-10-14T09:07:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59b77fe700 1 -- 172.21.15.6:0/2635990197 learned_addr learned my addr 172.21.15.6:0/2635990197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 0x55f9a7fb5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36254/0 (socket says 172.21.15.6:36254) 2023-10-14T09:07:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59b7fff700 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4120 0x55f9a7fb4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 -- 172.21.15.6:0/2635990197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4120 msgr2=0x55f9a7fb4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4120 0x55f9a7fb4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 -- 172.21.15.6:0/2635990197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4a80 msgr2=0x55f9a7fb5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fb5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.115+0000 7f59bcca1700 1 -- 172.21.15.6:0/2635990197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9a7ebc390 con 0x55f9a7fb5920 2023-10-14T09:07:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.116+0000 7f59bcca1700 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 0x55f9a7fb5da0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f59b000b6c0 tx=0x7f59b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742180a8b6876b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.116+0000 7f599e7fc700 1 -- 172.21.15.6:0/2635990197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000e040 con 0x55f9a7fb5920 2023-10-14T09:07:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.116+0000 7f599e7fc700 1 -- 172.21.15.6:0/2635990197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59b00075e0 con 0x55f9a7fb5920 2023-10-14T09:07:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.116+0000 7f599e7fc700 1 -- 172.21.15.6:0/2635990197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000bcc0 con 0x55f9a7fb5920 2023-10-14T09:07:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/2635990197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 msgr2=0x55f9a7fb5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 0x55f9a7fb5da0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f59b000b6c0 tx=0x7f59b0009b60 comp rx=0 tx=0).stop 2023-10-14T09:07:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/2635990197 shutdown_connections 2023-10-14T09:07:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb5920 0x55f9a7fb5da0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4120 0x55f9a7fb4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/2635990197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fb5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/2635990197 >> 172.21.15.6:0/2635990197 conn(0x55f9a7ed9d70 msgr2=0x55f9a7fa6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/2635990197 shutdown_connections 2023-10-14T09:07:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/2635990197 wait complete. 2023-10-14T09:07:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 -- start start 2023-10-14T09:07:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.117+0000 7f59ca8eeb80 1 Processor -- start 2023-10-14T09:07:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fbe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7efee10 con 0x55f9a7fb4120 2023-10-14T09:07:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7e9b6b0 con 0x55f9a7fb5920 2023-10-14T09:07:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7e9b350 con 0x55f9a7fb4a80 2023-10-14T09:07:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59ca8eeb80 10 client.0 _ll_register_callbacks cb 0x55f9a7cf87a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36256/0 (socket says 172.21.15.6:36256) 2023-10-14T09:07:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59b7fff700 1 -- 172.21.15.6:0/3330920842 learned_addr learned my addr 172.21.15.6:0/3330920842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59b77fe700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fbe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 -- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 msgr2=0x55f9a7fbe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fbe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 -- 172.21.15.6:0/3330920842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 msgr2=0x55f9a7fbdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 -- 172.21.15.6:0/3330920842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b8109c40 con 0x55f9a7fb5920 2023-10-14T09:07:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59b7fff700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:07:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59bcca1700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc5480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59b0007900 tx=0x7f59b0007820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61311d2f3a232886 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.118+0000 7f59977fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-14T09:07:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59977fe700 1 -- 172.21.15.6:0/3330920842 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000e040 con 0x55f9a7fb5920 2023-10-14T09:07:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59977fe700 1 -- 172.21.15.6:0/3330920842 <== mon.2 v2:172.21.15.57:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f59b000bc70 con 0x55f9a7fb5920 2023-10-14T09:07:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9a7f03e90 con 0x55f9a7fb5920 2023-10-14T09:07:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59977fe700 1 -- 172.21.15.6:0/3330920842 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59b0007e80 con 0x55f9a7fb5920 2023-10-14T09:07:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 10 client.26243 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55f9a7d29d80 con 0x55f9a7fb5920 2023-10-14T09:07:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59977fe700 1 -- 172.21.15.6:0/3330920842 <== mon.2 v2:172.21.15.57:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f9a7f03e90 con 0x55f9a7fb5920 2023-10-14T09:07:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59977fe700 1 -- 172.21.15.6:0/3330920842 <== mon.2 v2:172.21.15.57:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f59b0019040 con 0x55f9a7fb5920 2023-10-14T09:07:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 10 client.26243 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 10 client.26243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 20 client.26243 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a7fc97b0 0x55f9a7fcbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 4 client.26243 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:07:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.119+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9a7f7bbb0 con 0x55f9a7fc97b0 2023-10-14T09:07:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.121+0000 7f59b7fff700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a7fc97b0 0x55f9a7fcbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.121+0000 7f59977fe700 10 client.26243 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.121+0000 7f59b7fff700 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a7fc97b0 0x55f9a7fcbba0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5068d8f2e82b28 server_cookie=7532f2f8731125cb in_seq=0 out_seq=0 2023-10-14T09:07:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59977fe700 1 -- 172.21.15.6:0/3330920842 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f9a7f7bbb0 con 0x55f9a7fc97b0 2023-10-14T09:07:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59977fe700 10 client.26243 handle_command_reply: tid=0 2023-10-14T09:07:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 client.26243 shutdown 2023-10-14T09:07:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 msgr2=0x55f9a7fc5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc5480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f59b0007900 tx=0x7f59b0007820 comp rx=0 tx=0).stop 2023-10-14T09:07:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 shutdown_connections 2023-10-14T09:07:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a7fc97b0 0x55f9a7fcbba0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc5480 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59977fe700 0 client.26243 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:23.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3330920842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fbe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.142 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 >> 172.21.15.6:0/3330920842 conn(0x55f9a7ed9d70 msgr2=0x55f9a7fa6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:23.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.122+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 shutdown_connections 2023-10-14T09:07:23.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.123+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3330920842 wait complete. 2023-10-14T09:07:23.143 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.123+0000 7f59ca8eeb80 20 client.26243 trim_cache size 0 max 16384 2023-10-14T09:07:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.145+0000 7f59ca8eeb80 1 Processor -- start 2023-10-14T09:07:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 -- start start 2023-10-14T09:07:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fc5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb5920 0x55f9a7fbe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7fbd240 con 0x55f9a7fb4a80 2023-10-14T09:07:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7d7f8c0 con 0x55f9a7fb4120 2023-10-14T09:07:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.146+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7fbc580 con 0x55f9a7fb5920 2023-10-14T09:07:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.152+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.152+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35022/0 (socket says 172.21.15.6:35022) 2023-10-14T09:07:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.152+0000 7f59b7fff700 1 -- 172.21.15.6:0/1104559775 learned_addr learned my addr 172.21.15.6:0/1104559775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f59b7fff700 1 -- 172.21.15.6:0/1104559775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb5920 msgr2=0x55f9a7fbe420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:07:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f59b7fff700 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb5920 0x55f9a7fbe420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f59b7fff700 1 -- 172.21.15.6:0/1104559775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4a80 msgr2=0x55f9a7fc5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f59b7fff700 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fc5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f59b7fff700 1 -- 172.21.15.6:0/1104559775 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9a7d12c00 con 0x55f9a7fb4120 2023-10-14T09:07:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f59b7fff700 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f9a7fcc480 tx=0x7f59a8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b2ff459a5e8769f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f599effd700 1 -- 172.21.15.6:0/1104559775 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8025040 con 0x55f9a7fb4120 2023-10-14T09:07:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f599effd700 1 -- 172.21.15.6:0/1104559775 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59a8016070 con 0x55f9a7fb4120 2023-10-14T09:07:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.153+0000 7f599effd700 1 -- 172.21.15.6:0/1104559775 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80207b0 con 0x55f9a7fb4120 2023-10-14T09:07:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.154+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/1104559775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 msgr2=0x55f9a7fbdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.154+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55f9a7fcc480 tx=0x7f59a8014000 comp rx=0 tx=0).stop 2023-10-14T09:07:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.164+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/1104559775 shutdown_connections 2023-10-14T09:07:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.164+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb5920 0x55f9a7fbe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.164+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb4120 0x55f9a7fbdee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.164+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/1104559775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fc5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.164+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/1104559775 >> 172.21.15.6:0/1104559775 conn(0x55f9a7ed9d70 msgr2=0x55f9a7fb8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.165+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/1104559775 shutdown_connections 2023-10-14T09:07:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.166+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/1104559775 wait complete. 2023-10-14T09:07:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.166+0000 7f59ca8eeb80 1 -- start start 2023-10-14T09:07:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.166+0000 7f59ca8eeb80 1 Processor -- start 2023-10-14T09:07:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fc11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fc16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7fc4c50 con 0x55f9a7fb4120 2023-10-14T09:07:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7fc4dc0 con 0x55f9a7fb5920 2023-10-14T09:07:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a7fc4f80 con 0x55f9a7fb4a80 2023-10-14T09:07:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59ca8eeb80 10 client.0 _ll_register_callbacks cb 0x7f59ac095e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fc11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fc11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36268/0 (socket says 172.21.15.6:36268) 2023-10-14T09:07:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 -- 172.21.15.6:0/3972155890 learned_addr learned my addr 172.21.15.6:0/3972155890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 -- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 msgr2=0x55f9a7fc16f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:07:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fc16f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 -- 172.21.15.6:0/3972155890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 msgr2=0x55f9a7fc4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.167+0000 7f59b7fff700 1 -- 172.21.15.6:0/3972155890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9a7d501f0 con 0x55f9a7fb4120 2023-10-14T09:07:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59b7fff700 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fc11b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005cb0 tx=0x7f59a802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b1c37f66701da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59977fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59977fe700 1 -- 172.21.15.6:0/3972155890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8025040 con 0x55f9a7fb4120 2023-10-14T09:07:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59977fe700 1 -- 172.21.15.6:0/3972155890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f59a8018070 con 0x55f9a7fb4120 2023-10-14T09:07:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59b00075e0 con 0x55f9a7fb4120 2023-10-14T09:07:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59977fe700 1 -- 172.21.15.6:0/3972155890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59a804deb0 con 0x55f9a7fb4120 2023-10-14T09:07:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59ca8eeb80 10 client.16707 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.168+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55f9a7d28250 con 0x55f9a7fb4120 2023-10-14T09:07:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.169+0000 7f59977fe700 1 -- 172.21.15.6:0/3972155890 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59b00075e0 con 0x55f9a7fb4120 2023-10-14T09:07:23.174 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59977fe700 1 -- 172.21.15.6:0/3972155890 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f59a8004d00 con 0x55f9a7fb4120 2023-10-14T09:07:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59ca8eeb80 10 client.16707 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59ca8eeb80 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59ca8eeb80 20 client.16707 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a801e4a0 0x55f9a80208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:23.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59ca8eeb80 4 client.16707 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:07:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.170+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f9a7ef7df0 con 0x55f9a801e4a0 2023-10-14T09:07:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.174+0000 7f59b77fe700 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a801e4a0 0x55f9a80208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.177+0000 7f59977fe700 10 client.16707 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:23.179 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.177+0000 7f59b77fe700 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a801e4a0 0x55f9a80208c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1d48c43ab560ef server_cookie=cc2eb7eceda2d370 in_seq=0 out_seq=0 2023-10-14T09:07:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.197+0000 7f59977fe700 1 -- 172.21.15.6:0/3972155890 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f9a7ef7df0 con 0x55f9a801e4a0 2023-10-14T09:07:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.197+0000 7f59977fe700 10 client.16707 handle_command_reply: tid=0 2023-10-14T09:07:23.200 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.197+0000 7f59ca8eeb80 1 client.16707 shutdown 2023-10-14T09:07:23.202 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.201+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 msgr2=0x55f9a7fc11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.201+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fc11b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005cb0 tx=0x7f59a802a5b0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 shutdown_connections 2023-10-14T09:07:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f9a801e4a0 0x55f9a80208c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f9a7fb5920 0x55f9a7fc4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f9a7fb4120 0x55f9a7fc11b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 --2- 172.21.15.6:0/3972155890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f9a7fb4a80 0x55f9a7fc16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59977fe700 0 client.16707 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 >> 172.21.15.6:0/3972155890 conn(0x55f9a7ed9d70 msgr2=0x55f9a7fbdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 shutdown_connections 2023-10-14T09:07:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 1 -- 172.21.15.6:0/3972155890 wait complete. 2023-10-14T09:07:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59ca8eeb80 20 client.16707 trim_cache size 0 max 16384 2023-10-14T09:07:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:07:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:07:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:07:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:07:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59a00a1500 msgr2=0x7f59a00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59a00a1500 0x7f59a00a39c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f59a8005fd0 tx=0x7f59a8009310 comp rx=0 tx=0).stop 2023-10-14T09:07:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 msgr2=0x7f59b8100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 0x7f59b8100540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00d980 tx=0x7f59ac00dd40 comp rx=0 tx=0).stop 2023-10-14T09:07:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 shutdown_connections 2023-10-14T09:07:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b8106b80 0x7f59b8100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b80fec50 0x7f59b8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f59a00a1500 0x7f59a00a39c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 --2- 172.21.15.6:0/2420413122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59b80ff5b0 0x7f59b8100540 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.203+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 >> 172.21.15.6:0/2420413122 conn(0x7f59b80fa6c0 msgr2=0x7f59b80fb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.204+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 shutdown_connections 2023-10-14T09:07:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:23.204+0000 7f59be704700 1 -- 172.21.15.6:0/2420413122 wait complete. 2023-10-14T09:07:23.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:23 smithi178 ceph-mon[103612]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 748 op/s 2023-10-14T09:07:23.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:23 smithi057 ceph-mon[103313]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 748 op/s 2023-10-14T09:07:23.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:23 smithi006 ceph-mon[99452]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 748 op/s 2023-10-14T09:07:25.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:25 smithi178 ceph-mon[103612]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 668 op/s 2023-10-14T09:07:25.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:25 smithi057 ceph-mon[103313]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 668 op/s 2023-10-14T09:07:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 865.0 s, 1552.0 tps, lat 64.286 ms stddev 74.658 2023-10-14T09:07:25.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:25 smithi006 ceph-mon[99452]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 668 op/s 2023-10-14T09:07:26.891 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:26 smithi178 ceph-mon[103612]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 784 op/s 2023-10-14T09:07:26.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:26 smithi057 ceph-mon[103313]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 784 op/s 2023-10-14T09:07:26.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:26 smithi006 ceph-mon[99452]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 MiB/s wr, 784 op/s 2023-10-14T09:07:28.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:27 smithi006 ceph-mon[99452]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 741 op/s 2023-10-14T09:07:28.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:27 smithi178 ceph-mon[103612]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 741 op/s 2023-10-14T09:07:28.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:27 smithi057 ceph-mon[103313]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 741 op/s 2023-10-14T09:07:30.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:29 smithi006 ceph-mon[99452]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.4 MiB/s wr, 732 op/s 2023-10-14T09:07:30.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:29 smithi178 ceph-mon[103612]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.4 MiB/s wr, 732 op/s 2023-10-14T09:07:30.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:29 smithi057 ceph-mon[103313]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 9.4 MiB/s wr, 732 op/s 2023-10-14T09:07:30.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 870.0 s, 1466.8 tps, lat 68.187 ms stddev 75.933 2023-10-14T09:07:32.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:32 smithi178 ceph-mon[103612]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 810 op/s 2023-10-14T09:07:32.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:32 smithi057 ceph-mon[103313]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 810 op/s 2023-10-14T09:07:32.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:32 smithi006 ceph-mon[99452]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 810 op/s 2023-10-14T09:07:34.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:33 smithi006 ceph-mon[99452]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2023-10-14T09:07:34.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:33 smithi178 ceph-mon[103612]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2023-10-14T09:07:34.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:33 smithi057 ceph-mon[103313]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2023-10-14T09:07:35.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 875.0 s, 1165.2 tps, lat 85.183 ms stddev 110.613 2023-10-14T09:07:36.386 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:35 smithi178 ceph-mon[103612]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 770 op/s 2023-10-14T09:07:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 -- 172.21.15.6:0/397264065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8340106be0 msgr2=0x7f8340109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 --2- 172.21.15.6:0/397264065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8340106be0 0x7f8340109050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f833c0098f0 tx=0x7f833c009c00 comp rx=0 tx=0).stop 2023-10-14T09:07:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 -- 172.21.15.6:0/397264065 shutdown_connections 2023-10-14T09:07:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 --2- 172.21.15.6:0/397264065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8340106be0 0x7f8340109050 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 --2- 172.21.15.6:0/397264065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8340101980 0x7f8340103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 --2- 172.21.15.6:0/397264065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83401042b0 0x7f83401066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 -- 172.21.15.6:0/397264065 >> 172.21.15.6:0/397264065 conn(0x7f83400fb390 msgr2=0x7f83400fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 -- 172.21.15.6:0/397264065 shutdown_connections 2023-10-14T09:07:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.418+0000 7f834826b700 1 -- 172.21.15.6:0/397264065 wait complete. 2023-10-14T09:07:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 Processor -- start 2023-10-14T09:07:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 -- start start 2023-10-14T09:07:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8340101980 0x7f83401949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 0x7f8340194f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8340106be0 0x7f834019bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834019c550 con 0x7f83401042b0 2023-10-14T09:07:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834019c6c0 con 0x7f8340106be0 2023-10-14T09:07:36.424 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.419+0000 7f834826b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834019c880 con 0x7f8340101980 2023-10-14T09:07:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 0x7f8340194f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 0x7f8340194f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36282/0 (socket says 172.21.15.6:36282) 2023-10-14T09:07:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 -- 172.21.15.6:0/2689420716 learned_addr learned my addr 172.21.15.6:0/2689420716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:36.425 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8346007700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8340101980 0x7f83401949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 -- 172.21.15.6:0/2689420716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8340101980 msgr2=0x7f83401949d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8340101980 0x7f83401949d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 -- 172.21.15.6:0/2689420716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8340106be0 msgr2=0x7f834019bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8340106be0 0x7f834019bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 -- 172.21.15.6:0/2689420716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009520 con 0x7f83401042b0 2023-10-14T09:07:36.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f8345806700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 0x7f8340194f10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8338007fa0 tx=0x7f833800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:36.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f83377fe700 1 -- 172.21.15.6:0/2689420716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800dde0 con 0x7f83401042b0 2023-10-14T09:07:36.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f83377fe700 1 -- 172.21.15.6:0/2689420716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833800f040 con 0x7f83401042b0 2023-10-14T09:07:36.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f83377fe700 1 -- 172.21.15.6:0/2689420716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338014690 con 0x7f83401042b0 2023-10-14T09:07:36.427 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.420+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834019cb00 con 0x7f83401042b0 2023-10-14T09:07:36.428 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.421+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834019cfc0 con 0x7f83401042b0 2023-10-14T09:07:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.424+0000 7f83377fe700 1 -- 172.21.15.6:0/2689420716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f83380159c0 con 0x7f83401042b0 2023-10-14T09:07:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.425+0000 7f83377fe700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f832c0a14d0 0x7f832c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.431 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.425+0000 7f83377fe700 1 -- 172.21.15.6:0/2689420716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f83380cc330 con 0x7f83401042b0 2023-10-14T09:07:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.425+0000 7f8346007700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f832c0a14d0 0x7f832c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.425+0000 7f8354455b80 1 Processor -- start 2023-10-14T09:07:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 -- start start 2023-10-14T09:07:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346007700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f832c0a14d0 0x7f832c0a3990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8330009bf0 tx=0x7f8330009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:36.432 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b573862c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738631b0 0x55b573863ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b573864520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5737d7c10 con 0x55b5738640a0 2023-10-14T09:07:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5737bcc00 con 0x55b573862850 2023-10-14T09:07:36.433 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8354455b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5737ba520 con 0x55b5738631b0 2023-10-14T09:07:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b573864520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b573864520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36290/0 (socket says 172.21.15.6:36290) 2023-10-14T09:07:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 -- 172.21.15.6:0/4185340119 learned_addr learned my addr 172.21.15.6:0/4185340119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:36.434 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8345806700 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738631b0 0x55b573863ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 -- 172.21.15.6:0/4185340119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738631b0 msgr2=0x55b573863ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738631b0 0x55b573863ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 -- 172.21.15.6:0/4185340119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 msgr2=0x55b573862c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b573862c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.426+0000 7f8346808700 1 -- 172.21.15.6:0/4185340119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b573773390 con 0x55b5738640a0 2023-10-14T09:07:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.427+0000 7f8346808700 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b573864520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f833c005950 tx=0x7f833c00bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beda6b3970043c14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.427+0000 7f8334d82700 1 -- 172.21.15.6:0/4185340119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c01c070 con 0x55b5738640a0 2023-10-14T09:07:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.427+0000 7f8334d82700 1 -- 172.21.15.6:0/4185340119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833c010cd0 con 0x55b5738640a0 2023-10-14T09:07:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.427+0000 7f8334d82700 1 -- 172.21.15.6:0/4185340119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c00bc20 con 0x55b5738640a0 2023-10-14T09:07:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 -- 172.21.15.6:0/4185340119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 msgr2=0x55b573864520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b573864520 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f833c005950 tx=0x7f833c00bfc0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 -- 172.21.15.6:0/4185340119 shutdown_connections 2023-10-14T09:07:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b573864520 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b573862c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 --2- 172.21.15.6:0/4185340119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738631b0 0x55b573863ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 -- 172.21.15.6:0/4185340119 >> 172.21.15.6:0/4185340119 conn(0x55b573790d70 msgr2=0x55b57385dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 -- 172.21.15.6:0/4185340119 shutdown_connections 2023-10-14T09:07:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 -- 172.21.15.6:0/4185340119 wait complete. 2023-10-14T09:07:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.428+0000 7f8354455b80 1 -- start start 2023-10-14T09:07:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 Processor -- start 2023-10-14T09:07:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b57386c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b57386cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738640a0 0x55b573873c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5737b5e10 con 0x55b5738631b0 2023-10-14T09:07:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5737526b0 con 0x55b5738640a0 2023-10-14T09:07:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b573752350 con 0x55b573862850 2023-10-14T09:07:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8354455b80 10 client.0 _ll_register_callbacks cb 0x55b5735af7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b57386cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b57386cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36294/0 (socket says 172.21.15.6:36294) 2023-10-14T09:07:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 -- 172.21.15.6:0/2245258241 learned_addr learned my addr 172.21.15.6:0/2245258241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 -- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 msgr2=0x55b57386c6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:07:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b57386c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 -- 172.21.15.6:0/2245258241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738640a0 msgr2=0x55b573873c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738640a0 0x55b573873c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.429+0000 7f8345806700 1 -- 172.21.15.6:0/2245258241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340109c40 con 0x55b5738631b0 2023-10-14T09:07:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8345806700 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b57386cc30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f83380995e0 tx=0x7f8338098fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a60654213aeb9d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8329ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8329ffb700 1 -- 172.21.15.6:0/2245258241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833809d7a0 con 0x55b5738631b0 2023-10-14T09:07:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8329ffb700 1 -- 172.21.15.6:0/2245258241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f83380a19e0 con 0x55b5738631b0 2023-10-14T09:07:36.442 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5737bae90 con 0x55b5738631b0 2023-10-14T09:07:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8329ffb700 1 -- 172.21.15.6:0/2245258241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8338098b40 con 0x55b5738631b0 2023-10-14T09:07:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8354455b80 10 client.16719 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.430+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55b5735e0d80 con 0x55b5738631b0 2023-10-14T09:07:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8329ffb700 1 -- 172.21.15.6:0/2245258241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833807c020 con 0x55b5738631b0 2023-10-14T09:07:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8329ffb700 1 -- 172.21.15.6:0/2245258241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f83380b7b50 con 0x55b5738631b0 2023-10-14T09:07:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8354455b80 10 client.16719 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8354455b80 10 client.16719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8354455b80 20 client.16719 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8354455b80 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738784b0 0x55b57387a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8354455b80 4 client.16719 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:07:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.431+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b573832bb0 con 0x55b5738784b0 2023-10-14T09:07:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.433+0000 7f8346007700 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738784b0 0x55b57387a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8329ffb700 10 client.16719 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8346007700 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738784b0 0x55b57387a930 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c798892ec4427e server_cookie=4f768c9a2238ca9f in_seq=0 out_seq=0 2023-10-14T09:07:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8329ffb700 1 -- 172.21.15.6:0/2245258241 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b573832bb0 con 0x55b5738784b0 2023-10-14T09:07:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8329ffb700 10 client.16719 handle_command_reply: tid=0 2023-10-14T09:07:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8354455b80 1 client.16719 shutdown 2023-10-14T09:07:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 msgr2=0x55b57386cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.434+0000 7f8354455b80 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b57386cc30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f83380995e0 tx=0x7f8338098fb0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 shutdown_connections 2023-10-14T09:07:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738784b0 0x55b57387a930 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738640a0 0x55b573873c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8329ffb700 0 client.16719 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b57386c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 --2- 172.21.15.6:0/2245258241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b57386cc30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 >> 172.21.15.6:0/2245258241 conn(0x55b573790d70 msgr2=0x55b57385d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 shutdown_connections 2023-10-14T09:07:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 1 -- 172.21.15.6:0/2245258241 wait complete. 2023-10-14T09:07:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.435+0000 7f8354455b80 20 client.16719 trim_cache size 0 max 16384 2023-10-14T09:07:36.451 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:35 smithi057 ceph-mon[103313]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 770 op/s 2023-10-14T09:07:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 Processor -- start 2023-10-14T09:07:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 -- start start 2023-10-14T09:07:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b57386a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b573873c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738640a0 0x55b573867040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5736368c0 con 0x55b5738631b0 2023-10-14T09:07:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57385a400 con 0x55b573862850 2023-10-14T09:07:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8354455b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b573863f20 con 0x55b5738640a0 2023-10-14T09:07:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.455+0000 7f8345806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b573873c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b57386a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8345806700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b573873c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36304/0 (socket says 172.21.15.6:36304) 2023-10-14T09:07:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8345806700 1 -- 172.21.15.6:0/2866982154 learned_addr learned my addr 172.21.15.6:0/2866982154 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346808700 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738640a0 0x55b573867040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 -- 172.21.15.6:0/2866982154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738640a0 msgr2=0x55b573867040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738640a0 0x55b573867040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 -- 172.21.15.6:0/2866982154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 msgr2=0x55b573873c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b573873c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 -- 172.21.15.6:0/2866982154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5735c9c00 con 0x55b573862850 2023-10-14T09:07:36.461 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8345806700 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b573873c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:07:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8346007700 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b57386a510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55b573878890 tx=0x7f8330014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e903c883cab701a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.456+0000 7f8335583700 1 -- 172.21.15.6:0/2866982154 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300243b0 con 0x55b573862850 2023-10-14T09:07:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.457+0000 7f8335583700 1 -- 172.21.15.6:0/2866982154 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8330024040 con 0x55b573862850 2023-10-14T09:07:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.457+0000 7f8335583700 1 -- 172.21.15.6:0/2866982154 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330012cb0 con 0x55b573862850 2023-10-14T09:07:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.457+0000 7f8354455b80 1 -- 172.21.15.6:0/2866982154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 msgr2=0x55b57386a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.457+0000 7f8354455b80 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b57386a510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55b573878890 tx=0x7f8330014000 comp rx=0 tx=0).stop 2023-10-14T09:07:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- 172.21.15.6:0/2866982154 shutdown_connections 2023-10-14T09:07:36.466 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5738640a0 0x55b573867040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b573862850 0x55b57386a510 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 --2- 172.21.15.6:0/2866982154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738631b0 0x55b573873c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- 172.21.15.6:0/2866982154 >> 172.21.15.6:0/2866982154 conn(0x55b573790d70 msgr2=0x55b57386b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- 172.21.15.6:0/2866982154 shutdown_connections 2023-10-14T09:07:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- 172.21.15.6:0/2866982154 wait complete. 2023-10-14T09:07:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- start start 2023-10-14T09:07:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 Processor -- start 2023-10-14T09:07:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b573871b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738631b0 0x55b5738720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b5738730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5738735f0 con 0x55b5738640a0 2023-10-14T09:07:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b573873760 con 0x55b5738631b0 2023-10-14T09:07:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b573873920 con 0x55b573862850 2023-10-14T09:07:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8354455b80 10 client.0 _ll_register_callbacks cb 0x7f8338095a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8346808700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b5738730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8346808700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b5738730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36310/0 (socket says 172.21.15.6:36310) 2023-10-14T09:07:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8345806700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738631b0 0x55b5738720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8346808700 1 -- 172.21.15.6:0/1908945095 learned_addr learned my addr 172.21.15.6:0/1908945095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.458+0000 7f8346007700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b573871b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8346808700 1 -- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 msgr2=0x55b573871b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8346808700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b573871b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8346808700 1 -- 172.21.15.6:0/1908945095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738631b0 msgr2=0x55b5738720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8346808700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738631b0 0x55b5738720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8346808700 1 -- 172.21.15.6:0/1908945095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5735e0d80 con 0x55b5738640a0 2023-10-14T09:07:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8345806700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738631b0 0x55b5738720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:07:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8346808700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b5738730b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f833c005b70 tx=0x7f833c00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47567ea061cdca05 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8329ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8329ffb700 1 -- 172.21.15.6:0/1908945095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c01c040 con 0x55b5738640a0 2023-10-14T09:07:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8329ffb700 1 -- 172.21.15.6:0/1908945095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f833c0054e0 con 0x55b5738640a0 2023-10-14T09:07:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f833c010cd0 con 0x55b5738640a0 2023-10-14T09:07:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8329ffb700 1 -- 172.21.15.6:0/1908945095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f833c0056a0 con 0x55b5738640a0 2023-10-14T09:07:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8354455b80 10 client.16725 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.459+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f83300119e0 con 0x55b5738640a0 2023-10-14T09:07:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8329ffb700 1 -- 172.21.15.6:0/1908945095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833c038020 con 0x55b5738640a0 2023-10-14T09:07:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8329ffb700 1 -- 172.21.15.6:0/1908945095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f833c015020 con 0x55b5738640a0 2023-10-14T09:07:36.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8354455b80 10 client.16725 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:36.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8354455b80 10 client.16725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:36.474 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8354455b80 20 client.16725 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:36.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8354455b80 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738cd0f0 0x55b5738cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:36.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8354455b80 4 client.16725 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:07:36.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b5737aedf0 con 0x55b5738cd0f0 2023-10-14T09:07:36.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8346007700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738cd0f0 0x55b5738cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:36.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8329ffb700 10 client.16725 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:36.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.460+0000 7f8346007700 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738cd0f0 0x55b5738cf510 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f4a359284e6cf5 server_cookie=e5e60fac2e8949ac in_seq=0 out_seq=0 2023-10-14T09:07:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:35 smithi006 ceph-mon[99452]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 770 op/s 2023-10-14T09:07:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.504+0000 7f8329ffb700 1 -- 172.21.15.6:0/1908945095 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b5737aedf0 con 0x55b5738cd0f0 2023-10-14T09:07:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.504+0000 7f8329ffb700 10 client.16725 handle_command_reply: tid=0 2023-10-14T09:07:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.504+0000 7f8354455b80 1 client.16725 shutdown 2023-10-14T09:07:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 msgr2=0x55b5738730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b5738730b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f833c005b70 tx=0x7f833c00f8d0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 shutdown_connections 2023-10-14T09:07:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55b5738cd0f0 0x55b5738cf510 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5738640a0 0x55b5738730b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8329ffb700 0 client.16725 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b573862850 0x55b573871b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 --2- 172.21.15.6:0/1908945095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b5738631b0 0x55b5738720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 >> 172.21.15.6:0/1908945095 conn(0x55b573790d70 msgr2=0x55b57386a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 shutdown_connections 2023-10-14T09:07:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 1 -- 172.21.15.6:0/1908945095 wait complete. 2023-10-14T09:07:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f8354455b80 20 client.16725 trim_cache size 0 max 16384 2023-10-14T09:07:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:07:36.510 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:07:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:07:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:07:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f832c0a14d0 msgr2=0x7f832c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f832c0a14d0 0x7f832c0a3990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8330009bf0 tx=0x7f8330009260 comp rx=0 tx=0).stop 2023-10-14T09:07:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 msgr2=0x7f8340194f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 0x7f8340194f10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8338007fa0 tx=0x7f833800d3b0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 shutdown_connections 2023-10-14T09:07:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f832c0a14d0 0x7f832c0a3990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8340106be0 0x7f834019bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8340101980 0x7f83401949d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 --2- 172.21.15.6:0/2689420716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83401042b0 0x7f8340194f10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 >> 172.21.15.6:0/2689420716 conn(0x7f83400fb390 msgr2=0x7f8340100080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 shutdown_connections 2023-10-14T09:07:36.514 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:36.505+0000 7f834826b700 1 -- 172.21.15.6:0/2689420716 wait complete. 2023-10-14T09:07:38.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:38 smithi178 ceph-mon[103612]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 676 op/s 2023-10-14T09:07:38.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:37 smithi057 ceph-mon[103313]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 676 op/s 2023-10-14T09:07:38.483 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:37 smithi006 ceph-mon[99452]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 676 op/s 2023-10-14T09:07:40.233 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:39 smithi006 ceph-mon[99452]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 681 op/s 2023-10-14T09:07:40.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:39 smithi178 ceph-mon[103612]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 681 op/s 2023-10-14T09:07:40.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:39 smithi057 ceph-mon[103313]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 681 op/s 2023-10-14T09:07:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 880.0 s, 1101.2 tps, lat 91.825 ms stddev 95.703 2023-10-14T09:07:42.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:42 smithi178 ceph-mon[103612]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 782 op/s 2023-10-14T09:07:42.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:42 smithi057 ceph-mon[103313]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 782 op/s 2023-10-14T09:07:42.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:42 smithi006 ceph-mon[99452]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 782 op/s 2023-10-14T09:07:44.237 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:43 smithi006 ceph-mon[99452]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 712 op/s 2023-10-14T09:07:44.388 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:43 smithi178 ceph-mon[103612]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 712 op/s 2023-10-14T09:07:44.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:43 smithi057 ceph-mon[103313]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 712 op/s 2023-10-14T09:07:45.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 885.0 s, 1365.7 tps, lat 73.735 ms stddev 80.964 2023-10-14T09:07:46.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:45 smithi006 ceph-mon[99452]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 794 op/s 2023-10-14T09:07:46.388 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:45 smithi178 ceph-mon[103612]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 794 op/s 2023-10-14T09:07:46.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:45 smithi057 ceph-mon[103313]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 794 op/s 2023-10-14T09:07:48.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:47 smithi006 ceph-mon[99452]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 690 op/s 2023-10-14T09:07:48.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:47 smithi178 ceph-mon[103612]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 690 op/s 2023-10-14T09:07:48.450 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:47 smithi057 ceph-mon[103313]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 690 op/s 2023-10-14T09:07:49.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:07:49.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:07:49.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:07:49.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 -- 172.21.15.6:0/1256118378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 msgr2=0x7f923c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 --2- 172.21.15.6:0/1256118378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 0x7f923c0693b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f923400b0a0 tx=0x7f923400b3b0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.665 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 -- 172.21.15.6:0/1256118378 shutdown_connections 2023-10-14T09:07:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 --2- 172.21.15.6:0/1256118378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 0x7f923c0693b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 --2- 172.21.15.6:0/1256118378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0ffde0 0x7f923c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 --2- 172.21.15.6:0/1256118378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 -- 172.21.15.6:0/1256118378 >> 172.21.15.6:0/1256118378 conn(0x7f923c0fb3b0 msgr2=0x7f923c0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:49.666 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 -- 172.21.15.6:0/1256118378 shutdown_connections 2023-10-14T09:07:49.667 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.663+0000 7f9242096700 1 -- 172.21.15.6:0/1256118378 wait complete. 2023-10-14T09:07:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 Processor -- start 2023-10-14T09:07:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 -- start start 2023-10-14T09:07:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0ffde0 0x7f923c10dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c10e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.668 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 0x7f923c10a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c10b0d0 con 0x7f923c101970 2023-10-14T09:07:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c10b240 con 0x7f923c100fd0 2023-10-14T09:07:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f9242096700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c10b400 con 0x7f923c0ffde0 2023-10-14T09:07:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.664+0000 7f923b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0ffde0 0x7f923c10dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.669 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c10e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c10e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35082/0 (socket says 172.21.15.6:35082) 2023-10-14T09:07:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 -- 172.21.15.6:0/1934718160 learned_addr learned my addr 172.21.15.6:0/1934718160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:49.670 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 0x7f923c10a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 -- 172.21.15.6:0/1934718160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0ffde0 msgr2=0x7f923c10dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0ffde0 0x7f923c10dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.671 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 -- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 msgr2=0x7f923c10a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 0x7f923c10a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 -- 172.21.15.6:0/1934718160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234009d00 con 0x7f923c100fd0 2023-10-14T09:07:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f923affd700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c10e2e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f923000e9a0 tx=0x7f923000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f9238ff9700 1 -- 172.21.15.6:0/1934718160 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230009790 con 0x7f923c100fd0 2023-10-14T09:07:49.672 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c198be0 con 0x7f923c100fd0 2023-10-14T09:07:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f9238ff9700 1 -- 172.21.15.6:0/1934718160 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9230010430 con 0x7f923c100fd0 2023-10-14T09:07:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f9238ff9700 1 -- 172.21.15.6:0/1934718160 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230018680 con 0x7f923c100fd0 2023-10-14T09:07:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.665+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c199140 con 0x7f923c100fd0 2023-10-14T09:07:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.668+0000 7f9238ff9700 1 -- 172.21.15.6:0/1934718160 <== mon.2 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f923000ca10 con 0x7f923c100fd0 2023-10-14T09:07:49.673 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.669+0000 7f9238ff9700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f92240a1480 0x7f92240a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.669+0000 7f923b7fe700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f92240a1480 0x7f92240a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.669+0000 7f9238ff9700 1 -- 172.21.15.6:0/1934718160 <== mon.2 v2:172.21.15.57:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f9230014070 con 0x7f923c100fd0 2023-10-14T09:07:49.674 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.669+0000 7f923b7fe700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f92240a1480 0x7f92240a3940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f923c100e30 tx=0x7f922c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 Processor -- start 2023-10-14T09:07:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 -- start start 2023-10-14T09:07:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0ca9ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0ca9bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.679 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0ca0fc10 con 0x55bc0ca9a850 2023-10-14T09:07:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0c9f4c00 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.670+0000 7f924e280b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0c9f2520 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0ca9bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.680 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0ca9bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.6:33732/0 (socket says 172.21.15.6:33732) 2023-10-14T09:07:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923affd700 1 -- 172.21.15.6:0/3287325453 learned_addr learned my addr 172.21.15.6:0/3287325453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0ca9ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923b7fe700 1 -- 172.21.15.6:0/3287325453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 msgr2=0x55bc0ca9bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:49.681 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0ca9bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923b7fe700 1 -- 172.21.15.6:0/3287325453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 msgr2=0x55bc0ca9c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.671+0000 7f923b7fe700 1 -- 172.21.15.6:0/3287325453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc0c9ab390 con 0x55bc0ca9a850 2023-10-14T09:07:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.672+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0ca9ac70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f922c011c80 tx=0x7f922c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22600cb396442cf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:49.682 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.672+0000 7f9221ffb700 1 -- 172.21.15.6:0/3287325453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c004220 con 0x55bc0ca9a850 2023-10-14T09:07:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.672+0000 7f9221ffb700 1 -- 172.21.15.6:0/3287325453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f922c021070 con 0x55bc0ca9a850 2023-10-14T09:07:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.672+0000 7f9221ffb700 1 -- 172.21.15.6:0/3287325453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c003b90 con 0x55bc0ca9a850 2023-10-14T09:07:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 -- 172.21.15.6:0/3287325453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 msgr2=0x55bc0ca9ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0ca9ac70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f922c011c80 tx=0x7f922c014000 comp rx=0 tx=0).stop 2023-10-14T09:07:49.683 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 -- 172.21.15.6:0/3287325453 shutdown_connections 2023-10-14T09:07:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0ca9ac70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 --2- 172.21.15.6:0/3287325453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0ca9bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 -- 172.21.15.6:0/3287325453 >> 172.21.15.6:0/3287325453 conn(0x55bc0c9c8d70 msgr2=0x55bc0ca95c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:49.684 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 -- 172.21.15.6:0/3287325453 shutdown_connections 2023-10-14T09:07:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.673+0000 7f924e280b80 1 -- 172.21.15.6:0/3287325453 wait complete. 2023-10-14T09:07:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 -- start start 2023-10-14T09:07:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 Processor -- start 2023-10-14T09:07:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9a850 0x55bc0caa4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caa4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caabd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0c9ede10 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0c98a6b0 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0c98a350 con 0x55bc0ca9a850 2023-10-14T09:07:49.686 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.674+0000 7f924e280b80 10 client.0 _ll_register_callbacks cb 0x55bc0c7e77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caa4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caa4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36336/0 (socket says 172.21.15.6:36336) 2023-10-14T09:07:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 -- 172.21.15.6:0/3599850222 learned_addr learned my addr 172.21.15.6:0/3599850222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923bfff700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caabd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9a850 0x55bc0caa4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 -- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9a850 msgr2=0x55bc0caa4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9a850 0x55bc0caa4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 -- 172.21.15.6:0/3599850222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 msgr2=0x55bc0caabd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caabd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 -- 172.21.15.6:0/3599850222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c017070 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9a850 0x55bc0caa4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:07:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f923affd700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caa4cd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9230005830 tx=0x7f923009a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31139cc9b8e72462 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f921affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f921affd700 1 -- 172.21.15.6:0/3599850222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923009e320 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f921affd700 1 -- 172.21.15.6:0/3599850222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f92300a2560 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.675+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc0c9f2e90 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f921affd700 1 -- 172.21.15.6:0/3599850222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9230010880 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 10 client.16737 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:49.690 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55bc0c818d80 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f921affd700 1 -- 172.21.15.6:0/3599850222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9230063070 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f921affd700 1 -- 172.21.15.6:0/3599850222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f92300a20d0 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 10 client.16737 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 10 client.16737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 20 client.16737 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cab0550 0x55bc0cab2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 4 client.16737 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:07:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc0ca6abb0 con 0x55bc0cab0550 2023-10-14T09:07:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.676+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cab0550 0x55bc0cab2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.677+0000 7f921affd700 10 client.16737 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:49.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.677+0000 7f923b7fe700 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cab0550 0x55bc0cab2970 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af4e844fda6bfd6 server_cookie=a82780945239a074 in_seq=0 out_seq=0 2023-10-14T09:07:49.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.677+0000 7f921affd700 1 -- 172.21.15.6:0/3599850222 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc0ca6abb0 con 0x55bc0cab0550 2023-10-14T09:07:49.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.677+0000 7f921affd700 10 client.16737 handle_command_reply: tid=0 2023-10-14T09:07:49.693 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.677+0000 7f924e280b80 1 client.16737 shutdown 2023-10-14T09:07:49.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 msgr2=0x55bc0caa4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.694 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caa4cd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9230005830 tx=0x7f923009a950 comp rx=0 tx=0).stop 2023-10-14T09:07:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 shutdown_connections 2023-10-14T09:07:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cab0550 0x55bc0cab2970 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caabd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f921affd700 0 client.16737 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9a850 0x55bc0caa4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 --2- 172.21.15.6:0/3599850222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caa4cd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 >> 172.21.15.6:0/3599850222 conn(0x55bc0c9c8d70 msgr2=0x55bc0ca95830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 shutdown_connections 2023-10-14T09:07:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 1 -- 172.21.15.6:0/3599850222 wait complete. 2023-10-14T09:07:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.678+0000 7f924e280b80 20 client.16737 trim_cache size 0 max 16384 2023-10-14T09:07:49.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 Processor -- start 2023-10-14T09:07:49.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 -- start start 2023-10-14T09:07:49.701 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0caac540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caabcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0c86e8c0 con 0x55bc0ca9a850 2023-10-14T09:07:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0caada00 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f924e280b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0ca9bf20 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f923b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0caac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.698+0000 7f923b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0caac540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36342/0 (socket says 172.21.15.6:36342) 2023-10-14T09:07:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923b7fe700 1 -- 172.21.15.6:0/2895341136 learned_addr learned my addr 172.21.15.6:0/2895341136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923affd700 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caabcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 -- 172.21.15.6:0/2895341136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 msgr2=0x55bc0caabcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caabcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 -- 172.21.15.6:0/2895341136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 msgr2=0x55bc0caac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:07:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0caac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 -- 172.21.15.6:0/2895341136 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc0c801c00 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923b7fe700 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0caac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:07:49.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f923bfff700 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9f010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9234009fd0 tx=0x7f9234009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36db2fe904e0cfeb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:49.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f92227fc700 1 -- 172.21.15.6:0/2895341136 <== mon.2 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400e040 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f92227fc700 1 -- 172.21.15.6:0/2895341136 <== mon.2 v2:172.21.15.57:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92340076e0 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.705 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.699+0000 7f92227fc700 1 -- 172.21.15.6:0/2895341136 <== mon.2 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234005280 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 -- 172.21.15.6:0/2895341136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 msgr2=0x55bc0ca9f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9f010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9234009fd0 tx=0x7f9234009490 comp rx=0 tx=0).stop 2023-10-14T09:07:49.708 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 -- 172.21.15.6:0/2895341136 shutdown_connections 2023-10-14T09:07:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9c0a0 0x55bc0ca9f010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9a850 0x55bc0caac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 --2- 172.21.15.6:0/2895341136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caabcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.709 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 -- 172.21.15.6:0/2895341136 >> 172.21.15.6:0/2895341136 conn(0x55bc0c9c8d70 msgr2=0x55bc0caa33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 -- 172.21.15.6:0/2895341136 shutdown_connections 2023-10-14T09:07:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.700+0000 7f924e280b80 1 -- 172.21.15.6:0/2895341136 wait complete. 2023-10-14T09:07:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 -- start start 2023-10-14T09:07:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 Processor -- start 2023-10-14T09:07:49.710 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9a850 0x55bc0caa9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caaa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0caab5d0 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0caab740 con 0x55bc0ca9a850 2023-10-14T09:07:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc0caab900 con 0x55bc0ca9c0a0 2023-10-14T09:07:49.711 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.701+0000 7f924e280b80 10 client.0 _ll_register_callbacks cb 0x55bc0c7e77a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:07:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caaa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caaa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36348/0 (socket says 172.21.15.6:36348) 2023-10-14T09:07:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 -- 172.21.15.6:0/4004089888 learned_addr learned my addr 172.21.15.6:0/4004089888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:07:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 -- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9c0a0 msgr2=0x55bc0caab090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T09:07:49.712 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caab090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 -- 172.21.15.6:0/4004089888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9a850 msgr2=0x55bc0caa9b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T09:07:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9a850 0x55bc0caa9b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.702+0000 7f923affd700 1 -- 172.21.15.6:0/4004089888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc0c9ab390 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f923affd700 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caaa080 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f92300966d0 tx=0x7f923009b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6854da4a943cec4c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:07:49.713 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f921affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:07:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f921affd700 1 -- 172.21.15.6:0/4004089888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a2560 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f921affd700 1 -- 172.21.15.6:0/4004089888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f923009e320 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f922c021070 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f921affd700 1 -- 172.21.15.6:0/4004089888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9230010880 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f924e280b80 10 client.16743 fetch_fsmap learned FSMap version 55 2023-10-14T09:07:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.703+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x7f923c069de0 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f921affd700 1 -- 172.21.15.6:0/4004089888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f922c021070 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f921affd700 1 -- 172.21.15.6:0/4004089888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f923007e030 con 0x55bc0ca9b1b0 2023-10-14T09:07:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f924e280b80 10 client.16743 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:07:49.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f924e280b80 10 client.16743 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:07:49.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f924e280b80 20 client.16743 populate_metadata read hostname 'smithi006' 2023-10-14T09:07:49.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f924e280b80 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cb05030 0x55bc0cb07450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:07:49.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f924e280b80 4 client.16743 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:07:49.716 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bc0c9e6df0 con 0x55bc0cb05030 2023-10-14T09:07:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.704+0000 7f923b7fe700 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cb05030 0x55bc0cb07450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:07:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.705+0000 7f921affd700 10 client.16743 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:49.717 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.705+0000 7f923b7fe700 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cb05030 0x55bc0cb07450 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b27ce4cd814bf6b server_cookie=7f990cd333cfbac4 in_seq=0 out_seq=0 2023-10-14T09:07:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f921affd700 1 -- 172.21.15.6:0/4004089888 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bc0c9e6df0 con 0x55bc0cb05030 2023-10-14T09:07:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f921affd700 10 client.16743 handle_command_reply: tid=0 2023-10-14T09:07:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 client.16743 shutdown 2023-10-14T09:07:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 msgr2=0x55bc0caaa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caaa080 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f92300966d0 tx=0x7f923009b3b0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 shutdown_connections 2023-10-14T09:07:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55bc0cb05030 0x55bc0cb07450 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bc0ca9c0a0 0x55bc0caab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bc0ca9a850 0x55bc0caa9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f921affd700 0 client.16743 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:07:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 --2- 172.21.15.6:0/4004089888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bc0ca9b1b0 0x55bc0caaa080 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 >> 172.21.15.6:0/4004089888 conn(0x55bc0c9c8d70 msgr2=0x55bc0caac540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 shutdown_connections 2023-10-14T09:07:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 1 -- 172.21.15.6:0/4004089888 wait complete. 2023-10-14T09:07:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.717+0000 7f924e280b80 20 client.16743 trim_cache size 0 max 16384 2023-10-14T09:07:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:07:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:07:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:07:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:07:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f92240a1480 msgr2=0x7f92240a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f92240a1480 0x7f92240a3940 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f923c100e30 tx=0x7f922c009260 comp rx=0 tx=0).stop 2023-10-14T09:07:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 msgr2=0x7f923c10e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:07:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c10e2e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f923000e9a0 tx=0x7f923000ecb0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.724 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 shutdown_connections 2023-10-14T09:07:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f923c101970 0x7f923c10a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0ffde0 0x7f923c10dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f92240a1480 0x7f92240a3940 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 --2- 172.21.15.6:0/1934718160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f923c100fd0 0x7f923c10e2e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:07:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 >> 172.21.15.6:0/1934718160 conn(0x7f923c0fb3b0 msgr2=0x7f923c1021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:07:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 shutdown_connections 2023-10-14T09:07:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:07:49.718+0000 7f9242096700 1 -- 172.21.15.6:0/1934718160 wait complete. 2023-10-14T09:07:50.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:07:50.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:07:50.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:49 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:07:50.234 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:49 smithi006 ceph-mon[99452]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 675 op/s 2023-10-14T09:07:50.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:07:50.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:07:50.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:49 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:07:50.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:49 smithi178 ceph-mon[103612]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 675 op/s 2023-10-14T09:07:50.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-14T09:07:50.447 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-14T09:07:50.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:49 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' 2023-10-14T09:07:50.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:49 smithi057 ceph-mon[103313]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 675 op/s 2023-10-14T09:07:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 890.0 s, 1442.6 tps, lat 69.499 ms stddev 75.625 2023-10-14T09:07:52.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:52 smithi178 ceph-mon[103612]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 785 op/s 2023-10-14T09:07:52.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:52 smithi057 ceph-mon[103313]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 785 op/s 2023-10-14T09:07:52.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:52 smithi006 ceph-mon[99452]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 785 op/s 2023-10-14T09:07:54.243 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:53 smithi006 ceph-mon[99452]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 674 op/s 2023-10-14T09:07:54.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:53 smithi178 ceph-mon[103612]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 674 op/s 2023-10-14T09:07:54.448 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:53 smithi057 ceph-mon[103313]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 674 op/s 2023-10-14T09:07:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 895.0 s, 1336.6 tps, lat 74.179 ms stddev 102.674 2023-10-14T09:07:56.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:55 smithi006 ceph-mon[99452]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 760 op/s 2023-10-14T09:07:56.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:55 smithi178 ceph-mon[103612]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 760 op/s 2023-10-14T09:07:56.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:55 smithi057 ceph-mon[103313]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 760 op/s 2023-10-14T09:07:58.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:07:58 smithi178 ceph-mon[103612]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 739 op/s 2023-10-14T09:07:58.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:07:58 smithi057 ceph-mon[103313]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 739 op/s 2023-10-14T09:07:58.490 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:07:58 smithi006 ceph-mon[99452]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 739 op/s 2023-10-14T09:08:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:progress: 900.0 s, 969.0 tps, lat 103.608 ms stddev 194.307 2023-10-14T09:08:01.123 INFO:teuthology.orchestra.run.smithi006.stdout:transaction type: 2023-10-14T09:08:01.124 INFO:teuthology.orchestra.run.smithi006.stdout:scaling factor: 32 2023-10-14T09:08:01.124 INFO:teuthology.orchestra.run.smithi006.stdout:query mode: simple 2023-10-14T09:08:01.124 INFO:teuthology.orchestra.run.smithi006.stdout:number of clients: 100 2023-10-14T09:08:01.125 INFO:teuthology.orchestra.run.smithi006.stdout:number of threads: 4 2023-10-14T09:08:01.125 INFO:teuthology.orchestra.run.smithi006.stdout:duration: 900 s 2023-10-14T09:08:01.125 INFO:teuthology.orchestra.run.smithi006.stdout:number of transactions actually processed: 1899582 2023-10-14T09:08:01.125 INFO:teuthology.orchestra.run.smithi006.stdout:latency average = 47.380 ms 2023-10-14T09:08:01.126 INFO:teuthology.orchestra.run.smithi006.stdout:latency stddev = 67.982 ms 2023-10-14T09:08:01.126 INFO:teuthology.orchestra.run.smithi006.stdout:tps = 2110.271311 (including connections establishing) 2023-10-14T09:08:01.126 INFO:teuthology.orchestra.run.smithi006.stdout:tps = 2110.276529 (excluding connections establishing) 2023-10-14T09:08:01.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-10-14T09:08:01.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:00 smithi006 ceph-mon[99452]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 1.06k op/s 2023-10-14T09:08:01.396 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:00 smithi178 ceph-mon[103612]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 1.06k op/s 2023-10-14T09:08:01.452 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:00 smithi057 ceph-mon[103313]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 1.06k op/s 2023-10-14T09:08:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.939+0000 7f1b635fa700 1 -- 172.21.15.6:0/2324994547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c107eb0 msgr2=0x7f1b5c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.939+0000 7f1b635fa700 1 --2- 172.21.15.6:0/2324994547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c107eb0 0x7f1b5c10a2e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1b580098f0 tx=0x7f1b58009c00 comp rx=0 tx=0).stop 2023-10-14T09:08:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.953+0000 7f1b635fa700 1 -- 172.21.15.6:0/2324994547 shutdown_connections 2023-10-14T09:08:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.953+0000 7f1b635fa700 1 --2- 172.21.15.6:0/2324994547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b5c10d1f0 0x7f1b5c10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.953+0000 7f1b635fa700 1 --2- 172.21.15.6:0/2324994547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c107eb0 0x7f1b5c10a2e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.953+0000 7f1b635fa700 1 --2- 172.21.15.6:0/2324994547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c10a820 0x7f1b5c10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:02.957 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.954+0000 7f1b635fa700 1 -- 172.21.15.6:0/2324994547 >> 172.21.15.6:0/2324994547 conn(0x7f1b5c06dcf0 msgr2=0x7f1b5c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:02.962 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.961+0000 7f1b635fa700 1 -- 172.21.15.6:0/2324994547 shutdown_connections 2023-10-14T09:08:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.966+0000 7f1b635fa700 1 -- 172.21.15.6:0/2324994547 wait complete. 2023-10-14T09:08:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.967+0000 7f1b635fa700 1 Processor -- start 2023-10-14T09:08:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.982+0000 7f1b635fa700 1 -- start start 2023-10-14T09:08:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.983+0000 7f1b635fa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c107eb0 0x7f1b5c114370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.983+0000 7f1b635fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 0x7f1b5c1148b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.983+0000 7f1b635fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b5c10d1f0 0x7f1b5c1b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.983+0000 7f1b635fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c117990 con 0x7f1b5c10a820 2023-10-14T09:08:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.983+0000 7f1b635fa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c117b00 con 0x7f1b5c10d1f0 2023-10-14T09:08:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.983+0000 7f1b635fa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c1b6250 con 0x7f1b5c107eb0 2023-10-14T09:08:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.987+0000 7f1b60b95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 0x7f1b5c1148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.987+0000 7f1b60b95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 0x7f1b5c1148b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36364/0 (socket says 172.21.15.6:36364) 2023-10-14T09:08:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.987+0000 7f1b60b95700 1 -- 172.21.15.6:0/1743841063 learned_addr learned my addr 172.21.15.6:0/1743841063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.994+0000 7f1b61396700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c107eb0 0x7f1b5c114370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:02.995+0000 7f1b61b97700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b5c10d1f0 0x7f1b5c1b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.002+0000 7f1b60b95700 1 -- 172.21.15.6:0/1743841063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c107eb0 msgr2=0x7f1b5c114370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.002+0000 7f1b60b95700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c107eb0 0x7f1b5c114370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.002+0000 7f1b60b95700 1 -- 172.21.15.6:0/1743841063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b5c10d1f0 msgr2=0x7f1b5c1b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.002+0000 7f1b60b95700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b5c10d1f0 0x7f1b5c1b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.002+0000 7f1b60b95700 1 -- 172.21.15.6:0/1743841063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b58009520 con 0x7f1b5c10a820 2023-10-14T09:08:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.007+0000 7f1b60b95700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 0x7f1b5c1148b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400efc0 tx=0x7f1b5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.008+0000 7f1b527fc700 1 -- 172.21.15.6:0/1743841063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54018070 con 0x7f1b5c10a820 2023-10-14T09:08:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.008+0000 7f1b527fc700 1 -- 172.21.15.6:0/1743841063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b5400f040 con 0x7f1b5c10a820 2023-10-14T09:08:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.008+0000 7f1b527fc700 1 -- 172.21.15.6:0/1743841063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54004280 con 0x7f1b5c10a820 2023-10-14T09:08:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.008+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c1b6390 con 0x7f1b5c10a820 2023-10-14T09:08:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.008+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c1b6820 con 0x7f1b5c10a820 2023-10-14T09:08:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.013+0000 7f1b527fc700 1 -- 172.21.15.6:0/1743841063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1b5400ca10 con 0x7f1b5c10a820 2023-10-14T09:08:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.014+0000 7f1b527fc700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1b480a1680 0x7f1b480a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.014+0000 7f1b527fc700 1 -- 172.21.15.6:0/1743841063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1b540ccaf0 con 0x7f1b5c10a820 2023-10-14T09:08:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.020+0000 7f1b6f7e4b80 1 Processor -- start 2023-10-14T09:08:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 -- start start 2023-10-14T09:08:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e1850 0x55f0434e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e21b0 0x55f0434e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434e3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f043456c10 con 0x55f0434e30a0 2023-10-14T09:08:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04343bc00 con 0x55f0434e1850 2023-10-14T09:08:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.021+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f043439520 con 0x55f0434e21b0 2023-10-14T09:08:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.023+0000 7f1b61396700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e1850 0x55f0434e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.023+0000 7f1b61396700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e1850 0x55f0434e1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35128/0 (socket says 172.21.15.6:35128) 2023-10-14T09:08:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.023+0000 7f1b61396700 1 -- 172.21.15.6:0/70049334 learned_addr learned my addr 172.21.15.6:0/70049334 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.023+0000 7f1b60b95700 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e21b0 0x55f0434e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.029+0000 7f1b61b97700 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.031 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.030+0000 7f1b60b95700 1 -- 172.21.15.6:0/70049334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e1850 msgr2=0x55f0434e1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.030+0000 7f1b60b95700 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e1850 0x55f0434e1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.030+0000 7f1b60b95700 1 -- 172.21.15.6:0/70049334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 msgr2=0x55f0434e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.030+0000 7f1b60b95700 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434e3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.030+0000 7f1b60b95700 1 -- 172.21.15.6:0/70049334 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0433f2390 con 0x55f0434e21b0 2023-10-14T09:08:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.036+0000 7f1b61396700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1b480a1680 0x7f1b480a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.036+0000 7f1b60b95700 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e21b0 0x55f0434e2ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400ef90 tx=0x7f1b54099cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b63266e076a85e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.037+0000 7f1b61396700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1b480a1680 0x7f1b480a3b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c010 tx=0x7f1b58009c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.046+0000 7f1b477fe700 1 -- 172.21.15.6:0/70049334 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5409a560 con 0x55f0434e21b0 2023-10-14T09:08:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.046+0000 7f1b477fe700 1 -- 172.21.15.6:0/70049334 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b54099e60 con 0x55f0434e21b0 2023-10-14T09:08:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.046+0000 7f1b477fe700 1 -- 172.21.15.6:0/70049334 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5409a0c0 con 0x55f0434e21b0 2023-10-14T09:08:03.048 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.047+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/70049334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e21b0 msgr2=0x55f0434e2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:03.049 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.047+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e21b0 0x55f0434e2ac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400ef90 tx=0x7f1b54099cb0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.065 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.061+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/70049334 shutdown_connections 2023-10-14T09:08:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.061+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.061+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e1850 0x55f0434e1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.066 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.061+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/70049334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e21b0 0x55f0434e2ac0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.061+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/70049334 >> 172.21.15.6:0/70049334 conn(0x55f04340fd70 msgr2=0x55f0434dcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:03.067 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.064+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/70049334 shutdown_connections 2023-10-14T09:08:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.064+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/70049334 wait complete. 2023-10-14T09:08:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 -- start start 2023-10-14T09:08:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 Processor -- start 2023-10-14T09:08:03.068 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f043434e10 con 0x55f0434e30a0 2023-10-14T09:08:03.069 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0433d16b0 con 0x55f0434e21b0 2023-10-14T09:08:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0433d1350 con 0x55f0434e1850 2023-10-14T09:08:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.065+0000 7f1b6f7e4b80 10 client.0 _ll_register_callbacks cb 0x55f04322e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:08:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.066+0000 7f1b61b97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.070 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.066+0000 7f1b61b97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36378/0 (socket says 172.21.15.6:36378) 2023-10-14T09:08:03.071 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.066+0000 7f1b61b97700 1 -- 172.21.15.6:0/3787620649 learned_addr learned my addr 172.21.15.6:0/3787620649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.067+0000 7f1b61b97700 1 -- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 msgr2=0x55f0434eb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.067+0000 7f1b61b97700 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.067+0000 7f1b61b97700 1 -- 172.21.15.6:0/3787620649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 msgr2=0x55f0434ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.072 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.067+0000 7f1b61b97700 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.067+0000 7f1b61b97700 1 -- 172.21.15.6:0/3787620649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c1b6820 con 0x55f0434e30a0 2023-10-14T09:08:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.067+0000 7f1b61b97700 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434f2d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0126a0 tx=0x7f1b4c012a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f6790f71345ea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.068+0000 7f1b44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:08:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.068+0000 7f1b44ff9700 1 -- 172.21.15.6:0/3787620649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c004a30 con 0x55f0434e30a0 2023-10-14T09:08:03.073 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.068+0000 7f1b44ff9700 1 -- 172.21.15.6:0/3787620649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1b4c004b90 con 0x55f0434e30a0 2023-10-14T09:08:03.074 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.068+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f043439e90 con 0x55f0434e30a0 2023-10-14T09:08:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.071+0000 7f1b44ff9700 1 -- 172.21.15.6:0/3787620649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b4c004d50 con 0x55f0434e30a0 2023-10-14T09:08:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.071+0000 7f1b6f7e4b80 10 client.16755 fetch_fsmap learned FSMap version 55 2023-10-14T09:08:03.075 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.071+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55f04325fd80 con 0x55f0434e30a0 2023-10-14T09:08:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.071+0000 7f1b44ff9700 1 -- 172.21.15.6:0/3787620649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f043439e90 con 0x55f0434e30a0 2023-10-14T09:08:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b44ff9700 1 -- 172.21.15.6:0/3787620649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1b4c010b30 con 0x55f0434e30a0 2023-10-14T09:08:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b6f7e4b80 10 client.16755 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:08:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b6f7e4b80 10 client.16755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:08:03.076 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b6f7e4b80 20 client.16755 populate_metadata read hostname 'smithi006' 2023-10-14T09:08:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f0434f77b0 0x55f0434f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b6f7e4b80 4 client.16755 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T09:08:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.072+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0434b1bb0 con 0x55f0434f77b0 2023-10-14T09:08:03.077 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.074+0000 7f1b61396700 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f0434f77b0 0x55f0434f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.097 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.096+0000 7f1b61396700 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f0434f77b0 0x55f0434f9bd0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecf3e5304ccbd6b6 server_cookie=84d65cff178fb283 in_seq=0 out_seq=0 2023-10-14T09:08:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.099+0000 7f1b44ff9700 10 client.16755 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:08:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b44ff9700 1 -- 172.21.15.6:0/3787620649 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f0434b1bb0 con 0x55f0434f77b0 2023-10-14T09:08:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b44ff9700 10 client.16755 handle_command_reply: tid=0 2023-10-14T09:08:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 client.16755 shutdown 2023-10-14T09:08:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 msgr2=0x55f0434f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434f2d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0126a0 tx=0x7f1b4c012a60 comp rx=0 tx=0).stop 2023-10-14T09:08:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 shutdown_connections 2023-10-14T09:08:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f0434f77b0 0x55f0434f9bd0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434f2d30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434eb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/3787620649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 >> 172.21.15.6:0/3787620649 conn(0x55f04340fd70 msgr2=0x55f0434dc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.115+0000 7f1b44ff9700 0 client.16755 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:08:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.130+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 shutdown_connections 2023-10-14T09:08:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.130+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/3787620649 wait complete. 2023-10-14T09:08:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.139+0000 7f1b6f7e4b80 20 client.16755 trim_cache size 0 max 16384 2023-10-14T09:08:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 Processor -- start 2023-10-14T09:08:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 -- start start 2023-10-14T09:08:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0432b58c0 con 0x55f0434e30a0 2023-10-14T09:08:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0434d7fa0 con 0x55f0434e21b0 2023-10-14T09:08:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0434e3920 con 0x55f0434e1850 2023-10-14T09:08:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.174+0000 7f1b60b95700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.175+0000 7f1b60b95700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35142/0 (socket says 172.21.15.6:35142) 2023-10-14T09:08:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.175+0000 7f1b60b95700 1 -- 172.21.15.6:0/706511845 learned_addr learned my addr 172.21.15.6:0/706511845 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.175+0000 7f1b61396700 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.187+0000 7f1b61396700 1 -- 172.21.15.6:0/706511845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 msgr2=0x55f0434f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.187+0000 7f1b61396700 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.187+0000 7f1b61396700 1 -- 172.21.15.6:0/706511845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 msgr2=0x55f0434dc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.187+0000 7f1b61396700 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.187+0000 7f1b61396700 1 -- 172.21.15.6:0/706511845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f043248c00 con 0x55f0434e1850 2023-10-14T09:08:03.196 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.195+0000 7f1b61396700 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434ea3d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009810 tx=0x7f1b58009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ae118bfd4bdc180 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.202+0000 7f1b47fff700 1 -- 172.21.15.6:0/706511845 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5802c040 con 0x55f0434e1850 2023-10-14T09:08:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.202+0000 7f1b47fff700 1 -- 172.21.15.6:0/706511845 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b580055a0 con 0x55f0434e1850 2023-10-14T09:08:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.202+0000 7f1b47fff700 1 -- 172.21.15.6:0/706511845 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800b7c0 con 0x55f0434e1850 2023-10-14T09:08:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/706511845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 msgr2=0x55f0434ea3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434ea3d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009810 tx=0x7f1b58009f50 comp rx=0 tx=0).stop 2023-10-14T09:08:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/706511845 shutdown_connections 2023-10-14T09:08:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e30a0 0x55f0434dc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434ea3d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/706511845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e21b0 0x55f0434f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/706511845 >> 172.21.15.6:0/706511845 conn(0x55f04340fd70 msgr2=0x55f0434f3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/706511845 shutdown_connections 2023-10-14T09:08:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/706511845 wait complete. 2023-10-14T09:08:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.203+0000 7f1b6f7e4b80 1 -- start start 2023-10-14T09:08:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 Processor -- start 2023-10-14T09:08:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434f0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e21b0 0x55f0434f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e30a0 0x55f0434f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0434f23b0 con 0x55f0434e21b0 2023-10-14T09:08:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0434f2520 con 0x55f0434e30a0 2023-10-14T09:08:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0434f26e0 con 0x55f0434e1850 2023-10-14T09:08:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b6f7e4b80 10 client.0 _ll_register_callbacks cb 0x7f1b4c009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T09:08:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.204+0000 7f1b61b97700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e30a0 0x55f0434f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.205+0000 7f1b61b97700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e30a0 0x55f0434f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.6:35148/0 (socket says 172.21.15.6:35148) 2023-10-14T09:08:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.205+0000 7f1b61b97700 1 -- 172.21.15.6:0/4266180544 learned_addr learned my addr 172.21.15.6:0/4266180544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.207+0000 7f1b60b95700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e21b0 0x55f0434f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.212+0000 7f1b61396700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.217+0000 7f1b60b95700 1 -- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 msgr2=0x55f0434f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.217+0000 7f1b60b95700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.217+0000 7f1b60b95700 1 -- 172.21.15.6:0/4266180544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e30a0 msgr2=0x55f0434f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T09:08:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.217+0000 7f1b60b95700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e30a0 0x55f0434f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.217+0000 7f1b60b95700 1 -- 172.21.15.6:0/4266180544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5801f040 con 0x55f0434e21b0 2023-10-14T09:08:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.277+0000 7f1b60b95700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e21b0 0x55f0434f0e60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1b540090a0 tx=0x7f1b54099ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33276738f336b93f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.277+0000 7f1b44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-10-14T09:08:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.288+0000 7f1b44ff9700 1 -- 172.21.15.6:0/4266180544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5409e030 con 0x55f0434e21b0 2023-10-14T09:08:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.288+0000 7f1b44ff9700 1 -- 172.21.15.6:0/4266180544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1b5409c070 con 0x55f0434e21b0 2023-10-14T09:08:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.288+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b54099e60 con 0x55f0434e21b0 2023-10-14T09:08:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.299+0000 7f1b44ff9700 1 -- 172.21.15.6:0/4266180544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b540a2160 con 0x55f0434e21b0 2023-10-14T09:08:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.299+0000 7f1b6f7e4b80 10 client.16758 fetch_fsmap learned FSMap version 55 2023-10-14T09:08:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.299+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55f0432861f0 con 0x55f0434e21b0 2023-10-14T09:08:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.301+0000 7f1b44ff9700 1 -- 172.21.15.6:0/4266180544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b54099e60 con 0x55f0434e21b0 2023-10-14T09:08:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.301+0000 7f1b44ff9700 1 -- 172.21.15.6:0/4266180544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 55) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1b540a1cd0 con 0x55f0434e21b0 2023-10-14T09:08:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b6f7e4b80 10 client.16758 fetch_fsmap finished waiting for FSMap version 55 2023-10-14T09:08:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b6f7e4b80 10 client.16758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-14T09:08:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b6f7e4b80 20 client.16758 populate_metadata read hostname 'smithi006' 2023-10-14T09:08:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f04354bf90 0x55f04354e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b6f7e4b80 4 client.16758 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-14T09:08:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 --> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f04342ddf0 con 0x55f04354bf90 2023-10-14T09:08:03.308 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.302+0000 7f1b61396700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f04354bf90 0x55f04354e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:03.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.334+0000 7f1b61396700 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f04354bf90 0x55f04354e3b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a46b5a307631995d server_cookie=715b68b80b0429b5 in_seq=0 out_seq=0 2023-10-14T09:08:03.336 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:03.334+0000 7f1b44ff9700 10 client.16758 ms_handle_connect on v2:172.21.15.178:6838/1495241908 2023-10-14T09:08:03.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:03 smithi057 ceph-mon[103313]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 1.78k op/s 2023-10-14T09:08:03.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:03 smithi006 ceph-mon[99452]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 1.78k op/s 2023-10-14T09:08:04.138 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:03 smithi178 ceph-mon[103612]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 29 MiB/s wr, 1.78k op/s 2023-10-14T09:08:04.420 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.419+0000 7f1b44ff9700 1 -- 172.21.15.6:0/4266180544 <== mds.0 v2:172.21.15.178:6838/1495241908 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f04342ddf0 con 0x55f04354bf90 2023-10-14T09:08:04.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.419+0000 7f1b44ff9700 10 client.16758 handle_command_reply: tid=0 2023-10-14T09:08:04.421 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.419+0000 7f1b6f7e4b80 1 client.16758 shutdown 2023-10-14T09:08:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.431+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e21b0 msgr2=0x55f0434f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.431+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e21b0 0x55f0434f0e60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1b540090a0 tx=0x7f1b54099ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.443 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 shutdown_connections 2023-10-14T09:08:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:6838/1495241908,v1:172.21.15.178:6839/1495241908] conn(0x55f04354bf90 0x55f04354e3b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.444 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f0434e30a0 0x55f0434f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f0434e1850 0x55f0434f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 --2- 172.21.15.6:0/4266180544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0434e21b0 0x55f0434f0e60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.445 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 >> 172.21.15.6:0/4266180544 conn(0x55f04340fd70 msgr2=0x55f0434f3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:04.446 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b44ff9700 0 client.16758 ms_handle_reset on v2:172.21.15.178:6838/1495241908 2023-10-14T09:08:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:{ 2023-10-14T09:08:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "message": "", 2023-10-14T09:08:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout: "return_code": 0 2023-10-14T09:08:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stdout:} 2023-10-14T09:08:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.441+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 shutdown_connections 2023-10-14T09:08:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.446+0000 7f1b6f7e4b80 1 -- 172.21.15.6:0/4266180544 wait complete. 2023-10-14T09:08:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.447+0000 7f1b6f7e4b80 20 client.16758 trim_cache size 0 max 16384 2023-10-14T09:08:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1b480a1680 msgr2=0x7f1b480a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1b480a1680 0x7f1b480a3b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c010 tx=0x7f1b58009c00 comp rx=0 tx=0).stop 2023-10-14T09:08:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 msgr2=0x7f1b5c1148b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 0x7f1b5c1148b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400efc0 tx=0x7f1b5400c3a0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 shutdown_connections 2023-10-14T09:08:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1b480a1680 0x7f1b480a3b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b5c10d1f0 0x7f1b5c1b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c107eb0 0x7f1b5c114370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 --2- 172.21.15.6:0/1743841063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5c10a820 0x7f1b5c1148b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.462+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 >> 172.21.15.6:0/1743841063 conn(0x7f1b5c06dcf0 msgr2=0x7f1b5c108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.463+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 shutdown_connections 2023-10-14T09:08:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi006.front.sepia.ceph.com.smithi006.stderr:2023-10-14T09:08:04.463+0000 7f1b635fa700 1 -- 172.21.15.6:0/1743841063 wait complete. 2023-10-14T09:08:04.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:04 smithi006 ceph-mon[99452]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 28 MiB/s wr, 1.81k op/s 2023-10-14T09:08:05.135 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:04 smithi178 ceph-mon[103612]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 28 MiB/s wr, 1.81k op/s 2023-10-14T09:08:05.195 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:04 smithi057 ceph-mon[103313]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 28 MiB/s wr, 1.81k op/s 2023-10-14T09:08:06.389 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:06 smithi178 ceph-mon[103612]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 2.06k op/s 2023-10-14T09:08:06.449 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:06 smithi057 ceph-mon[103313]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 2.06k op/s 2023-10-14T09:08:06.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:06 smithi006 ceph-mon[99452]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 30 MiB/s wr, 2.06k op/s 2023-10-14T09:08:08.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:07 smithi178 ceph-mon[103612]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 29 MiB/s wr, 2.10k op/s 2023-10-14T09:08:08.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:07 smithi057 ceph-mon[103313]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 29 MiB/s wr, 2.10k op/s 2023-10-14T09:08:08.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:07 smithi006 ceph-mon[99452]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 29 MiB/s wr, 2.10k op/s 2023-10-14T09:08:09.356 DEBUG:teuthology.orchestra.run.smithi006:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-14T09:08:09.496 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/: 2023-10-14T09:08:09.496 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.496 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T09:08:09.496 INFO:teuthology.orchestra.run.smithi006.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 .. 2023-10-14T09:08:09.497 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 data 2023-10-14T09:08:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.497 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data: 2023-10-14T09:08:09.497 INFO:teuthology.orchestra.run.smithi006.stdout:total 31 2023-10-14T09:08:09.497 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 . 2023-10-14T09:08:09.498 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 .. 2023-10-14T09:08:09.498 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 14 08:52 base 2023-10-14T09:08:09.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Oct 14 08:52 current_logfiles 2023-10-14T09:08:09.498 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Oct 14 08:52 global 2023-10-14T09:08:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 log 2023-10-14T09:08:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_commit_ts 2023-10-14T09:08:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_dynshmem 2023-10-14T09:08:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 14 08:52 pg_hba.conf 2023-10-14T09:08:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 14 08:52 pg_ident.conf 2023-10-14T09:08:09.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 09:08 pg_logical 2023-10-14T09:08:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 pg_multixact 2023-10-14T09:08:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 pg_notify 2023-10-14T09:08:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_replslot 2023-10-14T09:08:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_serial 2023-10-14T09:08:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_snapshots 2023-10-14T09:08:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 09:08 pg_stat 2023-10-14T09:08:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 09:08 pg_stat_tmp 2023-10-14T09:08:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 09:08 pg_subtrans 2023-10-14T09:08:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_tblspc 2023-10-14T09:08:09.501 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 pg_twophase 2023-10-14T09:08:09.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T09:08:09.502 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 14 09:08 pg_wal 2023-10-14T09:08:09.502 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:59 pg_xact 2023-10-14T09:08:09.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 14 08:52 postgresql.auto.conf 2023-10-14T09:08:09.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 14 08:52 postgresql.conf 2023-10-14T09:08:09.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Oct 14 08:52 postmaster.opts 2023-10-14T09:08:09.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.503 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base: 2023-10-14T09:08:09.503 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.503 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 14 08:52 . 2023-10-14T09:08:09.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 1 2023-10-14T09:08:09.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 12346 2023-10-14T09:08:09.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Oct 14 08:53 12347 2023-10-14T09:08:09.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:53 pgsql_tmp 2023-10-14T09:08:09.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.505 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-14T09:08:09.505 INFO:teuthology.orchestra.run.smithi006.stdout:total 7193 2023-10-14T09:08:09.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 . 2023-10-14T09:08:09.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 14 08:52 .. 2023-10-14T09:08:09.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 112 2023-10-14T09:08:09.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 113 2023-10-14T09:08:09.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 14 08:52 12182 2023-10-14T09:08:09.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12182_fsm 2023-10-14T09:08:09.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12182_vm 2023-10-14T09:08:09.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12184 2023-10-14T09:08:09.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12186 2023-10-14T09:08:09.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187 2023-10-14T09:08:09.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12187_fsm 2023-10-14T09:08:09.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187_vm 2023-10-14T09:08:09.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12189 2023-10-14T09:08:09.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12191 2023-10-14T09:08:09.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192 2023-10-14T09:08:09.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12192_fsm 2023-10-14T09:08:09.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192_vm 2023-10-14T09:08:09.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12194 2023-10-14T09:08:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12196 2023-10-14T09:08:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197 2023-10-14T09:08:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12197_fsm 2023-10-14T09:08:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197_vm 2023-10-14T09:08:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12199 2023-10-14T09:08:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12201 2023-10-14T09:08:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202 2023-10-14T09:08:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12202_fsm 2023-10-14T09:08:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202_vm 2023-10-14T09:08:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12204 2023-10-14T09:08:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12206 2023-10-14T09:08:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207 2023-10-14T09:08:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12207_fsm 2023-10-14T09:08:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207_vm 2023-10-14T09:08:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12209 2023-10-14T09:08:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12211 2023-10-14T09:08:09.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12212 2023-10-14T09:08:09.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12214 2023-10-14T09:08:09.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12216 2023-10-14T09:08:09.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 14 08:52 1247 2023-10-14T09:08:09.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1247_fsm 2023-10-14T09:08:09.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1247_vm 2023-10-14T09:08:09.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 14 08:52 1249 2023-10-14T09:08:09.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1249_fsm 2023-10-14T09:08:09.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1249_vm 2023-10-14T09:08:09.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 14 08:52 1255 2023-10-14T09:08:09.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1255_fsm 2023-10-14T09:08:09.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1255_vm 2023-10-14T09:08:09.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 08:52 1259 2023-10-14T09:08:09.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1259_fsm 2023-10-14T09:08:09.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1259_vm 2023-10-14T09:08:09.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417 2023-10-14T09:08:09.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417_vm 2023-10-14T09:08:09.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418 2023-10-14T09:08:09.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418_vm 2023-10-14T09:08:09.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 174 2023-10-14T09:08:09.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 175 2023-10-14T09:08:09.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2187 2023-10-14T09:08:09.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224 2023-10-14T09:08:09.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224_vm 2023-10-14T09:08:09.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328 2023-10-14T09:08:09.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328_vm 2023-10-14T09:08:09.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336 2023-10-14T09:08:09.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336_vm 2023-10-14T09:08:09.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2337 2023-10-14T09:08:09.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2600 2023-10-14T09:08:09.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2600_fsm 2023-10-14T09:08:09.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2600_vm 2023-10-14T09:08:09.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601 2023-10-14T09:08:09.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2601_fsm 2023-10-14T09:08:09.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601_vm 2023-10-14T09:08:09.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2602 2023-10-14T09:08:09.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2602_fsm 2023-10-14T09:08:09.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2602_vm 2023-10-14T09:08:09.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2603 2023-10-14T09:08:09.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2603_fsm 2023-10-14T09:08:09.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2603_vm 2023-10-14T09:08:09.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604 2023-10-14T09:08:09.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604_vm 2023-10-14T09:08:09.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2605 2023-10-14T09:08:09.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2605_fsm 2023-10-14T09:08:09.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2605_vm 2023-10-14T09:08:09.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606 2023-10-14T09:08:09.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2606_fsm 2023-10-14T09:08:09.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606_vm 2023-10-14T09:08:09.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607 2023-10-14T09:08:09.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607_fsm 2023-10-14T09:08:09.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2607_vm 2023-10-14T09:08:09.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 14 08:52 2608 2023-10-14T09:08:09.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2608_fsm 2023-10-14T09:08:09.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2608_vm 2023-10-14T09:08:09.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 14 08:52 2609 2023-10-14T09:08:09.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2609_fsm 2023-10-14T09:08:09.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2609_vm 2023-10-14T09:08:09.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610 2023-10-14T09:08:09.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610_fsm 2023-10-14T09:08:09.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2610_vm 2023-10-14T09:08:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611 2023-10-14T09:08:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611_vm 2023-10-14T09:08:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612 2023-10-14T09:08:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2612_fsm 2023-10-14T09:08:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612_vm 2023-10-14T09:08:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613 2023-10-14T09:08:09.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613_vm 2023-10-14T09:08:09.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615 2023-10-14T09:08:09.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2615_fsm 2023-10-14T09:08:09.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615_vm 2023-10-14T09:08:09.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616 2023-10-14T09:08:09.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616_fsm 2023-10-14T09:08:09.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2616_vm 2023-10-14T09:08:09.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 14 08:52 2617 2023-10-14T09:08:09.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2617_fsm 2023-10-14T09:08:09.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2617_vm 2023-10-14T09:08:09.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 14 08:52 2618 2023-10-14T09:08:09.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2618_fsm 2023-10-14T09:08:09.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2618_vm 2023-10-14T09:08:09.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 14 08:52 2619 2023-10-14T09:08:09.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2619_fsm 2023-10-14T09:08:09.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2619_vm 2023-10-14T09:08:09.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620 2023-10-14T09:08:09.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620_vm 2023-10-14T09:08:09.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2650 2023-10-14T09:08:09.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2651 2023-10-14T09:08:09.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2652 2023-10-14T09:08:09.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2653 2023-10-14T09:08:09.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2654 2023-10-14T09:08:09.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2655 2023-10-14T09:08:09.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2656 2023-10-14T09:08:09.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2657 2023-10-14T09:08:09.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 14 08:52 2658 2023-10-14T09:08:09.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2659 2023-10-14T09:08:09.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2660 2023-10-14T09:08:09.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2661 2023-10-14T09:08:09.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2662 2023-10-14T09:08:09.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2663 2023-10-14T09:08:09.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2664 2023-10-14T09:08:09.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2665 2023-10-14T09:08:09.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2666 2023-10-14T09:08:09.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2667 2023-10-14T09:08:09.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2668 2023-10-14T09:08:09.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2669 2023-10-14T09:08:09.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2670 2023-10-14T09:08:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 14 08:52 2673 2023-10-14T09:08:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 14 08:52 2674 2023-10-14T09:08:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 14 08:52 2675 2023-10-14T09:08:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2678 2023-10-14T09:08:09.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2679 2023-10-14T09:08:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2680 2023-10-14T09:08:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2681 2023-10-14T09:08:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2682 2023-10-14T09:08:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2683 2023-10-14T09:08:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2684 2023-10-14T09:08:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2685 2023-10-14T09:08:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2686 2023-10-14T09:08:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2687 2023-10-14T09:08:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2688 2023-10-14T09:08:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2689 2023-10-14T09:08:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2690 2023-10-14T09:08:09.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 14 08:52 2691 2023-10-14T09:08:09.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2692 2023-10-14T09:08:09.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2693 2023-10-14T09:08:09.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2696 2023-10-14T09:08:09.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2699 2023-10-14T09:08:09.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2701 2023-10-14T09:08:09.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2702 2023-10-14T09:08:09.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2703 2023-10-14T09:08:09.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2704 2023-10-14T09:08:09.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2753 2023-10-14T09:08:09.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2753_fsm 2023-10-14T09:08:09.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2753_vm 2023-10-14T09:08:09.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2754 2023-10-14T09:08:09.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2755 2023-10-14T09:08:09.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2756 2023-10-14T09:08:09.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2757 2023-10-14T09:08:09.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830 2023-10-14T09:08:09.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830_vm 2023-10-14T09:08:09.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2831 2023-10-14T09:08:09.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832 2023-10-14T09:08:09.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832_vm 2023-10-14T09:08:09.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2833 2023-10-14T09:08:09.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834 2023-10-14T09:08:09.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834_vm 2023-10-14T09:08:09.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2835 2023-10-14T09:08:09.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836 2023-10-14T09:08:09.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836_vm 2023-10-14T09:08:09.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2837 2023-10-14T09:08:09.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 14 08:52 2838 2023-10-14T09:08:09.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2838_fsm 2023-10-14T09:08:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2838_vm 2023-10-14T09:08:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2839 2023-10-14T09:08:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840 2023-10-14T09:08:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840_fsm 2023-10-14T09:08:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2840_vm 2023-10-14T09:08:09.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2841 2023-10-14T09:08:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995 2023-10-14T09:08:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995_vm 2023-10-14T09:08:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2996 2023-10-14T09:08:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079 2023-10-14T09:08:09.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3079_fsm 2023-10-14T09:08:09.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079_vm 2023-10-14T09:08:09.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3080 2023-10-14T09:08:09.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3081 2023-10-14T09:08:09.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3085 2023-10-14T09:08:09.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118 2023-10-14T09:08:09.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118_vm 2023-10-14T09:08:09.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3119 2023-10-14T09:08:09.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3164 2023-10-14T09:08:09.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256 2023-10-14T09:08:09.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256_vm 2023-10-14T09:08:09.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3257 2023-10-14T09:08:09.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3258 2023-10-14T09:08:09.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350 2023-10-14T09:08:09.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350_vm 2023-10-14T09:08:09.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3351 2023-10-14T09:08:09.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3379 2023-10-14T09:08:09.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3380 2023-10-14T09:08:09.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381 2023-10-14T09:08:09.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381_vm 2023-10-14T09:08:09.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3394 2023-10-14T09:08:09.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3394_fsm 2023-10-14T09:08:09.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3394_vm 2023-10-14T09:08:09.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3395 2023-10-14T09:08:09.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439 2023-10-14T09:08:09.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439_vm 2023-10-14T09:08:09.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3440 2023-10-14T09:08:09.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 3455 2023-10-14T09:08:09.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3456 2023-10-14T09:08:09.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3456_fsm 2023-10-14T09:08:09.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3456_vm 2023-10-14T09:08:09.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466 2023-10-14T09:08:09.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466_vm 2023-10-14T09:08:09.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3467 2023-10-14T09:08:09.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3468 2023-10-14T09:08:09.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501 2023-10-14T09:08:09.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501_vm 2023-10-14T09:08:09.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3502 2023-10-14T09:08:09.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3503 2023-10-14T09:08:09.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3534 2023-10-14T09:08:09.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541 2023-10-14T09:08:09.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3541_fsm 2023-10-14T09:08:09.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541_vm 2023-10-14T09:08:09.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3542 2023-10-14T09:08:09.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3574 2023-10-14T09:08:09.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3575 2023-10-14T09:08:09.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576 2023-10-14T09:08:09.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576_vm 2023-10-14T09:08:09.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596 2023-10-14T09:08:09.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596_vm 2023-10-14T09:08:09.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3597 2023-10-14T09:08:09.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598 2023-10-14T09:08:09.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598_vm 2023-10-14T09:08:09.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3599 2023-10-14T09:08:09.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600 2023-10-14T09:08:09.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3600_fsm 2023-10-14T09:08:09.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600_vm 2023-10-14T09:08:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601 2023-10-14T09:08:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3601_fsm 2023-10-14T09:08:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601_vm 2023-10-14T09:08:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602 2023-10-14T09:08:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3602_fsm 2023-10-14T09:08:09.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602_vm 2023-10-14T09:08:09.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3603 2023-10-14T09:08:09.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3603_fsm 2023-10-14T09:08:09.556 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3603_vm 2023-10-14T09:08:09.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3604 2023-10-14T09:08:09.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3605 2023-10-14T09:08:09.559 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3606 2023-10-14T09:08:09.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3607 2023-10-14T09:08:09.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3608 2023-10-14T09:08:09.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 3609 2023-10-14T09:08:09.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3712 2023-10-14T09:08:09.560 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764 2023-10-14T09:08:09.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3764_fsm 2023-10-14T09:08:09.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764_vm 2023-10-14T09:08:09.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3766 2023-10-14T09:08:09.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3767 2023-10-14T09:08:09.561 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3997 2023-10-14T09:08:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 5002 2023-10-14T09:08:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 548 2023-10-14T09:08:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 549 2023-10-14T09:08:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102 2023-10-14T09:08:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102_vm 2023-10-14T09:08:09.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104 2023-10-14T09:08:09.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104_vm 2023-10-14T09:08:09.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106 2023-10-14T09:08:09.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106_vm 2023-10-14T09:08:09.563 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6110 2023-10-14T09:08:09.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6111 2023-10-14T09:08:09.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6112 2023-10-14T09:08:09.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6113 2023-10-14T09:08:09.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6117 2023-10-14T09:08:09.564 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826 2023-10-14T09:08:09.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826_vm 2023-10-14T09:08:09.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 827 2023-10-14T09:08:09.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 828 2023-10-14T09:08:09.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T09:08:09.565 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T09:08:09.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.566 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-14T09:08:09.566 INFO:teuthology.orchestra.run.smithi006.stdout:total 7193 2023-10-14T09:08:09.566 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Oct 14 08:52 . 2023-10-14T09:08:09.566 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 14 08:52 .. 2023-10-14T09:08:09.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 112 2023-10-14T09:08:09.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 113 2023-10-14T09:08:09.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 14 08:52 12182 2023-10-14T09:08:09.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12182_fsm 2023-10-14T09:08:09.567 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12182_vm 2023-10-14T09:08:09.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12184 2023-10-14T09:08:09.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12186 2023-10-14T09:08:09.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187 2023-10-14T09:08:09.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12187_fsm 2023-10-14T09:08:09.568 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187_vm 2023-10-14T09:08:09.569 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12189 2023-10-14T09:08:09.569 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12191 2023-10-14T09:08:09.569 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192 2023-10-14T09:08:09.569 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12192_fsm 2023-10-14T09:08:09.569 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192_vm 2023-10-14T09:08:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12194 2023-10-14T09:08:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12196 2023-10-14T09:08:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197 2023-10-14T09:08:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12197_fsm 2023-10-14T09:08:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197_vm 2023-10-14T09:08:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12199 2023-10-14T09:08:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12201 2023-10-14T09:08:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202 2023-10-14T09:08:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12202_fsm 2023-10-14T09:08:09.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202_vm 2023-10-14T09:08:09.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12204 2023-10-14T09:08:09.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12206 2023-10-14T09:08:09.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207 2023-10-14T09:08:09.572 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12207_fsm 2023-10-14T09:08:09.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207_vm 2023-10-14T09:08:09.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12209 2023-10-14T09:08:09.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12211 2023-10-14T09:08:09.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12212 2023-10-14T09:08:09.573 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12214 2023-10-14T09:08:09.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12216 2023-10-14T09:08:09.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 14 08:52 1247 2023-10-14T09:08:09.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1247_fsm 2023-10-14T09:08:09.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1247_vm 2023-10-14T09:08:09.574 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 14 08:52 1249 2023-10-14T09:08:09.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1249_fsm 2023-10-14T09:08:09.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1249_vm 2023-10-14T09:08:09.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 14 08:52 1255 2023-10-14T09:08:09.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1255_fsm 2023-10-14T09:08:09.575 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1255_vm 2023-10-14T09:08:09.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 08:52 1259 2023-10-14T09:08:09.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1259_fsm 2023-10-14T09:08:09.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1259_vm 2023-10-14T09:08:09.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417 2023-10-14T09:08:09.576 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417_vm 2023-10-14T09:08:09.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418 2023-10-14T09:08:09.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418_vm 2023-10-14T09:08:09.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 174 2023-10-14T09:08:09.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 175 2023-10-14T09:08:09.577 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2187 2023-10-14T09:08:09.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224 2023-10-14T09:08:09.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224_vm 2023-10-14T09:08:09.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328 2023-10-14T09:08:09.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328_vm 2023-10-14T09:08:09.578 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336 2023-10-14T09:08:09.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336_vm 2023-10-14T09:08:09.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2337 2023-10-14T09:08:09.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2600 2023-10-14T09:08:09.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2600_fsm 2023-10-14T09:08:09.579 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2600_vm 2023-10-14T09:08:09.580 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601 2023-10-14T09:08:09.580 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2601_fsm 2023-10-14T09:08:09.580 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601_vm 2023-10-14T09:08:09.580 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2602 2023-10-14T09:08:09.580 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2602_fsm 2023-10-14T09:08:09.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2602_vm 2023-10-14T09:08:09.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2603 2023-10-14T09:08:09.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2603_fsm 2023-10-14T09:08:09.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2603_vm 2023-10-14T09:08:09.581 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604 2023-10-14T09:08:09.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604_vm 2023-10-14T09:08:09.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2605 2023-10-14T09:08:09.582 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2605_fsm 2023-10-14T09:08:09.583 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2605_vm 2023-10-14T09:08:09.583 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606 2023-10-14T09:08:09.583 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2606_fsm 2023-10-14T09:08:09.583 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2606_vm 2023-10-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607 2023-10-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607_fsm 2023-10-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2607_vm 2023-10-14T09:08:09.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 14 08:52 2608 2023-10-14T09:08:09.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2608_fsm 2023-10-14T09:08:09.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2608_vm 2023-10-14T09:08:09.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 14 08:52 2609 2023-10-14T09:08:09.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2609_fsm 2023-10-14T09:08:09.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2609_vm 2023-10-14T09:08:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610 2023-10-14T09:08:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2610_fsm 2023-10-14T09:08:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2610_vm 2023-10-14T09:08:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611 2023-10-14T09:08:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611_vm 2023-10-14T09:08:09.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612 2023-10-14T09:08:09.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2612_fsm 2023-10-14T09:08:09.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612_vm 2023-10-14T09:08:09.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613 2023-10-14T09:08:09.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613_vm 2023-10-14T09:08:09.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615 2023-10-14T09:08:09.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2615_fsm 2023-10-14T09:08:09.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615_vm 2023-10-14T09:08:09.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616 2023-10-14T09:08:09.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616_fsm 2023-10-14T09:08:09.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2616_vm 2023-10-14T09:08:09.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 14 08:52 2617 2023-10-14T09:08:09.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2617_fsm 2023-10-14T09:08:09.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2617_vm 2023-10-14T09:08:09.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 14 08:52 2618 2023-10-14T09:08:09.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2618_fsm 2023-10-14T09:08:09.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2618_vm 2023-10-14T09:08:09.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 14 08:52 2619 2023-10-14T09:08:09.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2619_fsm 2023-10-14T09:08:09.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2619_vm 2023-10-14T09:08:09.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620 2023-10-14T09:08:09.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620_vm 2023-10-14T09:08:09.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2650 2023-10-14T09:08:09.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2651 2023-10-14T09:08:09.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2652 2023-10-14T09:08:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2653 2023-10-14T09:08:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2654 2023-10-14T09:08:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2655 2023-10-14T09:08:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2656 2023-10-14T09:08:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2657 2023-10-14T09:08:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 14 08:52 2658 2023-10-14T09:08:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2659 2023-10-14T09:08:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2660 2023-10-14T09:08:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2661 2023-10-14T09:08:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2662 2023-10-14T09:08:09.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2663 2023-10-14T09:08:09.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2664 2023-10-14T09:08:09.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2665 2023-10-14T09:08:09.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2666 2023-10-14T09:08:09.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2667 2023-10-14T09:08:09.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2668 2023-10-14T09:08:09.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2669 2023-10-14T09:08:09.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2670 2023-10-14T09:08:09.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 14 08:52 2673 2023-10-14T09:08:09.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 14 08:52 2674 2023-10-14T09:08:09.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 14 08:52 2675 2023-10-14T09:08:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2678 2023-10-14T09:08:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2679 2023-10-14T09:08:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2680 2023-10-14T09:08:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2681 2023-10-14T09:08:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2682 2023-10-14T09:08:09.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2683 2023-10-14T09:08:09.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2684 2023-10-14T09:08:09.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2685 2023-10-14T09:08:09.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2686 2023-10-14T09:08:09.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2687 2023-10-14T09:08:09.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2688 2023-10-14T09:08:09.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2689 2023-10-14T09:08:09.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2690 2023-10-14T09:08:09.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 14 08:52 2691 2023-10-14T09:08:09.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2692 2023-10-14T09:08:09.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2693 2023-10-14T09:08:09.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2696 2023-10-14T09:08:09.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2699 2023-10-14T09:08:09.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2701 2023-10-14T09:08:09.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2702 2023-10-14T09:08:09.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2703 2023-10-14T09:08:09.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2704 2023-10-14T09:08:09.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2753 2023-10-14T09:08:09.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2753_fsm 2023-10-14T09:08:09.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2753_vm 2023-10-14T09:08:09.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2754 2023-10-14T09:08:09.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2755 2023-10-14T09:08:09.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2756 2023-10-14T09:08:09.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2757 2023-10-14T09:08:09.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830 2023-10-14T09:08:09.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830_vm 2023-10-14T09:08:09.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2831 2023-10-14T09:08:09.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832 2023-10-14T09:08:09.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832_vm 2023-10-14T09:08:09.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2833 2023-10-14T09:08:09.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834 2023-10-14T09:08:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834_vm 2023-10-14T09:08:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2835 2023-10-14T09:08:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836 2023-10-14T09:08:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836_vm 2023-10-14T09:08:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2837 2023-10-14T09:08:09.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 14 08:52 2838 2023-10-14T09:08:09.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2838_fsm 2023-10-14T09:08:09.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2838_vm 2023-10-14T09:08:09.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2839 2023-10-14T09:08:09.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840 2023-10-14T09:08:09.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840_fsm 2023-10-14T09:08:09.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2840_vm 2023-10-14T09:08:09.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2841 2023-10-14T09:08:09.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995 2023-10-14T09:08:09.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995_vm 2023-10-14T09:08:09.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2996 2023-10-14T09:08:09.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079 2023-10-14T09:08:09.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3079_fsm 2023-10-14T09:08:09.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079_vm 2023-10-14T09:08:09.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3080 2023-10-14T09:08:09.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3081 2023-10-14T09:08:09.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3085 2023-10-14T09:08:09.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118 2023-10-14T09:08:09.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118_vm 2023-10-14T09:08:09.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3119 2023-10-14T09:08:09.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3164 2023-10-14T09:08:09.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256 2023-10-14T09:08:09.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256_vm 2023-10-14T09:08:09.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3257 2023-10-14T09:08:09.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3258 2023-10-14T09:08:09.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350 2023-10-14T09:08:09.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350_vm 2023-10-14T09:08:09.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3351 2023-10-14T09:08:09.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3379 2023-10-14T09:08:09.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3380 2023-10-14T09:08:09.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381 2023-10-14T09:08:09.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381_vm 2023-10-14T09:08:09.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3394 2023-10-14T09:08:09.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3394_fsm 2023-10-14T09:08:09.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3394_vm 2023-10-14T09:08:09.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3395 2023-10-14T09:08:09.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439 2023-10-14T09:08:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439_vm 2023-10-14T09:08:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3440 2023-10-14T09:08:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 3455 2023-10-14T09:08:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3456 2023-10-14T09:08:09.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3456_fsm 2023-10-14T09:08:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3456_vm 2023-10-14T09:08:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466 2023-10-14T09:08:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466_vm 2023-10-14T09:08:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3467 2023-10-14T09:08:09.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3468 2023-10-14T09:08:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501 2023-10-14T09:08:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501_vm 2023-10-14T09:08:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3502 2023-10-14T09:08:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3503 2023-10-14T09:08:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3534 2023-10-14T09:08:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541 2023-10-14T09:08:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3541_fsm 2023-10-14T09:08:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541_vm 2023-10-14T09:08:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3542 2023-10-14T09:08:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3574 2023-10-14T09:08:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3575 2023-10-14T09:08:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576 2023-10-14T09:08:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576_vm 2023-10-14T09:08:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596 2023-10-14T09:08:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596_vm 2023-10-14T09:08:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3597 2023-10-14T09:08:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598 2023-10-14T09:08:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598_vm 2023-10-14T09:08:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3599 2023-10-14T09:08:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600 2023-10-14T09:08:09.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3600_fsm 2023-10-14T09:08:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600_vm 2023-10-14T09:08:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601 2023-10-14T09:08:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3601_fsm 2023-10-14T09:08:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601_vm 2023-10-14T09:08:09.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602 2023-10-14T09:08:09.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3602_fsm 2023-10-14T09:08:09.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602_vm 2023-10-14T09:08:09.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3603 2023-10-14T09:08:09.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3603_fsm 2023-10-14T09:08:09.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3603_vm 2023-10-14T09:08:09.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3604 2023-10-14T09:08:09.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3605 2023-10-14T09:08:09.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3606 2023-10-14T09:08:09.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3607 2023-10-14T09:08:09.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3608 2023-10-14T09:08:09.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 3609 2023-10-14T09:08:09.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3712 2023-10-14T09:08:09.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764 2023-10-14T09:08:09.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3764_fsm 2023-10-14T09:08:09.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764_vm 2023-10-14T09:08:09.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3766 2023-10-14T09:08:09.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3767 2023-10-14T09:08:09.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3997 2023-10-14T09:08:09.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 5002 2023-10-14T09:08:09.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 548 2023-10-14T09:08:09.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 549 2023-10-14T09:08:09.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102 2023-10-14T09:08:09.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102_vm 2023-10-14T09:08:09.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104 2023-10-14T09:08:09.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104_vm 2023-10-14T09:08:09.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106 2023-10-14T09:08:09.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106_vm 2023-10-14T09:08:09.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6110 2023-10-14T09:08:09.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6111 2023-10-14T09:08:09.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6112 2023-10-14T09:08:09.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6113 2023-10-14T09:08:09.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6117 2023-10-14T09:08:09.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826 2023-10-14T09:08:09.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826_vm 2023-10-14T09:08:09.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 827 2023-10-14T09:08:09.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 828 2023-10-14T09:08:09.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T09:08:09.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T09:08:09.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.625 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-14T09:08:09.625 INFO:teuthology.orchestra.run.smithi006.stdout:total 640496 2023-10-14T09:08:09.625 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Oct 14 08:53 . 2023-10-14T09:08:09.626 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 14 08:52 .. 2023-10-14T09:08:09.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 112 2023-10-14T09:08:09.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 113 2023-10-14T09:08:09.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 14 08:52 12182 2023-10-14T09:08:09.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12182_fsm 2023-10-14T09:08:09.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12182_vm 2023-10-14T09:08:09.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12184 2023-10-14T09:08:09.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12186 2023-10-14T09:08:09.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187 2023-10-14T09:08:09.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12187_fsm 2023-10-14T09:08:09.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12187_vm 2023-10-14T09:08:09.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12189 2023-10-14T09:08:09.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12191 2023-10-14T09:08:09.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192 2023-10-14T09:08:09.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12192_fsm 2023-10-14T09:08:09.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12192_vm 2023-10-14T09:08:09.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12194 2023-10-14T09:08:09.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12196 2023-10-14T09:08:09.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197 2023-10-14T09:08:09.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12197_fsm 2023-10-14T09:08:09.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12197_vm 2023-10-14T09:08:09.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12199 2023-10-14T09:08:09.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12201 2023-10-14T09:08:09.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202 2023-10-14T09:08:09.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12202_fsm 2023-10-14T09:08:09.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12202_vm 2023-10-14T09:08:09.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12204 2023-10-14T09:08:09.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12206 2023-10-14T09:08:09.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207 2023-10-14T09:08:09.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 12207_fsm 2023-10-14T09:08:09.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12207_vm 2023-10-14T09:08:09.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12209 2023-10-14T09:08:09.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12211 2023-10-14T09:08:09.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12212 2023-10-14T09:08:09.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 12214 2023-10-14T09:08:09.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 12216 2023-10-14T09:08:09.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 14 08:53 1247 2023-10-14T09:08:09.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:53 1247_fsm 2023-10-14T09:08:09.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 1247_vm 2023-10-14T09:08:09.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 14 08:53 1249 2023-10-14T09:08:09.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:53 1249_fsm 2023-10-14T09:08:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 1249_vm 2023-10-14T09:08:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 14 08:52 1255 2023-10-14T09:08:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1255_fsm 2023-10-14T09:08:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1255_vm 2023-10-14T09:08:09.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 09:08 1259 2023-10-14T09:08:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1259_fsm 2023-10-14T09:08:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 1259_vm 2023-10-14T09:08:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417 2023-10-14T09:08:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1417_vm 2023-10-14T09:08:09.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418 2023-10-14T09:08:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 1418_vm 2023-10-14T09:08:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 5128192 Oct 14 09:08 16387 2023-10-14T09:08:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 09:08 16387_fsm 2023-10-14T09:08:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 09:08 16387_vm 2023-10-14T09:08:09.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 909312 Oct 14 09:08 16393 2023-10-14T09:08:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 09:08 16393_fsm 2023-10-14T09:08:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 09:08 16393_vm 2023-10-14T09:08:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 468672512 Oct 14 09:08 16396 2023-10-14T09:08:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Oct 14 09:07 16396_fsm 2023-10-14T09:08:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:55 16396_vm 2023-10-14T09:08:09.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 14 09:08 16397 2023-10-14T09:08:09.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 614400 Oct 14 09:08 16399 2023-10-14T09:08:09.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 72384512 Oct 14 09:08 16401 2023-10-14T09:08:09.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 100229120 Oct 14 09:08 16403 2023-10-14T09:08:09.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 09:08 16403_fsm 2023-10-14T09:08:09.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 174 2023-10-14T09:08:09.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 175 2023-10-14T09:08:09.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2187 2023-10-14T09:08:09.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224 2023-10-14T09:08:09.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2224_vm 2023-10-14T09:08:09.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328 2023-10-14T09:08:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2328_vm 2023-10-14T09:08:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336 2023-10-14T09:08:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2336_vm 2023-10-14T09:08:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2337 2023-10-14T09:08:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2600 2023-10-14T09:08:09.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2600_fsm 2023-10-14T09:08:09.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2600_vm 2023-10-14T09:08:09.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601 2023-10-14T09:08:09.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2601_fsm 2023-10-14T09:08:09.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2601_vm 2023-10-14T09:08:09.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2602 2023-10-14T09:08:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2602_fsm 2023-10-14T09:08:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2602_vm 2023-10-14T09:08:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2603 2023-10-14T09:08:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2603_fsm 2023-10-14T09:08:09.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2603_vm 2023-10-14T09:08:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604 2023-10-14T09:08:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2604_vm 2023-10-14T09:08:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2605 2023-10-14T09:08:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2605_fsm 2023-10-14T09:08:09.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2605_vm 2023-10-14T09:08:09.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 2606 2023-10-14T09:08:09.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2606_fsm 2023-10-14T09:08:09.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 2606_vm 2023-10-14T09:08:09.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607 2023-10-14T09:08:09.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2607_fsm 2023-10-14T09:08:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2607_vm 2023-10-14T09:08:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Oct 14 08:53 2608 2023-10-14T09:08:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:53 2608_fsm 2023-10-14T09:08:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 2608_vm 2023-10-14T09:08:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 14 08:52 2609 2023-10-14T09:08:09.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2609_fsm 2023-10-14T09:08:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2609_vm 2023-10-14T09:08:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:53 2610 2023-10-14T09:08:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:53 2610_fsm 2023-10-14T09:08:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 2610_vm 2023-10-14T09:08:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611 2023-10-14T09:08:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2611_vm 2023-10-14T09:08:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612 2023-10-14T09:08:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2612_fsm 2023-10-14T09:08:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2612_vm 2023-10-14T09:08:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613 2023-10-14T09:08:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2613_vm 2023-10-14T09:08:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615 2023-10-14T09:08:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2615_fsm 2023-10-14T09:08:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2615_vm 2023-10-14T09:08:09.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616 2023-10-14T09:08:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2616_fsm 2023-10-14T09:08:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2616_vm 2023-10-14T09:08:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 14 08:52 2617 2023-10-14T09:08:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2617_fsm 2023-10-14T09:08:09.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2617_vm 2023-10-14T09:08:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 14 08:52 2618 2023-10-14T09:08:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2618_fsm 2023-10-14T09:08:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2618_vm 2023-10-14T09:08:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Oct 14 09:08 2619 2023-10-14T09:08:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:57 2619_fsm 2023-10-14T09:08:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 2619_vm 2023-10-14T09:08:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620 2023-10-14T09:08:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2620_vm 2023-10-14T09:08:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2650 2023-10-14T09:08:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2651 2023-10-14T09:08:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2652 2023-10-14T09:08:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2653 2023-10-14T09:08:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2654 2023-10-14T09:08:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2655 2023-10-14T09:08:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2656 2023-10-14T09:08:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2657 2023-10-14T09:08:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Oct 14 08:53 2658 2023-10-14T09:08:09.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:53 2659 2023-10-14T09:08:09.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2660 2023-10-14T09:08:09.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2661 2023-10-14T09:08:09.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:53 2662 2023-10-14T09:08:09.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:53 2663 2023-10-14T09:08:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2664 2023-10-14T09:08:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2665 2023-10-14T09:08:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2666 2023-10-14T09:08:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2667 2023-10-14T09:08:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2668 2023-10-14T09:08:09.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2669 2023-10-14T09:08:09.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2670 2023-10-14T09:08:09.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 14 08:53 2673 2023-10-14T09:08:09.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 14 08:53 2674 2023-10-14T09:08:09.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 14 08:52 2675 2023-10-14T09:08:09.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2678 2023-10-14T09:08:09.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2679 2023-10-14T09:08:09.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2680 2023-10-14T09:08:09.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2681 2023-10-14T09:08:09.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2682 2023-10-14T09:08:09.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2683 2023-10-14T09:08:09.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2684 2023-10-14T09:08:09.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2685 2023-10-14T09:08:09.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2686 2023-10-14T09:08:09.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2687 2023-10-14T09:08:09.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:52 2688 2023-10-14T09:08:09.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 14 08:52 2689 2023-10-14T09:08:09.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 14 08:52 2690 2023-10-14T09:08:09.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 14 08:52 2691 2023-10-14T09:08:09.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2692 2023-10-14T09:08:09.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2693 2023-10-14T09:08:09.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:57 2696 2023-10-14T09:08:09.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2699 2023-10-14T09:08:09.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2701 2023-10-14T09:08:09.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2702 2023-10-14T09:08:09.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:53 2703 2023-10-14T09:08:09.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:53 2704 2023-10-14T09:08:09.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2753 2023-10-14T09:08:09.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2753_fsm 2023-10-14T09:08:09.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2753_vm 2023-10-14T09:08:09.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2754 2023-10-14T09:08:09.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2755 2023-10-14T09:08:09.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2756 2023-10-14T09:08:09.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 2757 2023-10-14T09:08:09.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830 2023-10-14T09:08:09.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2830_vm 2023-10-14T09:08:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2831 2023-10-14T09:08:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832 2023-10-14T09:08:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2832_vm 2023-10-14T09:08:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2833 2023-10-14T09:08:09.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834 2023-10-14T09:08:09.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2834_vm 2023-10-14T09:08:09.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2835 2023-10-14T09:08:09.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836 2023-10-14T09:08:09.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2836_vm 2023-10-14T09:08:09.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2837 2023-10-14T09:08:09.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 14 08:52 2838 2023-10-14T09:08:09.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2838_fsm 2023-10-14T09:08:09.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2838_vm 2023-10-14T09:08:09.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2839 2023-10-14T09:08:09.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840 2023-10-14T09:08:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2840_fsm 2023-10-14T09:08:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2840_vm 2023-10-14T09:08:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2841 2023-10-14T09:08:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995 2023-10-14T09:08:09.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2995_vm 2023-10-14T09:08:09.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2996 2023-10-14T09:08:09.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079 2023-10-14T09:08:09.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3079_fsm 2023-10-14T09:08:09.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3079_vm 2023-10-14T09:08:09.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3080 2023-10-14T09:08:09.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3081 2023-10-14T09:08:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3085 2023-10-14T09:08:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118 2023-10-14T09:08:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3118_vm 2023-10-14T09:08:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3119 2023-10-14T09:08:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3164 2023-10-14T09:08:09.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256 2023-10-14T09:08:09.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3256_vm 2023-10-14T09:08:09.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3257 2023-10-14T09:08:09.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3258 2023-10-14T09:08:09.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350 2023-10-14T09:08:09.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3350_vm 2023-10-14T09:08:09.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3351 2023-10-14T09:08:09.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3379 2023-10-14T09:08:09.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3380 2023-10-14T09:08:09.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381 2023-10-14T09:08:09.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3381_vm 2023-10-14T09:08:09.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3394 2023-10-14T09:08:09.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3394_fsm 2023-10-14T09:08:09.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3394_vm 2023-10-14T09:08:09.670 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3395 2023-10-14T09:08:09.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439 2023-10-14T09:08:09.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3439_vm 2023-10-14T09:08:09.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3440 2023-10-14T09:08:09.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 14 08:53 3455 2023-10-14T09:08:09.671 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3456 2023-10-14T09:08:09.673 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3456_fsm 2023-10-14T09:08:09.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3456_vm 2023-10-14T09:08:09.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466 2023-10-14T09:08:09.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3466_vm 2023-10-14T09:08:09.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3467 2023-10-14T09:08:09.674 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3468 2023-10-14T09:08:09.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501 2023-10-14T09:08:09.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3501_vm 2023-10-14T09:08:09.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3502 2023-10-14T09:08:09.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3503 2023-10-14T09:08:09.675 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3534 2023-10-14T09:08:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541 2023-10-14T09:08:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3541_fsm 2023-10-14T09:08:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3541_vm 2023-10-14T09:08:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3542 2023-10-14T09:08:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3574 2023-10-14T09:08:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3575 2023-10-14T09:08:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576 2023-10-14T09:08:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3576_vm 2023-10-14T09:08:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596 2023-10-14T09:08:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3596_vm 2023-10-14T09:08:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3597 2023-10-14T09:08:09.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598 2023-10-14T09:08:09.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3598_vm 2023-10-14T09:08:09.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3599 2023-10-14T09:08:09.678 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600 2023-10-14T09:08:09.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3600_fsm 2023-10-14T09:08:09.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3600_vm 2023-10-14T09:08:09.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601 2023-10-14T09:08:09.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3601_fsm 2023-10-14T09:08:09.679 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3601_vm 2023-10-14T09:08:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602 2023-10-14T09:08:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3602_fsm 2023-10-14T09:08:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3602_vm 2023-10-14T09:08:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3603 2023-10-14T09:08:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3603_fsm 2023-10-14T09:08:09.680 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3603_vm 2023-10-14T09:08:09.681 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3604 2023-10-14T09:08:09.681 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3605 2023-10-14T09:08:09.681 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3606 2023-10-14T09:08:09.681 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3607 2023-10-14T09:08:09.681 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3608 2023-10-14T09:08:09.682 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 14 08:52 3609 2023-10-14T09:08:09.682 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3712 2023-10-14T09:08:09.682 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764 2023-10-14T09:08:09.682 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 3764_fsm 2023-10-14T09:08:09.682 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3764_vm 2023-10-14T09:08:09.683 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3766 2023-10-14T09:08:09.683 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 3767 2023-10-14T09:08:09.683 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3997 2023-10-14T09:08:09.683 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 5002 2023-10-14T09:08:09.683 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 548 2023-10-14T09:08:09.684 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 549 2023-10-14T09:08:09.684 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102 2023-10-14T09:08:09.684 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6102_vm 2023-10-14T09:08:09.684 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104 2023-10-14T09:08:09.684 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6104_vm 2023-10-14T09:08:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106 2023-10-14T09:08:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6106_vm 2023-10-14T09:08:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6110 2023-10-14T09:08:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6111 2023-10-14T09:08:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6112 2023-10-14T09:08:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6113 2023-10-14T09:08:09.686 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6117 2023-10-14T09:08:09.686 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826 2023-10-14T09:08:09.686 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 826_vm 2023-10-14T09:08:09.686 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 827 2023-10-14T09:08:09.686 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 828 2023-10-14T09:08:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T09:08:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Oct 14 08:52 pg_internal.init 2023-10-14T09:08:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 08:52 PG_VERSION 2023-10-14T09:08:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-10-14T09:08:09.688 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.688 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:53 . 2023-10-14T09:08:09.688 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Oct 14 08:52 .. 2023-10-14T09:08:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.688 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/global: 2023-10-14T09:08:09.689 INFO:teuthology.orchestra.run.smithi006.stdout:total 574 2023-10-14T09:08:09.689 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Oct 14 08:52 . 2023-10-14T09:08:09.689 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.689 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1136 2023-10-14T09:08:09.689 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1136_fsm 2023-10-14T09:08:09.689 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1136_vm 2023-10-14T09:08:09.690 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 1137 2023-10-14T09:08:09.690 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1213 2023-10-14T09:08:09.690 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1213_fsm 2023-10-14T09:08:09.690 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1213_vm 2023-10-14T09:08:09.690 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1214 2023-10-14T09:08:09.691 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1214_fsm 2023-10-14T09:08:09.691 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1214_vm 2023-10-14T09:08:09.691 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 1232 2023-10-14T09:08:09.691 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 1233 2023-10-14T09:08:09.691 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1260 2023-10-14T09:08:09.692 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1260_fsm 2023-10-14T09:08:09.692 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1260_vm 2023-10-14T09:08:09.692 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1261 2023-10-14T09:08:09.692 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1261_fsm 2023-10-14T09:08:09.692 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1261_vm 2023-10-14T09:08:09.692 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1262 2023-10-14T09:08:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 1262_fsm 2023-10-14T09:08:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 1262_vm 2023-10-14T09:08:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2396 2023-10-14T09:08:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 14 08:52 2396_fsm 2023-10-14T09:08:09.693 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2396_vm 2023-10-14T09:08:09.694 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2397 2023-10-14T09:08:09.694 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2671 2023-10-14T09:08:09.694 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2672 2023-10-14T09:08:09.694 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2676 2023-10-14T09:08:09.694 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2677 2023-10-14T09:08:09.695 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2694 2023-10-14T09:08:09.695 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2695 2023-10-14T09:08:09.695 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2697 2023-10-14T09:08:09.695 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 14 08:52 2698 2023-10-14T09:08:09.695 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2846 2023-10-14T09:08:09.696 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2846_vm 2023-10-14T09:08:09.696 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2847 2023-10-14T09:08:09.696 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2964 2023-10-14T09:08:09.696 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2964_vm 2023-10-14T09:08:09.696 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2965 2023-10-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2966 2023-10-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 2966_vm 2023-10-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 2967 2023-10-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3592 2023-10-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 3592_vm 2023-10-14T09:08:09.697 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 3593 2023-10-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 4060 2023-10-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 4060_vm 2023-10-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 4061 2023-10-14T09:08:09.698 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6000 2023-10-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6000_vm 2023-10-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6001 2023-10-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6002 2023-10-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6100 2023-10-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 6100_vm 2023-10-14T09:08:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6114 2023-10-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 6115 2023-10-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 09:08 pg_control 2023-10-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 14 08:52 pg_filenode.map 2023-10-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Oct 14 08:52 pg_internal.init 2023-10-14T09:08:09.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/log: 2023-10-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:total 3 2023-10-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2703 Oct 14 09:08 postgresql-Sat.log 2023-10-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.703 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:total 1 2023-10-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 09:08 . 2023-10-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 mappings 2023-10-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 14 09:08 replorigin_checkpoint 2023-10-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 snapshots 2023-10-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 09:08 .. 2023-10-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 09:08 .. 2023-10-14T09:08:09.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-14T09:08:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 . 2023-10-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 members 2023-10-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 offsets 2023-10-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 .. 2023-10-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T09:08:09.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:52 .. 2023-10-14T09:08:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:53 0000 2023-10-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi006.stdout:total 8 2023-10-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 08:52 . 2023-10-14T09:08:09.711 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 14 08:52 0000 2023-10-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.712 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.713 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.714 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi006.stdout:total 13 2023-10-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 14 09:08 . 2023-10-14T09:08:09.715 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Oct 14 09:08 db_0.stat 2023-10-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Oct 14 09:08 db_12347.stat 2023-10-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Oct 14 09:08 global.stat 2023-10-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.716 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 09:08 . 2023-10-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.717 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:total 256 2023-10-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Oct 14 09:08 . 2023-10-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Oct 14 09:08 001C 2023-10-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.719 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.720 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi006.stdout:total 1032192 2023-10-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 14 09:08 . 2023-10-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000027 2023-10-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000028 2023-10-14T09:08:09.721 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000029 2023-10-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000002A 2023-10-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000002B 2023-10-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000002C 2023-10-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000002D 2023-10-14T09:08:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000002E 2023-10-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000002F 2023-10-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000030 2023-10-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000031 2023-10-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000032 2023-10-14T09:08:09.723 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:08 000000010000000200000033 2023-10-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:08 000000010000000200000034 2023-10-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000035 2023-10-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000036 2023-10-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000037 2023-10-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000038 2023-10-14T09:08:09.724 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000039 2023-10-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000003A 2023-10-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000003B 2023-10-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000003C 2023-10-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000003D 2023-10-14T09:08:09.725 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000003E 2023-10-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000003F 2023-10-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000040 2023-10-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000041 2023-10-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000042 2023-10-14T09:08:09.726 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000043 2023-10-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000044 2023-10-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000045 2023-10-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000046 2023-10-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000047 2023-10-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000048 2023-10-14T09:08:09.727 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 000000010000000200000049 2023-10-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000004A 2023-10-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000004B 2023-10-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:05 00000001000000020000004C 2023-10-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000004D 2023-10-14T09:08:09.728 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000004E 2023-10-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000004F 2023-10-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000050 2023-10-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000051 2023-10-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000052 2023-10-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000053 2023-10-14T09:08:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000054 2023-10-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000055 2023-10-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000056 2023-10-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000057 2023-10-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000058 2023-10-14T09:08:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000059 2023-10-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000005A 2023-10-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000005B 2023-10-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000005C 2023-10-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000005D 2023-10-14T09:08:09.731 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 00000001000000020000005E 2023-10-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 00000001000000020000005F 2023-10-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000060 2023-10-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000061 2023-10-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000062 2023-10-14T09:08:09.732 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000063 2023-10-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:07 000000010000000200000064 2023-10-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 14 09:06 000000010000000200000065 2023-10-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 archive_status 2023-10-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.733 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi006.stdout:total 0 2023-10-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 14 08:52 . 2023-10-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Oct 14 09:08 .. 2023-10-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:09.734 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi006.stdout:total 464 2023-10-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Oct 14 08:59 . 2023-10-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi006.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Oct 14 09:08 .. 2023-10-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Oct 14 08:59 0000 2023-10-14T09:08:09.735 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 212992 Oct 14 09:08 0001 2023-10-14T09:08:09.737 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-14T09:08:09.748 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T09:08:09.756 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-14T09:08:09.765 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-14T09:08:09.766 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-14T09:08:09.766 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-14T09:08:09.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:08:09.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/2771606608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 msgr2=0x7f0fd4106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/2771606608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd4106680 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009990 tx=0x7f0fd0009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/2771606608 shutdown_connections 2023-10-14T09:08:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/2771606608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 0x7f0fd4109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/2771606608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 0x7f0fd4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:09.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/2771606608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd4106680 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/2771606608 >> 172.21.15.6:0/2771606608 conn(0x7f0fd40fb310 msgr2=0x7f0fd40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/2771606608 shutdown_connections 2023-10-14T09:08:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.926+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/2771606608 wait complete. 2023-10-14T09:08:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 Processor -- start 2023-10-14T09:08:09.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 -- start start 2023-10-14T09:08:09.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 0x7f0fd4196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:09.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd41970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:09.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 0x7f0fd419e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:09.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd419e710 con 0x7f0fd4104290 2023-10-14T09:08:09.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd419e850 con 0x7f0fd4101960 2023-10-14T09:08:09.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fdb9bf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd419e9e0 con 0x7f0fd4106bc0 2023-10-14T09:08:09.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd41970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:09.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd41970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36404/0 (socket says 172.21.15.6:36404) 2023-10-14T09:08:09.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 -- 172.21.15.6:0/3129417648 learned_addr learned my addr 172.21.15.6:0/3129417648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd9f5c700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 0x7f0fd419e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd975b700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 0x7f0fd4196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 -- 172.21.15.6:0/3129417648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 msgr2=0x7f0fd419e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 0x7f0fd419e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 -- 172.21.15.6:0/3129417648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 msgr2=0x7f0fd4196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:09.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 0x7f0fd4196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:09.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 -- 172.21.15.6:0/3129417648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd00095f0 con 0x7f0fd4104290 2023-10-14T09:08:09.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd9f5c700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 0x7f0fd419e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:08:09.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd975b700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 0x7f0fd4196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:08:09.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.927+0000 7f0fd8f5a700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd41970d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00059d0 tx=0x7f0fd0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:09.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.928+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd001d070 con 0x7f0fd4104290 2023-10-14T09:08:09.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.928+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0fd000fc40 con 0x7f0fd4104290 2023-10-14T09:08:09.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.928+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd419ec60 con 0x7f0fd4104290 2023-10-14T09:08:09.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.928+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0017650 con 0x7f0fd4104290 2023-10-14T09:08:09.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.928+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd419f080 con 0x7f0fd4104290 2023-10-14T09:08:09.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.929+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd40fce90 con 0x7f0fd4104290 2023-10-14T09:08:09.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.930+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f0fd0022470 con 0x7f0fd4104290 2023-10-14T09:08:09.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.931+0000 7f0fca7fc700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0fc00a1480 0x7f0fc00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:09.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.931+0000 7f0fd975b700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0fc00a1480 0x7f0fc00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.931+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f0fd00cea10 con 0x7f0fd4104290 2023-10-14T09:08:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.931+0000 7f0fd975b700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0fc00a1480 0x7f0fc00a3940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009be0 tx=0x7f0fc4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:09.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:09.934+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0fd0098100 con 0x7f0fd4104290 2023-10-14T09:08:10.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.141+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd402cf70 con 0x7f0fd4104290 2023-10-14T09:08:10.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.143+0000 7f0fca7fc700 1 -- 172.21.15.6:0/3129417648 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f0fd009b720 con 0x7f0fd4104290 2023-10-14T09:08:10.145 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:10.145 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:08:10.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0fc00a1480 msgr2=0x7f0fc00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0fc00a1480 0x7f0fc00a3940 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009be0 tx=0x7f0fc4009260 comp rx=0 tx=0).stop 2023-10-14T09:08:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 msgr2=0x7f0fd41970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd41970d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00059d0 tx=0x7f0fd0005ef0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 shutdown_connections 2023-10-14T09:08:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fd4106bc0 0x7f0fd419e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f0fc00a1480 0x7f0fc00a3940 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fd4101960 0x7f0fd4196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 --2- 172.21.15.6:0/3129417648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0fd4104290 0x7f0fd41970d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 >> 172.21.15.6:0/3129417648 conn(0x7f0fd40fb310 msgr2=0x7f0fd41025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 shutdown_connections 2023-10-14T09:08:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.145+0000 7f0fdb9bf700 1 -- 172.21.15.6:0/3129417648 wait complete. 2023-10-14T09:08:10.157 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:09 smithi006 ceph-mon[99452]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 2.14k op/s 2023-10-14T09:08:10.159 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:08:10.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:08:10.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 -- 172.21.15.6:0/2702302338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100ff0 msgr2=0x7f07a0101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 --2- 172.21.15.6:0/2702302338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100ff0 0x7f07a0101470 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0788009990 tx=0x7f0788009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 -- 172.21.15.6:0/2702302338 shutdown_connections 2023-10-14T09:08:10.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 --2- 172.21.15.6:0/2702302338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a01019b0 0x7f07a01082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 --2- 172.21.15.6:0/2702302338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a00ffea0 0x7f07a01002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 --2- 172.21.15.6:0/2702302338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a0100ff0 0x7f07a0101470 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 -- 172.21.15.6:0/2702302338 >> 172.21.15.6:0/2702302338 conn(0x7f07a00fb430 msgr2=0x7f07a00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:10.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 -- 172.21.15.6:0/2702302338 shutdown_connections 2023-10-14T09:08:10.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.289+0000 7f07a6317700 1 -- 172.21.15.6:0/2702302338 wait complete. 2023-10-14T09:08:10.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 Processor -- start 2023-10-14T09:08:10.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 -- start start 2023-10-14T09:08:10.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a00ffea0 0x7f07a0104180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0100ff0 0x7f07a01027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 0x7f07a0102d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01034a0 con 0x7f07a01019b0 2023-10-14T09:08:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a0103610 con 0x7f07a0100ff0 2023-10-14T09:08:10.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a6317700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a01a0cd0 con 0x7f07a00ffea0 2023-10-14T09:08:10.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 0x7f07a0102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 0x7f07a0102d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36420/0 (socket says 172.21.15.6:36420) 2023-10-14T09:08:10.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 -- 172.21.15.6:0/1038618284 learned_addr learned my addr 172.21.15.6:0/1038618284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:10.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f079f7fe700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0100ff0 0x7f07a01027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f079ffff700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a00ffea0 0x7f07a0104180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 -- 172.21.15.6:0/1038618284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a00ffea0 msgr2=0x7f07a0104180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a00ffea0 0x7f07a0104180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 -- 172.21.15.6:0/1038618284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0100ff0 msgr2=0x7f07a01027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0100ff0 0x7f07a01027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.290+0000 7f07a48b4700 1 -- 172.21.15.6:0/1038618284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880095f0 con 0x7f07a01019b0 2023-10-14T09:08:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.291+0000 7f07a48b4700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 0x7f07a0102d00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f079800ada0 tx=0x7f079800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.291+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800f070 con 0x7f07a01019b0 2023-10-14T09:08:10.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.291+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a01a0fb0 con 0x7f07a01019b0 2023-10-14T09:08:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.291+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0798007b30 con 0x7f07a01019b0 2023-10-14T09:08:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.291+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798005280 con 0x7f07a01019b0 2023-10-14T09:08:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.291+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01a13e0 con 0x7f07a01019b0 2023-10-14T09:08:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.292+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a0107fc0 con 0x7f07a01019b0 2023-10-14T09:08:10.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.293+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f079800a090 con 0x7f07a01019b0 2023-10-14T09:08:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.294+0000 7f079d7fa700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1480 0x7f078c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.294+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f07980cc7c0 con 0x7f07a01019b0 2023-10-14T09:08:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.294+0000 7f079ffff700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1480 0x7f078c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.294+0000 7f079ffff700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1480 0x7f078c0a3940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0790005950 tx=0x7f079000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:10.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.297+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0798099940 con 0x7f07a01019b0 2023-10-14T09:08:10.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:09 smithi178 ceph-mon[103612]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 2.14k op/s 2023-10-14T09:08:10.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:10 smithi057 ceph-mon[103313]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 2.14k op/s 2023-10-14T09:08:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.498+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07a010b860 con 0x7f07a01019b0 2023-10-14T09:08:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.498+0000 7f079d7fa700 1 -- 172.21.15.6:0/1038618284 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07980994d0 con 0x7f07a01019b0 2023-10-14T09:08:10.501 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T09:08:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1480 msgr2=0x7f078c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1480 0x7f078c0a3940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0790005950 tx=0x7f079000b410 comp rx=0 tx=0).stop 2023-10-14T09:08:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 msgr2=0x7f07a0102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 0x7f07a0102d00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f079800ada0 tx=0x7f079800c330 comp rx=0 tx=0).stop 2023-10-14T09:08:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 shutdown_connections 2023-10-14T09:08:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07a01019b0 0x7f07a0102d00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07a00ffea0 0x7f07a0104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f078c0a1480 0x7f078c0a3940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 --2- 172.21.15.6:0/1038618284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a0100ff0 0x7f07a01027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 >> 172.21.15.6:0/1038618284 conn(0x7f07a00fb430 msgr2=0x7f07a00fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 shutdown_connections 2023-10-14T09:08:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.500+0000 7f07a6317700 1 -- 172.21.15.6:0/1038618284 wait complete. 2023-10-14T09:08:10.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:08:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 -- 172.21.15.6:0/1174879249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 msgr2=0x7fe6c41082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 --2- 172.21.15.6:0/1174879249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c41082d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00b0a0 tx=0x7fe6bc00b3b0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 -- 172.21.15.6:0/1174879249 shutdown_connections 2023-10-14T09:08:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 --2- 172.21.15.6:0/1174879249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c41082d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 --2- 172.21.15.6:0/1174879249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c40ffea0 0x7fe6c41002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 --2- 172.21.15.6:0/1174879249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4100ff0 0x7fe6c4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 -- 172.21.15.6:0/1174879249 >> 172.21.15.6:0/1174879249 conn(0x7fe6c40fb430 msgr2=0x7fe6c40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 -- 172.21.15.6:0/1174879249 shutdown_connections 2023-10-14T09:08:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.644+0000 7fe6ca047700 1 -- 172.21.15.6:0/1174879249 wait complete. 2023-10-14T09:08:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 Processor -- start 2023-10-14T09:08:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 -- start start 2023-10-14T09:08:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c40ffea0 0x7fe6c4196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c4100ff0 0x7fe6c4197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419e890 con 0x7fe6c41019b0 2023-10-14T09:08:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419ea00 con 0x7fe6c4100ff0 2023-10-14T09:08:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6ca047700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c419ebc0 con 0x7fe6c40ffea0 2023-10-14T09:08:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c419e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36434/0 (socket says 172.21.15.6:36434) 2023-10-14T09:08:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 -- 172.21.15.6:0/2034250569 learned_addr learned my addr 172.21.15.6:0/2034250569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c2ffd700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c4100ff0 0x7fe6c4197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c37fe700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c40ffea0 0x7fe6c4196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 -- 172.21.15.6:0/2034250569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c40ffea0 msgr2=0x7fe6c4196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c40ffea0 0x7fe6c4196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 -- 172.21.15.6:0/2034250569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c4100ff0 msgr2=0x7fe6c4197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c4100ff0 0x7fe6c4197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.645+0000 7fe6c3fff700 1 -- 172.21.15.6:0/2034250569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc009d00 con 0x7fe6c41019b0 2023-10-14T09:08:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.646+0000 7fe6c3fff700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c419e2c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00d010 tx=0x7fe6bc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.646+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00e040 con 0x7fe6c41019b0 2023-10-14T09:08:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.646+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c419ee40 con 0x7fe6c41019b0 2023-10-14T09:08:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.646+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6bc004e30 con 0x7fe6c41019b0 2023-10-14T09:08:10.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.646+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc004020 con 0x7fe6c41019b0 2023-10-14T09:08:10.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.646+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c419f1b0 con 0x7fe6c41019b0 2023-10-14T09:08:10.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.647+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c4107380 con 0x7fe6c41019b0 2023-10-14T09:08:10.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.648+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fe6bc01d690 con 0x7fe6c41019b0 2023-10-14T09:08:10.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.648+0000 7fe6c0ff9700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6ac0a1480 0x7fe6ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:10.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.649+0000 7fe6c37fe700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6ac0a1480 0x7fe6ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:10.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.649+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fe6bc0ce490 con 0x7fe6c41019b0 2023-10-14T09:08:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.649+0000 7fe6c37fe700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6ac0a1480 0x7fe6ac0a3940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4198220 tx=0x7fe6b800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.653+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe6bc097b80 con 0x7fe6c41019b0 2023-10-14T09:08:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.856+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6c402d1a0 con 0x7fe6c41019b0 2023-10-14T09:08:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.857+0000 7fe6c0ff9700 1 -- 172.21.15.6:0/2034250569 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6bc09b1a0 con 0x7fe6c41019b0 2023-10-14T09:08:10.859 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T09:08:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6ac0a1480 msgr2=0x7fe6ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6ac0a1480 0x7fe6ac0a3940 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4198220 tx=0x7fe6b800a380 comp rx=0 tx=0).stop 2023-10-14T09:08:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 msgr2=0x7fe6c419e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c419e2c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00d010 tx=0x7fe6bc004c80 comp rx=0 tx=0).stop 2023-10-14T09:08:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 shutdown_connections 2023-10-14T09:08:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6c41019b0 0x7fe6c419e2c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c40ffea0 0x7fe6c4196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fe6ac0a1480 0x7fe6ac0a3940 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 --2- 172.21.15.6:0/2034250569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c4100ff0 0x7fe6c4197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 >> 172.21.15.6:0/2034250569 conn(0x7fe6c40fb430 msgr2=0x7fe6c41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 shutdown_connections 2023-10-14T09:08:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:10.859+0000 7fe6ca047700 1 -- 172.21.15.6:0/2034250569 wait complete. 2023-10-14T09:08:10.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:08:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 -- 172.21.15.6:0/172690292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c101a60 msgr2=0x7f869c103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 --2- 172.21.15.6:0/172690292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c101a60 0x7f869c103e50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8690009990 tx=0x7f8690009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 -- 172.21.15.6:0/172690292 shutdown_connections 2023-10-14T09:08:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 --2- 172.21.15.6:0/172690292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869c106cc0 0x7f869c109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 --2- 172.21.15.6:0/172690292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c101a60 0x7f869c103e50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 --2- 172.21.15.6:0/172690292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c104390 0x7f869c106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 -- 172.21.15.6:0/172690292 >> 172.21.15.6:0/172690292 conn(0x7f869c0fb450 msgr2=0x7f869c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 -- 172.21.15.6:0/172690292 shutdown_connections 2023-10-14T09:08:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.001+0000 7f86a312c700 1 -- 172.21.15.6:0/172690292 wait complete. 2023-10-14T09:08:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 Processor -- start 2023-10-14T09:08:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 -- start start 2023-10-14T09:08:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869c101a60 0x7f869c1013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c104390 0x7f869c0ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 0x7f869c0fff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c1006f0 con 0x7f869c106cc0 2023-10-14T09:08:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c100860 con 0x7f869c104390 2023-10-14T09:08:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a312c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c1a0d00 con 0x7f869c101a60 2023-10-14T09:08:11.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a16c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 0x7f869c0fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a16c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 0x7f869c0fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36448/0 (socket says 172.21.15.6:36448) 2023-10-14T09:08:11.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a16c9700 1 -- 172.21.15.6:0/2465611577 learned_addr learned my addr 172.21.15.6:0/2465611577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:11.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.002+0000 7f86a0ec8700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869c101a60 0x7f869c1013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f869bfff700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c104390 0x7f869c0ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a16c9700 1 -- 172.21.15.6:0/2465611577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869c101a60 msgr2=0x7f869c1013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a16c9700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869c101a60 0x7f869c1013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a16c9700 1 -- 172.21.15.6:0/2465611577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c104390 msgr2=0x7f869c0ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a16c9700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c104390 0x7f869c0ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a16c9700 1 -- 172.21.15.6:0/2465611577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86900095f0 con 0x7f869c106cc0 2023-10-14T09:08:11.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a16c9700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 0x7f869c0fff50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8694007ee0 tx=0x7f869400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:11.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869400dd20 con 0x7f869c106cc0 2023-10-14T09:08:11.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f869400f040 con 0x7f869c106cc0 2023-10-14T09:08:11.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c1a0fe0 con 0x7f869c106cc0 2023-10-14T09:08:11.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940048a0 con 0x7f869c106cc0 2023-10-14T09:08:11.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.003+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c1a1410 con 0x7f869c106cc0 2023-10-14T09:08:11.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.004+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c0fcfd0 con 0x7f869c106cc0 2023-10-14T09:08:11.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.005+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f8694003a00 con 0x7f869c106cc0 2023-10-14T09:08:11.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.006+0000 7f8699ffb700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f868c0a1480 0x7f868c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.006+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f86940ccd80 con 0x7f869c106cc0 2023-10-14T09:08:11.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.006+0000 7f86a0ec8700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f868c0a1480 0x7f868c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.007+0000 7f86a0ec8700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f868c0a1480 0x7f868c0a3940 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f869000b2e0 tx=0x7f8690005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:11.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.009+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f86940963a0 con 0x7f869c106cc0 2023-10-14T09:08:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.213+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f869c10ca60 con 0x7f869c106cc0 2023-10-14T09:08:11.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.213+0000 7f8699ffb700 1 -- 172.21.15.6:0/2465611577 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86940230a0 con 0x7f869c106cc0 2023-10-14T09:08:11.215 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T09:08:11.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f868c0a1480 msgr2=0x7f868c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f868c0a1480 0x7f868c0a3940 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f869000b2e0 tx=0x7f8690005fb0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 msgr2=0x7f869c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 0x7f869c0fff50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8694007ee0 tx=0x7f869400d3b0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 shutdown_connections 2023-10-14T09:08:11.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f869c106cc0 0x7f869c0fff50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869c101a60 0x7f869c1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f868c0a1480 0x7f868c0a3940 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 --2- 172.21.15.6:0/2465611577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c104390 0x7f869c0ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 >> 172.21.15.6:0/2465611577 conn(0x7f869c0fb450 msgr2=0x7f869c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:11.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 shutdown_connections 2023-10-14T09:08:11.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.215+0000 7f86a312c700 1 -- 172.21.15.6:0/2465611577 wait complete. 2023-10-14T09:08:11.228 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3129417648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:11.228 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1038618284' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T09:08:11.229 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:10 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2034250569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T09:08:11.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-14T09:08:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.354+0000 7fa1103c7700 1 -- 172.21.15.6:0/524685286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 msgr2=0x7fa1081003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.354+0000 7fa1103c7700 1 --2- 172.21.15.6:0/524685286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa1081003d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009990 tx=0x7fa0f8009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- 172.21.15.6:0/524685286 shutdown_connections 2023-10-14T09:08:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 --2- 172.21.15.6:0/524685286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa108100910 0x7fa108108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 --2- 172.21.15.6:0/524685286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108101300 0x7fa108101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 --2- 172.21.15.6:0/524685286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa1081003d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- 172.21.15.6:0/524685286 >> 172.21.15.6:0/524685286 conn(0x7fa1080faa80 msgr2=0x7fa1080fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- 172.21.15.6:0/524685286 shutdown_connections 2023-10-14T09:08:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- 172.21.15.6:0/524685286 wait complete. 2023-10-14T09:08:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 Processor -- start 2023-10-14T09:08:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- start start 2023-10-14T09:08:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa108196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108100910 0x7fa108197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa108101300 0x7fa10819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10819e680 con 0x7fa1080fff50 2023-10-14T09:08:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10819e7c0 con 0x7fa108100910 2023-10-14T09:08:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.355+0000 7fa1103c7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10819e950 con 0x7fa108101300 2023-10-14T09:08:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa108196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa108196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36458/0 (socket says 172.21.15.6:36458) 2023-10-14T09:08:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 -- 172.21.15.6:0/97476911 learned_addr learned my addr 172.21.15.6:0/97476911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10d962700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108100910 0x7fa108197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 -- 172.21.15.6:0/97476911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa108101300 msgr2=0x7fa10819e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa108101300 0x7fa10819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 -- 172.21.15.6:0/97476911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108100910 msgr2=0x7fa108197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108100910 0x7fa108197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 -- 172.21.15.6:0/97476911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f80095f0 con 0x7fa1080fff50 2023-10-14T09:08:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa10e163700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa108196b00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c990 tx=0x7fa10400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:11.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104007b00 con 0x7fa1080fff50 2023-10-14T09:08:11.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa104007c60 con 0x7fa1080fff50 2023-10-14T09:08:11.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10819ec30 con 0x7fa1080fff50 2023-10-14T09:08:11.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104018660 con 0x7fa1080fff50 2023-10-14T09:08:11.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.356+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10819f140 con 0x7fa1080fff50 2023-10-14T09:08:11.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.357+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10810b5f0 con 0x7fa1080fff50 2023-10-14T09:08:11.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.358+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fa10400f450 con 0x7fa1080fff50 2023-10-14T09:08:11.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.359+0000 7fa0ff7fe700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa0f40a1480 0x7fa0f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:11.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.359+0000 7fa10d962700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa0f40a1480 0x7fa0f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:11.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.359+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fa1040ccd00 con 0x7fa1080fff50 2023-10-14T09:08:11.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.359+0000 7fa10d962700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa0f40a1480 0x7fa0f40a3940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800b5c0 tx=0x7fa0f8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:11.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.362+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa1040963f0 con 0x7fa1080fff50 2023-10-14T09:08:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3129417648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1038618284' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T09:08:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:10 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2034250569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T09:08:11.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:11 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3129417648' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:11 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1038618284' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T09:08:11.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:11 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2034250569' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T09:08:11.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.627+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fa10810b7c0 con 0x7fa1080fff50 2023-10-14T09:08:11.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.635+0000 7fa0ff7fe700 1 -- 172.21.15.6:0/97476911 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733866 (secure 0 0 0) 0x7fa104099a10 con 0x7fa1080fff50 2023-10-14T09:08:11.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:11.646 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T09:08:11.646 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 18, 2023-10-14T09:08:11.647 INFO:teuthology.orchestra.run.smithi006.stdout: "active_gid": 14152, 2023-10-14T09:08:11.647 INFO:teuthology.orchestra.run.smithi006.stdout: "active_name": "x", 2023-10-14T09:08:11.647 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addrs": { 2023-10-14T09:08:11.647 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-14T09:08:11.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-14T09:08:11.648 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-10-14T09:08:11.648 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 827561147 2023-10-14T09:08:11.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-10-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-10-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 827561147 2023-10-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.650 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addr": "172.21.15.6:6801/827561147", 2023-10-14T09:08:11.650 INFO:teuthology.orchestra.run.smithi006.stdout: "active_change": "2023-10-14T08:45:03.353108+0000", 2023-10-14T09:08:11.650 INFO:teuthology.orchestra.run.smithi006.stdout: "active_mgr_features": 4540138322906710015, 2023-10-14T09:08:11.650 INFO:teuthology.orchestra.run.smithi006.stdout: "available": true, 2023-10-14T09:08:11.650 INFO:teuthology.orchestra.run.smithi006.stdout: "standbys": [ 2023-10-14T09:08:11.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.651 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24107, 2023-10-14T09:08:11.651 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "y", 2023-10-14T09:08:11.651 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540138322906710015, 2023-10-14T09:08:11.651 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2023-10-14T09:08:11.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.652 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2023-10-14T09:08:11.652 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:11.652 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:11.652 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:11.653 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:11.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:11.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.653 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:11.654 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.654 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2023-10-14T09:08:11.654 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.655 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:11.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:11.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.656 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.657 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.657 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.657 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.657 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.657 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.658 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.658 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.658 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.658 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.658 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.659 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.659 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.659 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:11.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:11.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.660 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.660 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.660 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.661 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.662 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:11.662 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:11.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.663 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:11.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.663 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.663 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.664 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.664 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.664 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.664 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.664 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.665 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.665 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.665 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.665 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.665 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.666 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.666 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:11.666 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:11.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.666 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.667 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.667 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.667 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.667 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.668 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.668 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.669 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2023-10-14T09:08:11.669 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2023-10-14T09:08:11.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.670 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.670 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.670 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.670 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2023-10-14T09:08:11.671 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.671 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2023-10-14T09:08:11.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2023-10-14T09:08:11.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.672 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.672 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2023-10-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2023-10-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.673 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2023-10-14T09:08:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2023-10-14T09:08:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.675 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.675 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.675 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.675 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.675 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.676 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.676 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2023-10-14T09:08:11.676 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.676 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.677 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2023-10-14T09:08:11.677 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2023-10-14T09:08:11.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.677 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.678 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.678 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.678 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.678 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.678 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2023-10-14T09:08:11.679 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.679 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.679 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.679 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2023-10-14T09:08:11.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2023-10-14T09:08:11.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.680 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2023-10-14T09:08:11.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.681 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.681 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2023-10-14T09:08:11.681 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.681 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.682 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.682 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2023-10-14T09:08:11.682 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2023-10-14T09:08:11.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.682 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.683 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2023-10-14T09:08:11.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.684 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2023-10-14T09:08:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2023-10-14T09:08:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.686 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.686 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.686 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-14T09:08:11.687 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.687 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2023-10-14T09:08:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2023-10-14T09:08:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.689 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.690 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.690 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2023-10-14T09:08:11.690 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.690 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.691 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.691 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2023-10-14T09:08:11.691 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:11.692 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:11.692 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:11.692 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2023-10-14T09:08:11.692 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2023-10-14T09:08:11.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.693 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.693 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.693 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.693 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.694 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.694 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2023-10-14T09:08:11.694 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.694 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.694 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.695 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2023-10-14T09:08:11.695 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2023-10-14T09:08:11.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.695 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.696 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2023-10-14T09:08:11.696 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.696 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.696 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2023-10-14T09:08:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-14T09:08:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2023-10-14T09:08:11.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2023-10-14T09:08:11.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:11.698 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:11.698 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-10-14T09:08:11.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-10-14T09:08:11.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-14T09:08:11.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-14T09:08:11.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.700 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2023-10-14T09:08:11.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2023-10-14T09:08:11.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:11.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2023-10-14T09:08:11.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:11.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2023-10-14T09:08:11.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-14T09:08:11.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.703 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2023-10-14T09:08:11.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2023-10-14T09:08:11.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.703 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2023-10-14T09:08:11.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.704 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-14T09:08:11.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-14T09:08:11.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.705 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.706 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2023-10-14T09:08:11.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2023-10-14T09:08:11.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:11.706 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.706 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2023-10-14T09:08:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2023-10-14T09:08:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2023-10-14T09:08:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2023-10-14T09:08:11.707 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-14T09:08:11.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.708 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2023-10-14T09:08:11.708 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2023-10-14T09:08:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2023-10-14T09:08:11.709 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2023-10-14T09:08:11.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-14T09:08:11.710 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2023-10-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2023-10-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:11.711 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:11.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-10-14T09:08:11.712 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-10-14T09:08:11.712 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-14T09:08:11.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-14T09:08:11.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.713 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.714 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:11.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:11.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.714 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.714 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.715 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.715 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.715 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.716 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.716 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.716 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.716 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.716 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.717 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.717 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.717 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.717 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.717 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.718 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:11.718 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:11.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.718 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.719 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.719 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.719 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.719 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.719 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.720 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.720 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.721 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:11.721 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:11.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.721 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.721 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.722 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:11.722 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.722 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.722 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.722 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.723 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.724 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.724 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.724 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.724 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.725 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:11.725 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:11.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.725 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.726 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.726 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.726 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.726 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.726 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.729 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.729 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2023-10-14T09:08:11.730 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2023-10-14T09:08:11.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:11.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.731 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:11.731 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.731 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.731 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-14T09:08:11.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.732 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.732 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.733 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-10-14T09:08:11.733 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-10-14T09:08:11.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.733 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.733 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2023-10-14T09:08:11.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.734 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.734 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2023-10-14T09:08:11.735 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2023-10-14T09:08:11.735 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap" 2023-10-14T09:08:11.735 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2023-10-14T09:08:11.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.736 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.736 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2023-10-14T09:08:11.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2023-10-14T09:08:11.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.737 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.738 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-14T09:08:11.738 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.738 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.738 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.740 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:11.740 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.740 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.740 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.740 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-14T09:08:11.740 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.741 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.741 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2023-10-14T09:08:11.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2023-10-14T09:08:11.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.742 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.742 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:11.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-14T09:08:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-14T09:08:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.744 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2023-10-14T09:08:11.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2023-10-14T09:08:11.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:11.744 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-14T09:08:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2023-10-14T09:08:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:11.747 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2023-10-14T09:08:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2023-10-14T09:08:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:11.748 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-10-14T09:08:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-14T09:08:11.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.750 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.750 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2023-10-14T09:08:11.751 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2023-10-14T09:08:11.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.751 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.751 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.751 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2023-10-14T09:08:11.752 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.752 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.752 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.752 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-14T09:08:11.753 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.753 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.753 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2023-10-14T09:08:11.754 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2023-10-14T09:08:11.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.754 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.754 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2023-10-14T09:08:11.755 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.755 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.755 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-14T09:08:11.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.756 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.756 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.756 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2023-10-14T09:08:11.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2023-10-14T09:08:11.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.757 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.757 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-14T09:08:11.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-14T09:08:11.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.759 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2023-10-14T09:08:11.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2023-10-14T09:08:11.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.760 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.760 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:11.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.761 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.761 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-14T09:08:11.761 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.762 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2023-10-14T09:08:11.762 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2023-10-14T09:08:11.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:11.762 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.763 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2023-10-14T09:08:11.763 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.763 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.763 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.763 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-14T09:08:11.764 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.764 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.764 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.764 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2023-10-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2023-10-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.765 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.766 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.766 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.766 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2023-10-14T09:08:11.766 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2023-10-14T09:08:11.766 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2023-10-14T09:08:11.767 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.767 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-14T09:08:11.767 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.767 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.767 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.768 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2023-10-14T09:08:11.768 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2023-10-14T09:08:11.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.768 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.769 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.769 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.769 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.769 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.769 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-14T09:08:11.770 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.770 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.770 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.770 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2023-10-14T09:08:11.771 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2023-10-14T09:08:11.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.771 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.771 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.772 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.772 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.772 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.772 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-14T09:08:11.772 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.773 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2023-10-14T09:08:11.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2023-10-14T09:08:11.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.775 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.776 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2023-10-14T09:08:11.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2023-10-14T09:08:11.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.776 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-14T09:08:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.777 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:11.778 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.778 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2023-10-14T09:08:11.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2023-10-14T09:08:11.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.779 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-14T09:08:11.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2023-10-14T09:08:11.780 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.781 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2023-10-14T09:08:11.781 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2023-10-14T09:08:11.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-14T09:08:11.782 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.783 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2023-10-14T09:08:11.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.784 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2023-10-14T09:08:11.784 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2023-10-14T09:08:11.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.785 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.785 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-14T09:08:11.785 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.785 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:11.786 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.786 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.787 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2023-10-14T09:08:11.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2023-10-14T09:08:11.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-14T09:08:11.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.789 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2023-10-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.790 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2023-10-14T09:08:11.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2023-10-14T09:08:11.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.791 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.791 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-14T09:08:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2023-10-14T09:08:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.792 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.793 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2023-10-14T09:08:11.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2023-10-14T09:08:11.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.794 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-14T09:08:11.794 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.794 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2023-10-14T09:08:11.795 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.795 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.796 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2023-10-14T09:08:11.796 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2023-10-14T09:08:11.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.796 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.796 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.797 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-14T09:08:11.797 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.797 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.797 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2023-10-14T09:08:11.798 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.798 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2023-10-14T09:08:11.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2023-10-14T09:08:11.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.799 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.799 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-14T09:08:11.800 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.800 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.800 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2023-10-14T09:08:11.800 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.801 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.801 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2023-10-14T09:08:11.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2023-10-14T09:08:11.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.802 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.802 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.802 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-14T09:08:11.802 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.802 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.803 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.803 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2023-10-14T09:08:11.803 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.803 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.803 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.804 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2023-10-14T09:08:11.804 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2023-10-14T09:08:11.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.804 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.805 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.805 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-14T09:08:11.805 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.805 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.805 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:11.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.806 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.806 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.807 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2023-10-14T09:08:11.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2023-10-14T09:08:11.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.807 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.807 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.807 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-14T09:08:11.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.808 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.808 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2023-10-14T09:08:11.808 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.809 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2023-10-14T09:08:11.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2023-10-14T09:08:11.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-14T09:08:11.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.811 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:11.811 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.811 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.811 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.812 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2023-10-14T09:08:11.812 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2023-10-14T09:08:11.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.812 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-14T09:08:11.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.813 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.814 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2023-10-14T09:08:11.814 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.814 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.814 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2023-10-14T09:08:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2023-10-14T09:08:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.815 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-14T09:08:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.816 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2023-10-14T09:08:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.817 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2023-10-14T09:08:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2023-10-14T09:08:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.818 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2023-10-14T09:08:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2023-10-14T09:08:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2023-10-14T09:08:11.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-14T09:08:11.822 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.822 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.823 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2023-10-14T09:08:11.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2023-10-14T09:08:11.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.823 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2023-10-14T09:08:11.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.825 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-14T09:08:11.825 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.825 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.825 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.826 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2023-10-14T09:08:11.826 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2023-10-14T09:08:11.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.826 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2023-10-14T09:08:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-14T09:08:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.828 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.828 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.828 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2023-10-14T09:08:11.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2023-10-14T09:08:11.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.829 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.829 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2023-10-14T09:08:11.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.830 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.830 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2023-10-14T09:08:11.830 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.830 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.831 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.831 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2023-10-14T09:08:11.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2023-10-14T09:08:11.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.831 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.832 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.832 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.833 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-14T09:08:11.833 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.833 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.833 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.834 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2023-10-14T09:08:11.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2023-10-14T09:08:11.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.834 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.834 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:11.835 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.835 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.835 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.835 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2023-10-14T09:08:11.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.836 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.836 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2023-10-14T09:08:11.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2023-10-14T09:08:11.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.837 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.837 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.837 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:11.837 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.838 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.838 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.838 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2023-10-14T09:08:11.838 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.838 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.839 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.839 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2023-10-14T09:08:11.839 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2023-10-14T09:08:11.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.840 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.840 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.841 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.841 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-14T09:08:11.841 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.841 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.842 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:11.842 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:11.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.842 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.843 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.843 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.843 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.844 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.844 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.844 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.844 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.844 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.845 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.845 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.845 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.845 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.845 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.846 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.846 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2023-10-14T09:08:11.846 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2023-10-14T09:08:11.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.847 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.847 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.847 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.847 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.848 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-14T09:08:11.848 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.848 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.849 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:11.849 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:11.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.850 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-14T09:08:11.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.851 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.851 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.851 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:11.852 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:11.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.852 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.852 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.854 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.854 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.854 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.854 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.854 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.855 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.855 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.855 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.855 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:11.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:11.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.856 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.856 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.856 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.857 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.857 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.857 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.857 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.857 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.858 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.858 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-14T09:08:11.858 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-14T09:08:11.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.859 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.860 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.860 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-14T09:08:11.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-14T09:08:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-14T09:08:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.861 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2023-10-14T09:08:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.862 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-14T09:08:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2023-10-14T09:08:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2023-10-14T09:08:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.864 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.865 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:11.865 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.865 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.865 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.865 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2023-10-14T09:08:11.866 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2023-10-14T09:08:11.867 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2023-10-14T09:08:11.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.867 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.867 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.867 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:11.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.868 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-14T09:08:11.868 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.869 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2023-10-14T09:08:11.869 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2023-10-14T09:08:11.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.870 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.870 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.871 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2023-10-14T09:08:11.871 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.871 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-10-14T09:08:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-10-14T09:08:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.872 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2023-10-14T09:08:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2023-10-14T09:08:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2023-10-14T09:08:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2023-10-14T09:08:11.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.875 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2023-10-14T09:08:11.876 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2023-10-14T09:08:11.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.876 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-14T09:08:11.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.877 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-14T09:08:11.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.878 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.878 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2023-10-14T09:08:11.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2023-10-14T09:08:11.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.879 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.879 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.879 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.880 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.880 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.880 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-14T09:08:11.880 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.880 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.881 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.881 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2023-10-14T09:08:11.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2023-10-14T09:08:11.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.881 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.882 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.882 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.882 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.882 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-14T09:08:11.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.884 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2023-10-14T09:08:11.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2023-10-14T09:08:11.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.885 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.885 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-14T09:08:11.886 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.886 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.886 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.886 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2023-10-14T09:08:11.887 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2023-10-14T09:08:11.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.887 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.887 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.887 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.888 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.888 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.888 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.888 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-14T09:08:11.888 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.889 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.889 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2023-10-14T09:08:11.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2023-10-14T09:08:11.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.890 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.890 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.891 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.891 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.891 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.891 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-14T09:08:11.892 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.892 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.892 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.892 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2023-10-14T09:08:11.893 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2023-10-14T09:08:11.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.893 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.893 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2023-10-14T09:08:11.894 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.894 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.894 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.894 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2023-10-14T09:08:11.894 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.895 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.895 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.895 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2023-10-14T09:08:11.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2023-10-14T09:08:11.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.896 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.896 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.897 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.897 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.897 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-14T09:08:11.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.898 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.898 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2023-10-14T09:08:11.899 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2023-10-14T09:08:11.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.900 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-14T09:08:11.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.901 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.901 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.901 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2023-10-14T09:08:11.902 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2023-10-14T09:08:11.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.902 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.902 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.903 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.903 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-14T09:08:11.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.904 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.904 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2023-10-14T09:08:11.904 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2023-10-14T09:08:11.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.905 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.906 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.906 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2023-10-14T09:08:11.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.907 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2023-10-14T09:08:11.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2023-10-14T09:08:11.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.907 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.908 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-14T09:08:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.909 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2023-10-14T09:08:11.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2023-10-14T09:08:11.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.910 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.910 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.910 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.911 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.911 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.911 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-14T09:08:11.911 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.912 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.912 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.912 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2023-10-14T09:08:11.913 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:11.913 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:11.913 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:11.913 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:11.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:11.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.914 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.914 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.915 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.915 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.915 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.915 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.916 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.916 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.916 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.916 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:11.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:11.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.919 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.920 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.920 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:11.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:11.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:11.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.922 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:11.922 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:11.922 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:11.922 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:11.922 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:11.923 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:11.923 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:11.923 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:11.923 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.923 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.924 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:11.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:11.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.925 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.926 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.926 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.927 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.927 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2023-10-14T09:08:11.929 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2023-10-14T09:08:11.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.930 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.930 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2023-10-14T09:08:11.930 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.930 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.931 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.931 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-14T09:08:11.931 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.931 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.931 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.932 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2023-10-14T09:08:11.932 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2023-10-14T09:08:11.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:11.932 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:11.933 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2023-10-14T09:08:11.933 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.933 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.933 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-14T09:08:11.934 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.934 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.934 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.935 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:11.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:11.935 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2023-10-14T09:08:11.935 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:11.935 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:11.936 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:11.936 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-14T09:08:11.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-14T09:08:11.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:11.936 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:11.937 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.937 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.937 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2023-10-14T09:08:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-14T09:08:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.940 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.940 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.940 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-14T09:08:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-14T09:08:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.942 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.943 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.943 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.944 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2023-10-14T09:08:11.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2023-10-14T09:08:11.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.944 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.946 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.946 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.946 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.947 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-14T09:08:11.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-14T09:08:11.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.947 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.948 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.949 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.949 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2023-10-14T09:08:11.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-14T09:08:11.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.952 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-14T09:08:11.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-14T09:08:11.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.953 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.954 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-14T09:08:11.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-14T09:08:11.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.955 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.955 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.957 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-14T09:08:11.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-14T09:08:11.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.957 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.958 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.958 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.958 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.958 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.960 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-14T09:08:11.960 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-14T09:08:11.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.961 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.961 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.961 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.962 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.962 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.962 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-14T09:08:11.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-14T09:08:11.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.963 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.963 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.964 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.964 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.964 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.965 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-14T09:08:11.965 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-14T09:08:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.967 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.967 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.967 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.967 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.968 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-14T09:08:11.968 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-14T09:08:11.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.969 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.969 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.970 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.971 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-14T09:08:11.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-14T09:08:11.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.971 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.972 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.972 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.973 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.973 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2023-10-14T09:08:11.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-14T09:08:11.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.974 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:11.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.975 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.975 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.976 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-14T09:08:11.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-14T09:08:11.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.978 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.979 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2023-10-14T09:08:11.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2023-10-14T09:08:11.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.980 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.981 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2023-10-14T09:08:11.981 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-14T09:08:11.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.982 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.982 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:11.982 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.983 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.983 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.984 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-14T09:08:11.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-14T09:08:11.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.984 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.985 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.985 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.985 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.985 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.986 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.986 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.986 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-14T09:08:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-14T09:08:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:11.988 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.988 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.988 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.988 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.989 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.989 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-14T09:08:11.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-14T09:08:11.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.990 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.991 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.992 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-14T09:08:11.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-14T09:08:11.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.994 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.994 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2023-10-14T09:08:11.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-14T09:08:11.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:11.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:11.996 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:11.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:11.997 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-14T09:08:11.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-14T09:08:11.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:11.998 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:11.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:11.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:11.998 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:11.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:11.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:11.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:11.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:11.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:11.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.000 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-14T09:08:12.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-14T09:08:12.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.002 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-14T09:08:12.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-14T09:08:12.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.005 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-14T09:08:12.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-14T09:08:12.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.007 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.007 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.008 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-14T09:08:12.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-14T09:08:12.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.008 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.009 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.010 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.010 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.010 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.011 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-14T09:08:12.011 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-14T09:08:12.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.011 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.012 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.012 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.012 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.012 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.013 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.013 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.013 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-14T09:08:12.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-14T09:08:12.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.015 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.016 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.016 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-14T09:08:12.016 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-14T09:08:12.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.018 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2023-10-14T09:08:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-14T09:08:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-14T09:08:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-14T09:08:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-14T09:08:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-14T09:08:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-14T09:08:12.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.025 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.025 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:12.025 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.026 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.027 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-14T09:08:12.027 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-14T09:08:12.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.027 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.028 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2023-10-14T09:08:12.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.028 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.029 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.029 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.029 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-14T09:08:12.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-14T09:08:12.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.030 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.030 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2023-10-14T09:08:12.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2023-10-14T09:08:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-14T09:08:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-14T09:08:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-14T09:08:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2023-10-14T09:08:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-14T09:08:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2023-10-14T09:08:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-14T09:08:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: "UNSAFE_TLS_v1_2": { 2023-10-14T09:08:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-14T09:08:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-14T09:08:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-14T09:08:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-14T09:08:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-14T09:08:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-14T09:08:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-14T09:08:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.052 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:12.052 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.052 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.053 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.054 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2023-10-14T09:08:12.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2023-10-14T09:08:12.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.054 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.056 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.056 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2023-10-14T09:08:12.057 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2023-10-14T09:08:12.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.057 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.058 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.058 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.058 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.058 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2023-10-14T09:08:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2023-10-14T09:08:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2023-10-14T09:08:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2023-10-14T09:08:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2023-10-14T09:08:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2023-10-14T09:08:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-10-14T09:08:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-10-14T09:08:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.070 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.070 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.070 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.070 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.070 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.071 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.071 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.071 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.071 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.072 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.072 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.072 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2023-10-14T09:08:12.081 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2023-10-14T09:08:12.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.081 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.081 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2023-10-14T09:08:12.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.083 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2023-10-14T09:08:12.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2023-10-14T09:08:12.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.086 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:12.086 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:12.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.086 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-10-14T09:08:12.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.088 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.088 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:12.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:12.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.089 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2023-10-14T09:08:12.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.090 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-10-14T09:08:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-10-14T09:08:12.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.094 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.094 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2023-10-14T09:08:12.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2023-10-14T09:08:12.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2023-10-14T09:08:12.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.097 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-10-14T09:08:12.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-10-14T09:08:12.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.098 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2023-10-14T09:08:12.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.098 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.099 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2023-10-14T09:08:12.099 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.099 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.099 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.100 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-10-14T09:08:12.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-10-14T09:08:12.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.101 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-10-14T09:08:12.101 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-10-14T09:08:12.101 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-10-14T09:08:12.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.102 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2023-10-14T09:08:12.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2023-10-14T09:08:12.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-10-14T09:08:12.106 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.106 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.106 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2023-10-14T09:08:12.107 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2023-10-14T09:08:12.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2023-10-14T09:08:12.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.109 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.111 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.111 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.111 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.111 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.112 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.112 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.112 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.112 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.112 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.113 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.113 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.114 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.114 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.115 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.115 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.116 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.116 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.117 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.118 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.118 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.118 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.118 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.118 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.119 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.119 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.119 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.119 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.120 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.122 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2023-10-14T09:08:12.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2023-10-14T09:08:12.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.123 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2023-10-14T09:08:12.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-14T09:08:12.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.125 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.125 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2023-10-14T09:08:12.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2023-10-14T09:08:12.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2023-10-14T09:08:12.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-14T09:08:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.127 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.128 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2023-10-14T09:08:12.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2023-10-14T09:08:12.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.128 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2023-10-14T09:08:12.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.129 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.129 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2023-10-14T09:08:12.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.131 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2023-10-14T09:08:12.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2023-10-14T09:08:12.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-10-14T09:08:12.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-14T09:08:12.133 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.133 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.133 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.133 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2023-10-14T09:08:12.133 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2023-10-14T09:08:12.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.134 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.134 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.138 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-14T09:08:12.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.139 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.139 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:12.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:12.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:12.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2023-10-14T09:08:12.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.142 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2023-10-14T09:08:12.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2023-10-14T09:08:12.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2023-10-14T09:08:12.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.143 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-14T09:08:12.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.144 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2023-10-14T09:08:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.145 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.146 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.147 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.148 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.148 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.148 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.148 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.148 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.148 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.149 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.149 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.150 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.150 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.150 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.151 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.151 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.153 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.154 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.154 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.154 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.155 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.155 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.155 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.155 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.155 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.156 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.156 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.157 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.158 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.159 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2023-10-14T09:08:12.159 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2023-10-14T09:08:12.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-10-14T09:08:12.160 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.162 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2023-10-14T09:08:12.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2023-10-14T09:08:12.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2023-10-14T09:08:12.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.164 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.164 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:12.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:12.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:12.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.166 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.166 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.167 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.167 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2023-10-14T09:08:12.168 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2023-10-14T09:08:12.168 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2023-10-14T09:08:12.168 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.169 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2023-10-14T09:08:12.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2023-10-14T09:08:12.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2023-10-14T09:08:12.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.170 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-14T09:08:12.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.171 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2023-10-14T09:08:12.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2023-10-14T09:08:12.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.172 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2023-10-14T09:08:12.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-14T09:08:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.174 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2023-10-14T09:08:12.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2023-10-14T09:08:12.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2023-10-14T09:08:12.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.177 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:12.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:12.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2023-10-14T09:08:12.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2023-10-14T09:08:12.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-14T09:08:12.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.179 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.179 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.181 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.181 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.181 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.182 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.182 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.182 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.182 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.188 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.188 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.188 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.188 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.188 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.189 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.189 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.189 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.189 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.190 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.190 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.190 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.192 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.192 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.193 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2023-10-14T09:08:12.193 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2023-10-14T09:08:12.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.194 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.194 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.194 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2023-10-14T09:08:12.195 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.195 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.195 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2023-10-14T09:08:12.196 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2023-10-14T09:08:12.196 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.196 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2023-10-14T09:08:12.197 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.197 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.197 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2023-10-14T09:08:12.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.198 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-10-14T09:08:12.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-10-14T09:08:12.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2023-10-14T09:08:12.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-14T09:08:12.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.201 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2023-10-14T09:08:12.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2023-10-14T09:08:12.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:12.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:12.202 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2023-10-14T09:08:12.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-14T09:08:12.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.203 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2023-10-14T09:08:12.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2023-10-14T09:08:12.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2023-10-14T09:08:12.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.206 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2023-10-14T09:08:12.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2023-10-14T09:08:12.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.207 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2023-10-14T09:08:12.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.208 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-14T09:08:12.208 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.208 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.209 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2023-10-14T09:08:12.210 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.210 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.210 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.210 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.213 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.213 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.213 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.213 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.214 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.215 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.216 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.216 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.217 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.217 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.218 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.218 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.219 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.219 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.219 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.219 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.219 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.220 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.220 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.220 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.221 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.222 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.224 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.224 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2023-10-14T09:08:12.225 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.225 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.225 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.225 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.227 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.227 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.227 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.227 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.228 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.228 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.228 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.228 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.228 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.230 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.230 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.231 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.232 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.233 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.234 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.234 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.235 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.235 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.235 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.235 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.235 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.236 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.236 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.236 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.237 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.237 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.237 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.238 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.238 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.238 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2023-10-14T09:08:12.240 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.240 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.240 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.240 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2023-10-14T09:08:12.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2023-10-14T09:08:12.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2023-10-14T09:08:12.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-14T09:08:12.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2023-10-14T09:08:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2023-10-14T09:08:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:12.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2023-10-14T09:08:12.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-14T09:08:12.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.246 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.248 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.248 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.248 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.248 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.249 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.249 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.249 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.249 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.249 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.250 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.250 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.250 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.251 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.251 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.252 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.252 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.253 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.255 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.255 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.255 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.255 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.255 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.256 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.256 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.257 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2023-10-14T09:08:12.261 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.261 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.261 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.261 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2023-10-14T09:08:12.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2023-10-14T09:08:12.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2023-10-14T09:08:12.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2023-10-14T09:08:12.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-14T09:08:12.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.264 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.266 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.266 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.266 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.266 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.266 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.266 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.267 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.268 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.269 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.270 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.273 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.273 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.273 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.273 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.274 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.276 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.277 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2023-10-14T09:08:12.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2023-10-14T09:08:12.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.278 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.279 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2023-10-14T09:08:12.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-14T09:08:12.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.281 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2023-10-14T09:08:12.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2023-10-14T09:08:12.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.282 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2023-10-14T09:08:12.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.283 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.283 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2023-10-14T09:08:12.283 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.283 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.284 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2023-10-14T09:08:12.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2023-10-14T09:08:12.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2023-10-14T09:08:12.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2023-10-14T09:08:12.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.286 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.287 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2023-10-14T09:08:12.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2023-10-14T09:08:12.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2023-10-14T09:08:12.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.289 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2023-10-14T09:08:12.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2023-10-14T09:08:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2023-10-14T09:08:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-14T09:08:12.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-14T09:08:12.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.291 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.292 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2023-10-14T09:08:12.293 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.293 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.293 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.293 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.295 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.295 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.295 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.296 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.296 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.296 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.296 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.296 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.297 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.297 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.298 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.298 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.300 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.300 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.301 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.302 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.302 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.302 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.302 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.302 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.303 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.303 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.304 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2023-10-14T09:08:12.308 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.308 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.308 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.308 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.310 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.310 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.310 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.310 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.311 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.311 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.311 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.311 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.311 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.313 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.315 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.316 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.317 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.317 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.317 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.318 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.318 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.318 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.318 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.318 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.319 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.320 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.321 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.322 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2023-10-14T09:08:12.323 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.323 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.323 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.324 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.325 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.325 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.326 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.326 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.326 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.326 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.326 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.328 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.328 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.329 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.329 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.329 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.330 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.330 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.331 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.331 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.332 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.332 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.333 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.333 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.333 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.333 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.333 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.334 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.334 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.334 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.334 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.335 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.335 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.335 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.335 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.335 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.337 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.337 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-10-14T09:08:12.338 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.338 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.338 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.339 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2023-10-14T09:08:12.339 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2023-10-14T09:08:12.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.339 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-14T09:08:12.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.343 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.345 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.345 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.345 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.346 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.346 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.346 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.346 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.347 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.347 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.347 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.348 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.349 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.349 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.350 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.350 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.350 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.350 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.351 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.351 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.351 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.351 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.352 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.352 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.352 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.352 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.352 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.352 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.353 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.353 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.353 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.353 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.353 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.354 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.354 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.354 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.355 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.355 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.355 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.357 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2023-10-14T09:08:12.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-10-14T09:08:12.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.358 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.358 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.358 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.358 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-10-14T09:08:12.359 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2023-10-14T09:08:12.359 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2023-10-14T09:08:12.359 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.359 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2023-10-14T09:08:12.359 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.360 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.360 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.360 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2023-10-14T09:08:12.361 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.361 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.361 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.362 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.362 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.362 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.362 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.363 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.363 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.363 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.363 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.363 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.364 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.364 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.364 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.364 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.364 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.365 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.365 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.366 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.366 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.366 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.370 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.370 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.370 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.370 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.371 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.371 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.371 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.371 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.372 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.372 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.372 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.372 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.373 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.374 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.374 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.375 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.375 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.375 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.376 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2023-10-14T09:08:12.376 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.377 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.377 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.377 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.377 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.379 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.379 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.379 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.379 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.380 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.380 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.380 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.380 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.381 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.381 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.381 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.382 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.382 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.383 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.383 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.383 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.383 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.384 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.384 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.384 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.385 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.385 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.386 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.387 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.387 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.387 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.387 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.387 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.388 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.388 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.388 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.389 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.391 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2023-10-14T09:08:12.392 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.393 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.393 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.393 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.393 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.394 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.394 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.394 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.394 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.394 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.395 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.395 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.395 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.395 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.396 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.396 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.396 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.396 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.397 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.397 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.399 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.400 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.400 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.400 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.401 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.401 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.401 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.402 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.402 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.402 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.402 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.402 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.403 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.403 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.403 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.403 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.404 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.404 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.404 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.405 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.405 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.405 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.405 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.406 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.407 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:12.407 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:12.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.407 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.407 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.408 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.409 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.409 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2023-10-14T09:08:12.409 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2023-10-14T09:08:12.410 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.410 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.410 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.410 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-10-14T09:08:12.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2023-10-14T09:08:12.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.411 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2023-10-14T09:08:12.411 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-14T09:08:12.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2023-10-14T09:08:12.413 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.413 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.413 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.413 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2023-10-14T09:08:12.414 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2023-10-14T09:08:12.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-14T09:08:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.416 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.416 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-10-14T09:08:12.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-10-14T09:08:12.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.418 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.418 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.419 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.420 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.420 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.420 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.420 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.420 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.421 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.421 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.421 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.421 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.421 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.422 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.422 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.425 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.426 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.426 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.428 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.428 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.428 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.428 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.429 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.429 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.429 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.429 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.429 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.430 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.430 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.431 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.432 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.432 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.432 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.433 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2023-10-14T09:08:12.433 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2023-10-14T09:08:12.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.433 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.433 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2023-10-14T09:08:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2023-10-14T09:08:12.434 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.435 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.435 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.435 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:12.435 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:12.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.436 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.436 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.436 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:12.437 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.437 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.437 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.437 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2023-10-14T09:08:12.437 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.438 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.438 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.438 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.438 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.439 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2023-10-14T09:08:12.439 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.439 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.440 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.440 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2023-10-14T09:08:12.440 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2023-10-14T09:08:12.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.441 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.441 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.441 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.441 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.442 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.442 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.442 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.443 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.443 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2023-10-14T09:08:12.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2023-10-14T09:08:12.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.444 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.444 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.444 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.444 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.445 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.445 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.445 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-14T09:08:12.445 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-14T09:08:12.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.446 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.446 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.447 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.448 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.448 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.448 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.449 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.449 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.449 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.449 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.449 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.449 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.450 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.453 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.453 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.456 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.456 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.456 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.457 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.458 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.458 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.458 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.459 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.460 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.460 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.460 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2023-10-14T09:08:12.461 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2023-10-14T09:08:12.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.461 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.462 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.462 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.462 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.463 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.463 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.464 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-14T09:08:12.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-14T09:08:12.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2023-10-14T09:08:12.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.465 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.465 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.466 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2023-10-14T09:08:12.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2023-10-14T09:08:12.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.467 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2023-10-14T09:08:12.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.468 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.468 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.468 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.468 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.469 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.469 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.469 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:12.469 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:12.469 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.470 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.470 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-10-14T09:08:12.470 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.470 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.471 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.471 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-14T09:08:12.471 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.471 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.471 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.472 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:12.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:12.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.473 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2023-10-14T09:08:12.473 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.473 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.474 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-14T09:08:12.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.474 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.474 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.475 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2023-10-14T09:08:12.475 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2023-10-14T09:08:12.475 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.475 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.475 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.476 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2023-10-14T09:08:12.476 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.476 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.476 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.476 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.477 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.478 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-10-14T09:08:12.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-10-14T09:08:12.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.478 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.479 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2023-10-14T09:08:12.479 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.479 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.479 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.479 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2023-10-14T09:08:12.480 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2023-10-14T09:08:12.480 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.480 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.481 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.481 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-10-14T09:08:12.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-10-14T09:08:12.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-10-14T09:08:12.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-10-14T09:08:12.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-10-14T09:08:12.483 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-10-14T09:08:12.485 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.485 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.485 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.485 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.486 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.486 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.486 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.486 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.487 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.487 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.487 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.487 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.487 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.488 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.488 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.488 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.488 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.488 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.488 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.489 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.490 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.491 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.493 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.494 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2023-10-14T09:08:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2023-10-14T09:08:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.500 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.501 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2023-10-14T09:08:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2023-10-14T09:08:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.502 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.504 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.504 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2023-10-14T09:08:12.504 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2023-10-14T09:08:12.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.505 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.505 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.505 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.506 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.506 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.506 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.506 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.506 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.507 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.507 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.507 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2023-10-14T09:08:12.508 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.508 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.508 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.508 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2023-10-14T09:08:12.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2023-10-14T09:08:12.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.510 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.510 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.511 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-10-14T09:08:12.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-10-14T09:08:12.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2023-10-14T09:08:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2023-10-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "drive_group_interval": { 2023-10-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "drive_group_interval", 2023-10-14T09:08:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300.0", 2023-10-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2023-10-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2023-10-14T09:08:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2023-10-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2023-10-14T09:08:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2023-10-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2023-10-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2023-10-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2023-10-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2023-10-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2023-10-14T09:08:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2023-10-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2023-10-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2023-10-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2023-10-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2023-10-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2023-10-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2023-10-14T09:08:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2023-10-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2023-10-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2023-10-14T09:08:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2023-10-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2023-10-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2023-10-14T09:08:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2023-10-14T09:08:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2023-10-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2023-10-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2023-10-14T09:08:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2023-10-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2023-10-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2023-10-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2023-10-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2023-10-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2023-10-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2023-10-14T09:08:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2023-10-14T09:08:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2023-10-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2023-10-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2023-10-14T09:08:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2023-10-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2023-10-14T09:08:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2023-10-14T09:08:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2023-10-14T09:08:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-14T09:08:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.670 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.670 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.670 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.671 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:12.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:12.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.671 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.672 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2023-10-14T09:08:12.672 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.672 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.672 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.672 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.673 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.673 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.673 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.673 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.674 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.674 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.674 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.674 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.675 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.675 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.675 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.675 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.675 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.675 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.676 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.676 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.676 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.676 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.676 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.677 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.677 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.677 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.677 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.678 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.678 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.678 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.678 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.678 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.679 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.679 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.679 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.679 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.679 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.679 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.680 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.680 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.680 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.681 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.681 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.681 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.681 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.681 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.682 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.682 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.682 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.682 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.682 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.683 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.683 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.683 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.683 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.684 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.684 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.684 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.685 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.685 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.685 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.685 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.686 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.686 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.686 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.687 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2023-10-14T09:08:12.687 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.687 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.688 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.688 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2023-10-14T09:08:12.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2023-10-14T09:08:12.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.688 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.689 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.689 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.690 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-14T09:08:12.690 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.690 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.691 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2023-10-14T09:08:12.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2023-10-14T09:08:12.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.691 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.691 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.691 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.692 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.692 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.692 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-14T09:08:12.692 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.693 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2023-10-14T09:08:12.693 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2023-10-14T09:08:12.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.694 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.694 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.695 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-14T09:08:12.695 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.695 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.695 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.696 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2023-10-14T09:08:12.696 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2023-10-14T09:08:12.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.696 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.696 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.697 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.697 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.697 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.697 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.697 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-14T09:08:12.697 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.698 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.698 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.698 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2023-10-14T09:08:12.698 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2023-10-14T09:08:12.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.699 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.699 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.699 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.699 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.700 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.700 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.700 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-14T09:08:12.700 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.700 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.701 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2023-10-14T09:08:12.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2023-10-14T09:08:12.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.702 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.702 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.702 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.702 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.703 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.703 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.703 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.703 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2023-10-14T09:08:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2023-10-14T09:08:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.705 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.705 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.706 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.706 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2023-10-14T09:08:12.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2023-10-14T09:08:12.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.707 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.707 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-14T09:08:12.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.707 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.709 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-10-14T09:08:12.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-10-14T09:08:12.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.710 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.710 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.711 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.711 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:12.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:12.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2023-10-14T09:08:12.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2023-10-14T09:08:12.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.714 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.714 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2023-10-14T09:08:12.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2023-10-14T09:08:12.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2023-10-14T09:08:12.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.715 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.715 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.716 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.716 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.716 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.717 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2023-10-14T09:08:12.717 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2023-10-14T09:08:12.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.717 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.717 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.718 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.718 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.718 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.718 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.718 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.719 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.719 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.719 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2023-10-14T09:08:12.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2023-10-14T09:08:12.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.720 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.720 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.721 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.721 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.721 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.721 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.721 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.722 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.722 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.722 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.723 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.723 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.723 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.724 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.724 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.724 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.724 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.724 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.724 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.725 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.725 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.725 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.725 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.726 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.726 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.726 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.726 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.728 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.728 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.728 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.729 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.729 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.729 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.730 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.730 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.730 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.730 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.730 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.731 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.731 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.731 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.731 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.731 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.732 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.733 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.733 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.733 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.733 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.734 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.734 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.734 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.734 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.734 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.735 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2023-10-14T09:08:12.735 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2023-10-14T09:08:12.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.735 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.736 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.736 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.736 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.736 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.737 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.737 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2023-10-14T09:08:12.738 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2023-10-14T09:08:12.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.738 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.738 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.738 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.739 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.739 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.739 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.739 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2023-10-14T09:08:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2023-10-14T09:08:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-14T09:08:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.741 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.743 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.743 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.743 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2023-10-14T09:08:12.743 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.744 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.744 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.744 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.745 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.746 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.746 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.746 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.746 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.746 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.747 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.747 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.747 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.747 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.748 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.748 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.748 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.749 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.750 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.755 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.755 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.755 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.756 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.756 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.756 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.756 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.757 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.757 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.757 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.757 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.757 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.757 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.759 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.759 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.760 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.760 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.760 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-10-14T09:08:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.764 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.765 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.765 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.765 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.765 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.765 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.766 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.766 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.766 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.767 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.767 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.769 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.769 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.769 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.770 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.771 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.771 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.771 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.771 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.772 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.772 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.772 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.772 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.772 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.773 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.773 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.775 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.775 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.775 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.776 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2023-10-14T09:08:12.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2023-10-14T09:08:12.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2023-10-14T09:08:12.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.777 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-14T09:08:12.778 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.779 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2023-10-14T09:08:12.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2023-10-14T09:08:12.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2023-10-14T09:08:12.781 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.781 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2023-10-14T09:08:12.782 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2023-10-14T09:08:12.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:12.783 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.783 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-14T09:08:12.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2023-10-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2023-10-14T09:08:12.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2023-10-14T09:08:12.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:12.786 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.786 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.786 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2023-10-14T09:08:12.786 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.787 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.787 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.787 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.787 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.788 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.788 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2023-10-14T09:08:12.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2023-10-14T09:08:12.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.789 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.789 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.790 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.791 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:12.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:12.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.791 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.794 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.795 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.796 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.796 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.796 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.796 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.796 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.797 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.797 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.797 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.797 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.799 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.799 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.799 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.800 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.800 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.801 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.801 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.801 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.801 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.802 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.802 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.802 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.802 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.802 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.803 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.803 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.803 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.803 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.803 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.804 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.804 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.804 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.804 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.805 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.805 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.805 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.805 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.805 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.806 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.806 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.806 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.807 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.807 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.807 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2023-10-14T09:08:12.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2023-10-14T09:08:12.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.808 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.808 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.809 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.809 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.809 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.809 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.810 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2023-10-14T09:08:12.810 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2023-10-14T09:08:12.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2023-10-14T09:08:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.811 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.812 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.812 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.812 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.812 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2023-10-14T09:08:12.813 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2023-10-14T09:08:12.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.813 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-14T09:08:12.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.814 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.814 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.814 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.814 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.814 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.815 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:12.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.816 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24109, 2023-10-14T09:08:12.816 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "z", 2023-10-14T09:08:12.816 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540138322906710015, 2023-10-14T09:08:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2023-10-14T09:08:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2023-10-14T09:08:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.817 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.818 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:12.818 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:12.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.818 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.819 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:12.819 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.819 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.819 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2023-10-14T09:08:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.822 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.823 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.823 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.823 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.823 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.823 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.824 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.824 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.824 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.824 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.824 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.825 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.826 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.826 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.826 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.826 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.827 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.827 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.827 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.828 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.828 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.828 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.828 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.828 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.829 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.829 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.829 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.829 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.829 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.830 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.830 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.830 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.830 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.830 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.831 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.831 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.831 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.832 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.832 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.833 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.833 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.833 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.833 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.833 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.834 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2023-10-14T09:08:12.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2023-10-14T09:08:12.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.834 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.834 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.835 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.835 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.835 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.835 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2023-10-14T09:08:12.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.836 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.836 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2023-10-14T09:08:12.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2023-10-14T09:08:12.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.837 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.837 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.837 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2023-10-14T09:08:12.838 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.838 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.838 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.838 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2023-10-14T09:08:12.838 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.839 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.839 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2023-10-14T09:08:12.839 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2023-10-14T09:08:12.839 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.840 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.840 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2023-10-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.842 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2023-10-14T09:08:12.842 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2023-10-14T09:08:12.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.842 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.842 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.843 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.843 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.843 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.843 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2023-10-14T09:08:12.844 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.844 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2023-10-14T09:08:12.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2023-10-14T09:08:12.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.845 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.845 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.845 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2023-10-14T09:08:12.845 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.846 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2023-10-14T09:08:12.846 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.846 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.847 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2023-10-14T09:08:12.847 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2023-10-14T09:08:12.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.848 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.848 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.848 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.848 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.848 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.849 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.849 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2023-10-14T09:08:12.849 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.849 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.850 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2023-10-14T09:08:12.850 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2023-10-14T09:08:12.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.850 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.851 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.851 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.851 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.851 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-14T09:08:12.852 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.852 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.852 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.852 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2023-10-14T09:08:12.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2023-10-14T09:08:12.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.853 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.853 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.854 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.854 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.854 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2023-10-14T09:08:12.854 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.855 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.855 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.855 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.855 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2023-10-14T09:08:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2023-10-14T09:08:12.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2023-10-14T09:08:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.857 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2023-10-14T09:08:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2023-10-14T09:08:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2023-10-14T09:08:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.860 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.860 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2023-10-14T09:08:12.860 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.860 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.860 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.861 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2023-10-14T09:08:12.861 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-14T09:08:12.861 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.862 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2023-10-14T09:08:12.862 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2023-10-14T09:08:12.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:12.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.863 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:12.863 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-10-14T09:08:12.863 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-10-14T09:08:12.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-14T09:08:12.864 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-14T09:08:12.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.864 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2023-10-14T09:08:12.864 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2023-10-14T09:08:12.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:12.865 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.865 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.865 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2023-10-14T09:08:12.865 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:12.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2023-10-14T09:08:12.866 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.866 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-14T09:08:12.866 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.867 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2023-10-14T09:08:12.867 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2023-10-14T09:08:12.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.867 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2023-10-14T09:08:12.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.869 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-14T09:08:12.869 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-14T09:08:12.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2023-10-14T09:08:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2023-10-14T09:08:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2023-10-14T09:08:12.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2023-10-14T09:08:12.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2023-10-14T09:08:12.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.871 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2023-10-14T09:08:12.871 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-14T09:08:12.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.872 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2023-10-14T09:08:12.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2023-10-14T09:08:12.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2023-10-14T09:08:12.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.874 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2023-10-14T09:08:12.874 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-14T09:08:12.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.874 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.875 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2023-10-14T09:08:12.875 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2023-10-14T09:08:12.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:12.875 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:12.876 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-10-14T09:08:12.876 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-10-14T09:08:12.876 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-14T09:08:12.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-14T09:08:12.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.877 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.877 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:12.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:12.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.878 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.879 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.879 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.880 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.880 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.880 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.880 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.880 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.881 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.881 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.881 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.881 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.882 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:12.882 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:12.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.882 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.883 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.883 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.883 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.883 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.884 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.884 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.884 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:12.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:12.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.886 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.886 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.886 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:12.886 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:12.886 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:12.887 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:12.887 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:12.887 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:12.887 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.887 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.887 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.888 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:12.888 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:12.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.889 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.889 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.889 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.890 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.890 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.890 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:12.890 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.891 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2023-10-14T09:08:12.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2023-10-14T09:08:12.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.891 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.892 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:12.892 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.892 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.892 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.893 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-14T09:08:12.893 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.894 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.894 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-10-14T09:08:12.894 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-10-14T09:08:12.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.895 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.895 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.895 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2023-10-14T09:08:12.895 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.896 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.896 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.896 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2023-10-14T09:08:12.896 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2023-10-14T09:08:12.896 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap" 2023-10-14T09:08:12.897 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2023-10-14T09:08:12.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.897 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.898 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2023-10-14T09:08:12.898 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2023-10-14T09:08:12.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.898 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.899 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.899 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-14T09:08:12.900 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.900 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.900 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.901 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:12.901 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:12.901 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.901 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:12.902 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.902 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.902 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-14T09:08:12.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.903 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.904 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2023-10-14T09:08:12.904 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2023-10-14T09:08:12.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.904 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:12.905 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:12.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.905 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.906 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-14T09:08:12.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-14T09:08:12.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.907 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2023-10-14T09:08:12.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2023-10-14T09:08:12.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:12.907 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:12.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.908 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-14T09:08:12.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.909 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.909 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:12.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:12.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2023-10-14T09:08:12.910 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:12.911 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:12.911 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:12.911 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2023-10-14T09:08:12.911 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2023-10-14T09:08:12.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.912 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.912 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-10-14T09:08:12.912 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.913 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.913 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-14T09:08:12.913 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.914 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.914 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2023-10-14T09:08:12.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2023-10-14T09:08:12.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2023-10-14T09:08:12.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-14T09:08:12.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.917 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2023-10-14T09:08:12.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2023-10-14T09:08:12.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:12.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2023-10-14T09:08:12.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-14T09:08:12.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2023-10-14T09:08:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2023-10-14T09:08:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-14T09:08:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-14T09:08:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2023-10-14T09:08:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2023-10-14T09:08:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-14T09:08:12.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.926 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2023-10-14T09:08:12.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2023-10-14T09:08:12.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:12.927 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2023-10-14T09:08:12.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.928 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-14T09:08:12.929 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.929 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.929 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.929 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2023-10-14T09:08:12.930 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2023-10-14T09:08:12.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.930 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.931 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:12.931 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.931 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.931 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:12.931 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2023-10-14T09:08:12.932 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2023-10-14T09:08:12.932 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2023-10-14T09:08:12.932 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:12.932 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-14T09:08:12.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.934 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2023-10-14T09:08:12.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2023-10-14T09:08:12.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.935 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.935 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-14T09:08:12.936 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.937 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2023-10-14T09:08:12.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2023-10-14T09:08:12.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.938 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.938 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:12.938 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.938 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.939 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-14T09:08:12.939 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.939 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.939 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.940 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2023-10-14T09:08:12.940 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2023-10-14T09:08:12.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.940 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.940 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.941 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.941 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.941 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.942 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-14T09:08:12.942 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.942 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.942 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.943 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2023-10-14T09:08:12.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2023-10-14T09:08:12.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.943 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.944 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-14T09:08:12.944 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.944 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.944 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:12.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.945 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.946 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2023-10-14T09:08:12.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2023-10-14T09:08:12.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:12.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-14T09:08:12.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2023-10-14T09:08:12.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.949 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2023-10-14T09:08:12.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2023-10-14T09:08:12.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-14T09:08:12.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2023-10-14T09:08:12.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.952 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2023-10-14T09:08:12.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2023-10-14T09:08:12.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-14T09:08:12.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:12.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.955 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2023-10-14T09:08:12.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2023-10-14T09:08:12.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-14T09:08:12.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2023-10-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2023-10-14T09:08:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2023-10-14T09:08:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-14T09:08:12.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.959 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.960 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2023-10-14T09:08:12.960 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.960 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.960 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.961 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2023-10-14T09:08:12.961 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2023-10-14T09:08:12.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.961 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.962 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-14T09:08:12.962 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.962 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.963 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2023-10-14T09:08:12.963 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.964 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2023-10-14T09:08:12.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2023-10-14T09:08:12.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.965 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-14T09:08:12.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.966 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2023-10-14T09:08:12.966 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.966 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.967 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.967 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2023-10-14T09:08:12.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2023-10-14T09:08:12.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.968 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.968 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-14T09:08:12.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.969 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.969 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2023-10-14T09:08:12.969 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.969 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.970 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.970 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2023-10-14T09:08:12.970 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2023-10-14T09:08:12.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.971 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.971 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-14T09:08:12.971 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.972 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2023-10-14T09:08:12.972 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.972 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.973 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2023-10-14T09:08:12.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2023-10-14T09:08:12.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.974 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-14T09:08:12.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.975 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:12.975 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.976 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2023-10-14T09:08:12.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2023-10-14T09:08:12.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-14T09:08:12.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2023-10-14T09:08:12.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.979 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2023-10-14T09:08:12.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2023-10-14T09:08:12.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-14T09:08:12.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:12.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.982 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.982 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2023-10-14T09:08:12.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2023-10-14T09:08:12.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-14T09:08:12.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.984 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.984 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2023-10-14T09:08:12.984 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.985 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.985 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2023-10-14T09:08:12.985 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2023-10-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.986 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-14T09:08:12.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.987 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2023-10-14T09:08:12.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.988 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2023-10-14T09:08:12.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2023-10-14T09:08:12.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:12.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:12.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2023-10-14T09:08:12.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.991 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2023-10-14T09:08:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2023-10-14T09:08:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:12.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-14T09:08:12.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.994 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2023-10-14T09:08:12.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2023-10-14T09:08:12.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:12.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2023-10-14T09:08:12.996 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-14T09:08:12.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:12.997 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:12.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:12.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:12.997 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2023-10-14T09:08:12.998 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2023-10-14T09:08:12.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:12.998 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:12.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:12.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2023-10-14T09:08:12.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:12.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:12.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:12.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-14T09:08:12.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.000 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.000 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2023-10-14T09:08:13.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2023-10-14T09:08:13.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2023-10-14T09:08:13.002 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.002 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.002 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.002 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2023-10-14T09:08:13.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.003 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2023-10-14T09:08:13.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2023-10-14T09:08:13.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.004 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.004 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.005 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.005 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.005 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-14T09:08:13.005 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.006 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.006 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2023-10-14T09:08:13.007 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2023-10-14T09:08:13.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.007 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.007 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:13.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.008 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.008 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.008 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2023-10-14T09:08:13.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.009 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2023-10-14T09:08:13.010 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2023-10-14T09:08:13.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:13.011 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2023-10-14T09:08:13.012 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.012 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.012 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2023-10-14T09:08:13.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2023-10-14T09:08:13.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.013 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.014 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.014 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.014 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-14T09:08:13.014 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.016 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.016 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.016 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.017 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.017 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.017 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.018 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.018 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.018 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.018 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.018 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.019 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.019 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.020 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2023-10-14T09:08:13.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2023-10-14T09:08:13.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-14T09:08:13.022 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.023 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.024 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.025 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.025 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.025 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-14T09:08:13.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.026 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.026 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.026 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.027 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.027 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.027 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.028 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.028 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.028 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.029 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.029 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.029 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.029 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.031 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.031 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.032 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.032 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.033 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.033 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.033 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.033 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.034 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-14T09:08:13.034 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-14T09:08:13.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.034 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.034 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.035 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.035 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.035 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.035 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-14T09:08:13.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.037 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-14T09:08:13.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-14T09:08:13.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2023-10-14T09:08:13.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-14T09:08:13.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2023-10-14T09:08:13.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2023-10-14T09:08:13.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2023-10-14T09:08:13.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.042 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2023-10-14T09:08:13.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2023-10-14T09:08:13.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.043 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.043 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.044 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.044 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-14T09:08:13.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.046 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2023-10-14T09:08:13.046 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2023-10-14T09:08:13.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.047 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.047 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2023-10-14T09:08:13.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-10-14T09:08:13.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-10-14T09:08:13.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.049 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2023-10-14T09:08:13.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2023-10-14T09:08:13.051 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2023-10-14T09:08:13.051 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.051 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2023-10-14T09:08:13.051 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.052 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.052 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2023-10-14T09:08:13.052 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2023-10-14T09:08:13.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.053 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-14T09:08:13.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.054 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.054 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.054 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-14T09:08:13.054 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.055 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2023-10-14T09:08:13.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2023-10-14T09:08:13.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.056 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.057 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-14T09:08:13.057 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2023-10-14T09:08:13.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2023-10-14T09:08:13.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.059 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.059 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.060 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.060 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.060 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-14T09:08:13.060 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.061 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.061 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2023-10-14T09:08:13.061 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2023-10-14T09:08:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-14T09:08:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.064 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2023-10-14T09:08:13.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2023-10-14T09:08:13.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.067 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-14T09:08:13.067 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.068 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2023-10-14T09:08:13.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2023-10-14T09:08:13.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.069 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.069 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.069 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.069 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.070 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.070 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-14T09:08:13.070 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.071 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.071 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2023-10-14T09:08:13.071 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2023-10-14T09:08:13.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.072 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.072 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2023-10-14T09:08:13.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.073 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.073 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2023-10-14T09:08:13.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.074 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2023-10-14T09:08:13.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2023-10-14T09:08:13.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.076 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-14T09:08:13.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.077 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2023-10-14T09:08:13.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2023-10-14T09:08:13.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.078 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.079 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-14T09:08:13.079 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.079 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.080 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2023-10-14T09:08:13.080 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2023-10-14T09:08:13.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.081 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.081 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-14T09:08:13.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.083 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2023-10-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2023-10-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.085 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.085 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2023-10-14T09:08:13.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.086 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.086 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.086 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2023-10-14T09:08:13.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2023-10-14T09:08:13.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.088 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.088 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.088 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-14T09:08:13.089 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.089 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2023-10-14T09:08:13.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2023-10-14T09:08:13.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.091 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.091 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.091 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-14T09:08:13.092 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.092 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.093 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2023-10-14T09:08:13.093 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.093 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.094 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.094 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.096 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.096 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.096 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.096 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.096 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.097 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.097 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.097 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.097 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.097 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.098 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.098 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.098 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.098 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.099 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.099 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.099 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.100 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.100 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.101 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.101 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.103 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.103 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.103 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.104 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.104 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.104 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.104 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.106 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.109 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2023-10-14T09:08:13.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2023-10-14T09:08:13.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.109 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2023-10-14T09:08:13.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.110 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-14T09:08:13.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.112 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2023-10-14T09:08:13.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2023-10-14T09:08:13.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.112 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2023-10-14T09:08:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.113 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-14T09:08:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2023-10-14T09:08:13.118 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.118 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.118 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2023-10-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-14T09:08:13.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.126 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2023-10-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2023-10-14T09:08:13.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.129 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-14T09:08:13.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.132 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.133 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2023-10-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.134 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.136 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.137 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.138 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-14T09:08:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-14T09:08:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-14T09:08:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2023-10-14T09:08:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2023-10-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2023-10-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2023-10-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-14T09:08:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2023-10-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-14T09:08:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-14T09:08:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2023-10-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-14T09:08:13.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-14T09:08:13.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2023-10-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-14T09:08:13.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2023-10-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2023-10-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.234 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2023-10-14T09:08:13.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-14T09:08:13.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.235 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.236 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.236 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.236 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.237 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2023-10-14T09:08:13.237 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-14T09:08:13.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.238 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.239 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi006.stdout: "UNSAFE_TLS_v1_2": { 2023-10-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.240 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.241 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.241 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.241 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.242 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.243 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-14T09:08:13.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-14T09:08:13.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.243 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:13.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.246 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-14T09:08:13.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-14T09:08:13.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.249 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-14T09:08:13.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-14T09:08:13.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.250 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:13.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.251 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.252 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2023-10-14T09:08:13.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2023-10-14T09:08:13.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.253 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.254 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.254 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.255 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2023-10-14T09:08:13.255 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2023-10-14T09:08:13.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.256 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.256 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.257 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.257 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.257 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.258 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.258 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2023-10-14T09:08:13.258 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2023-10-14T09:08:13.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.259 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.259 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.260 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.260 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.260 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2023-10-14T09:08:13.261 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.261 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2023-10-14T09:08:13.262 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2023-10-14T09:08:13.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.263 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2023-10-14T09:08:13.263 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.264 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.264 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.264 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-10-14T09:08:13.265 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-10-14T09:08:13.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.265 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.266 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.269 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.270 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.270 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.270 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.270 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.270 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.271 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.272 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.273 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.275 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.277 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.277 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.277 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.278 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.278 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.278 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.278 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.278 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.279 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.279 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.280 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.280 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.282 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.282 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.282 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.283 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.283 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2023-10-14T09:08:13.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2023-10-14T09:08:13.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.284 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.284 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.285 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.285 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.285 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2023-10-14T09:08:13.285 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.285 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.286 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.286 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2023-10-14T09:08:13.286 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2023-10-14T09:08:13.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.287 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.288 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.288 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.288 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.289 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.289 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.289 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:13.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-10-14T09:08:13.291 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.291 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.291 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.292 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:13.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:13.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.293 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2023-10-14T09:08:13.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.294 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.294 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.295 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-10-14T09:08:13.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-10-14T09:08:13.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.297 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.299 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2023-10-14T09:08:13.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2023-10-14T09:08:13.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.299 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.300 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2023-10-14T09:08:13.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.301 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.301 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-10-14T09:08:13.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-10-14T09:08:13.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2023-10-14T09:08:13.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.303 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.304 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2023-10-14T09:08:13.304 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.304 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.304 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.305 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-10-14T09:08:13.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-10-14T09:08:13.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.306 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-10-14T09:08:13.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-10-14T09:08:13.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-10-14T09:08:13.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.307 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.308 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2023-10-14T09:08:13.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2023-10-14T09:08:13.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.310 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.310 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.310 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-10-14T09:08:13.312 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.312 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.313 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2023-10-14T09:08:13.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2023-10-14T09:08:13.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.315 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2023-10-14T09:08:13.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.316 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.317 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.318 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.318 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.318 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.318 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.318 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.319 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.319 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.320 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.322 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.322 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.322 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.323 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.325 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.325 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.325 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.326 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.326 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.326 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.326 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.327 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.328 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.328 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.328 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.329 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.329 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.329 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.329 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.329 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.330 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.331 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2023-10-14T09:08:13.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2023-10-14T09:08:13.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.331 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2023-10-14T09:08:13.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-14T09:08:13.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.334 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2023-10-14T09:08:13.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2023-10-14T09:08:13.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2023-10-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-14T09:08:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2023-10-14T09:08:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2023-10-14T09:08:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2023-10-14T09:08:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2023-10-14T09:08:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2023-10-14T09:08:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2023-10-14T09:08:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-10-14T09:08:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-14T09:08:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2023-10-14T09:08:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2023-10-14T09:08:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-14T09:08:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2023-10-14T09:08:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2023-10-14T09:08:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2023-10-14T09:08:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2023-10-14T09:08:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-14T09:08:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2023-10-14T09:08:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2023-10-14T09:08:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2023-10-14T09:08:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-10-14T09:08:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2023-10-14T09:08:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2023-10-14T09:08:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2023-10-14T09:08:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2023-10-14T09:08:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2023-10-14T09:08:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2023-10-14T09:08:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2023-10-14T09:08:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2023-10-14T09:08:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2023-10-14T09:08:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-14T09:08:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2023-10-14T09:08:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2023-10-14T09:08:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2023-10-14T09:08:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-14T09:08:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2023-10-14T09:08:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2023-10-14T09:08:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2023-10-14T09:08:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2023-10-14T09:08:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2023-10-14T09:08:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-14T09:08:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2023-10-14T09:08:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2023-10-14T09:08:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2023-10-14T09:08:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2023-10-14T09:08:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2023-10-14T09:08:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2023-10-14T09:08:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2023-10-14T09:08:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-10-14T09:08:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-10-14T09:08:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2023-10-14T09:08:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-14T09:08:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2023-10-14T09:08:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2023-10-14T09:08:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2023-10-14T09:08:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-14T09:08:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2023-10-14T09:08:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2023-10-14T09:08:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.424 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.424 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2023-10-14T09:08:13.424 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.425 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.425 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2023-10-14T09:08:13.425 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2023-10-14T09:08:13.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.426 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.426 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2023-10-14T09:08:13.426 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.426 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.427 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.427 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-14T09:08:13.427 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.428 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.429 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2023-10-14T09:08:13.429 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.429 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.429 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.429 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.430 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.430 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.431 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.431 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.431 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.431 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.432 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.432 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.432 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.432 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.432 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.433 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.433 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.434 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.434 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.434 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.436 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.436 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.437 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.439 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.440 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.440 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.440 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.440 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.440 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.441 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.441 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.441 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.442 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.442 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.443 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.443 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.443 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.443 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.444 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.444 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.444 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2023-10-14T09:08:13.445 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.446 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.446 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.446 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.446 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.447 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.447 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.447 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.447 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.447 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.448 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.448 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.448 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.449 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.449 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.449 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.449 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.449 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.450 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.451 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.452 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.453 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.453 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.453 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.454 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.455 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.456 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.456 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.456 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.456 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.456 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.457 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.457 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.457 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.458 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.458 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.459 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.459 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.459 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.460 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.460 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.460 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.460 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.461 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.461 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.462 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2023-10-14T09:08:13.462 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.462 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.462 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.463 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2023-10-14T09:08:13.463 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2023-10-14T09:08:13.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.463 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.464 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2023-10-14T09:08:13.464 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.464 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.464 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.464 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-14T09:08:13.465 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.465 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.466 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2023-10-14T09:08:13.466 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2023-10-14T09:08:13.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.466 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.467 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.467 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2023-10-14T09:08:13.467 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.467 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.468 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-14T09:08:13.468 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.468 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.468 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.469 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.469 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.469 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.469 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.469 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.470 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.470 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.470 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.470 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.471 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.471 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.471 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.471 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.471 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.472 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.472 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.472 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.472 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.474 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.474 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.475 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.475 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.475 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.475 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.476 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.476 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.478 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.479 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.479 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.479 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.479 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.480 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.480 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.481 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.483 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.484 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2023-10-14T09:08:13.484 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.484 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.485 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.485 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2023-10-14T09:08:13.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2023-10-14T09:08:13.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.485 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.486 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2023-10-14T09:08:13.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.486 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.487 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2023-10-14T09:08:13.487 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-14T09:08:13.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.488 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.489 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.489 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.489 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.490 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.490 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.490 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.490 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.490 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.491 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.491 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.491 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.491 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.493 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.494 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.495 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.495 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.497 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.497 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.497 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.498 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.498 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.498 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.498 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.499 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.499 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.499 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.499 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.500 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.500 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.501 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.501 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.501 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.502 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.502 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.502 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.503 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2023-10-14T09:08:13.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2023-10-14T09:08:13.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.504 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.505 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2023-10-14T09:08:13.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-14T09:08:13.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.505 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.506 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2023-10-14T09:08:13.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2023-10-14T09:08:13.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.506 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2023-10-14T09:08:13.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.507 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2023-10-14T09:08:13.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.509 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2023-10-14T09:08:13.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2023-10-14T09:08:13.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.510 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2023-10-14T09:08:13.510 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.510 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.511 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2023-10-14T09:08:13.511 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.512 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2023-10-14T09:08:13.512 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2023-10-14T09:08:13.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.513 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.513 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.513 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2023-10-14T09:08:13.514 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.514 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.514 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.515 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2023-10-14T09:08:13.515 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2023-10-14T09:08:13.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.515 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2023-10-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.518 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2023-10-14T09:08:13.518 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.520 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.520 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.520 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.520 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.521 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.521 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.521 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.521 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.522 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.522 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.522 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.522 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.523 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.524 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.524 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.524 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.525 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.525 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.525 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.525 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.526 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.526 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.526 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.527 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.527 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.528 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.528 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.528 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.528 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.529 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.529 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.529 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.529 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.529 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.531 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.532 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2023-10-14T09:08:13.535 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.535 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.535 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.536 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.536 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.536 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.536 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.537 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.537 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.537 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.537 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.537 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.538 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.538 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.538 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.538 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.538 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.539 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.540 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.541 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.542 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.543 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.543 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.544 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.545 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.546 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.546 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.546 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.546 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.546 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.547 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.547 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.548 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.548 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.549 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.549 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.549 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2023-10-14T09:08:13.551 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.551 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.551 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.552 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.552 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.553 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.553 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.553 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.553 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.553 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.554 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.554 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.554 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.554 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.555 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.555 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.555 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.555 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.556 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.556 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.556 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.557 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.557 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.558 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.558 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.558 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.559 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.559 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.560 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.560 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.561 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.561 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.561 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.561 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.561 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.562 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.562 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.562 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.563 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.563 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.563 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.564 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.565 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.565 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.566 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.567 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-10-14T09:08:13.567 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.567 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.567 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.568 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2023-10-14T09:08:13.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2023-10-14T09:08:13.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.569 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.570 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-14T09:08:13.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.570 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.570 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.571 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.571 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.571 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.572 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.572 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.572 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.572 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.572 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.573 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.573 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.573 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.573 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.573 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.574 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.574 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.574 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.574 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.575 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.575 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.575 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.576 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.576 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.576 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.576 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.577 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.577 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.577 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.577 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.578 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.578 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.578 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.579 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.579 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.579 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.580 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.580 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.580 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.580 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.580 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.581 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.581 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.581 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.581 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.582 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.582 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.582 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.583 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.583 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.584 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.584 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.584 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.584 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.585 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.585 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.585 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.586 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2023-10-14T09:08:13.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-10-14T09:08:13.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.586 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.587 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-10-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2023-10-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2023-10-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.588 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2023-10-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2023-10-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.590 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.591 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.591 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.591 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.593 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.593 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.593 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.593 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.593 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.594 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.596 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.596 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.597 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.597 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.599 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.599 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.600 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.600 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.601 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.601 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.601 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.601 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.603 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.603 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.603 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.604 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.604 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.605 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.605 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.605 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.605 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.606 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.606 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.606 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2023-10-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.607 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.608 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.608 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.610 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.610 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.610 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.610 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.611 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.611 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.611 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.611 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.611 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.612 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.612 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.612 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.612 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.613 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.614 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.614 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.614 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.614 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.615 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.615 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.615 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.616 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.616 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.617 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.617 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.617 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.618 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.618 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.618 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.618 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.618 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.619 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.619 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.619 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.622 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.622 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.623 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2023-10-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.624 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.625 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.626 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.627 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.629 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.630 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.631 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.632 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.633 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.634 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.635 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.636 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.637 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.638 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.639 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.640 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.641 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.642 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2023-10-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2023-10-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.643 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-10-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2023-10-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2023-10-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2023-10-14T09:08:13.646 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2023-10-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2023-10-14T09:08:13.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.648 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.649 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-10-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-10-14T09:08:13.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.651 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.655 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.656 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.657 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.658 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.659 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.660 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.661 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.662 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.663 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.667 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2023-10-14T09:08:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2023-10-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2023-10-14T09:08:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2023-10-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2023-10-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2023-10-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.675 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2023-10-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2023-10-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2023-10-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2023-10-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2023-10-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2023-10-14T09:08:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-14T09:08:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2023-10-14T09:08:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2023-10-14T09:08:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2023-10-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2023-10-14T09:08:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-10-14T09:08:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2023-10-14T09:08:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2023-10-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2023-10-14T09:08:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2023-10-14T09:08:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-10-14T09:08:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-10-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2023-10-14T09:08:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2023-10-14T09:08:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2023-10-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-10-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-10-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-10-14T09:08:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-10-14T09:08:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-10-14T09:08:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-10-14T09:08:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2023-10-14T09:08:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2023-10-14T09:08:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2023-10-14T09:08:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2023-10-14T09:08:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2023-10-14T09:08:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2023-10-14T09:08:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2023-10-14T09:08:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2023-10-14T09:08:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2023-10-14T09:08:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-10-14T09:08:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-10-14T09:08:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2023-10-14T09:08:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.783 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.783 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.783 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.783 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.783 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2023-10-14T09:08:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.796 INFO:teuthology.orchestra.run.smithi006.stdout: "drive_group_interval": { 2023-10-14T09:08:13.796 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "drive_group_interval", 2023-10-14T09:08:13.796 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:13.796 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.796 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.797 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300.0", 2023-10-14T09:08:13.797 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.797 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.797 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-14T09:08:13.798 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.798 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.799 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.799 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.800 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.800 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.800 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.800 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.801 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.801 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.801 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.801 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.801 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.802 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.802 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.802 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.802 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.802 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.803 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.803 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.803 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.804 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.804 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.804 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.805 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.805 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.805 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.805 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.806 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.807 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.807 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.807 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.807 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.807 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.808 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.808 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.808 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.808 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.808 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.809 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.811 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.811 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.811 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.811 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.811 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.812 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2023-10-14T09:08:13.812 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2023-10-14T09:08:13.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.812 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2023-10-14T09:08:13.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.813 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.814 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-14T09:08:13.814 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.814 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.814 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.814 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2023-10-14T09:08:13.815 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.817 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.817 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.817 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.817 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.817 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.818 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.818 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.818 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.818 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.818 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.819 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.819 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.819 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.820 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.822 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.822 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.823 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.823 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.824 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.825 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.825 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.825 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.825 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.825 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.826 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.826 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.826 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.826 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.827 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.827 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.827 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.828 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.828 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.828 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.828 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.828 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.829 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.829 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.829 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2023-10-14T09:08:13.830 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2023-10-14T09:08:13.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.830 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.830 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.831 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.831 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.831 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.831 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.831 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.832 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.832 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2023-10-14T09:08:13.832 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2023-10-14T09:08:13.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.833 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.833 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2023-10-14T09:08:13.833 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.833 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.834 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.834 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.834 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.835 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2023-10-14T09:08:13.835 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2023-10-14T09:08:13.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.835 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.836 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.837 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.837 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2023-10-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2023-10-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.838 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.839 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.839 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.840 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.840 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2023-10-14T09:08:13.840 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2023-10-14T09:08:13.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:13.841 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.841 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.841 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.841 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.842 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2023-10-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2023-10-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.843 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.844 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.844 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.844 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.844 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.845 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.845 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.845 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.845 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.845 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2023-10-14T09:08:13.846 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2023-10-14T09:08:13.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.846 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.847 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.847 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.847 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.847 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.848 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.848 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2023-10-14T09:08:13.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2023-10-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.849 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.850 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.850 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.850 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.850 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.851 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2023-10-14T09:08:13.851 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2023-10-14T09:08:13.851 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.851 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.852 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.852 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:13.852 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2023-10-14T09:08:13.852 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.853 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.853 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.853 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.853 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.854 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2023-10-14T09:08:13.854 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2023-10-14T09:08:13.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.854 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.855 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.855 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.855 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.855 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.855 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2023-10-14T09:08:13.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2023-10-14T09:08:13.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.857 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.857 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.857 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.858 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.858 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.858 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.859 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.859 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2023-10-14T09:08:13.859 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2023-10-14T09:08:13.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.860 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.860 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.860 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.860 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.860 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.861 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.861 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.861 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.861 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.862 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2023-10-14T09:08:13.863 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.863 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.863 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.863 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2023-10-14T09:08:13.863 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2023-10-14T09:08:13.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.864 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.864 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.864 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.864 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.865 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.865 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.865 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2023-10-14T09:08:13.865 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.866 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2023-10-14T09:08:13.866 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2023-10-14T09:08:13.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.867 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.867 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.867 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.867 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.868 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2023-10-14T09:08:13.868 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.868 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.869 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.869 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.869 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.870 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.870 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.870 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.871 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.871 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.871 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.871 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.872 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.872 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.872 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.872 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.873 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.873 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.873 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.874 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.874 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.874 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.874 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.875 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.875 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.876 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.876 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.876 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.877 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.877 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.878 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.878 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.878 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.878 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.878 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.879 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.879 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.880 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.881 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.882 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.882 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.882 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.882 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.882 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2023-10-14T09:08:13.884 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.884 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.884 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.884 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.886 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.886 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.886 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.886 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.886 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.887 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.887 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.887 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.887 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.887 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.888 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.888 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.889 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.889 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.890 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.890 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.890 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.890 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.890 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.891 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.891 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.891 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.892 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.892 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.892 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.893 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.893 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.893 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.893 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.893 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.894 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.894 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.894 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.894 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.894 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.895 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.895 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.895 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.895 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.896 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.896 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.897 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.897 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.897 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.898 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.899 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2023-10-14T09:08:13.899 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.899 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.899 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.899 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.900 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.900 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.900 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.900 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.900 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.901 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.901 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.901 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.901 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.901 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.902 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.902 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.902 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.902 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.902 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.903 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.904 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.905 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.905 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.905 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.905 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.906 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.906 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.907 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.907 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.907 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.908 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.908 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.908 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.908 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.909 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.909 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.909 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.909 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.909 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.910 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.910 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.911 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.911 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.912 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.912 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.912 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.913 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2023-10-14T09:08:13.914 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.914 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.914 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.914 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2023-10-14T09:08:13.915 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2023-10-14T09:08:13.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-14T09:08:13.916 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.917 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:13.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:13.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:13.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2023-10-14T09:08:13.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.920 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.922 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.922 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.922 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.922 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.922 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.923 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.923 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.923 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.923 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.923 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.924 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.925 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.926 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.926 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.927 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.927 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.930 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.930 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.930 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.930 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.930 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2023-10-14T09:08:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2023-10-14T09:08:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2023-10-14T09:08:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-14T09:08:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2023-10-14T09:08:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2023-10-14T09:08:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-14T09:08:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2023-10-14T09:08:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2023-10-14T09:08:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-14T09:08:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2023-10-14T09:08:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2023-10-14T09:08:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-14T09:08:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2023-10-14T09:08:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2023-10-14T09:08:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-14T09:08:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2023-10-14T09:08:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2023-10-14T09:08:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2023-10-14T09:08:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2023-10-14T09:08:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2023-10-14T09:08:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2023-10-14T09:08:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-14T09:08:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-10-14T09:08:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-10-14T09:08:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2023-10-14T09:08:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2023-10-14T09:08:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2023-10-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2023-10-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2023-10-14T09:08:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2023-10-14T09:08:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2023-10-14T09:08:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2023-10-14T09:08:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2023-10-14T09:08:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2023-10-14T09:08:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2023-10-14T09:08:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2023-10-14T09:08:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2023-10-14T09:08:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2023-10-14T09:08:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2023-10-14T09:08:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-14T09:08:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2023-10-14T09:08:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-10-14T09:08:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.020 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.022 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.022 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.022 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.022 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.023 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.023 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.023 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.023 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.023 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.024 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.024 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.025 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.025 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.025 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.025 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.026 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.026 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.026 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2023-10-14T09:08:14.027 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2023-10-14T09:08:14.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.027 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.028 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2023-10-14T09:08:14.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.028 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.028 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-14T09:08:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.029 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2023-10-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2023-10-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.030 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2023-10-14T09:08:14.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.032 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2023-10-14T09:08:14.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2023-10-14T09:08:14.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:14.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.033 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-14T09:08:14.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.035 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.035 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2023-10-14T09:08:14.036 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.036 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.036 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.036 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2023-10-14T09:08:14.036 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2023-10-14T09:08:14.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:14.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.037 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2023-10-14T09:08:14.037 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.037 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.038 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.039 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2023-10-14T09:08:14.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2023-10-14T09:08:14.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.040 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.040 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.041 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.042 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:14.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:14.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.042 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.043 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:14.043 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.043 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.043 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.043 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.044 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.044 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.045 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.045 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.045 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.046 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.046 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.046 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.046 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.047 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.047 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.047 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.047 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.047 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.047 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.048 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.048 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.048 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.049 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.049 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.050 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.050 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.051 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.051 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.052 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.052 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.053 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.053 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.053 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.053 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.053 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.054 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.054 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.054 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.054 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.054 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.055 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.056 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.057 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.057 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.057 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.057 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.058 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2023-10-14T09:08:14.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2023-10-14T09:08:14.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.058 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.059 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.059 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.059 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.059 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.060 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.060 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.060 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.060 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.061 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2023-10-14T09:08:14.061 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2023-10-14T09:08:14.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.061 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.061 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.062 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2023-10-14T09:08:14.062 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.062 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.062 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.062 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.063 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.063 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.063 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.063 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2023-10-14T09:08:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2023-10-14T09:08:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-14T09:08:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.065 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.065 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.065 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.065 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.066 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.066 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.066 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.066 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.066 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:14.067 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.067 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.067 INFO:teuthology.orchestra.run.smithi006.stdout: "modules": [ 2023-10-14T09:08:14.067 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-10-14T09:08:14.067 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard", 2023-10-14T09:08:14.068 INFO:teuthology.orchestra.run.smithi006.stdout: "iostat", 2023-10-14T09:08:14.068 INFO:teuthology.orchestra.run.smithi006.stdout: "nfs", 2023-10-14T09:08:14.068 INFO:teuthology.orchestra.run.smithi006.stdout: "restful" 2023-10-14T09:08:14.068 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.068 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2023-10-14T09:08:14.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.069 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2023-10-14T09:08:14.069 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.069 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.069 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.069 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:14.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.071 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.071 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.071 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2023-10-14T09:08:14.071 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.072 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.072 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.072 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.073 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.073 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.073 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.073 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.074 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.074 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.074 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.074 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.074 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.075 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.075 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.075 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.075 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.076 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.076 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.077 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.077 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.078 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.079 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.079 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.080 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.080 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.080 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.081 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.081 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.081 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.081 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.081 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.086 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2023-10-14T09:08:14.086 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2023-10-14T09:08:14.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.086 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2023-10-14T09:08:14.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.088 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.088 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2023-10-14T09:08:14.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2023-10-14T09:08:14.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.089 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2023-10-14T09:08:14.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.090 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2023-10-14T09:08:14.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.091 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2023-10-14T09:08:14.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2023-10-14T09:08:14.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2023-10-14T09:08:14.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.093 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.094 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2023-10-14T09:08:14.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2023-10-14T09:08:14.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2023-10-14T09:08:14.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.097 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2023-10-14T09:08:14.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2023-10-14T09:08:14.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.098 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2023-10-14T09:08:14.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2023-10-14T09:08:14.099 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.099 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2023-10-14T09:08:14.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2023-10-14T09:08:14.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.101 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2023-10-14T09:08:14.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.102 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2023-10-14T09:08:14.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2023-10-14T09:08:14.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-14T09:08:14.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.104 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.105 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2023-10-14T09:08:14.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2023-10-14T09:08:14.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.106 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2023-10-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.108 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2023-10-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2023-10-14T09:08:14.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2023-10-14T09:08:14.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2023-10-14T09:08:14.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.112 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2023-10-14T09:08:14.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2023-10-14T09:08:14.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2023-10-14T09:08:14.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2023-10-14T09:08:14.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-14T09:08:14.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.115 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2023-10-14T09:08:14.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2023-10-14T09:08:14.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:14.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:14.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-10-14T09:08:14.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-10-14T09:08:14.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-14T09:08:14.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-14T09:08:14.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.118 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2023-10-14T09:08:14.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2023-10-14T09:08:14.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:14.118 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.118 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2023-10-14T09:08:14.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:14.119 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2023-10-14T09:08:14.119 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-14T09:08:14.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.120 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2023-10-14T09:08:14.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2023-10-14T09:08:14.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2023-10-14T09:08:14.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.122 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-14T09:08:14.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-14T09:08:14.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.123 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2023-10-14T09:08:14.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2023-10-14T09:08:14.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2023-10-14T09:08:14.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2023-10-14T09:08:14.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2023-10-14T09:08:14.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2023-10-14T09:08:14.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-14T09:08:14.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.126 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2023-10-14T09:08:14.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2023-10-14T09:08:14.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.127 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2023-10-14T09:08:14.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2023-10-14T09:08:14.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-14T09:08:14.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.129 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2023-10-14T09:08:14.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2023-10-14T09:08:14.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:14.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:14.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-10-14T09:08:14.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-10-14T09:08:14.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-14T09:08:14.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-14T09:08:14.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.132 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.132 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.132 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.133 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.133 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.133 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.134 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.134 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.134 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.134 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.134 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.135 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.135 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.136 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.136 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.136 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.137 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.137 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.139 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.140 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.140 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.140 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.141 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.141 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.141 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.141 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.143 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2023-10-14T09:08:14.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2023-10-14T09:08:14.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-14T09:08:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.148 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-10-14T09:08:14.148 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-10-14T09:08:14.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.148 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.148 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2023-10-14T09:08:14.149 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.149 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.149 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.149 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2023-10-14T09:08:14.150 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2023-10-14T09:08:14.150 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap" 2023-10-14T09:08:14.150 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2023-10-14T09:08:14.150 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.151 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2023-10-14T09:08:14.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2023-10-14T09:08:14.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.153 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-14T09:08:14.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.153 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.154 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:14.154 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:14.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.154 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.155 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:14.155 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.155 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.155 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-14T09:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2023-10-14T09:08:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2023-10-14T09:08:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:14.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:14.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-14T09:08:14.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-14T09:08:14.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.159 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2023-10-14T09:08:14.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2023-10-14T09:08:14.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:14.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-14T09:08:14.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.163 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2023-10-14T09:08:14.163 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.163 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.163 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.164 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2023-10-14T09:08:14.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2023-10-14T09:08:14.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.164 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.164 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-10-14T09:08:14.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.165 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-14T09:08:14.165 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.166 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2023-10-14T09:08:14.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2023-10-14T09:08:14.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.167 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2023-10-14T09:08:14.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.168 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-14T09:08:14.168 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.169 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.169 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2023-10-14T09:08:14.169 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2023-10-14T09:08:14.169 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.170 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.170 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2023-10-14T09:08:14.170 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.170 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.171 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.171 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-14T09:08:14.171 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2023-10-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2023-10-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.174 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2023-10-14T09:08:14.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2023-10-14T09:08:14.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.175 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:14.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.176 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.176 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-14T09:08:14.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2023-10-14T09:08:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2023-10-14T09:08:14.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2023-10-14T09:08:14.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.179 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.179 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-14T09:08:14.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.180 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.180 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_log_destination": { 2023-10-14T09:08:14.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm_log_destination", 2023-10-14T09:08:14.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.181 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.182 INFO:teuthology.orchestra.run.smithi006.stdout: "file", 2023-10-14T09:08:14.182 INFO:teuthology.orchestra.run.smithi006.stdout: "file,syslog", 2023-10-14T09:08:14.182 INFO:teuthology.orchestra.run.smithi006.stdout: "syslog" 2023-10-14T09:08:14.182 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.183 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-14T09:08:14.183 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.184 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2023-10-14T09:08:14.184 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2023-10-14T09:08:14.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.185 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.185 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.185 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-14T09:08:14.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.186 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.186 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2023-10-14T09:08:14.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2023-10-14T09:08:14.187 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-14T09:08:14.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.189 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2023-10-14T09:08:14.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2023-10-14T09:08:14.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.190 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.190 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.190 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.190 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-14T09:08:14.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.192 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2023-10-14T09:08:14.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2023-10-14T09:08:14.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-14T09:08:14.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:14.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2023-10-14T09:08:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2023-10-14T09:08:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-14T09:08:14.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2023-10-14T09:08:14.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.197 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2023-10-14T09:08:14.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2023-10-14T09:08:14.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-14T09:08:14.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.199 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2023-10-14T09:08:14.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.200 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.200 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2023-10-14T09:08:14.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2023-10-14T09:08:14.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.201 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.201 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-14T09:08:14.201 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.202 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:14.202 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.203 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2023-10-14T09:08:14.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2023-10-14T09:08:14.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.204 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2023-10-14T09:08:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2023-10-14T09:08:14.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2023-10-14T09:08:14.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.206 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-14T09:08:14.206 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2023-10-14T09:08:14.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2023-10-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2023-10-14T09:08:14.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-14T09:08:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2023-10-14T09:08:14.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.211 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2023-10-14T09:08:14.211 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2023-10-14T09:08:14.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.212 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-14T09:08:14.212 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2023-10-14T09:08:14.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.213 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2023-10-14T09:08:14.214 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2023-10-14T09:08:14.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.214 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-14T09:08:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2023-10-14T09:08:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.216 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.216 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2023-10-14T09:08:14.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2023-10-14T09:08:14.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.217 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-14T09:08:14.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.218 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.218 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.218 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2023-10-14T09:08:14.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.219 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.219 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2023-10-14T09:08:14.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2023-10-14T09:08:14.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.220 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.220 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-14T09:08:14.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.221 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.221 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:14.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.222 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2023-10-14T09:08:14.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2023-10-14T09:08:14.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2023-10-14T09:08:14.224 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.224 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2023-10-14T09:08:14.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2023-10-14T09:08:14.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.225 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-14T09:08:14.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.226 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-10-14T09:08:14.226 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.227 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2023-10-14T09:08:14.227 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2023-10-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2023-10-14T09:08:14.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.229 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.230 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2023-10-14T09:08:14.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2023-10-14T09:08:14.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.230 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-14T09:08:14.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.231 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.231 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2023-10-14T09:08:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.233 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2023-10-14T09:08:14.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2023-10-14T09:08:14.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.233 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2023-10-14T09:08:14.234 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2023-10-14T09:08:14.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2023-10-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:14.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2023-10-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2023-10-14T09:08:14.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2023-10-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2023-10-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2023-10-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2023-10-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.243 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2023-10-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2023-10-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2023-10-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2023-10-14T09:08:14.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2023-10-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2023-10-14T09:08:14.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2023-10-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2023-10-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2023-10-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.251 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2023-10-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2023-10-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2023-10-14T09:08:14.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2023-10-14T09:08:14.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2023-10-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.258 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.259 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2023-10-14T09:08:14.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2023-10-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.268 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.269 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.272 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.273 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.274 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-14T09:08:14.275 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-14T09:08:14.276 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2023-10-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.277 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.278 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2023-10-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2023-10-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.279 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.280 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2023-10-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2023-10-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2023-10-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-14T09:08:14.283 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2023-10-14T09:08:14.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2023-10-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.285 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2023-10-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-10-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-10-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.287 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2023-10-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.288 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2023-10-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2023-10-14T09:08:14.289 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2023-10-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2023-10-14T09:08:14.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2023-10-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.292 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.293 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2023-10-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2023-10-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.297 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2023-10-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2023-10-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-14T09:08:14.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2023-10-14T09:08:14.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2023-10-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2023-10-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2023-10-14T09:08:14.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2023-10-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2023-10-14T09:08:14.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.307 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2023-10-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2023-10-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2023-10-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.310 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2023-10-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.311 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2023-10-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2023-10-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.312 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2023-10-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2023-10-14T09:08:14.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.315 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.316 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2023-10-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2023-10-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.317 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2023-10-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2023-10-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.321 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2023-10-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2023-10-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2023-10-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2023-10-14T09:08:14.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2023-10-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.326 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2023-10-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.329 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.330 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.331 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.332 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.333 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.336 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.337 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.337 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.338 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.338 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.338 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.338 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.338 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.339 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.339 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.339 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.340 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.341 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.341 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.342 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.342 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.343 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2023-10-14T09:08:14.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2023-10-14T09:08:14.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.344 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2023-10-14T09:08:14.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.345 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-14T09:08:14.345 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.346 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2023-10-14T09:08:14.346 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2023-10-14T09:08:14.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.346 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.347 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.347 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2023-10-14T09:08:14.347 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.347 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.347 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-14T09:08:14.348 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.348 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2023-10-14T09:08:14.349 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.349 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.350 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.350 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-14T09:08:14.350 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-14T09:08:14.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.350 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.351 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.351 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.351 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.351 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.351 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.352 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.352 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.352 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.353 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2023-10-14T09:08:14.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-14T09:08:14.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.353 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.354 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.354 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.355 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.355 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.355 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-14T09:08:14.356 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-14T09:08:14.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.356 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.356 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.356 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.357 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.357 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.357 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.357 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.357 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.358 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.358 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2023-10-14T09:08:14.358 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2023-10-14T09:08:14.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.359 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.359 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.359 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.359 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.360 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.360 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.360 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.360 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.361 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.361 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-14T09:08:14.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-14T09:08:14.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.362 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2023-10-14T09:08:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-14T09:08:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.366 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-14T09:08:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-14T09:08:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.367 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-14T09:08:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-14T09:08:14.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-14T09:08:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-14T09:08:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.374 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-14T09:08:14.375 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-14T09:08:14.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.375 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.376 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.376 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.376 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.376 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.376 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.377 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.377 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-14T09:08:14.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-14T09:08:14.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.379 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.379 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.379 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.379 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.380 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-14T09:08:14.380 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-14T09:08:14.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.381 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.381 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.382 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.382 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-14T09:08:14.383 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-14T09:08:14.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.384 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.384 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.384 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.385 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.385 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.385 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.386 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-14T09:08:14.386 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-14T09:08:14.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.386 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.387 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.387 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.387 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.387 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.389 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2023-10-14T09:08:14.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-14T09:08:14.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:14.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.390 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.391 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.391 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-14T09:08:14.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-14T09:08:14.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.392 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.392 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.392 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.393 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.393 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.393 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.393 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.394 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.394 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2023-10-14T09:08:14.394 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2023-10-14T09:08:14.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.395 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.395 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.395 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.396 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.396 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.397 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2023-10-14T09:08:14.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-14T09:08:14.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.397 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:14.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.398 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-14T09:08:14.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-14T09:08:14.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.400 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.400 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.401 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.401 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.401 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.401 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.401 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.402 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.402 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-14T09:08:14.402 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-14T09:08:14.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.403 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.403 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.403 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.404 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.404 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.404 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.404 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.404 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.405 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-14T09:08:14.405 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-14T09:08:14.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.405 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.406 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.406 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.406 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.406 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.407 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.407 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.407 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.407 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.407 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-14T09:08:14.408 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-14T09:08:14.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.408 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.408 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.409 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.409 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.409 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.409 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.409 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.410 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.410 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2023-10-14T09:08:14.410 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-14T09:08:14.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.411 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.411 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.411 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.411 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.412 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.412 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.413 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-14T09:08:14.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-14T09:08:14.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.413 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.414 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.414 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.414 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.415 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.415 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-14T09:08:14.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-14T09:08:14.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.416 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.417 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.417 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.418 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.418 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-14T09:08:14.418 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-14T09:08:14.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.419 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.419 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.419 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.419 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.420 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.420 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.420 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.421 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-14T09:08:14.421 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-14T09:08:14.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.423 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-14T09:08:14.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-14T09:08:14.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.426 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-14T09:08:14.426 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-14T09:08:14.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.427 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.427 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.427 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.427 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.428 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.428 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.428 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.428 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.428 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.429 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-14T09:08:14.429 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-14T09:08:14.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.429 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.432 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-14T09:08:14.432 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-14T09:08:14.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.432 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.433 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.433 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.433 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.433 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.434 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.434 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2023-10-14T09:08:14.434 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-14T09:08:14.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.435 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.436 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.436 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.437 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.438 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-14T09:08:14.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.439 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.440 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-14T09:08:14.440 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-14T09:08:14.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.441 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.441 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.441 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.441 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.441 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.442 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.442 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.442 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-14T09:08:14.443 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-14T09:08:14.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.443 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2023-10-14T09:08:14.444 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.444 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.444 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.444 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.444 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.445 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.445 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-14T09:08:14.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-14T09:08:14.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.446 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.446 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2023-10-14T09:08:14.446 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.447 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.447 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.447 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.447 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.448 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.448 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2023-10-14T09:08:14.448 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-14T09:08:14.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.449 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.449 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.449 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.449 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.449 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.450 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.450 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.450 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.451 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-14T09:08:14.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-14T09:08:14.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-10-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.453 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.453 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.453 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.453 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.454 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2023-10-14T09:08:14.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-14T09:08:14.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.455 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.456 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2023-10-14T09:08:14.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-14T09:08:14.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.457 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.457 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.458 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.458 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.458 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.458 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.458 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.459 INFO:teuthology.orchestra.run.smithi006.stdout: "UNSAFE_TLS_v1_2": { 2023-10-14T09:08:14.459 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-14T09:08:14.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.460 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.460 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.461 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.461 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.461 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.461 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.461 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.462 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-14T09:08:14.462 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-14T09:08:14.462 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.462 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.463 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:14.463 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.463 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.463 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.464 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.464 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.464 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.464 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.465 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-14T09:08:14.465 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-14T09:08:14.465 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.465 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.465 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.466 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.466 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.466 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.466 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.467 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.467 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.467 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-14T09:08:14.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-14T09:08:14.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.468 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:14.468 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.469 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.469 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.469 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.469 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.470 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.470 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2023-10-14T09:08:14.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2023-10-14T09:08:14.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.471 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.472 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.472 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.472 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.472 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.473 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2023-10-14T09:08:14.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2023-10-14T09:08:14.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.473 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.474 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.474 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.474 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.474 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.475 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.475 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.475 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.475 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2023-10-14T09:08:14.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2023-10-14T09:08:14.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.476 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.477 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2023-10-14T09:08:14.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.478 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.478 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.478 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2023-10-14T09:08:14.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2023-10-14T09:08:14.479 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.479 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.479 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.479 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2023-10-14T09:08:14.479 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.480 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.480 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.480 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.481 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.481 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-10-14T09:08:14.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-10-14T09:08:14.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.482 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.483 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.483 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.484 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.484 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.484 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.484 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.485 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.485 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.485 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.485 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.485 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.486 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.486 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.486 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.486 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.486 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.487 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.487 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.487 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.488 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.489 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.489 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.489 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.490 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.490 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.491 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.491 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.491 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.492 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.493 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.493 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.493 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.493 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.493 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.493 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.495 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.495 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.495 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.495 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.496 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.496 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.496 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.497 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.497 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.497 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2023-10-14T09:08:14.498 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2023-10-14T09:08:14.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.498 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.498 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.498 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.499 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.499 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2023-10-14T09:08:14.499 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2023-10-14T09:08:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2023-10-14T09:08:14.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.501 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.501 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.501 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.502 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.502 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.502 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.502 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.503 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:14.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:14.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.504 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-10-14T09:08:14.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.504 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.505 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.506 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:14.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:14.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.506 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2023-10-14T09:08:14.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.507 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.507 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.508 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-10-14T09:08:14.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-10-14T09:08:14.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.510 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.511 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2023-10-14T09:08:14.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2023-10-14T09:08:14.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.512 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2023-10-14T09:08:14.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.513 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.513 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.513 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.513 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.514 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-10-14T09:08:14.514 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-10-14T09:08:14.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.514 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.515 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2023-10-14T09:08:14.515 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.515 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.516 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2023-10-14T09:08:14.516 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.517 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.517 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-10-14T09:08:14.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-10-14T09:08:14.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.518 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.518 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-10-14T09:08:14.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-10-14T09:08:14.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-10-14T09:08:14.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.519 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.520 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2023-10-14T09:08:14.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2023-10-14T09:08:14.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.520 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.521 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.521 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.521 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.522 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.522 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-10-14T09:08:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.524 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2023-10-14T09:08:14.524 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2023-10-14T09:08:14.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.524 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.525 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.525 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.525 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.525 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.525 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2023-10-14T09:08:14.526 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.526 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.526 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.527 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.527 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.527 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.528 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.528 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.528 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.528 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.529 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.529 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.529 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.529 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.529 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.530 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.531 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.531 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.532 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.532 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.532 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.532 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.533 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.533 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.533 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.533 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.534 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.534 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.534 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.534 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.536 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.536 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.536 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.537 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2023-10-14T09:08:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2023-10-14T09:08:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.540 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2023-10-14T09:08:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.541 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-14T09:08:14.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.543 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2023-10-14T09:08:14.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2023-10-14T09:08:14.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.543 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2023-10-14T09:08:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-14T09:08:14.544 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.545 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2023-10-14T09:08:14.545 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2023-10-14T09:08:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2023-10-14T09:08:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2023-10-14T09:08:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2023-10-14T09:08:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2023-10-14T09:08:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-10-14T09:08:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2023-10-14T09:08:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2023-10-14T09:08:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-14T09:08:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2023-10-14T09:08:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2023-10-14T09:08:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2023-10-14T09:08:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2023-10-14T09:08:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-14T09:08:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2023-10-14T09:08:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.568 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.568 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.568 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.569 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.569 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.569 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.569 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.570 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.570 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.570 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.570 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.571 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.571 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.571 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.572 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.572 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.572 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.572 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.573 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.573 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.573 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.573 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.573 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.574 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2023-10-14T09:08:14.574 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2023-10-14T09:08:14.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.575 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-10-14T09:08:14.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.575 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.576 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.576 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.576 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.576 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.576 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.577 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2023-10-14T09:08:14.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2023-10-14T09:08:14.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.577 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.578 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2023-10-14T09:08:14.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.578 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.578 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.578 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.579 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.579 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:14.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:14.580 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.580 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.580 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.580 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-10-14T09:08:14.580 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.581 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.581 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.581 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.581 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.581 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2023-10-14T09:08:14.583 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2023-10-14T09:08:14.583 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2023-10-14T09:08:14.583 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.583 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2023-10-14T09:08:14.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2023-10-14T09:08:14.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.584 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.584 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2023-10-14T09:08:14.585 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.585 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.585 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.585 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-14T09:08:14.585 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.586 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.586 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2023-10-14T09:08:14.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2023-10-14T09:08:14.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.587 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.587 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.587 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2023-10-14T09:08:14.587 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.588 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.588 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.588 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-14T09:08:14.588 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.589 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.589 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2023-10-14T09:08:14.589 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2023-10-14T09:08:14.589 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.590 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.590 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.590 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.590 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.591 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.591 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2023-10-14T09:08:14.591 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.591 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.591 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.592 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:14.592 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:14.592 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.592 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.593 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2023-10-14T09:08:14.593 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2023-10-14T09:08:14.593 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.593 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.594 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-14T09:08:14.594 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.594 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.595 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.595 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.596 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.596 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.596 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.596 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.597 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.598 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.598 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.598 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.599 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.599 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.600 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.600 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.601 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.601 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.601 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.601 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.602 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.602 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.602 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.602 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.603 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.604 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.606 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2023-10-14T09:08:14.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2023-10-14T09:08:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.609 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2023-10-14T09:08:14.610 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2023-10-14T09:08:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2023-10-14T09:08:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2023-10-14T09:08:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2023-10-14T09:08:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.613 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-10-14T09:08:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-10-14T09:08:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.614 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2023-10-14T09:08:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.615 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-14T09:08:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2023-10-14T09:08:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2023-10-14T09:08:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.617 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2023-10-14T09:08:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-14T09:08:14.618 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2023-10-14T09:08:14.619 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2023-10-14T09:08:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.620 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2023-10-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.621 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2023-10-14T09:08:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2023-10-14T09:08:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.622 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2023-10-14T09:08:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.623 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2023-10-14T09:08:14.625 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.626 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.627 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.629 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.631 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.633 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.634 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.635 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.638 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2023-10-14T09:08:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.640 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.645 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.646 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.647 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.648 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.649 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.650 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.651 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.652 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.653 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2023-10-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.655 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2023-10-14T09:08:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2023-10-14T09:08:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2023-10-14T09:08:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-14T09:08:14.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2023-10-14T09:08:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2023-10-14T09:08:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2023-10-14T09:08:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-14T09:08:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.662 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.663 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.668 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.669 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.670 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.672 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.673 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2023-10-14T09:08:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.675 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2023-10-14T09:08:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2023-10-14T09:08:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2023-10-14T09:08:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2023-10-14T09:08:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-14T09:08:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.678 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.679 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.680 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.681 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.687 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.688 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.691 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2023-10-14T09:08:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2023-10-14T09:08:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.692 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2023-10-14T09:08:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-14T09:08:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2023-10-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2023-10-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.695 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2023-10-14T09:08:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2023-10-14T09:08:14.696 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2023-10-14T09:08:14.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2023-10-14T09:08:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2023-10-14T09:08:14.698 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2023-10-14T09:08:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2023-10-14T09:08:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2023-10-14T09:08:14.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2023-10-14T09:08:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2023-10-14T09:08:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2023-10-14T09:08:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.703 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2023-10-14T09:08:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.704 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-14T09:08:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-14T09:08:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.705 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2023-10-14T09:08:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2023-10-14T09:08:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2023-10-14T09:08:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-10-14T09:08:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2023-10-14T09:08:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2023-10-14T09:08:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-14T09:08:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2023-10-14T09:08:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-10-14T09:08:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-10-14T09:08:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2023-10-14T09:08:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2023-10-14T09:08:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2023-10-14T09:08:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2023-10-14T09:08:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2023-10-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2023-10-14T09:08:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.804 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.804 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.804 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.804 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.805 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.805 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.805 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.805 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.805 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.806 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.806 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.806 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.807 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.807 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.807 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.808 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.808 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.808 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.809 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.811 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.811 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.811 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.811 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.812 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.812 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.812 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.812 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.812 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.812 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.813 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.813 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.813 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.814 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.814 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.814 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.814 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.815 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.815 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.815 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.815 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.815 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.816 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:14.816 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:14.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.816 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.817 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.818 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.818 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.818 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.818 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.819 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2023-10-14T09:08:14.819 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2023-10-14T09:08:14.819 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.819 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.819 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.820 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-10-14T09:08:14.820 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2023-10-14T09:08:14.820 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.820 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.820 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2023-10-14T09:08:14.820 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.822 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2023-10-14T09:08:14.822 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.822 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.822 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2023-10-14T09:08:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2023-10-14T09:08:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.824 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-14T09:08:14.825 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.825 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.825 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.825 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-10-14T09:08:14.826 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-10-14T09:08:14.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.826 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.826 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.827 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.827 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.827 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.827 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.828 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.828 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.828 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.829 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.829 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.829 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.830 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.830 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.830 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.830 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.831 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.831 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.831 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.831 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.832 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.832 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.832 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.833 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.833 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.833 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.834 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.834 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.834 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.835 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.835 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.835 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.835 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.836 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.836 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.837 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.837 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.837 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.837 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.837 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.838 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.838 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.838 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.838 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.838 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.839 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.839 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.839 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.840 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.841 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.841 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.841 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.841 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.842 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2023-10-14T09:08:14.842 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2023-10-14T09:08:14.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.843 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2023-10-14T09:08:14.843 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.843 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.844 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.844 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2023-10-14T09:08:14.844 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.845 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-10-14T09:08:14.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-10-14T09:08:14.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:14.845 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-10-14T09:08:14.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.847 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2023-10-14T09:08:14.847 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2023-10-14T09:08:14.848 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.848 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.849 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.849 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2023-10-14T09:08:14.849 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2023-10-14T09:08:14.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.851 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.851 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.852 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2023-10-14T09:08:14.852 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2023-10-14T09:08:14.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.852 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.853 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.853 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.853 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.853 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-14T09:08:14.854 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-14T09:08:14.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.854 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.854 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.855 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.855 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.855 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.855 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.856 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.856 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.856 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.856 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.856 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.856 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.857 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.857 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.857 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.857 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.857 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.858 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.858 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.858 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.858 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.861 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.861 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.862 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.863 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.863 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.863 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.863 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.863 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.865 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.866 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.867 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.867 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.867 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.868 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2023-10-14T09:08:14.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2023-10-14T09:08:14.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.868 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.869 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.869 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.869 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.869 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.870 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.870 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.870 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-14T09:08:14.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-14T09:08:14.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.871 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2023-10-14T09:08:14.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.872 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.872 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.873 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2023-10-14T09:08:14.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2023-10-14T09:08:14.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.874 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2023-10-14T09:08:14.874 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.874 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.874 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.875 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:14.876 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:14.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.876 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-10-14T09:08:14.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.877 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-14T09:08:14.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:14.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:14.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.879 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.879 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.879 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2023-10-14T09:08:14.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.880 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.880 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-14T09:08:14.880 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.880 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.880 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.881 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2023-10-14T09:08:14.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2023-10-14T09:08:14.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.882 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.882 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2023-10-14T09:08:14.882 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.882 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.883 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.884 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-10-14T09:08:14.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-10-14T09:08:14.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.885 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2023-10-14T09:08:14.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.885 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.886 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2023-10-14T09:08:14.886 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2023-10-14T09:08:14.886 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.886 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.886 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.887 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.887 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.887 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-10-14T09:08:14.887 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-10-14T09:08:14.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.888 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.888 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.888 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-10-14T09:08:14.888 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-10-14T09:08:14.889 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-10-14T09:08:14.889 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.889 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.889 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.890 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.890 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.890 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-10-14T09:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.892 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.892 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.892 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.893 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.893 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.893 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.893 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.893 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.894 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.894 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.894 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.894 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.894 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.895 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.895 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.895 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.895 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.896 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.896 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.897 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.897 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.897 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.898 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.898 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.898 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.899 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.900 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.900 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.900 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.900 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.901 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.901 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.901 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.901 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.902 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.902 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.902 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.902 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.903 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.903 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.903 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.904 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.904 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.904 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.904 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.904 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.904 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2023-10-14T09:08:14.905 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2023-10-14T09:08:14.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.906 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-10-14T09:08:14.906 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.906 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.906 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.907 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.907 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.907 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.908 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2023-10-14T09:08:14.908 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2023-10-14T09:08:14.908 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.908 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.909 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.909 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.909 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.909 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.910 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.910 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2023-10-14T09:08:14.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2023-10-14T09:08:14.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.911 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.911 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.912 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.912 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.912 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.912 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.913 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2023-10-14T09:08:14.914 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.914 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.914 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.914 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2023-10-14T09:08:14.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2023-10-14T09:08:14.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:14.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-10-14T09:08:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-10-14T09:08:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.917 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.918 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.918 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.919 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.920 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.920 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.920 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.921 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.921 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.922 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.922 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.922 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.922 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.922 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.923 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.923 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.923 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.923 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.924 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.924 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.925 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.926 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.927 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.927 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.928 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.929 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.929 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.929 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.929 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.929 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.930 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.930 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.930 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.930 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.930 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.931 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.931 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.931 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.932 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.932 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.932 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.932 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.933 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-10-14T09:08:14.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-10-14T09:08:14.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.935 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.935 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.935 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.936 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-10-14T09:08:14.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-10-14T09:08:14.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.937 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.938 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.938 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.939 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.939 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2023-10-14T09:08:14.940 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.940 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.940 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.940 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.940 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.941 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.941 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.942 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.942 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.942 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.942 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.942 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.943 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.943 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.943 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.943 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.944 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.944 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.944 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.945 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.945 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.946 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.946 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.946 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.946 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.946 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.948 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.949 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.950 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.951 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.951 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.951 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.952 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.952 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.952 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.952 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.953 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.953 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.953 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.954 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.954 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.954 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2023-10-14T09:08:14.955 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.955 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.955 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.955 INFO:teuthology.orchestra.run.smithi006.stdout: "drive_group_interval": { 2023-10-14T09:08:14.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "drive_group_interval", 2023-10-14T09:08:14.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:14.956 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300.0", 2023-10-14T09:08:14.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.957 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.957 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-14T09:08:14.957 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.958 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.958 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.959 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.959 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.959 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.959 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.960 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.961 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.961 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.962 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.962 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.963 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.963 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.963 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.963 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.965 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.966 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.966 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.966 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.967 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.967 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.967 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.967 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.968 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.969 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.971 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2023-10-14T09:08:14.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2023-10-14T09:08:14.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2023-10-14T09:08:14.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-14T09:08:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:14.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:14.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2023-10-14T09:08:14.974 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:14.975 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:14.975 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:14.975 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:14.975 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:14.975 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.976 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.976 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.976 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.976 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.977 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.977 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.977 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.977 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.978 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.978 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.978 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.979 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.979 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:14.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:14.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.982 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:14.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:14.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:14.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:14.984 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:14.984 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:14.984 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:14.984 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:14.984 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.986 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:14.986 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:14.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:14.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:14.987 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:14.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.988 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.988 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.988 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.989 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2023-10-14T09:08:14.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2023-10-14T09:08:14.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.992 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2023-10-14T09:08:14.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2023-10-14T09:08:14.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2023-10-14T09:08:14.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.994 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2023-10-14T09:08:14.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2023-10-14T09:08:14.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:14.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:14.997 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2023-10-14T09:08:14.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2023-10-14T09:08:14.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:14.997 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:14.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:14.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:14.998 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:14.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:14.998 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:14.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:14.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:14.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:14.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:14.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.000 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2023-10-14T09:08:15.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2023-10-14T09:08:15.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-10-14T09:08:15.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.002 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2023-10-14T09:08:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2023-10-14T09:08:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.005 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2023-10-14T09:08:15.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2023-10-14T09:08:15.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.006 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.007 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.008 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2023-10-14T09:08:15.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2023-10-14T09:08:15.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.010 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.010 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.010 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2023-10-14T09:08:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2023-10-14T09:08:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-10-14T09:08:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2023-10-14T09:08:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2023-10-14T09:08:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2023-10-14T09:08:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2023-10-14T09:08:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2023-10-14T09:08:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.017 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.017 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.017 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.017 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.017 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.018 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.018 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.018 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.019 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2023-10-14T09:08:15.019 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2023-10-14T09:08:15.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.019 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.020 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.020 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.020 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.020 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.020 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.021 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2023-10-14T09:08:15.022 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.022 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.023 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.023 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2023-10-14T09:08:15.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2023-10-14T09:08:15.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.024 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2023-10-14T09:08:15.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.025 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2023-10-14T09:08:15.026 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2023-10-14T09:08:15.026 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.027 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.027 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2023-10-14T09:08:15.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.029 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.029 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.037 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2023-10-14T09:08:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.045 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.046 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.047 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.048 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.048 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.048 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.048 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.049 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.049 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.049 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.050 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.050 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.050 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.051 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.051 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.052 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.052 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.052 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.052 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.052 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.053 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.053 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.053 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.054 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.054 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.055 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.055 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.055 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.055 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.056 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.056 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.056 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.057 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.057 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2023-10-14T09:08:15.057 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.058 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.058 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.058 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.059 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.059 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.059 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.059 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.060 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.060 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.060 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.060 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.060 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.060 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.061 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.061 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.062 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.064 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.065 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.066 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.067 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.067 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.067 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.067 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.067 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.068 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.068 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.068 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.068 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.069 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.069 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.070 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.070 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.071 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.071 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.071 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.071 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.072 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2023-10-14T09:08:15.073 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.073 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.073 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.073 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2023-10-14T09:08:15.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2023-10-14T09:08:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-14T09:08:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.075 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.075 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.076 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:15.076 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:15.076 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:15.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.077 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2023-10-14T09:08:15.077 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.077 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.078 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.078 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.079 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.079 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.080 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.080 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.081 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.081 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.081 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.081 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.081 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.082 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.082 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.083 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.084 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.084 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.085 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.085 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.085 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.086 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.086 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.087 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.087 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.088 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.088 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.088 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.088 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.088 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.089 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.089 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.089 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.089 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.090 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.090 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.091 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.091 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.092 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.092 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.092 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.092 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.093 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.093 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2023-10-14T09:08:15.093 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.094 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.094 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.094 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2023-10-14T09:08:15.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2023-10-14T09:08:15.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:15.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-14T09:08:15.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.097 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2023-10-14T09:08:15.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2023-10-14T09:08:15.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.098 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:15.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-14T09:08:15.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2023-10-14T09:08:15.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2023-10-14T09:08:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-10-14T09:08:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-14T09:08:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2023-10-14T09:08:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2023-10-14T09:08:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-14T09:08:15.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.104 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.104 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2023-10-14T09:08:15.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2023-10-14T09:08:15.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.106 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-14T09:08:15.106 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.107 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2023-10-14T09:08:15.107 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2023-10-14T09:08:15.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.108 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.109 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.110 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2023-10-14T09:08:15.110 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2023-10-14T09:08:15.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.112 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2023-10-14T09:08:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2023-10-14T09:08:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-14T09:08:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-10-14T09:08:15.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-10-14T09:08:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:15.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2023-10-14T09:08:15.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2023-10-14T09:08:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2023-10-14T09:08:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2023-10-14T09:08:15.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2023-10-14T09:08:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2023-10-14T09:08:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2023-10-14T09:08:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.126 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2023-10-14T09:08:15.127 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2023-10-14T09:08:15.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.127 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.129 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.129 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.130 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.131 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.131 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.131 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.132 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.133 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.133 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.133 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.133 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.134 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.134 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.137 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.139 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.139 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.139 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.139 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.140 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.140 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.140 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.140 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.140 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.141 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.141 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.142 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.142 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.142 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.143 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.143 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.143 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.143 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.144 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2023-10-14T09:08:15.144 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2023-10-14T09:08:15.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.144 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.145 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.145 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.145 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.145 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.146 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.146 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2023-10-14T09:08:15.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2023-10-14T09:08:15.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.148 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.149 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.149 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2023-10-14T09:08:15.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2023-10-14T09:08:15.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.150 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.150 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-14T09:08:15.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.151 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.151 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2023-10-14T09:08:15.152 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.152 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.153 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.153 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.153 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.153 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.154 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.154 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.154 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.154 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.154 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.155 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.155 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.155 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.155 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.155 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.156 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.156 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.156 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.157 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.157 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.157 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.158 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.158 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.158 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.158 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.159 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.159 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.160 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.161 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.162 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.162 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.162 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.162 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.162 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.163 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.163 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.163 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.164 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.164 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.164 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.165 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.165 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.165 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.165 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-10-14T09:08:15.167 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.167 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.167 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.167 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.168 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.169 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.169 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.169 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.169 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.169 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.170 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.170 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.170 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.170 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.171 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.171 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.172 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.173 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.173 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.174 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.175 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.175 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.175 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.176 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.176 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.176 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.176 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.176 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.177 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.177 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.177 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.177 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.178 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.178 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.178 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.178 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.179 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.179 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.179 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.179 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.180 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.180 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.180 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2023-10-14T09:08:15.181 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2023-10-14T09:08:15.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:15.181 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2023-10-14T09:08:15.182 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.182 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.182 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-14T09:08:15.182 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi006.stdout: "periodic_async_work": { 2023-10-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "periodic_async_work", 2023-10-14T09:08:15.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.184 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Periodically check for async work", 2023-10-14T09:08:15.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.186 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2023-10-14T09:08:15.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2023-10-14T09:08:15.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:15.186 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-10-14T09:08:15.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.187 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.187 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-14T09:08:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.189 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2023-10-14T09:08:15.189 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-10-14T09:08:15.189 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-10-14T09:08:15.189 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-10-14T09:08:15.190 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2023-10-14T09:08:15.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2023-10-14T09:08:15.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-10-14T09:08:15.190 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.191 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2023-10-14T09:08:15.191 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.191 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.191 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.192 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.192 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2023-10-14T09:08:15.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2023-10-14T09:08:15.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-10-14T09:08:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-10-14T09:08:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-10-14T09:08:15.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-10-14T09:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.197 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-10-14T09:08:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-10-14T09:08:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.199 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-10-14T09:08:15.201 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-10-14T09:08:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.202 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-10-14T09:08:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-10-14T09:08:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.204 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-10-14T09:08:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.205 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-10-14T09:08:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-10-14T09:08:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-10-14T09:08:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-10-14T09:08:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-10-14T09:08:15.206 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-10-14T09:08:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-10-14T09:08:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.207 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-10-14T09:08:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-10-14T09:08:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-10-14T09:08:15.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-10-14T09:08:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-10-14T09:08:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2023-10-14T09:08:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2023-10-14T09:08:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-10-14T09:08:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.212 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2023-10-14T09:08:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2023-10-14T09:08:15.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-10-14T09:08:15.214 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.214 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2023-10-14T09:08:15.214 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.215 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.215 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.215 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.216 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2023-10-14T09:08:15.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2023-10-14T09:08:15.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-10-14T09:08:15.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-10-14T09:08:15.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-10-14T09:08:15.217 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-14T09:08:15.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-10-14T09:08:15.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-10-14T09:08:15.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-10-14T09:08:15.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-10-14T09:08:15.218 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-10-14T09:08:15.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-10-14T09:08:15.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-10-14T09:08:15.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.219 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.219 INFO:teuthology.orchestra.run.smithi006.stdout: "services": { 2023-10-14T09:08:15.219 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard": "https://172.21.15.6:8443/" 2023-10-14T09:08:15.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: "always_on_modules": { 2023-10-14T09:08:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: "octopus": [ 2023-10-14T09:08:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-10-14T09:08:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-10-14T09:08:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-10-14T09:08:15.220 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-10-14T09:08:15.221 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-10-14T09:08:15.221 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-10-14T09:08:15.221 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-10-14T09:08:15.221 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-10-14T09:08:15.221 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-10-14T09:08:15.222 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-10-14T09:08:15.222 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.222 INFO:teuthology.orchestra.run.smithi006.stdout: "pacific": [ 2023-10-14T09:08:15.222 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-10-14T09:08:15.222 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-10-14T09:08:15.223 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-10-14T09:08:15.223 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-10-14T09:08:15.223 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-10-14T09:08:15.223 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-10-14T09:08:15.223 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-10-14T09:08:15.223 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-10-14T09:08:15.224 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-10-14T09:08:15.224 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-10-14T09:08:15.224 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.224 INFO:teuthology.orchestra.run.smithi006.stdout: "quincy": [ 2023-10-14T09:08:15.224 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-10-14T09:08:15.225 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-10-14T09:08:15.225 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-10-14T09:08:15.225 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-10-14T09:08:15.225 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-10-14T09:08:15.225 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-10-14T09:08:15.225 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-10-14T09:08:15.226 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-10-14T09:08:15.226 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-10-14T09:08:15.226 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-10-14T09:08:15.226 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-10-14T09:08:15.226 INFO:teuthology.orchestra.run.smithi006.stdout: "reef": [ 2023-10-14T09:08:15.227 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-10-14T09:08:15.227 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-10-14T09:08:15.227 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-10-14T09:08:15.227 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-10-14T09:08:15.227 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-10-14T09:08:15.228 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-10-14T09:08:15.228 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-10-14T09:08:15.228 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-10-14T09:08:15.228 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-10-14T09:08:15.228 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-10-14T09:08:15.228 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:15.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.229 INFO:teuthology.orchestra.run.smithi006.stdout: "last_failure_osd_epoch": 3, 2023-10-14T09:08:15.229 INFO:teuthology.orchestra.run.smithi006.stdout: "active_clients": [ 2023-10-14T09:08:15.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.229 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-10-14T09:08:15.230 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-14T09:08:15.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-14T09:08:15.230 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-10-14T09:08:15.230 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2747318236 2023-10-14T09:08:15.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:15.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "libcephsqlite", 2023-10-14T09:08:15.231 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-14T09:08:15.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-14T09:08:15.232 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-10-14T09:08:15.232 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 887401432 2023-10-14T09:08:15.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.233 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:15.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-10-14T09:08:15.233 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-14T09:08:15.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-14T09:08:15.234 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-10-14T09:08:15.234 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4218490888 2023-10-14T09:08:15.234 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.234 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:15.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:15.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-10-14T09:08:15.235 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-10-14T09:08:15.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-10-14T09:08:15.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-10-14T09:08:15.236 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-10-14T09:08:15.236 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3739699064 2023-10-14T09:08:15.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:15.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:15.237 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-10-14T09:08:15.237 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T09:08:15.239 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:12 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2465611577' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T09:08:15.239 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:12 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/97476911' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-14T09:08:15.239 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:12 smithi057 ceph-mon[103313]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 1.91k op/s 2023-10-14T09:08:15.239 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:13 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:15.239 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:14 smithi057 ceph-mon[103313]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2023-10-14T09:08:15.240 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:12 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2465611577' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T09:08:15.240 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:12 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/97476911' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-14T09:08:15.240 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:12 smithi178 ceph-mon[103612]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 1.91k op/s 2023-10-14T09:08:15.240 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:13 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:15.240 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:14 smithi178 ceph-mon[103612]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2023-10-14T09:08:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa0f40a1480 msgr2=0x7fa0f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa0f40a1480 0x7fa0f40a3940 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0f800b5c0 tx=0x7fa0f8005fd0 comp rx=0 tx=0).stop 2023-10-14T09:08:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 msgr2=0x7fa108196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa108196b00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fa10400c990 tx=0x7fa10400cca0 comp rx=0 tx=0).stop 2023-10-14T09:08:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 shutdown_connections 2023-10-14T09:08:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa108101300 0x7fa10819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1080fff50 0x7fa108196b00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fa0f40a1480 0x7fa0f40a3940 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 --2- 172.21.15.6:0/97476911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa108100910 0x7fa108197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 >> 172.21.15.6:0/97476911 conn(0x7fa1080faa80 msgr2=0x7fa1080feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 shutdown_connections 2023-10-14T09:08:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:11.641+0000 7fa1103c7700 1 -- 172.21.15.6:0/97476911 wait complete. 2023-10-14T09:08:15.250 DEBUG:tasks.check_counter:Getting stats from a 2023-10-14T09:08:15.250 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-14T09:08:15.251 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2465611577' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T09:08:15.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:12 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/97476911' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-14T09:08:15.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:12 smithi006 ceph-mon[99452]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 24 MiB/s wr, 1.91k op/s 2023-10-14T09:08:15.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:13 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:15.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:14 smithi006 ceph-mon[99452]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 12 MiB/s wr, 1.14k op/s 2023-10-14T09:08:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T09:08:16.340 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:15 smithi006 ceph-mon[99452]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 902 op/s 2023-10-14T09:08:16.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:15 smithi178 ceph-mon[103612]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 902 op/s 2023-10-14T09:08:16.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:16 smithi057 ceph-mon[103313]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 902 op/s 2023-10-14T09:08:17.091 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T09:08:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2106, 2023-10-14T09:08:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2108, 2023-10-14T09:08:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 2509962, 2023-10-14T09:08:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 654967, 2023-10-14T09:08:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2023-10-14T09:08:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2023-10-14T09:08:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.181141839, 2023-10-14T09:08:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.050476039, 2023-10-14T09:08:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.047634953, 2023-10-14T09:08:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.066538406, 2023-10-14T09:08:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2106, 2023-10-14T09:08:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.188495784, 2023-10-14T09:08:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000089504 2023-10-14T09:08:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-14T09:08:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2023-10-14T09:08:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 5, 2023-10-14T09:08:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 213, 2023-10-14T09:08:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 1710, 2023-10-14T09:08:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 530841, 2023-10-14T09:08:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 8, 2023-10-14T09:08:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.015601453, 2023-10-14T09:08:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.010849680, 2023-10-14T09:08:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002781797, 2023-10-14T09:08:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000129639, 2023-10-14T09:08:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 211, 2023-10-14T09:08:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.038065672, 2023-10-14T09:08:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000180406 2023-10-14T09:08:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 529840 2023-10-14T09:08:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1237, 2023-10-14T09:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1203, 2023-10-14T09:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 919526, 2023-10-14T09:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 452632, 2023-10-14T09:08:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.120604133, 2023-10-14T09:08:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.034358716, 2023-10-14T09:08:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.036366497, 2023-10-14T09:08:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.043410764, 2023-10-14T09:08:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1203, 2023-10-14T09:08:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.184139659, 2023-10-14T09:08:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000153067 2023-10-14T09:08:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 693184, 2023-10-14T09:08:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 166512 2023-10-14T09:08:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-10-14T09:08:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2023-10-14T09:08:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-10-14T09:08:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2023-10-14T09:08:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-10-14T09:08:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-10-14T09:08:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 5006, 2023-10-14T09:08:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.148950062, 2023-10-14T09:08:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000029754 2023-10-14T09:08:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-10-14T09:08:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-10-14T09:08:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2023-10-14T09:08:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2023-10-14T09:08:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2023-10-14T09:08:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2023-10-14T09:08:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2023-10-14T09:08:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2023-10-14T09:08:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:17.111 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2023-10-14T09:08:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2023-10-14T09:08:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2023-10-14T09:08:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 310, 2023-10-14T09:08:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2023-10-14T09:08:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 174, 2023-10-14T09:08:17.112 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 136, 2023-10-14T09:08:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 309, 2023-10-14T09:08:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 775, 2023-10-14T09:08:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2023-10-14T09:08:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2023-10-14T09:08:17.113 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 3, 2023-10-14T09:08:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2023-10-14T09:08:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2023-10-14T09:08:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2023-10-14T09:08:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2023-10-14T09:08:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:17.114 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2023-10-14T09:08:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2023-10-14T09:08:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2023-10-14T09:08:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2023-10-14T09:08:17.115 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2023-10-14T09:08:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2023-10-14T09:08:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2023-10-14T09:08:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:17.116 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2023-10-14T09:08:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2023-10-14T09:08:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2023-10-14T09:08:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:17.117 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:17.118 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2023-10-14T09:08:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2023-10-14T09:08:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:17.119 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2023-10-14T09:08:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2023-10-14T09:08:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2023-10-14T09:08:17.120 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2023-10-14T09:08:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2023-10-14T09:08:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2023-10-14T09:08:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2023-10-14T09:08:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2023-10-14T09:08:17.121 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2023-10-14T09:08:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2023-10-14T09:08:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2023-10-14T09:08:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:17.122 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2023-10-14T09:08:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2023-10-14T09:08:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2023-10-14T09:08:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:17.123 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2023-10-14T09:08:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2023-10-14T09:08:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2023-10-14T09:08:17.124 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2023-10-14T09:08:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2023-10-14T09:08:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2023-10-14T09:08:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2023-10-14T09:08:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2023-10-14T09:08:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2023-10-14T09:08:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2023-10-14T09:08:17.126 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 950, 2023-10-14T09:08:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2023-10-14T09:08:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2023-10-14T09:08:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2023-10-14T09:08:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2023-10-14T09:08:17.127 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2023-10-14T09:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 2, 2023-10-14T09:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 2, 2023-10-14T09:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2023-10-14T09:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2023-10-14T09:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 4194304, 2023-10-14T09:08:17.128 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 6079837, 2023-10-14T09:08:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 6078699, 2023-10-14T09:08:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2023-10-14T09:08:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.129 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 950 2023-10-14T09:08:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.130 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2023-10-14T09:08:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 75, 2023-10-14T09:08:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 114, 2023-10-14T09:08:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 39, 2023-10-14T09:08:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 11, 2023-10-14T09:08:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 13, 2023-10-14T09:08:17.131 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 2, 2023-10-14T09:08:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 310, 2023-10-14T09:08:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 1124, 2023-10-14T09:08:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 814, 2023-10-14T09:08:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2023-10-14T09:08:17.132 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2023-10-14T09:08:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2023-10-14T09:08:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 49604, 2023-10-14T09:08:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 207152 2023-10-14T09:08:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2023-10-14T09:08:17.133 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2023-10-14T09:08:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2023-10-14T09:08:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2023-10-14T09:08:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2023-10-14T09:08:17.134 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2023-10-14T09:08:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.135 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2023-10-14T09:08:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.136 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2023-10-14T09:08:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2023-10-14T09:08:17.138 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.139 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2023-10-14T09:08:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.140 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2023-10-14T09:08:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.141 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.142 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.143 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2023-10-14T09:08:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2023-10-14T09:08:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.145 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2023-10-14T09:08:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2023-10-14T09:08:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2023-10-14T09:08:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2023-10-14T09:08:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.149 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2023-10-14T09:08:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.150 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.151 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.152 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2023-10-14T09:08:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:17.154 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2023-10-14T09:08:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.155 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.156 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.157 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2023-10-14T09:08:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.158 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2023-10-14T09:08:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.159 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2023-10-14T09:08:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.160 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2023-10-14T09:08:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.162 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2023-10-14T09:08:17.163 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2023-10-14T09:08:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2023-10-14T09:08:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2023-10-14T09:08:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2023-10-14T09:08:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2023-10-14T09:08:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2023-10-14T09:08:17.164 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2023-10-14T09:08:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 2328, 2023-10-14T09:08:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-10-14T09:08:17.165 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:17.166 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:17.167 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:17.168 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:17.169 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:17.170 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-10-14T09:08:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:17.171 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 199983, 2023-10-14T09:08:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 122, 2023-10-14T09:08:17.172 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-10-14T09:08:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-10-14T09:08:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:17.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 160, 2023-10-14T09:08:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:17.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-10-14T09:08:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 412940, 2023-10-14T09:08:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 15569, 2023-10-14T09:08:17.175 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-10-14T09:08:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-10-14T09:08:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2023-10-14T09:08:17.176 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2023-10-14T09:08:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2023-10-14T09:08:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 3029, 2023-10-14T09:08:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2023-10-14T09:08:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2023-10-14T09:08:17.177 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 3029, 2023-10-14T09:08:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2023-10-14T09:08:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3029, 2023-10-14T09:08:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 12.597878218, 2023-10-14T09:08:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.004159088 2023-10-14T09:08:17.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2023-10-14T09:08:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2023-10-14T09:08:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3029, 2023-10-14T09:08:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 3030 2023-10-14T09:08:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.179 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 3029, 2023-10-14T09:08:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 3029, 2023-10-14T09:08:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2023-10-14T09:08:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2023-10-14T09:08:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2023-10-14T09:08:17.180 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 1922, 2023-10-14T09:08:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2023-10-14T09:08:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 1105, 2023-10-14T09:08:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2023-10-14T09:08:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2023-10-14T09:08:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2023-10-14T09:08:17.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2023-10-14T09:08:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2023-10-14T09:08:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2023-10-14T09:08:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2023-10-14T09:08:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2023-10-14T09:08:17.182 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2023-10-14T09:08:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2023-10-14T09:08:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:17.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2023-10-14T09:08:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2023-10-14T09:08:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2023-10-14T09:08:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:17.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2023-10-14T09:08:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2023-10-14T09:08:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2023-10-14T09:08:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2023-10-14T09:08:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2023-10-14T09:08:17.185 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2023-10-14T09:08:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2023-10-14T09:08:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2023-10-14T09:08:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2023-10-14T09:08:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2023-10-14T09:08:17.186 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2023-10-14T09:08:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2023-10-14T09:08:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2023-10-14T09:08:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2023-10-14T09:08:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2023-10-14T09:08:17.187 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2023-10-14T09:08:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2023-10-14T09:08:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2023-10-14T09:08:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 84, 2023-10-14T09:08:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2023-10-14T09:08:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 2, 2023-10-14T09:08:17.188 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 6, 2023-10-14T09:08:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 9, 2023-10-14T09:08:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 3, 2023-10-14T09:08:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2023-10-14T09:08:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2023-10-14T09:08:17.189 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2023-10-14T09:08:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2023-10-14T09:08:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2023-10-14T09:08:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2023-10-14T09:08:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:17.190 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2023-10-14T09:08:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2023-10-14T09:08:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2023-10-14T09:08:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2023-10-14T09:08:17.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2023-10-14T09:08:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2023-10-14T09:08:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:17.192 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2023-10-14T09:08:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:17.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-10-14T09:08:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 3344, 2023-10-14T09:08:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 3111251, 2023-10-14T09:08:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:17.194 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 3344, 2023-10-14T09:08:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3344, 2023-10-14T09:08:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 3111251, 2023-10-14T09:08:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:17.195 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.196 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-10-14T09:08:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:17.197 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 3029, 2023-10-14T09:08:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 1885538, 2023-10-14T09:08:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3029, 2023-10-14T09:08:17.198 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1885538, 2023-10-14T09:08:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2023-10-14T09:08:17.200 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 3029, 2023-10-14T09:08:17.201 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 3029, 2023-10-14T09:08:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3029, 2023-10-14T09:08:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 3029, 2023-10-14T09:08:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.202 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:17.203 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-10-14T09:08:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:17.204 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-10-14T09:08:17.205 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-10-14T09:08:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:17.206 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:17.207 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x5616613f2960": { 2023-10-14T09:08:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-10-14T09:08:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:17.208 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-10-14T09:08:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-10-14T09:08:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:17.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.211 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:17.211 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T09:08:17.692 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-14T09:08:17.692 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-14T09:08:17.693 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-10-14T09:08:17.693 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-10-14T09:08:17.693 DEBUG:tasks.check_counter:Getting stats from d 2023-10-14T09:08:17.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-14T09:08:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T09:08:18.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:17 smithi178 ceph-mon[103612]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2023-10-14T09:08:18.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:18 smithi057 ceph-mon[103313]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2023-10-14T09:08:18.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:18 smithi006 ceph-mon[99452]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2023-10-14T09:08:19.511 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T09:08:19.512 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:19.512 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2023-10-14T09:08:19.512 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2023-10-14T09:08:19.512 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2023-10-14T09:08:19.512 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2023-10-14T09:08:19.513 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-10-14T09:08:19.513 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2023-10-14T09:08:19.513 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.001523254, 2023-10-14T09:08:19.513 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2023-10-14T09:08:19.513 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000381973, 2023-10-14T09:08:19.514 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-14T09:08:19.514 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:19.514 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:19.514 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:19.514 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:19.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.515 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:19.515 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:19.515 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:19.515 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-14T09:08:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2023-10-14T09:08:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:19.516 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 286, 2023-10-14T09:08:19.517 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 281, 2023-10-14T09:08:19.517 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 493568, 2023-10-14T09:08:19.517 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 168448, 2023-10-14T09:08:19.517 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2023-10-14T09:08:19.517 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2023-10-14T09:08:19.518 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.040186805, 2023-10-14T09:08:19.518 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.015245504, 2023-10-14T09:08:19.518 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.017390339, 2023-10-14T09:08:19.518 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.007313690, 2023-10-14T09:08:19.518 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:19.519 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 281, 2023-10-14T09:08:19.519 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.047665085, 2023-10-14T09:08:19.519 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000169626 2023-10-14T09:08:19.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.519 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:19.520 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:19.520 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:19.520 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:19.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.520 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 493568, 2023-10-14T09:08:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 168448 2023-10-14T09:08:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2023-10-14T09:08:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 214, 2023-10-14T09:08:19.521 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2023-10-14T09:08:19.522 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 191008, 2023-10-14T09:08:19.522 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-10-14T09:08:19.522 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2023-10-14T09:08:19.522 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.015012099, 2023-10-14T09:08:19.523 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.011001030, 2023-10-14T09:08:19.523 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002086152, 2023-10-14T09:08:19.523 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-14T09:08:19.523 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:19.523 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 212, 2023-10-14T09:08:19.523 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.031234860, 2023-10-14T09:08:19.524 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000147334 2023-10-14T09:08:19.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.524 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:19.524 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:19.524 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:19.525 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:19.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.525 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:19.525 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 191008 2023-10-14T09:08:19.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.526 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-10-14T09:08:19.526 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2023-10-14T09:08:19.526 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-10-14T09:08:19.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.526 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-10-14T09:08:19.527 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:19.527 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:19.527 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:19.527 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:19.527 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:19.528 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:19.528 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:19.528 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:19.528 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:19.528 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:19.528 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:19.529 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:19.529 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:19.529 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:19.529 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:19.529 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:19.530 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:19.530 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:19.530 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:19.530 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:19.530 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:19.531 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:19.531 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:19.531 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:19.531 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:19.531 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:19.532 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:19.532 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:19.532 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:19.532 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:19.532 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:19.533 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-10-14T09:08:19.533 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:19.533 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:19.533 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:19.533 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:19.533 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 147977, 2023-10-14T09:08:19.534 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 29, 2023-10-14T09:08:19.534 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:19.534 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:19.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-10-14T09:08:19.534 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-10-14T09:08:19.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:19.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:19.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:19.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:19.535 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2023-10-14T09:08:19.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2023-10-14T09:08:19.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:19.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:19.536 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:19.536 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-10-14T09:08:19.537 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2023-10-14T09:08:19.537 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2023-10-14T09:08:19.537 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:19.537 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-10-14T09:08:19.537 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-10-14T09:08:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-10-14T09:08:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:19.539 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 284, 2023-10-14T09:08:19.539 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 450706, 2023-10-14T09:08:19.539 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:19.539 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 284, 2023-10-14T09:08:19.539 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:19.539 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:19.540 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 284, 2023-10-14T09:08:19.540 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 450706, 2023-10-14T09:08:19.540 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:19.540 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:19.540 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:19.541 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:19.541 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:19.541 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:19.541 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T09:08:19.921 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-14T09:08:19.921 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-14T09:08:19.922 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-14T09:08:19.922 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-14T09:08:19.922 DEBUG:tasks.check_counter:Getting stats from g 2023-10-14T09:08:19.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-14T09:08:20.231 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:20 smithi006 ceph-mon[99452]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.3 MiB/s wr, 382 op/s 2023-10-14T09:08:20.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:20 smithi178 ceph-mon[103612]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.3 MiB/s wr, 382 op/s 2023-10-14T09:08:20.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:20 smithi057 ceph-mon[103313]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.3 MiB/s wr, 382 op/s 2023-10-14T09:08:20.492 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T09:08:21.687 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T09:08:21.687 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:21.687 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1014, 2023-10-14T09:08:21.688 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1013, 2023-10-14T09:08:21.688 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 342648, 2023-10-14T09:08:21.688 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 314248, 2023-10-14T09:08:21.688 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 7, 2023-10-14T09:08:21.688 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2023-10-14T09:08:21.689 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.108800417, 2023-10-14T09:08:21.689 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.037388924, 2023-10-14T09:08:21.689 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.026292786, 2023-10-14T09:08:21.689 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.035334588, 2023-10-14T09:08:21.690 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:21.690 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1012, 2023-10-14T09:08:21.690 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.187887408, 2023-10-14T09:08:21.690 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000185659 2023-10-14T09:08:21.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.691 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:21.691 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.691 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.691 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.692 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-14T09:08:21.692 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2023-10-14T09:08:21.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.692 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:21.693 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1997, 2023-10-14T09:08:21.693 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2206, 2023-10-14T09:08:21.693 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 952007, 2023-10-14T09:08:21.693 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 1150518, 2023-10-14T09:08:21.693 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2023-10-14T09:08:21.694 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:21.694 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.159157931, 2023-10-14T09:08:21.694 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.045362023, 2023-10-14T09:08:21.694 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.038491761, 2023-10-14T09:08:21.694 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.063111520, 2023-10-14T09:08:21.695 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:21.695 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2204, 2023-10-14T09:08:21.695 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.273568744, 2023-10-14T09:08:21.695 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000124123 2023-10-14T09:08:21.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.696 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:21.696 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.699 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.700 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.700 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:21.700 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 530016 2023-10-14T09:08:21.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 318, 2023-10-14T09:08:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 286, 2023-10-14T09:08:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 692084, 2023-10-14T09:08:21.701 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 168256, 2023-10-14T09:08:21.702 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:21.702 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:21.702 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.041037229, 2023-10-14T09:08:21.702 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.014957356, 2023-10-14T09:08:21.702 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.019363109, 2023-10-14T09:08:21.703 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.007051296, 2023-10-14T09:08:21.703 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:21.703 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 285, 2023-10-14T09:08:21.703 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.039952525, 2023-10-14T09:08:21.703 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000140184 2023-10-14T09:08:21.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.704 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:21.704 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.704 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.704 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.705 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 690736, 2023-10-14T09:08:21.705 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 167312 2023-10-14T09:08:21.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.705 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-10-14T09:08:21.705 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2023-10-14T09:08:21.706 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-10-14T09:08:21.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.706 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2023-10-14T09:08:21.706 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-10-14T09:08:21.706 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-10-14T09:08:21.707 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 5090, 2023-10-14T09:08:21.707 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.132902964, 2023-10-14T09:08:21.707 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000026110 2023-10-14T09:08:21.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.708 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:21.708 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-10-14T09:08:21.708 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-10-14T09:08:21.708 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.708 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.709 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.709 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.709 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2023-10-14T09:08:21.709 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2023-10-14T09:08:21.709 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2023-10-14T09:08:21.710 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2023-10-14T09:08:21.710 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.710 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.710 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.711 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2023-10-14T09:08:21.711 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2023-10-14T09:08:21.711 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:21.711 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:21.711 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2023-10-14T09:08:21.712 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2023-10-14T09:08:21.712 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2023-10-14T09:08:21.712 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 93, 2023-10-14T09:08:21.712 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 5, 2023-10-14T09:08:21.712 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 49, 2023-10-14T09:08:21.713 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 39, 2023-10-14T09:08:21.713 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 85, 2023-10-14T09:08:21.713 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 0, 2023-10-14T09:08:21.713 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2023-10-14T09:08:21.713 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2023-10-14T09:08:21.713 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 4, 2023-10-14T09:08:21.714 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2023-10-14T09:08:21.714 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2023-10-14T09:08:21.714 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2023-10-14T09:08:21.714 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2023-10-14T09:08:21.714 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:21.715 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:21.715 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2023-10-14T09:08:21.715 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2023-10-14T09:08:21.715 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2023-10-14T09:08:21.715 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2023-10-14T09:08:21.716 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2023-10-14T09:08:21.716 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2023-10-14T09:08:21.716 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2023-10-14T09:08:21.716 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:21.716 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:21.717 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:21.717 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2023-10-14T09:08:21.717 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2023-10-14T09:08:21.717 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2023-10-14T09:08:21.717 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:21.718 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:21.718 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:21.718 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:21.718 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:21.718 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:21.719 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:21.719 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:21.719 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:21.719 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2023-10-14T09:08:21.719 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2023-10-14T09:08:21.720 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:21.720 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:21.720 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:21.720 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2023-10-14T09:08:21.720 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2023-10-14T09:08:21.721 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2023-10-14T09:08:21.721 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2023-10-14T09:08:21.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.721 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2023-10-14T09:08:21.721 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2023-10-14T09:08:21.722 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2023-10-14T09:08:21.722 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2023-10-14T09:08:21.722 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2023-10-14T09:08:21.722 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2023-10-14T09:08:21.722 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2023-10-14T09:08:21.723 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:21.723 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:21.723 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2023-10-14T09:08:21.723 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2023-10-14T09:08:21.724 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:21.724 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2023-10-14T09:08:21.724 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:21.724 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:21.724 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:21.725 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2023-10-14T09:08:21.725 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2023-10-14T09:08:21.725 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:21.725 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2023-10-14T09:08:21.725 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2023-10-14T09:08:21.725 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:21.726 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:21.726 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2023-10-14T09:08:21.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.726 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2023-10-14T09:08:21.726 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2023-10-14T09:08:21.727 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2023-10-14T09:08:21.727 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2023-10-14T09:08:21.727 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2023-10-14T09:08:21.727 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 382, 2023-10-14T09:08:21.727 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2023-10-14T09:08:21.728 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2023-10-14T09:08:21.728 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2023-10-14T09:08:21.728 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2023-10-14T09:08:21.728 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2023-10-14T09:08:21.728 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 2, 2023-10-14T09:08:21.729 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 2, 2023-10-14T09:08:21.729 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2023-10-14T09:08:21.729 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2023-10-14T09:08:21.729 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 4194304, 2023-10-14T09:08:21.729 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 4639029, 2023-10-14T09:08:21.729 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 4638455, 2023-10-14T09:08:21.730 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2023-10-14T09:08:21.730 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.730 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.730 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 382 2023-10-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2023-10-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 92, 2023-10-14T09:08:21.731 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 92, 2023-10-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 0, 2023-10-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 11, 2023-10-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 11, 2023-10-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 0, 2023-10-14T09:08:21.732 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 93, 2023-10-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 93, 2023-10-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 0, 2023-10-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2023-10-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2023-10-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2023-10-14T09:08:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 47360, 2023-10-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 207152 2023-10-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2023-10-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2023-10-14T09:08:21.734 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2023-10-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2023-10-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2023-10-14T09:08:21.735 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2023-10-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.736 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2023-10-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.737 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.738 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2023-10-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.739 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2023-10-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:21.740 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2023-10-14T09:08:21.741 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2023-10-14T09:08:21.742 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.743 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.744 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2023-10-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.745 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2023-10-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.746 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2023-10-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.747 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2023-10-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.748 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2023-10-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.749 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2023-10-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.750 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2023-10-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2023-10-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.754 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.755 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2023-10-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.757 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.758 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.759 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2023-10-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.760 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2023-10-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2023-10-14T09:08:21.761 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2023-10-14T09:08:21.762 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:21.763 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.764 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2023-10-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2023-10-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2023-10-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2023-10-14T09:08:21.765 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2023-10-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2023-10-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2023-10-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2023-10-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 2330, 2023-10-14T09:08:21.766 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-10-14T09:08:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:21.767 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:21.768 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:21.769 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:21.770 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:21.771 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:21.772 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-10-14T09:08:21.773 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 200632, 2023-10-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 139, 2023-10-14T09:08:21.774 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-10-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-10-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:21.775 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 160, 2023-10-14T09:08:21.776 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-10-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 283947, 2023-10-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2360, 2023-10-14T09:08:21.777 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-10-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-10-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.778 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2023-10-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2023-10-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2023-10-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 3007, 2023-10-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2023-10-14T09:08:21.779 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2023-10-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 3007, 2023-10-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2023-10-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3007, 2023-10-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 11.454889299, 2023-10-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.003809407 2023-10-14T09:08:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2023-10-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2023-10-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3007, 2023-10-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 3008 2023-10-14T09:08:21.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 3007, 2023-10-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 3007, 2023-10-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2023-10-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2023-10-14T09:08:21.782 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2023-10-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 1842, 2023-10-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2023-10-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 1163, 2023-10-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2023-10-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2023-10-14T09:08:21.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2023-10-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2023-10-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2023-10-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2023-10-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2023-10-14T09:08:21.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2023-10-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2023-10-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2023-10-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:21.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2023-10-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2023-10-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2023-10-14T09:08:21.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2023-10-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2023-10-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2023-10-14T09:08:21.787 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2023-10-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2023-10-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2023-10-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2023-10-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2023-10-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2023-10-14T09:08:21.788 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2023-10-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2023-10-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2023-10-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2023-10-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2023-10-14T09:08:21.789 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2023-10-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2023-10-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2023-10-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2023-10-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 84, 2023-10-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2023-10-14T09:08:21.790 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 2, 2023-10-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 6, 2023-10-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 8, 2023-10-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 2, 2023-10-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2023-10-14T09:08:21.791 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2023-10-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2023-10-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2023-10-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2023-10-14T09:08:21.792 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2023-10-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2023-10-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2023-10-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.793 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2023-10-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2023-10-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2023-10-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:21.794 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2023-10-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2023-10-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:21.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-10-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:21.796 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 3325, 2023-10-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 1668398, 2023-10-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 3325, 2023-10-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:21.797 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3325, 2023-10-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 1668398, 2023-10-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.798 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-10-14T09:08:21.799 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:21.800 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 3007, 2023-10-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 444730, 2023-10-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3007, 2023-10-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 444730, 2023-10-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:21.801 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.802 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2023-10-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:21.803 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 3007, 2023-10-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 3007, 2023-10-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 3007, 2023-10-14T09:08:21.804 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 3007, 2023-10-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-10-14T09:08:21.806 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:21.807 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-10-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-10-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.808 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x5582bbe3c960": { 2023-10-14T09:08:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-10-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-10-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-10-14T09:08:21.810 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-10-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-10-14T09:08:21.811 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:21.813 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T09:08:22.160 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-14T09:08:22.160 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-14T09:08:22.160 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-14T09:08:22.161 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-14T09:08:22.161 DEBUG:tasks.check_counter:Getting stats from j 2023-10-14T09:08:22.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-14T09:08:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.a/config 2023-10-14T09:08:22.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:22 smithi178 ceph-mon[103612]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 217 op/s 2023-10-14T09:08:22.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:22 smithi057 ceph-mon[103313]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 217 op/s 2023-10-14T09:08:22.970 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:22 smithi006 ceph-mon[99452]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.8 MiB/s wr, 217 op/s 2023-10-14T09:08:23.994 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-10-14T09:08:23.995 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:23.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2023-10-14T09:08:23.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2023-10-14T09:08:23.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2023-10-14T09:08:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2023-10-14T09:08:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-10-14T09:08:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2023-10-14T09:08:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.001425930, 2023-10-14T09:08:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2023-10-14T09:08:23.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000324348, 2023-10-14T09:08:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-14T09:08:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:23.997 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:23.998 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-14T09:08:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2023-10-14T09:08:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:23.999 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 6, 2023-10-14T09:08:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 217, 2023-10-14T09:08:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 3312, 2023-10-14T09:08:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 191632, 2023-10-14T09:08:24.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-10-14T09:08:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2023-10-14T09:08:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.014713718, 2023-10-14T09:08:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.010868150, 2023-10-14T09:08:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.001996637, 2023-10-14T09:08:24.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-14T09:08:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 216, 2023-10-14T09:08:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.045125850, 2023-10-14T09:08:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000208915 2023-10-14T09:08:24.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:24.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-14T09:08:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 191632 2023-10-14T09:08:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 284, 2023-10-14T09:08:24.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 281, 2023-10-14T09:08:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 491120, 2023-10-14T09:08:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 169248, 2023-10-14T09:08:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2023-10-14T09:08:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2023-10-14T09:08:24.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.039396708, 2023-10-14T09:08:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.015308119, 2023-10-14T09:08:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.015911745, 2023-10-14T09:08:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.007143233, 2023-10-14T09:08:24.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 280, 2023-10-14T09:08:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.060114277, 2023-10-14T09:08:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000214693 2023-10-14T09:08:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.007 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 491120, 2023-10-14T09:08:24.008 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 169248 2023-10-14T09:08:24.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.009 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-10-14T09:08:24.009 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2023-10-14T09:08:24.009 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-10-14T09:08:24.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.010 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-10-14T09:08:24.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:24.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:24.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:24.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:24.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:24.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:24.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:24.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:24.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:24.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:24.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:24.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:24.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:24.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:24.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:24.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:24.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:24.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:24.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:24.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-10-14T09:08:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:24.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:24.019 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 147920, 2023-10-14T09:08:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 27, 2023-10-14T09:08:24.021 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-10-14T09:08:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-10-14T09:08:24.022 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:24.023 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2023-10-14T09:08:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2023-10-14T09:08:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:24.024 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-10-14T09:08:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2023-10-14T09:08:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2023-10-14T09:08:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:24.025 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-10-14T09:08:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-10-14T09:08:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-10-14T09:08:24.026 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-10-14T09:08:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-10-14T09:08:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-10-14T09:08:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 286, 2023-10-14T09:08:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 450966, 2023-10-14T09:08:24.027 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 286, 2023-10-14T09:08:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-10-14T09:08:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-10-14T09:08:24.028 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 286, 2023-10-14T09:08:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 450966, 2023-10-14T09:08:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-10-14T09:08:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-10-14T09:08:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-10-14T09:08:24.029 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-10-14T09:08:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:24.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-10-14T09:08:24.030 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-10-14T09:08:24.398 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-14T09:08:24.399 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-14T09:08:24.399 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-14T09:08:24.399 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-14T09:08:24.400 DEBUG:tasks.check_counter:Getting stats from b 2023-10-14T09:08:24.400 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-14T09:08:24.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:24 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:24.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:24 smithi178 ceph-mon[103612]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 250 KiB/s wr, 49 op/s 2023-10-14T09:08:24.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:24 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:24.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:24 smithi057 ceph-mon[103313]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 250 KiB/s wr, 49 op/s 2023-10-14T09:08:24.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:24 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:24.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:24 smithi006 ceph-mon[99452]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 250 KiB/s wr, 49 op/s 2023-10-14T09:08:24.994 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T09:08:26.301 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-14T09:08:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 5431, 2023-10-14T09:08:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 4051, 2023-10-14T09:08:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 2004785, 2023-10-14T09:08:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 5169176, 2023-10-14T09:08:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 11, 2023-10-14T09:08:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.340089612, 2023-10-14T09:08:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.117695729, 2023-10-14T09:08:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.238251842, 2023-10-14T09:08:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.035536540, 2023-10-14T09:08:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4050, 2023-10-14T09:08:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.907109407, 2023-10-14T09:08:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000223977 2023-10-14T09:08:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 7277, 2023-10-14T09:08:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001903205, 2023-10-14T09:08:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000261 2023-10-14T09:08:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-14T09:08:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 448 2023-10-14T09:08:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 4093, 2023-10-14T09:08:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 5212, 2023-10-14T09:08:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 2194984, 2023-10-14T09:08:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 3035844, 2023-10-14T09:08:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 13, 2023-10-14T09:08:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 6, 2023-10-14T09:08:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.350207968, 2023-10-14T09:08:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.140993065, 2023-10-14T09:08:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.254445478, 2023-10-14T09:08:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.012169805, 2023-10-14T09:08:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 5211, 2023-10-14T09:08:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1.092419926, 2023-10-14T09:08:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000209637 2023-10-14T09:08:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 7344, 2023-10-14T09:08:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001502446, 2023-10-14T09:08:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000204 2023-10-14T09:08:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 1681936, 2023-10-14T09:08:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 2413056 2023-10-14T09:08:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 996, 2023-10-14T09:08:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 1285, 2023-10-14T09:08:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 436973, 2023-10-14T09:08:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 1194395, 2023-10-14T09:08:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 14, 2023-10-14T09:08:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 8, 2023-10-14T09:08:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.098935365, 2023-10-14T09:08:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.038436054, 2023-10-14T09:08:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.045851739, 2023-10-14T09:08:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.015633569, 2023-10-14T09:08:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1283, 2023-10-14T09:08:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.220700531, 2023-10-14T09:08:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000172019 2023-10-14T09:08:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1061, 2023-10-14T09:08:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000245786, 2023-10-14T09:08:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000231 2023-10-14T09:08:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 533216 2023-10-14T09:08:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2023-10-14T09:08:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2023-10-14T09:08:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2023-10-14T09:08:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2023-10-14T09:08:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1378, 2023-10-14T09:08:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.968221180, 2023-10-14T09:08:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000702627 2023-10-14T09:08:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 935, 2023-10-14T09:08:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.041011035, 2023-10-14T09:08:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000043862 2023-10-14T09:08:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2023-10-14T09:08:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 1728, 2023-10-14T09:08:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 1267, 2023-10-14T09:08:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2023-10-14T09:08:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1267, 2023-10-14T09:08:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 3.142317120, 2023-10-14T09:08:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002480124 2023-10-14T09:08:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2023-10-14T09:08:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 461, 2023-10-14T09:08:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 11, 2023-10-14T09:08:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2023-10-14T09:08:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2023-10-14T09:08:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 189, 2023-10-14T09:08:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 8, 2023-10-14T09:08:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 137, 2023-10-14T09:08:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 44, 2023-10-14T09:08:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 177, 2023-10-14T09:08:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 211, 2023-10-14T09:08:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 129, 2023-10-14T09:08:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 129, 2023-10-14T09:08:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 13, 2023-10-14T09:08:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 3007, 2023-10-14T09:08:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 2043, 2023-10-14T09:08:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 461, 2023-10-14T09:08:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 37, 2023-10-14T09:08:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 95, 2023-10-14T09:08:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 2894, 2023-10-14T09:08:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2023-10-14T09:08:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 25, 2023-10-14T09:08:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 202, 2023-10-14T09:08:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 33, 2023-10-14T09:08:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 317, 2023-10-14T09:08:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 123, 2023-10-14T09:08:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 1039, 2023-10-14T09:08:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 1736659720, 2023-10-14T09:08:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2023-10-14T09:08:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 123, 2023-10-14T09:08:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 5, 2023-10-14T09:08:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 5, 2023-10-14T09:08:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 118, 2023-10-14T09:08:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 8, 2023-10-14T09:08:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 865, 2023-10-14T09:08:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 664, 2023-10-14T09:08:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 409, 2023-10-14T09:08:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 118, 2023-10-14T09:08:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 1067 2023-10-14T09:08:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2023-10-14T09:08:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 526, 2023-10-14T09:08:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 233, 2023-10-14T09:08:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 129, 2023-10-14T09:08:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 181, 2023-10-14T09:08:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 544, 2023-10-14T09:08:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 11, 2023-10-14T09:08:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 257, 2023-10-14T09:08:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 246, 2023-10-14T09:08:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2023-10-14T09:08:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2023-10-14T09:08:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2023-10-14T09:08:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 25, 2023-10-14T09:08:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2023-10-14T09:08:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2023-10-14T09:08:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2023-10-14T09:08:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2023-10-14T09:08:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 2349, 2023-10-14T09:08:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2023-10-14T09:08:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2023-10-14T09:08:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 2349, 2023-10-14T09:08:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2023-10-14T09:08:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2023-10-14T09:08:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 4, 2023-10-14T09:08:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2023-10-14T09:08:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2023-10-14T09:08:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 4, 2023-10-14T09:08:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2023-10-14T09:08:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2023-10-14T09:08:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2023-10-14T09:08:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2023-10-14T09:08:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 8073422, 2023-10-14T09:08:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 0, 2023-10-14T09:08:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2023-10-14T09:08:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 562, 2023-10-14T09:08:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 5.021475826, 2023-10-14T09:08:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.008935010 2023-10-14T09:08:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 0 2023-10-14T09:08:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2023-10-14T09:08:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 162, 2023-10-14T09:08:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 603, 2023-10-14T09:08:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 441, 2023-10-14T09:08:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 55, 2023-10-14T09:08:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 134, 2023-10-14T09:08:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 79, 2023-10-14T09:08:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 192, 2023-10-14T09:08:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 650, 2023-10-14T09:08:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 458, 2023-10-14T09:08:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 121, 2023-10-14T09:08:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 710, 2023-10-14T09:08:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 589, 2023-10-14T09:08:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 56824, 2023-10-14T09:08:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 198960 2023-10-14T09:08:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2023-10-14T09:08:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 2108, 2023-10-14T09:08:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 1728, 2023-10-14T09:08:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 60, 2023-10-14T09:08:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 95, 2023-10-14T09:08:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2023-10-14T09:08:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 254, 2023-10-14T09:08:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.573718684, 2023-10-14T09:08:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002258734 2023-10-14T09:08:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2023-10-14T09:08:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 3, 2023-10-14T09:08:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.006721018, 2023-10-14T09:08:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002240339 2023-10-14T09:08:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2023-10-14T09:08:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2023-10-14T09:08:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 539, 2023-10-14T09:08:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1.624673318, 2023-10-14T09:08:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.003014236 2023-10-14T09:08:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2023-10-14T09:08:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2023-10-14T09:08:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2023-10-14T09:08:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2023-10-14T09:08:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.366 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.366 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.366 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2023-10-14T09:08:26.367 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.367 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.367 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.367 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2023-10-14T09:08:26.368 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.368 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.368 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.369 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2023-10-14T09:08:26.369 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 185, 2023-10-14T09:08:26.369 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.182700437, 2023-10-14T09:08:26.369 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000987569 2023-10-14T09:08:26.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.370 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2023-10-14T09:08:26.370 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 29, 2023-10-14T09:08:26.370 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.020656612, 2023-10-14T09:08:26.371 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000712296 2023-10-14T09:08:26.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.371 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2023-10-14T09:08:26.371 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 226, 2023-10-14T09:08:26.372 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.621645635, 2023-10-14T09:08:26.372 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002750644 2023-10-14T09:08:26.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.372 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:26.372 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.373 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.373 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.373 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:26.373 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.374 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.374 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.374 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2023-10-14T09:08:26.375 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.375 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.375 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.375 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:26.376 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.376 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.376 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.377 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:26.377 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.377 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.378 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.378 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2023-10-14T09:08:26.379 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.379 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.379 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.379 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:26.380 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.380 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.380 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.380 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:26.381 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.381 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.381 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.381 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2023-10-14T09:08:26.382 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.382 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.382 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.382 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2023-10-14T09:08:26.383 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.383 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.383 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.383 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2023-10-14T09:08:26.383 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.384 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.384 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.384 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2023-10-14T09:08:26.384 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 31, 2023-10-14T09:08:26.385 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.112201416, 2023-10-14T09:08:26.385 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.003619400 2023-10-14T09:08:26.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.385 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:26.385 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:26.386 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:26.386 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.386 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.386 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.386 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.387 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2023-10-14T09:08:26.387 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2023-10-14T09:08:26.387 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 1, 2023-10-14T09:08:26.387 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 0, 2023-10-14T09:08:26.388 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2023-10-14T09:08:26.388 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2023-10-14T09:08:26.388 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 132, 2023-10-14T09:08:26.388 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 132, 2023-10-14T09:08:26.388 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 930, 2023-10-14T09:08:26.389 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:26.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.389 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2023-10-14T09:08:26.389 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:26.389 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:26.390 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:26.390 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:26.390 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:26.390 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:26.390 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:26.390 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:26.391 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:26.391 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:26.391 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:26.391 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:26.391 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:26.392 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:26.392 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:26.392 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:26.392 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:26.392 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:26.393 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:26.393 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:26.393 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:26.393 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:26.393 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:26.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:26.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:26.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:26.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:26.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:26.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:26.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:26.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:26.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2023-10-14T09:08:26.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:26.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:26.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:26.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:26.396 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 349983, 2023-10-14T09:08:26.396 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 288, 2023-10-14T09:08:26.396 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 528, 2023-10-14T09:08:26.397 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 6, 2023-10-14T09:08:26.397 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2023-10-14T09:08:26.397 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2023-10-14T09:08:26.397 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:26.397 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2023-10-14T09:08:26.398 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:26.399 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:26.399 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:26.399 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2023-10-14T09:08:26.399 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 636453, 2023-10-14T09:08:26.399 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 7504, 2023-10-14T09:08:26.400 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:26.400 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2023-10-14T09:08:26.400 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:26.400 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2023-10-14T09:08:26.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.401 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2023-10-14T09:08:26.401 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2023-10-14T09:08:26.401 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2023-10-14T09:08:26.401 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 1499, 2023-10-14T09:08:26.401 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 3976484, 2023-10-14T09:08:26.402 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 27, 2023-10-14T09:08:26.402 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 1499, 2023-10-14T09:08:26.402 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2023-10-14T09:08:26.402 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1499, 2023-10-14T09:08:26.402 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 13.649792297, 2023-10-14T09:08:26.403 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.009105932 2023-10-14T09:08:26.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.403 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2023-10-14T09:08:26.403 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2023-10-14T09:08:26.403 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1499, 2023-10-14T09:08:26.403 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1715 2023-10-14T09:08:26.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.404 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 1499, 2023-10-14T09:08:26.404 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 240, 2023-10-14T09:08:26.404 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 1259, 2023-10-14T09:08:26.404 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2023-10-14T09:08:26.405 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2023-10-14T09:08:26.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 0, 2023-10-14T09:08:26.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 10, 2023-10-14T09:08:26.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 117, 2023-10-14T09:08:26.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 679, 2023-10-14T09:08:26.406 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 154, 2023-10-14T09:08:26.406 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2023-10-14T09:08:26.406 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2023-10-14T09:08:26.406 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2023-10-14T09:08:26.406 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2023-10-14T09:08:26.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 258, 2023-10-14T09:08:26.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2023-10-14T09:08:26.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:26.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:26.407 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 123, 2023-10-14T09:08:26.408 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 20, 2023-10-14T09:08:26.408 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:26.408 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:26.408 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:26.408 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2023-10-14T09:08:26.408 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2023-10-14T09:08:26.409 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2023-10-14T09:08:26.409 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:26.409 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2023-10-14T09:08:26.409 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:26.409 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 0, 2023-10-14T09:08:26.410 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2023-10-14T09:08:26.410 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2023-10-14T09:08:26.410 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2023-10-14T09:08:26.410 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2023-10-14T09:08:26.410 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2023-10-14T09:08:26.411 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2023-10-14T09:08:26.411 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2023-10-14T09:08:26.411 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2023-10-14T09:08:26.411 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2023-10-14T09:08:26.411 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2023-10-14T09:08:26.412 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2023-10-14T09:08:26.412 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2023-10-14T09:08:26.412 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2023-10-14T09:08:26.412 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2023-10-14T09:08:26.412 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2023-10-14T09:08:26.412 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2023-10-14T09:08:26.413 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 84, 2023-10-14T09:08:26.413 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2023-10-14T09:08:26.413 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2023-10-14T09:08:26.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 12, 2023-10-14T09:08:26.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 12, 2023-10-14T09:08:26.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 0, 2023-10-14T09:08:26.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2023-10-14T09:08:26.414 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 262, 2023-10-14T09:08:26.414 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 0, 2023-10-14T09:08:26.414 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 92 2023-10-14T09:08:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2023-10-14T09:08:26.415 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 1, 2023-10-14T09:08:26.416 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:26.416 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2023-10-14T09:08:26.416 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2023-10-14T09:08:26.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.417 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2023-10-14T09:08:26.417 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 0 2023-10-14T09:08:26.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.417 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2023-10-14T09:08:26.417 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:26.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 6, 2023-10-14T09:08:26.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2023-10-14T09:08:26.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 6, 2023-10-14T09:08:26.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 246, 2023-10-14T09:08:26.418 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:26.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.419 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:26.419 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:26.419 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:26.419 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 10516, 2023-10-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 3543454, 2023-10-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 10516, 2023-10-14T09:08:26.420 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:26.421 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:26.421 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 10516, 2023-10-14T09:08:26.421 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 3543454, 2023-10-14T09:08:26.421 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:26.421 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.422 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.422 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.422 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:26.423 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:26.423 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:26.423 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:26.423 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:26.423 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:26.423 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:26.424 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:26.424 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 1499, 2023-10-14T09:08:26.424 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 4001330, 2023-10-14T09:08:26.424 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1499, 2023-10-14T09:08:26.424 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 4001330, 2023-10-14T09:08:26.425 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:26.425 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.425 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.425 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.426 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:26.426 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:26.426 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2023-10-14T09:08:26.426 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:26.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:26.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:26.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:26.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:26.427 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 1499, 2023-10-14T09:08:26.428 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 1499, 2023-10-14T09:08:26.428 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 1499, 2023-10-14T09:08:26.428 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 1499, 2023-10-14T09:08:26.428 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:26.428 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.429 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.429 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.430 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:26.430 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:26.430 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:26.430 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:26.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 246, 2023-10-14T09:08:26.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 24846, 2023-10-14T09:08:26.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:26.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 246, 2023-10-14T09:08:26.432 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:26.432 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:26.432 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 117, 2023-10-14T09:08:26.432 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 24846, 2023-10-14T09:08:26.432 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:26.432 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.433 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.433 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:26.433 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x55883b7ee640": { 2023-10-14T09:08:26.434 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 17103, 2023-10-14T09:08:26.434 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:26.434 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:26.434 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 2349, 2023-10-14T09:08:26.434 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 3879118, 2023-10-14T09:08:26.435 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:26.435 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 2349, 2023-10-14T09:08:26.435 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:26.435 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:26.435 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 562, 2023-10-14T09:08:26.436 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 3862015, 2023-10-14T09:08:26.436 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:26.436 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:26.436 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:26.436 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:26.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:26.437 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-14T09:08:26.438 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:25 smithi178 ceph-mon[103612]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2023-10-14T09:08:26.438 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:26 smithi057 ceph-mon[103313]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2023-10-14T09:08:26.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:25 smithi006 ceph-mon[99452]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.0 KiB/s wr, 14 op/s 2023-10-14T09:08:26.740 INFO:tasks.check_counter:Daemon mds.b mds.exported=25 2023-10-14T09:08:26.740 INFO:tasks.check_counter:Daemon mds.b mds.imported=33 2023-10-14T09:08:26.741 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=526 2023-10-14T09:08:26.741 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=233 2023-10-14T09:08:26.741 DEBUG:tasks.check_counter:Getting stats from e 2023-10-14T09:08:26.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-14T09:08:27.310 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T09:08:28.567 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-14T09:08:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:28.567 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 4047, 2023-10-14T09:08:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 4386, 2023-10-14T09:08:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 1398382, 2023-10-14T09:08:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 4296858, 2023-10-14T09:08:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 15, 2023-10-14T09:08:28.568 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.288546008, 2023-10-14T09:08:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.114824248, 2023-10-14T09:08:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.183891054, 2023-10-14T09:08:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.022909955, 2023-10-14T09:08:28.569 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4385, 2023-10-14T09:08:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.583626206, 2023-10-14T09:08:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000133096 2023-10-14T09:08:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.570 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6037, 2023-10-14T09:08:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001060874, 2023-10-14T09:08:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000175 2023-10-14T09:08:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 828960, 2023-10-14T09:08:28.571 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 1815072 2023-10-14T09:08:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 643, 2023-10-14T09:08:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 669, 2023-10-14T09:08:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 407748, 2023-10-14T09:08:28.573 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 896463, 2023-10-14T09:08:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 16, 2023-10-14T09:08:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.060502977, 2023-10-14T09:08:28.574 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.026832139, 2023-10-14T09:08:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.040358636, 2023-10-14T09:08:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.000385595, 2023-10-14T09:08:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 667, 2023-10-14T09:08:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.190650409, 2023-10-14T09:08:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000285832 2023-10-14T09:08:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:28.576 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1015, 2023-10-14T09:08:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000218399, 2023-10-14T09:08:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000215 2023-10-14T09:08:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:28.577 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 533888 2023-10-14T09:08:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 5487, 2023-10-14T09:08:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 4834, 2023-10-14T09:08:28.578 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 2411335, 2023-10-14T09:08:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 1712600, 2023-10-14T09:08:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 7, 2023-10-14T09:08:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2023-10-14T09:08:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.363912102, 2023-10-14T09:08:28.579 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.128479111, 2023-10-14T09:08:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.300693175, 2023-10-14T09:08:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.014534494, 2023-10-14T09:08:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4833, 2023-10-14T09:08:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.924406729, 2023-10-14T09:08:28.580 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000191269 2023-10-14T09:08:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 9205, 2023-10-14T09:08:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.002421441, 2023-10-14T09:08:28.581 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000263 2023-10-14T09:08:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 726320, 2023-10-14T09:08:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 174960 2023-10-14T09:08:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.582 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2023-10-14T09:08:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2023-10-14T09:08:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2023-10-14T09:08:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2023-10-14T09:08:28.583 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1432, 2023-10-14T09:08:28.584 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 1.231183457, 2023-10-14T09:08:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000859764 2023-10-14T09:08:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.585 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2, 2023-10-14T09:08:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000015193, 2023-10-14T09:08:28.586 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000007596 2023-10-14T09:08:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2023-10-14T09:08:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 2060, 2023-10-14T09:08:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 1863, 2023-10-14T09:08:28.587 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2023-10-14T09:08:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1863, 2023-10-14T09:08:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 16.002699268, 2023-10-14T09:08:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.008589747 2023-10-14T09:08:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.588 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2023-10-14T09:08:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 197, 2023-10-14T09:08:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 11, 2023-10-14T09:08:28.589 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2023-10-14T09:08:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2023-10-14T09:08:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 1186, 2023-10-14T09:08:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 602, 2023-10-14T09:08:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 574, 2023-10-14T09:08:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 10, 2023-10-14T09:08:28.590 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 322, 2023-10-14T09:08:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 37, 2023-10-14T09:08:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 67, 2023-10-14T09:08:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 67, 2023-10-14T09:08:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 10, 2023-10-14T09:08:28.591 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 9530, 2023-10-14T09:08:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 6684, 2023-10-14T09:08:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 197, 2023-10-14T09:08:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 36, 2023-10-14T09:08:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:28.592 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 2003, 2023-10-14T09:08:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 10356, 2023-10-14T09:08:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2023-10-14T09:08:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 1, 2023-10-14T09:08:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 37, 2023-10-14T09:08:28.593 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 2, 2023-10-14T09:08:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 876, 2023-10-14T09:08:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:28.594 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 1039, 2023-10-14T09:08:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 1736659720, 2023-10-14T09:08:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2023-10-14T09:08:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:28.595 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:28.596 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 4, 2023-10-14T09:08:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 363, 2023-10-14T09:08:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 556, 2023-10-14T09:08:28.597 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 701, 2023-10-14T09:08:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 157, 2023-10-14T09:08:28.598 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 32, 2023-10-14T09:08:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 708 2023-10-14T09:08:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2023-10-14T09:08:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 136, 2023-10-14T09:08:28.599 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 577, 2023-10-14T09:08:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 301, 2023-10-14T09:08:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 544, 2023-10-14T09:08:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 148, 2023-10-14T09:08:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 0, 2023-10-14T09:08:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:28.600 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 175, 2023-10-14T09:08:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 0, 2023-10-14T09:08:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 735, 2023-10-14T09:08:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2023-10-14T09:08:28.601 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2023-10-14T09:08:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2023-10-14T09:08:28.602 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 1, 2023-10-14T09:08:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2023-10-14T09:08:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:28.603 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2023-10-14T09:08:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2023-10-14T09:08:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2023-10-14T09:08:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 960, 2023-10-14T09:08:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2023-10-14T09:08:28.604 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2023-10-14T09:08:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 960, 2023-10-14T09:08:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2023-10-14T09:08:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2023-10-14T09:08:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 2, 2023-10-14T09:08:28.605 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2023-10-14T09:08:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2023-10-14T09:08:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 2, 2023-10-14T09:08:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2023-10-14T09:08:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2023-10-14T09:08:28.606 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2023-10-14T09:08:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2023-10-14T09:08:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 6091081, 2023-10-14T09:08:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 0, 2023-10-14T09:08:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2023-10-14T09:08:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 672, 2023-10-14T09:08:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 4.374802656, 2023-10-14T09:08:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.006510123 2023-10-14T09:08:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 0 2023-10-14T09:08:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.608 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2023-10-14T09:08:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 101, 2023-10-14T09:08:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 138, 2023-10-14T09:08:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 37, 2023-10-14T09:08:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 47, 2023-10-14T09:08:28.609 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 305, 2023-10-14T09:08:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 258, 2023-10-14T09:08:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 1186, 2023-10-14T09:08:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 1248, 2023-10-14T09:08:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 62, 2023-10-14T09:08:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 67, 2023-10-14T09:08:28.610 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 264, 2023-10-14T09:08:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 197, 2023-10-14T09:08:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 54708, 2023-10-14T09:08:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 198960 2023-10-14T09:08:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.611 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2023-10-14T09:08:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 6005, 2023-10-14T09:08:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 8, 2023-10-14T09:08:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 2060, 2023-10-14T09:08:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 350, 2023-10-14T09:08:28.612 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 56, 2023-10-14T09:08:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2023-10-14T09:08:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2023-10-14T09:08:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4, 2023-10-14T09:08:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.002650274, 2023-10-14T09:08:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000662568 2023-10-14T09:08:28.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2023-10-14T09:08:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 175, 2023-10-14T09:08:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.735452840, 2023-10-14T09:08:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.004202587 2023-10-14T09:08:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.616 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2023-10-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 755, 2023-10-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 2.401091115, 2023-10-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.003180253 2023-10-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.617 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.618 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2023-10-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1, 2023-10-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000229964, 2023-10-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000229964 2023-10-14T09:08:28.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2023-10-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.621 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.622 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2023-10-14T09:08:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.623 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2023-10-14T09:08:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.624 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2023-10-14T09:08:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2023-10-14T09:08:28.625 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.626 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2023-10-14T09:08:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 10, 2023-10-14T09:08:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.010244075, 2023-10-14T09:08:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001024407 2023-10-14T09:08:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.627 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2023-10-14T09:08:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 8, 2023-10-14T09:08:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.023274076, 2023-10-14T09:08:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002909259 2023-10-14T09:08:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2023-10-14T09:08:28.628 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 735, 2023-10-14T09:08:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 12.222901952, 2023-10-14T09:08:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.016629798 2023-10-14T09:08:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.629 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.630 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.631 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2023-10-14T09:08:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.632 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.633 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.634 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2023-10-14T09:08:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:28.635 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:28.636 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2023-10-14T09:08:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2023-10-14T09:08:28.638 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2023-10-14T09:08:28.639 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2023-10-14T09:08:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 175, 2023-10-14T09:08:28.640 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.606854972, 2023-10-14T09:08:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.003467742 2023-10-14T09:08:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:28.641 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2023-10-14T09:08:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2023-10-14T09:08:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 1, 2023-10-14T09:08:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 0, 2023-10-14T09:08:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2023-10-14T09:08:28.643 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2023-10-14T09:08:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 365, 2023-10-14T09:08:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 365, 2023-10-14T09:08:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 938, 2023-10-14T09:08:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:28.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2023-10-14T09:08:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:28.645 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:28.646 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:28.647 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:28.648 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:28.649 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:28.650 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2023-10-14T09:08:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:28.651 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 266267, 2023-10-14T09:08:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 171, 2023-10-14T09:08:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2023-10-14T09:08:28.652 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2023-10-14T09:08:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:28.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2023-10-14T09:08:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2023-10-14T09:08:28.654 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 1201130, 2023-10-14T09:08:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 47857, 2023-10-14T09:08:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2023-10-14T09:08:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:28.655 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2023-10-14T09:08:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2023-10-14T09:08:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2023-10-14T09:08:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2023-10-14T09:08:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 802, 2023-10-14T09:08:28.656 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 1927621, 2023-10-14T09:08:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 27, 2023-10-14T09:08:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 802, 2023-10-14T09:08:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2023-10-14T09:08:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 802, 2023-10-14T09:08:28.657 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 6.900897385, 2023-10-14T09:08:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.008604610 2023-10-14T09:08:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2023-10-14T09:08:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2023-10-14T09:08:28.658 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 802, 2023-10-14T09:08:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 904 2023-10-14T09:08:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 802, 2023-10-14T09:08:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 0, 2023-10-14T09:08:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 802, 2023-10-14T09:08:28.659 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2023-10-14T09:08:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2023-10-14T09:08:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 0, 2023-10-14T09:08:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 10, 2023-10-14T09:08:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 0, 2023-10-14T09:08:28.660 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 672, 2023-10-14T09:08:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 33, 2023-10-14T09:08:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2023-10-14T09:08:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2023-10-14T09:08:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2023-10-14T09:08:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2023-10-14T09:08:28.661 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 6, 2023-10-14T09:08:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2023-10-14T09:08:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 0, 2023-10-14T09:08:28.662 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 20, 2023-10-14T09:08:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2023-10-14T09:08:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2023-10-14T09:08:28.663 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2023-10-14T09:08:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2023-10-14T09:08:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 0, 2023-10-14T09:08:28.664 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2023-10-14T09:08:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2023-10-14T09:08:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2023-10-14T09:08:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2023-10-14T09:08:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2023-10-14T09:08:28.665 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2023-10-14T09:08:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2023-10-14T09:08:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2023-10-14T09:08:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2023-10-14T09:08:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2023-10-14T09:08:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2023-10-14T09:08:28.666 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2023-10-14T09:08:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2023-10-14T09:08:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2023-10-14T09:08:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2023-10-14T09:08:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2023-10-14T09:08:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 84, 2023-10-14T09:08:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2023-10-14T09:08:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2023-10-14T09:08:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 8, 2023-10-14T09:08:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 11, 2023-10-14T09:08:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 3, 2023-10-14T09:08:28.668 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2023-10-14T09:08:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 104, 2023-10-14T09:08:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 0, 2023-10-14T09:08:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 59 2023-10-14T09:08:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.669 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2023-10-14T09:08:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 1, 2023-10-14T09:08:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2023-10-14T09:08:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2023-10-14T09:08:28.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2023-10-14T09:08:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 0 2023-10-14T09:08:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2023-10-14T09:08:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:28.671 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2023-10-14T09:08:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 0, 2023-10-14T09:08:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:28.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:28.673 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 10173, 2023-10-14T09:08:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 3166980, 2023-10-14T09:08:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 10173, 2023-10-14T09:08:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:28.674 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 10173, 2023-10-14T09:08:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 3166980, 2023-10-14T09:08:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.675 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 802, 2023-10-14T09:08:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 1927621, 2023-10-14T09:08:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 802, 2023-10-14T09:08:28.678 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 1927621, 2023-10-14T09:08:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.679 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2023-10-14T09:08:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:28.680 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 802, 2023-10-14T09:08:28.681 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 802, 2023-10-14T09:08:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 802, 2023-10-14T09:08:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 802, 2023-10-14T09:08:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.682 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:28.683 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:28.684 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2023-10-14T09:08:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2023-10-14T09:08:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:28.685 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:28.686 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x559156fee640": { 2023-10-14T09:08:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 4360, 2023-10-14T09:08:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 960, 2023-10-14T09:08:28.687 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 1896777, 2023-10-14T09:08:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 960, 2023-10-14T09:08:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 672, 2023-10-14T09:08:28.688 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 1892417, 2023-10-14T09:08:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:28.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.690 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:28.690 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-14T09:08:28.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:28 smithi057 ceph-mon[103313]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:28.951 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:28 smithi057 ceph-mon[103313]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2023-10-14T09:08:28.971 INFO:tasks.check_counter:Daemon mds.e mds.exported=1 2023-10-14T09:08:28.971 INFO:tasks.check_counter:Daemon mds.e mds.imported=2 2023-10-14T09:08:28.971 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=136 2023-10-14T09:08:28.971 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=577 2023-10-14T09:08:28.972 DEBUG:tasks.check_counter:Getting stats from h 2023-10-14T09:08:28.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-14T09:08:29.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:28 smithi006 ceph-mon[99452]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:29.232 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:28 smithi006 ceph-mon[99452]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2023-10-14T09:08:29.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:28 smithi178 ceph-mon[103612]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-14T09:08:29.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:28 smithi178 ceph-mon[103612]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2023-10-14T09:08:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T09:08:30.188 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:30 smithi057 ceph-mon[103313]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 15 op/s 2023-10-14T09:08:30.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:29 smithi178 ceph-mon[103612]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 15 op/s 2023-10-14T09:08:30.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:29 smithi006 ceph-mon[99452]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 15 op/s 2023-10-14T09:08:30.998 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-14T09:08:30.998 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 2030, 2023-10-14T09:08:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 3250, 2023-10-14T09:08:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 1441216, 2023-10-14T09:08:30.999 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 5496921, 2023-10-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 13, 2023-10-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.227733131, 2023-10-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.091093374, 2023-10-14T09:08:31.000 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.132440285, 2023-10-14T09:08:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.021418331, 2023-10-14T09:08:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 3249, 2023-10-14T09:08:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.391791549, 2023-10-14T09:08:31.001 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000120588 2023-10-14T09:08:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 3228, 2023-10-14T09:08:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000871488, 2023-10-14T09:08:31.002 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000269 2023-10-14T09:08:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 1039296, 2023-10-14T09:08:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 1525568 2023-10-14T09:08:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.003 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 714, 2023-10-14T09:08:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 1067, 2023-10-14T09:08:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 550131, 2023-10-14T09:08:31.004 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 1036915, 2023-10-14T09:08:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 15, 2023-10-14T09:08:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2023-10-14T09:08:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.077377476, 2023-10-14T09:08:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.036600378, 2023-10-14T09:08:31.005 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.044140252, 2023-10-14T09:08:31.006 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.001380733, 2023-10-14T09:08:31.006 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:31.006 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1066, 2023-10-14T09:08:31.006 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.137351309, 2023-10-14T09:08:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000128847 2023-10-14T09:08:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1387, 2023-10-14T09:08:31.007 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000346385, 2023-10-14T09:08:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000249 2023-10-14T09:08:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-14T09:08:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 449728 2023-10-14T09:08:31.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 4624, 2023-10-14T09:08:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 3294, 2023-10-14T09:08:31.009 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 2221112, 2023-10-14T09:08:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 1593036, 2023-10-14T09:08:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 10, 2023-10-14T09:08:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2023-10-14T09:08:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.283149765, 2023-10-14T09:08:31.010 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.100977369, 2023-10-14T09:08:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.236174477, 2023-10-14T09:08:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.008360627, 2023-10-14T09:08:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 3292, 2023-10-14T09:08:31.011 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.623328658, 2023-10-14T09:08:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000189346 2023-10-14T09:08:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 7407, 2023-10-14T09:08:31.012 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001736514, 2023-10-14T09:08:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000234 2023-10-14T09:08:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-14T09:08:31.013 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 0 2023-10-14T09:08:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2023-10-14T09:08:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2023-10-14T09:08:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2023-10-14T09:08:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2023-10-14T09:08:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 755, 2023-10-14T09:08:31.015 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.459856645, 2023-10-14T09:08:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000609081 2023-10-14T09:08:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2, 2023-10-14T09:08:31.017 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000020361, 2023-10-14T09:08:31.018 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000010180 2023-10-14T09:08:31.018 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2023-10-14T09:08:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 504, 2023-10-14T09:08:31.019 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 271, 2023-10-14T09:08:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2023-10-14T09:08:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 271, 2023-10-14T09:08:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.208609120, 2023-10-14T09:08:31.020 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000769775 2023-10-14T09:08:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2023-10-14T09:08:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 233, 2023-10-14T09:08:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:31.021 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 11, 2023-10-14T09:08:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2023-10-14T09:08:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2023-10-14T09:08:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 643, 2023-10-14T09:08:31.022 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 15, 2023-10-14T09:08:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 614, 2023-10-14T09:08:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 14, 2023-10-14T09:08:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 621, 2023-10-14T09:08:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 469, 2023-10-14T09:08:31.023 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 601, 2023-10-14T09:08:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 601, 2023-10-14T09:08:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 10, 2023-10-14T09:08:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 1003, 2023-10-14T09:08:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 710, 2023-10-14T09:08:31.024 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 231, 2023-10-14T09:08:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 34, 2023-10-14T09:08:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:31.025 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 0, 2023-10-14T09:08:31.026 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 3496, 2023-10-14T09:08:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2023-10-14T09:08:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 12, 2023-10-14T09:08:31.027 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 472, 2023-10-14T09:08:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 26, 2023-10-14T09:08:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 871, 2023-10-14T09:08:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:31.028 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 1039, 2023-10-14T09:08:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 1736659720, 2023-10-14T09:08:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2023-10-14T09:08:31.029 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:31.030 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 3, 2023-10-14T09:08:31.031 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 3, 2023-10-14T09:08:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 112, 2023-10-14T09:08:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:31.032 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 204, 2023-10-14T09:08:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 170, 2023-10-14T09:08:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 9, 2023-10-14T09:08:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 24 2023-10-14T09:08:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.033 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2023-10-14T09:08:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 54, 2023-10-14T09:08:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 514, 2023-10-14T09:08:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 272, 2023-10-14T09:08:31.034 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 478, 2023-10-14T09:08:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 237, 2023-10-14T09:08:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 0, 2023-10-14T09:08:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 0, 2023-10-14T09:08:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 0, 2023-10-14T09:08:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2023-10-14T09:08:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:31.036 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2023-10-14T09:08:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2023-10-14T09:08:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 12, 2023-10-14T09:08:31.037 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2023-10-14T09:08:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2023-10-14T09:08:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.038 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2023-10-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2023-10-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 1082, 2023-10-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2023-10-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2023-10-14T09:08:31.039 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 1082, 2023-10-14T09:08:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2023-10-14T09:08:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2023-10-14T09:08:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 3, 2023-10-14T09:08:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2023-10-14T09:08:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2023-10-14T09:08:31.040 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 3, 2023-10-14T09:08:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2023-10-14T09:08:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2023-10-14T09:08:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2023-10-14T09:08:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2023-10-14T09:08:31.041 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 7358511, 2023-10-14T09:08:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 0, 2023-10-14T09:08:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2023-10-14T09:08:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 347, 2023-10-14T09:08:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 3.475103127, 2023-10-14T09:08:31.042 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.010014706 2023-10-14T09:08:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 0 2023-10-14T09:08:31.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2023-10-14T09:08:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 438, 2023-10-14T09:08:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 901, 2023-10-14T09:08:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 463, 2023-10-14T09:08:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 45, 2023-10-14T09:08:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 261, 2023-10-14T09:08:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 216, 2023-10-14T09:08:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 436, 2023-10-14T09:08:31.045 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 909, 2023-10-14T09:08:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 473, 2023-10-14T09:08:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 394, 2023-10-14T09:08:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 1474, 2023-10-14T09:08:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 1080, 2023-10-14T09:08:31.046 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 58136, 2023-10-14T09:08:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 198960 2023-10-14T09:08:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2023-10-14T09:08:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 522, 2023-10-14T09:08:31.047 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 2, 2023-10-14T09:08:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 504, 2023-10-14T09:08:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 28, 2023-10-14T09:08:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 4, 2023-10-14T09:08:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2023-10-14T09:08:31.048 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.049 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2023-10-14T09:08:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1, 2023-10-14T09:08:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000227866, 2023-10-14T09:08:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000227866 2023-10-14T09:08:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.050 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.051 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2023-10-14T09:08:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.052 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2023-10-14T09:08:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 223, 2023-10-14T09:08:31.053 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.132317082, 2023-10-14T09:08:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000593350 2023-10-14T09:08:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.054 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2023-10-14T09:08:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2023-10-14T09:08:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.057 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.058 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.059 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2023-10-14T09:08:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.060 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.061 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2023-10-14T09:08:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.062 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2023-10-14T09:08:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.063 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2023-10-14T09:08:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.064 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2023-10-14T09:08:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 25, 2023-10-14T09:08:31.065 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.030490608, 2023-10-14T09:08:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001219624 2023-10-14T09:08:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2023-10-14T09:08:31.066 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 22, 2023-10-14T09:08:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.045573564, 2023-10-14T09:08:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.002071525 2023-10-14T09:08:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2023-10-14T09:08:31.067 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:31.068 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:31.069 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.070 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2023-10-14T09:08:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:31.071 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:31.072 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2023-10-14T09:08:31.073 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:31.074 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:31.075 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2023-10-14T09:08:31.076 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2023-10-14T09:08:31.077 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2023-10-14T09:08:31.078 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2023-10-14T09:08:31.079 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:31.080 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2023-10-14T09:08:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2023-10-14T09:08:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 2, 2023-10-14T09:08:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 1, 2023-10-14T09:08:31.082 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2023-10-14T09:08:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2023-10-14T09:08:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 59, 2023-10-14T09:08:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 59, 2023-10-14T09:08:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 936, 2023-10-14T09:08:31.083 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2023-10-14T09:08:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:31.084 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:31.085 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:31.086 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:31.087 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:31.088 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:31.089 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2023-10-14T09:08:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:31.090 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 272331, 2023-10-14T09:08:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 724, 2023-10-14T09:08:31.091 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2023-10-14T09:08:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2023-10-14T09:08:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:31.092 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2023-10-14T09:08:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:31.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2023-10-14T09:08:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 2201498, 2023-10-14T09:08:31.094 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 23080, 2023-10-14T09:08:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2023-10-14T09:08:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:31.095 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2023-10-14T09:08:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2023-10-14T09:08:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2023-10-14T09:08:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2023-10-14T09:08:31.096 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 455, 2023-10-14T09:08:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 3234532, 2023-10-14T09:08:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 27, 2023-10-14T09:08:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 455, 2023-10-14T09:08:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2023-10-14T09:08:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 455, 2023-10-14T09:08:31.097 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 4.099937856, 2023-10-14T09:08:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.009010852 2023-10-14T09:08:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2023-10-14T09:08:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2023-10-14T09:08:31.098 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 455, 2023-10-14T09:08:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 501 2023-10-14T09:08:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 455, 2023-10-14T09:08:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 0, 2023-10-14T09:08:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 455, 2023-10-14T09:08:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2023-10-14T09:08:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2023-10-14T09:08:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 0, 2023-10-14T09:08:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 10, 2023-10-14T09:08:31.100 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 0, 2023-10-14T09:08:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 347, 2023-10-14T09:08:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 58, 2023-10-14T09:08:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2023-10-14T09:08:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2023-10-14T09:08:31.101 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2023-10-14T09:08:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2023-10-14T09:08:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 6, 2023-10-14T09:08:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2023-10-14T09:08:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:31.102 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 0, 2023-10-14T09:08:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 20, 2023-10-14T09:08:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:31.103 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2023-10-14T09:08:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2023-10-14T09:08:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2023-10-14T09:08:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2023-10-14T09:08:31.104 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 0, 2023-10-14T09:08:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2023-10-14T09:08:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2023-10-14T09:08:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2023-10-14T09:08:31.105 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2023-10-14T09:08:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2023-10-14T09:08:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2023-10-14T09:08:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2023-10-14T09:08:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2023-10-14T09:08:31.106 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2023-10-14T09:08:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2023-10-14T09:08:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2023-10-14T09:08:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2023-10-14T09:08:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2023-10-14T09:08:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2023-10-14T09:08:31.107 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2023-10-14T09:08:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2023-10-14T09:08:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 84, 2023-10-14T09:08:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2023-10-14T09:08:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2023-10-14T09:08:31.108 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 8, 2023-10-14T09:08:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 12, 2023-10-14T09:08:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 4, 2023-10-14T09:08:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2023-10-14T09:08:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 48, 2023-10-14T09:08:31.109 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 0, 2023-10-14T09:08:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 12 2023-10-14T09:08:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2023-10-14T09:08:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 1, 2023-10-14T09:08:31.110 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2023-10-14T09:08:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2023-10-14T09:08:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2023-10-14T09:08:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 0 2023-10-14T09:08:31.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2023-10-14T09:08:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2023-10-14T09:08:31.112 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 0, 2023-10-14T09:08:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:31.113 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 7364, 2023-10-14T09:08:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 3488605, 2023-10-14T09:08:31.114 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 7364, 2023-10-14T09:08:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 7364, 2023-10-14T09:08:31.115 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 3488605, 2023-10-14T09:08:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:31.117 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 455, 2023-10-14T09:08:31.118 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 3234532, 2023-10-14T09:08:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 455, 2023-10-14T09:08:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 3234532, 2023-10-14T09:08:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.119 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:31.120 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2023-10-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:31.121 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 455, 2023-10-14T09:08:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 455, 2023-10-14T09:08:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 455, 2023-10-14T09:08:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 455, 2023-10-14T09:08:31.122 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:31.124 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:31.125 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2023-10-14T09:08:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2023-10-14T09:08:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.126 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x557bdbbc6640": { 2023-10-14T09:08:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:31.127 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 1082, 2023-10-14T09:08:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 3164207, 2023-10-14T09:08:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 1082, 2023-10-14T09:08:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 347, 2023-10-14T09:08:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 3164207, 2023-10-14T09:08:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:31.129 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:31.130 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-14T09:08:31.400 INFO:tasks.check_counter:Daemon mds.h mds.exported=12 2023-10-14T09:08:31.400 INFO:tasks.check_counter:Daemon mds.h mds.imported=26 2023-10-14T09:08:31.400 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=54 2023-10-14T09:08:31.401 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=514 2023-10-14T09:08:31.401 DEBUG:tasks.check_counter:Getting stats from k 2023-10-14T09:08:31.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-14T09:08:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.b/config 2023-10-14T09:08:32.878 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:32 smithi057 ceph-mon[103313]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2023-10-14T09:08:32.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:32 smithi178 ceph-mon[103612]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2023-10-14T09:08:32.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:32 smithi006 ceph-mon[99452]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2023-10-14T09:08:33.310 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-14T09:08:33.310 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:33.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 5200, 2023-10-14T09:08:33.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 3387, 2023-10-14T09:08:33.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 2442145, 2023-10-14T09:08:33.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 2072597, 2023-10-14T09:08:33.311 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 9, 2023-10-14T09:08:33.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:33.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.337362387, 2023-10-14T09:08:33.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.119395802, 2023-10-14T09:08:33.312 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.256160840, 2023-10-14T09:08:33.313 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.023298798, 2023-10-14T09:08:33.313 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:33.313 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 3389, 2023-10-14T09:08:33.313 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.632485453, 2023-10-14T09:08:33.313 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000186628 2023-10-14T09:08:33.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.314 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:33.314 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 6975, 2023-10-14T09:08:33.314 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001845399, 2023-10-14T09:08:33.315 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000264 2023-10-14T09:08:33.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.315 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 721872, 2023-10-14T09:08:33.315 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 176592 2023-10-14T09:08:33.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.315 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:33.316 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 659, 2023-10-14T09:08:33.316 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 1176, 2023-10-14T09:08:33.316 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 225909, 2023-10-14T09:08:33.316 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 1176101, 2023-10-14T09:08:33.317 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 22, 2023-10-14T09:08:33.317 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 8, 2023-10-14T09:08:33.317 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.090071430, 2023-10-14T09:08:33.317 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.035082910, 2023-10-14T09:08:33.317 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.063829051, 2023-10-14T09:08:33.318 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.000327151, 2023-10-14T09:08:33.318 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:33.318 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1172, 2023-10-14T09:08:33.318 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.218723649, 2023-10-14T09:08:33.318 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000186624 2023-10-14T09:08:33.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.319 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:33.319 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1465, 2023-10-14T09:08:33.319 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.001605588, 2023-10-14T09:08:33.319 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000001095 2023-10-14T09:08:33.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.320 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 221488, 2023-10-14T09:08:33.320 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 1091136 2023-10-14T09:08:33.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.321 INFO:teuthology.orchestra.run.smithi057.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:33.321 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_messages": 608, 2023-10-14T09:08:33.321 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages": 530, 2023-10-14T09:08:33.321 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_bytes": 699819, 2023-10-14T09:08:33.322 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_bytes": 354376, 2023-10-14T09:08:33.322 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_created_connections": 11, 2023-10-14T09:08:33.322 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_active_connections": 5, 2023-10-14T09:08:33.322 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_total_time": 0.048204598, 2023-10-14T09:08:33.322 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_send_time": 0.019113896, 2023-10-14T09:08:33.323 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_recv_time": 0.032748234, 2023-10-14T09:08:33.323 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_running_fast_dispatch_time": 0.002971719, 2023-10-14T09:08:33.323 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:33.323 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 528, 2023-10-14T09:08:33.324 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.143882845, 2023-10-14T09:08:33.324 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000272505 2023-10-14T09:08:33.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.324 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:33.325 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 867, 2023-10-14T09:08:33.325 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000178451, 2023-10-14T09:08:33.325 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000205 2023-10-14T09:08:33.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.326 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-14T09:08:33.326 INFO:teuthology.orchestra.run.smithi057.stdout: "msgr_send_encrypted_bytes": 0 2023-10-14T09:08:33.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.326 INFO:teuthology.orchestra.run.smithi057.stdout: "cct": { 2023-10-14T09:08:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: "total_workers": 1, 2023-10-14T09:08:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: "unhealthy_workers": 0 2023-10-14T09:08:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-MDSRank": { 2023-10-14T09:08:33.327 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:33.328 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:33.328 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 572, 2023-10-14T09:08:33.328 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.085940017, 2023-10-14T09:08:33.328 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000150244 2023-10-14T09:08:33.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.329 INFO:teuthology.orchestra.run.smithi057.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:33.329 INFO:teuthology.orchestra.run.smithi057.stdout: "queue_len": 0, 2023-10-14T09:08:33.329 INFO:teuthology.orchestra.run.smithi057.stdout: "complete_latency": { 2023-10-14T09:08:33.329 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2, 2023-10-14T09:08:33.330 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000015329, 2023-10-14T09:08:33.330 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000007664 2023-10-14T09:08:33.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.331 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2023-10-14T09:08:33.331 INFO:teuthology.orchestra.run.smithi057.stdout: "request": 252, 2023-10-14T09:08:33.331 INFO:teuthology.orchestra.run.smithi057.stdout: "reply": 228, 2023-10-14T09:08:33.331 INFO:teuthology.orchestra.run.smithi057.stdout: "reply_latency": { 2023-10-14T09:08:33.332 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 228, 2023-10-14T09:08:33.332 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.211097069, 2023-10-14T09:08:33.332 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000925864 2023-10-14T09:08:33.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.333 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_reply": 0, 2023-10-14T09:08:33.333 INFO:teuthology.orchestra.run.smithi057.stdout: "forward": 24, 2023-10-14T09:08:33.333 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:33.334 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:33.334 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_commit": 11, 2023-10-14T09:08:33.334 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_split": 0, 2023-10-14T09:08:33.335 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_merge": 0, 2023-10-14T09:08:33.335 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes": 113, 2023-10-14T09:08:33.335 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_top": 6, 2023-10-14T09:08:33.335 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_bottom": 107, 2023-10-14T09:08:33.336 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pin_tail": 0, 2023-10-14T09:08:33.336 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_pinned": 100, 2023-10-14T09:08:33.336 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_expired": 0, 2023-10-14T09:08:33.336 INFO:teuthology.orchestra.run.smithi057.stdout: "inodes_with_caps": 82, 2023-10-14T09:08:33.337 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": 82, 2023-10-14T09:08:33.337 INFO:teuthology.orchestra.run.smithi057.stdout: "subtrees": 9, 2023-10-14T09:08:33.337 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse": 723, 2023-10-14T09:08:33.337 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_hit": 676, 2023-10-14T09:08:33.338 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_forward": 24, 2023-10-14T09:08:33.338 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_discover": 23, 2023-10-14T09:08:33.338 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:33.339 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:33.339 INFO:teuthology.orchestra.run.smithi057.stdout: "traverse_lock": 0, 2023-10-14T09:08:33.339 INFO:teuthology.orchestra.run.smithi057.stdout: "load_cent": 566, 2023-10-14T09:08:33.339 INFO:teuthology.orchestra.run.smithi057.stdout: "q": 0, 2023-10-14T09:08:33.339 INFO:teuthology.orchestra.run.smithi057.stdout: "exported": 0, 2023-10-14T09:08:33.340 INFO:teuthology.orchestra.run.smithi057.stdout: "exported_inodes": 0, 2023-10-14T09:08:33.340 INFO:teuthology.orchestra.run.smithi057.stdout: "imported": 7, 2023-10-14T09:08:33.340 INFO:teuthology.orchestra.run.smithi057.stdout: "imported_inodes": 292, 2023-10-14T09:08:33.340 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rfiles": 1039, 2023-10-14T09:08:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rbytes": 1736659720, 2023-10-14T09:08:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "root_rsnaps": 0, 2023-10-14T09:08:33.342 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:33.342 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:33.342 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:33.342 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:33.343 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:33.343 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:33.343 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:33.343 INFO:teuthology.orchestra.run.smithi057.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:33.343 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:33.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_revoke": 6, 2023-10-14T09:08:33.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_grant": 95, 2023-10-14T09:08:33.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_trunc": 4, 2023-10-14T09:08:33.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:33.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:33.345 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps": 221, 2023-10-14T09:08:33.345 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_caps_dirty": 190, 2023-10-14T09:08:33.345 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_cap_release": 5, 2023-10-14T09:08:33.346 INFO:teuthology.orchestra.run.smithi057.stdout: "process_request_cap_release": 6 2023-10-14T09:08:33.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.346 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_cache": { 2023-10-14T09:08:33.346 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update": 86, 2023-10-14T09:08:33.346 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_update_receipt": 510, 2023-10-14T09:08:33.347 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_try_discover": 266, 2023-10-14T09:08:33.347 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_send_discover": 470, 2023-10-14T09:08:33.347 INFO:teuthology.orchestra.run.smithi057.stdout: "dir_handle_discover": 86, 2023-10-14T09:08:33.347 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays": 0, 2023-10-14T09:08:33.347 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:33.348 INFO:teuthology.orchestra.run.smithi057.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:33.348 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_created": 0, 2023-10-14T09:08:33.348 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_enqueued": 0, 2023-10-14T09:08:33.348 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:33.348 INFO:teuthology.orchestra.run.smithi057.stdout: "strays_migrated": 0, 2023-10-14T09:08:33.348 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:33.349 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:33.349 INFO:teuthology.orchestra.run.smithi057.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:33.349 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_started": 0, 2023-10-14T09:08:33.349 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_completed": 0, 2023-10-14T09:08:33.349 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:33.350 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_exportdir": 0, 2023-10-14T09:08:33.350 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_flush": 0, 2023-10-14T09:08:33.350 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:33.350 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:33.350 INFO:teuthology.orchestra.run.smithi057.stdout: "ireq_inodestats": 0 2023-10-14T09:08:33.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.351 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_log": { 2023-10-14T09:08:33.351 INFO:teuthology.orchestra.run.smithi057.stdout: "evlrg": 0, 2023-10-14T09:08:33.351 INFO:teuthology.orchestra.run.smithi057.stdout: "evadd": 392, 2023-10-14T09:08:33.351 INFO:teuthology.orchestra.run.smithi057.stdout: "evex": 0, 2023-10-14T09:08:33.352 INFO:teuthology.orchestra.run.smithi057.stdout: "evtrm": 0, 2023-10-14T09:08:33.352 INFO:teuthology.orchestra.run.smithi057.stdout: "ev": 392, 2023-10-14T09:08:33.352 INFO:teuthology.orchestra.run.smithi057.stdout: "evexg": 0, 2023-10-14T09:08:33.352 INFO:teuthology.orchestra.run.smithi057.stdout: "evexd": 0, 2023-10-14T09:08:33.352 INFO:teuthology.orchestra.run.smithi057.stdout: "segadd": 2, 2023-10-14T09:08:33.353 INFO:teuthology.orchestra.run.smithi057.stdout: "segex": 0, 2023-10-14T09:08:33.353 INFO:teuthology.orchestra.run.smithi057.stdout: "segtrm": 0, 2023-10-14T09:08:33.353 INFO:teuthology.orchestra.run.smithi057.stdout: "seg": 2, 2023-10-14T09:08:33.353 INFO:teuthology.orchestra.run.smithi057.stdout: "segmjr": 2, 2023-10-14T09:08:33.354 INFO:teuthology.orchestra.run.smithi057.stdout: "segexg": 0, 2023-10-14T09:08:33.354 INFO:teuthology.orchestra.run.smithi057.stdout: "segexd": 0, 2023-10-14T09:08:33.354 INFO:teuthology.orchestra.run.smithi057.stdout: "expos": 4194304, 2023-10-14T09:08:33.354 INFO:teuthology.orchestra.run.smithi057.stdout: "wrpos": 4797128, 2023-10-14T09:08:33.354 INFO:teuthology.orchestra.run.smithi057.stdout: "rdpos": 0, 2023-10-14T09:08:33.354 INFO:teuthology.orchestra.run.smithi057.stdout: "jlat": { 2023-10-14T09:08:33.355 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 243, 2023-10-14T09:08:33.355 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 2.054822582, 2023-10-14T09:08:33.355 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.008456060 2023-10-14T09:08:33.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.356 INFO:teuthology.orchestra.run.smithi057.stdout: "replayed": 0 2023-10-14T09:08:33.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.356 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_mem": { 2023-10-14T09:08:33.356 INFO:teuthology.orchestra.run.smithi057.stdout: "ino": 323, 2023-10-14T09:08:33.356 INFO:teuthology.orchestra.run.smithi057.stdout: "ino+": 323, 2023-10-14T09:08:33.357 INFO:teuthology.orchestra.run.smithi057.stdout: "ino-": 0, 2023-10-14T09:08:33.357 INFO:teuthology.orchestra.run.smithi057.stdout: "dir": 45, 2023-10-14T09:08:33.357 INFO:teuthology.orchestra.run.smithi057.stdout: "dir+": 262, 2023-10-14T09:08:33.357 INFO:teuthology.orchestra.run.smithi057.stdout: "dir-": 217, 2023-10-14T09:08:33.357 INFO:teuthology.orchestra.run.smithi057.stdout: "dn": 320, 2023-10-14T09:08:33.358 INFO:teuthology.orchestra.run.smithi057.stdout: "dn+": 324, 2023-10-14T09:08:33.358 INFO:teuthology.orchestra.run.smithi057.stdout: "dn-": 4, 2023-10-14T09:08:33.358 INFO:teuthology.orchestra.run.smithi057.stdout: "cap": 289, 2023-10-14T09:08:33.358 INFO:teuthology.orchestra.run.smithi057.stdout: "cap+": 308, 2023-10-14T09:08:33.358 INFO:teuthology.orchestra.run.smithi057.stdout: "cap-": 19, 2023-10-14T09:08:33.359 INFO:teuthology.orchestra.run.smithi057.stdout: "rss": 52408, 2023-10-14T09:08:33.359 INFO:teuthology.orchestra.run.smithi057.stdout: "heap": 198960 2023-10-14T09:08:33.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.359 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_server": { 2023-10-14T09:08:33.359 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_client_request": 261, 2023-10-14T09:08:33.360 INFO:teuthology.orchestra.run.smithi057.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:33.360 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_request": 252, 2023-10-14T09:08:33.360 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_client_session": 12, 2023-10-14T09:08:33.360 INFO:teuthology.orchestra.run.smithi057.stdout: "handle_peer_request": 0, 2023-10-14T09:08:33.360 INFO:teuthology.orchestra.run.smithi057.stdout: "req_create_latency": { 2023-10-14T09:08:33.360 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.361 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.361 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.361 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getattr_latency": { 2023-10-14T09:08:33.361 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 1, 2023-10-14T09:08:33.362 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000457240, 2023-10-14T09:08:33.362 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000457240 2023-10-14T09:08:33.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.362 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:33.362 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: "req_link_latency": { 2023-10-14T09:08:33.363 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.364 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.364 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.364 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookup_latency": { 2023-10-14T09:08:33.365 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 203, 2023-10-14T09:08:33.365 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.169702976, 2023-10-14T09:08:33.365 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000835975 2023-10-14T09:08:33.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.365 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:33.365 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.366 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.366 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.366 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupino_latency": { 2023-10-14T09:08:33.366 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.367 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.367 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.367 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupname_latency": { 2023-10-14T09:08:33.367 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.368 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.368 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.368 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:33.368 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.369 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.369 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.369 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:33.369 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.370 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.370 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.370 INFO:teuthology.orchestra.run.smithi057.stdout: "req_lssnap_latency": { 2023-10-14T09:08:33.371 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.371 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.371 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.371 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mkdir_latency": { 2023-10-14T09:08:33.372 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.372 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.372 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.372 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mknod_latency": { 2023-10-14T09:08:33.372 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.373 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.373 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.373 INFO:teuthology.orchestra.run.smithi057.stdout: "req_mksnap_latency": { 2023-10-14T09:08:33.374 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.374 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.374 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.375 INFO:teuthology.orchestra.run.smithi057.stdout: "req_open_latency": { 2023-10-14T09:08:33.375 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 18, 2023-10-14T09:08:33.375 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.020571636, 2023-10-14T09:08:33.375 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001142868 2023-10-14T09:08:33.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.376 INFO:teuthology.orchestra.run.smithi057.stdout: "req_readdir_latency": { 2023-10-14T09:08:33.376 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 2, 2023-10-14T09:08:33.376 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.002913589, 2023-10-14T09:08:33.376 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.001456794 2023-10-14T09:08:33.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.377 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rename_latency": { 2023-10-14T09:08:33.377 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.377 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.377 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.378 INFO:teuthology.orchestra.run.smithi057.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:33.378 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.378 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.378 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.379 INFO:teuthology.orchestra.run.smithi057.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:33.379 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.379 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.379 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.380 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmdir_latency": { 2023-10-14T09:08:33.380 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.380 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.380 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.381 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:33.381 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.381 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.381 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.382 INFO:teuthology.orchestra.run.smithi057.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:33.382 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.382 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.382 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.383 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setattr_latency": { 2023-10-14T09:08:33.383 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 4, 2023-10-14T09:08:33.383 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.017451628, 2023-10-14T09:08:33.384 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.004362907 2023-10-14T09:08:33.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.384 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:33.384 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.384 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.385 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.385 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:33.385 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.385 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.386 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.386 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setlayout_latency": { 2023-10-14T09:08:33.386 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.387 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.387 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.387 INFO:teuthology.orchestra.run.smithi057.stdout: "req_setxattr_latency": { 2023-10-14T09:08:33.387 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.388 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.388 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.388 INFO:teuthology.orchestra.run.smithi057.stdout: "req_symlink_latency": { 2023-10-14T09:08:33.389 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.389 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.389 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.389 INFO:teuthology.orchestra.run.smithi057.stdout: "req_unlink_latency": { 2023-10-14T09:08:33.390 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.390 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.390 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.390 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:33.391 INFO:teuthology.orchestra.run.smithi057.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:33.391 INFO:teuthology.orchestra.run.smithi057.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:33.391 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.391 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.391 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.392 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.392 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_sessions": { 2023-10-14T09:08:33.392 INFO:teuthology.orchestra.run.smithi057.stdout: "session_count": 1, 2023-10-14T09:08:33.392 INFO:teuthology.orchestra.run.smithi057.stdout: "session_add": 1, 2023-10-14T09:08:33.393 INFO:teuthology.orchestra.run.smithi057.stdout: "session_remove": 0, 2023-10-14T09:08:33.393 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_open": 1, 2023-10-14T09:08:33.393 INFO:teuthology.orchestra.run.smithi057.stdout: "sessions_stale": 0, 2023-10-14T09:08:33.393 INFO:teuthology.orchestra.run.smithi057.stdout: "total_load": 28, 2023-10-14T09:08:33.393 INFO:teuthology.orchestra.run.smithi057.stdout: "average_load": 28, 2023-10-14T09:08:33.393 INFO:teuthology.orchestra.run.smithi057.stdout: "avg_session_uptime": 2324, 2023-10-14T09:08:33.394 INFO:teuthology.orchestra.run.smithi057.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:33.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.394 INFO:teuthology.orchestra.run.smithi057.stdout: "mempool": { 2023-10-14T09:08:33.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:33.394 INFO:teuthology.orchestra.run.smithi057.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:33.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:33.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:33.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:33.395 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:33.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:33.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:33.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:33.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:33.396 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:33.397 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:33.397 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:33.397 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:33.397 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:33.397 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:33.398 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:33.398 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:33.398 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:33.398 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:33.399 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:33.399 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:33.399 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:33.399 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:33.399 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:33.399 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:33.400 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:33.400 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:33.400 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:33.400 INFO:teuthology.orchestra.run.smithi057.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:33.401 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:33.401 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_items": 0, 2023-10-14T09:08:33.401 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:33.401 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:33.402 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:33.402 INFO:teuthology.orchestra.run.smithi057.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:33.402 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_bytes": 303366, 2023-10-14T09:08:33.402 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_anon_items": 225, 2023-10-14T09:08:33.403 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:33.403 INFO:teuthology.orchestra.run.smithi057.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:33.403 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_bytes": 0, 2023-10-14T09:08:33.403 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_items": 0, 2023-10-14T09:08:33.403 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:33.404 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:33.404 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:33.404 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:33.404 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:33.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_items": 160, 2023-10-14T09:08:33.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:33.405 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:33.405 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:33.405 INFO:teuthology.orchestra.run.smithi057.stdout: "pgmap_items": 0, 2023-10-14T09:08:33.406 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_bytes": 432097, 2023-10-14T09:08:33.406 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_co_items": 3634, 2023-10-14T09:08:33.406 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:33.406 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_1_items": 0, 2023-10-14T09:08:33.407 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:33.407 INFO:teuthology.orchestra.run.smithi057.stdout: "unittest_2_items": 0 2023-10-14T09:08:33.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.407 INFO:teuthology.orchestra.run.smithi057.stdout: "objecter": { 2023-10-14T09:08:33.407 INFO:teuthology.orchestra.run.smithi057.stdout: "op_active": 0, 2023-10-14T09:08:33.407 INFO:teuthology.orchestra.run.smithi057.stdout: "op_laggy": 0, 2023-10-14T09:08:33.408 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send": 356, 2023-10-14T09:08:33.408 INFO:teuthology.orchestra.run.smithi057.stdout: "op_send_bytes": 621493, 2023-10-14T09:08:33.408 INFO:teuthology.orchestra.run.smithi057.stdout: "op_resend": 27, 2023-10-14T09:08:33.408 INFO:teuthology.orchestra.run.smithi057.stdout: "op_reply": 356, 2023-10-14T09:08:33.408 INFO:teuthology.orchestra.run.smithi057.stdout: "op_latency": { 2023-10-14T09:08:33.409 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 356, 2023-10-14T09:08:33.409 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 3.109952249, 2023-10-14T09:08:33.409 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.008735820 2023-10-14T09:08:33.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.409 INFO:teuthology.orchestra.run.smithi057.stdout: "op_inflight": 0, 2023-10-14T09:08:33.410 INFO:teuthology.orchestra.run.smithi057.stdout: "oplen_avg": { 2023-10-14T09:08:33.410 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 356, 2023-10-14T09:08:33.410 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 401 2023-10-14T09:08:33.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.411 INFO:teuthology.orchestra.run.smithi057.stdout: "op": 356, 2023-10-14T09:08:33.411 INFO:teuthology.orchestra.run.smithi057.stdout: "op_r": 0, 2023-10-14T09:08:33.411 INFO:teuthology.orchestra.run.smithi057.stdout: "op_w": 356, 2023-10-14T09:08:33.411 INFO:teuthology.orchestra.run.smithi057.stdout: "op_rmw": 0, 2023-10-14T09:08:33.411 INFO:teuthology.orchestra.run.smithi057.stdout: "op_pg": 0, 2023-10-14T09:08:33.412 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_stat": 0, 2023-10-14T09:08:33.412 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_create": 10, 2023-10-14T09:08:33.412 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_read": 0, 2023-10-14T09:08:33.412 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_write": 243, 2023-10-14T09:08:33.412 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writefull": 54, 2023-10-14T09:08:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_writesame": 0, 2023-10-14T09:08:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_append": 0, 2023-10-14T09:08:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_zero": 0, 2023-10-14T09:08:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_truncate": 0, 2023-10-14T09:08:33.413 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_delete": 6, 2023-10-14T09:08:33.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_mapext": 0, 2023-10-14T09:08:33.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:33.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:33.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_getxattr": 0, 2023-10-14T09:08:33.414 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_setxattr": 20, 2023-10-14T09:08:33.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:33.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:33.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:33.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_call": 0, 2023-10-14T09:08:33.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_watch": 0, 2023-10-14T09:08:33.415 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_notify": 0, 2023-10-14T09:08:33.416 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:33.416 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls": 0, 2023-10-14T09:08:33.416 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:33.416 INFO:teuthology.orchestra.run.smithi057.stdout: "osdop_other": 7, 2023-10-14T09:08:33.417 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_active": 0, 2023-10-14T09:08:33.417 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_send": 0, 2023-10-14T09:08:33.417 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_resend": 0, 2023-10-14T09:08:33.417 INFO:teuthology.orchestra.run.smithi057.stdout: "linger_ping": 0, 2023-10-14T09:08:33.417 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_active": 0, 2023-10-14T09:08:33.418 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_send": 0, 2023-10-14T09:08:33.418 INFO:teuthology.orchestra.run.smithi057.stdout: "poolop_resend": 0, 2023-10-14T09:08:33.418 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_active": 0, 2023-10-14T09:08:33.418 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_send": 0, 2023-10-14T09:08:33.418 INFO:teuthology.orchestra.run.smithi057.stdout: "poolstat_resend": 0, 2023-10-14T09:08:33.419 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_active": 0, 2023-10-14T09:08:33.419 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_send": 0, 2023-10-14T09:08:33.419 INFO:teuthology.orchestra.run.smithi057.stdout: "statfs_resend": 0, 2023-10-14T09:08:33.419 INFO:teuthology.orchestra.run.smithi057.stdout: "command_active": 0, 2023-10-14T09:08:33.420 INFO:teuthology.orchestra.run.smithi057.stdout: "command_send": 0, 2023-10-14T09:08:33.420 INFO:teuthology.orchestra.run.smithi057.stdout: "command_resend": 0, 2023-10-14T09:08:33.420 INFO:teuthology.orchestra.run.smithi057.stdout: "map_epoch": 84, 2023-10-14T09:08:33.420 INFO:teuthology.orchestra.run.smithi057.stdout: "map_full": 0, 2023-10-14T09:08:33.420 INFO:teuthology.orchestra.run.smithi057.stdout: "map_inc": 2, 2023-10-14T09:08:33.420 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_sessions": 11, 2023-10-14T09:08:33.421 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_open": 15, 2023-10-14T09:08:33.421 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_session_close": 4, 2023-10-14T09:08:33.421 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_laggy": 0, 2023-10-14T09:08:33.421 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_wr": 51, 2023-10-14T09:08:33.422 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_rd": 0, 2023-10-14T09:08:33.422 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_del": 10 2023-10-14T09:08:33.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.422 INFO:teuthology.orchestra.run.smithi057.stdout: "oft": { 2023-10-14T09:08:33.422 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_objs": 1, 2023-10-14T09:08:33.423 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:33.423 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_updates": 0, 2023-10-14T09:08:33.423 INFO:teuthology.orchestra.run.smithi057.stdout: "omap_total_removes": 0 2023-10-14T09:08:33.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.424 INFO:teuthology.orchestra.run.smithi057.stdout: "osd-slow-ops": { 2023-10-14T09:08:33.424 INFO:teuthology.orchestra.run.smithi057.stdout: "slow_ops_count": 0 2023-10-14T09:08:33.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.424 INFO:teuthology.orchestra.run.smithi057.stdout: "purge_queue": { 2023-10-14T09:08:33.424 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:33.425 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:33.425 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing": 0, 2023-10-14T09:08:33.425 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:33.425 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_executed": 0, 2023-10-14T09:08:33.425 INFO:teuthology.orchestra.run.smithi057.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:33.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.426 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:33.426 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:33.426 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:33.426 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:33.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 6463, 2023-10-14T09:08:33.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 2736249, 2023-10-14T09:08:33.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:33.427 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 6463, 2023-10-14T09:08:33.427 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:33.428 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:33.428 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 6463, 2023-10-14T09:08:33.428 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 2736249, 2023-10-14T09:08:33.428 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:33.428 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.429 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.429 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.429 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:33.430 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:33.430 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 104857600, 2023-10-14T09:08:33.430 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:33.430 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:33.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:33.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:33.431 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:33.431 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 356, 2023-10-14T09:08:33.431 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 621493, 2023-10-14T09:08:33.432 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 356, 2023-10-14T09:08:33.432 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 621493, 2023-10-14T09:08:33.432 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:33.432 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.432 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.433 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.433 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.433 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:33.434 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:33.434 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 1024, 2023-10-14T09:08:33.434 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:33.434 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:33.434 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:33.435 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:33.435 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:33.435 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 356, 2023-10-14T09:08:33.435 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 356, 2023-10-14T09:08:33.436 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 356, 2023-10-14T09:08:33.436 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 356, 2023-10-14T09:08:33.436 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:33.436 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.436 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.437 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.437 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:33.437 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 0, 2023-10-14T09:08:33.437 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:33.438 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:33.438 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 0, 2023-10-14T09:08:33.438 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 0, 2023-10-14T09:08:33.438 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:33.439 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:33.439 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:33.439 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:33.439 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 0, 2023-10-14T09:08:33.439 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 0, 2023-10-14T09:08:33.439 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:33.440 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.440 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.440 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.440 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-14T09:08:33.441 INFO:teuthology.orchestra.run.smithi057.stdout: "throttle-write_buf_throttle-0x558d47b5e5a0": { 2023-10-14T09:08:33.441 INFO:teuthology.orchestra.run.smithi057.stdout: "val": 305, 2023-10-14T09:08:33.441 INFO:teuthology.orchestra.run.smithi057.stdout: "max": 3758096384, 2023-10-14T09:08:33.441 INFO:teuthology.orchestra.run.smithi057.stdout: "get_started": 0, 2023-10-14T09:08:33.441 INFO:teuthology.orchestra.run.smithi057.stdout: "get": 392, 2023-10-14T09:08:33.442 INFO:teuthology.orchestra.run.smithi057.stdout: "get_sum": 602824, 2023-10-14T09:08:33.442 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:33.442 INFO:teuthology.orchestra.run.smithi057.stdout: "get_or_fail_success": 392, 2023-10-14T09:08:33.442 INFO:teuthology.orchestra.run.smithi057.stdout: "take": 0, 2023-10-14T09:08:33.442 INFO:teuthology.orchestra.run.smithi057.stdout: "take_sum": 0, 2023-10-14T09:08:33.443 INFO:teuthology.orchestra.run.smithi057.stdout: "put": 243, 2023-10-14T09:08:33.443 INFO:teuthology.orchestra.run.smithi057.stdout: "put_sum": 602519, 2023-10-14T09:08:33.443 INFO:teuthology.orchestra.run.smithi057.stdout: "wait": { 2023-10-14T09:08:33.443 INFO:teuthology.orchestra.run.smithi057.stdout: "avgcount": 0, 2023-10-14T09:08:33.443 INFO:teuthology.orchestra.run.smithi057.stdout: "sum": 0.000000000, 2023-10-14T09:08:33.444 INFO:teuthology.orchestra.run.smithi057.stdout: "avgtime": 0.000000000 2023-10-14T09:08:33.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-14T09:08:33.444 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-14T09:08:33.726 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-14T09:08:33.727 INFO:tasks.check_counter:Daemon mds.k mds.imported=7 2023-10-14T09:08:33.727 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=86 2023-10-14T09:08:33.727 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=510 2023-10-14T09:08:33.728 DEBUG:tasks.check_counter:Getting stats from c 2023-10-14T09:08:33.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-14T09:08:34.134 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:34 smithi178 ceph-mon[103612]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 16 op/s 2023-10-14T09:08:34.309 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T09:08:34.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:34 smithi057 ceph-mon[103313]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 16 op/s 2023-10-14T09:08:34.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:34 smithi006 ceph-mon[99452]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 16 op/s 2023-10-14T09:08:35.641 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2023-10-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2033, 2023-10-14T09:08:35.642 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1991, 2023-10-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 5440373, 2023-10-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 699918, 2023-10-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:35.643 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 1, 2023-10-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.189489263, 2023-10-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.051881135, 2023-10-14T09:08:35.644 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.057434488, 2023-10-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.066812620, 2023-10-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:35.645 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1990, 2023-10-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.385441432, 2023-10-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000193689 2023-10-14T09:08:35.646 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.647 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 732720, 2023-10-14T09:08:35.648 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 170592 2023-10-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:35.649 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1519, 2023-10-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1732, 2023-10-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 8511550, 2023-10-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 1008909, 2023-10-14T09:08:35.650 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2023-10-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.121859397, 2023-10-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.036349712, 2023-10-14T09:08:35.651 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.034959782, 2023-10-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.040171550, 2023-10-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:35.652 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1730, 2023-10-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.369080622, 2023-10-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000213341 2023-10-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.654 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:35.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 537056 2023-10-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:35.656 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 263, 2023-10-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 263, 2023-10-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4262892, 2023-10-14T09:08:35.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 81004, 2023-10-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:35.658 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.024266894, 2023-10-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.006930368, 2023-10-14T09:08:35.659 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.008386093, 2023-10-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.007062265, 2023-10-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:35.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 262, 2023-10-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.015599453, 2023-10-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000059539 2023-10-14T09:08:35.661 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.662 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.663 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2023-10-14T09:08:35.664 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2023-10-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2023-10-14T09:08:35.665 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2023-10-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2023-10-14T09:08:35.666 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5850, 2023-10-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.167908919, 2023-10-14T09:08:35.667 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000028702 2023-10-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:35.669 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.671 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2023-10-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2023-10-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2023-10-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2023-10-14T09:08:35.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.673 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2023-10-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2023-10-14T09:08:35.674 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2023-10-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2023-10-14T09:08:35.675 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2023-10-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 461, 2023-10-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 170, 2023-10-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 285, 2023-10-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 6, 2023-10-14T09:08:35.676 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 218, 2023-10-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 142, 2023-10-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2023-10-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2023-10-14T09:08:35.677 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 15, 2023-10-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2023-10-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2023-10-14T09:08:35.678 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2023-10-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2023-10-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:35.679 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2023-10-14T09:08:35.680 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2023-10-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2023-10-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2023-10-14T09:08:35.681 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2023-10-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2023-10-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2023-10-14T09:08:35.682 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:35.683 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 1038, 2023-10-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 1728942748, 2023-10-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2023-10-14T09:08:35.684 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:35.685 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:35.686 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2023-10-14T09:08:35.687 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2023-10-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2023-10-14T09:08:35.688 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2023-10-14T09:08:35.689 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2023-10-14T09:08:35.689 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2023-10-14T09:08:35.689 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.690 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2023-10-14T09:08:35.690 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2023-10-14T09:08:35.690 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2023-10-14T09:08:35.691 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2023-10-14T09:08:35.691 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2023-10-14T09:08:35.691 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2023-10-14T09:08:35.692 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2023-10-14T09:08:35.692 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:35.692 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:35.693 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2023-10-14T09:08:35.693 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2023-10-14T09:08:35.693 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:35.694 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2023-10-14T09:08:35.694 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:35.695 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:35.695 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:35.695 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2023-10-14T09:08:35.696 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2023-10-14T09:08:35.696 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:35.696 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2023-10-14T09:08:35.697 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2023-10-14T09:08:35.697 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:35.697 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:35.698 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2023-10-14T09:08:35.698 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.698 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2023-10-14T09:08:35.699 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2023-10-14T09:08:35.699 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2023-10-14T09:08:35.699 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2023-10-14T09:08:35.699 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2023-10-14T09:08:35.699 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 5865, 2023-10-14T09:08:35.700 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2023-10-14T09:08:35.700 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2023-10-14T09:08:35.700 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2023-10-14T09:08:35.700 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2023-10-14T09:08:35.700 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2023-10-14T09:08:35.701 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2023-10-14T09:08:35.701 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 71, 2023-10-14T09:08:35.701 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2023-10-14T09:08:35.701 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2023-10-14T09:08:35.701 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 20454589, 2023-10-14T09:08:35.702 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 20707136, 2023-10-14T09:08:35.702 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 20704807, 2023-10-14T09:08:35.702 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2023-10-14T09:08:35.702 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.702 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.703 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.703 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 5865 2023-10-14T09:08:35.703 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.703 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2023-10-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 233, 2023-10-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 1306, 2023-10-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 1073, 2023-10-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 41, 2023-10-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 76, 2023-10-14T09:08:35.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 35, 2023-10-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 461, 2023-10-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 2074, 2023-10-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 1613, 2023-10-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2023-10-14T09:08:35.705 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2023-10-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2023-10-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 51728, 2023-10-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 207152 2023-10-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.706 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2023-10-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2023-10-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2023-10-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2023-10-14T09:08:35.707 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2023-10-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2023-10-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2023-10-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.709 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.710 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.711 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2023-10-14T09:08:35.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.711 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.711 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2023-10-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.712 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:35.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.713 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.713 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.713 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2023-10-14T09:08:35.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.714 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.714 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.714 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2023-10-14T09:08:35.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.715 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.715 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.715 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:35.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.716 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.716 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.716 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:35.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.717 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.717 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.717 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2023-10-14T09:08:35.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.718 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.718 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.718 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.718 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2023-10-14T09:08:35.718 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.719 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.719 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.719 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.719 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2023-10-14T09:08:35.719 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.719 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.720 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.720 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2023-10-14T09:08:35.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.720 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.721 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.721 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2023-10-14T09:08:35.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.721 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.722 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.722 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2023-10-14T09:08:35.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.722 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.723 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.723 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2023-10-14T09:08:35.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.723 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.724 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.724 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:35.724 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.724 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.724 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.725 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.725 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:35.725 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.725 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.725 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.725 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.726 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2023-10-14T09:08:35.726 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.726 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.726 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.726 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.727 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:35.727 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.727 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.727 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.727 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.728 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:35.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.728 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.728 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.729 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2023-10-14T09:08:35.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.729 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.729 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.730 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:35.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.730 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.730 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.730 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:35.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.731 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.731 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.731 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2023-10-14T09:08:35.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.732 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.732 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.732 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2023-10-14T09:08:35.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.733 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.733 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.733 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2023-10-14T09:08:35.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.734 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.734 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.734 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.734 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2023-10-14T09:08:35.734 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.735 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.735 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.735 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.735 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:35.735 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:35.736 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:35.736 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.736 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.736 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.736 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.737 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.737 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2023-10-14T09:08:35.737 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2023-10-14T09:08:35.737 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2023-10-14T09:08:35.737 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2023-10-14T09:08:35.737 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2023-10-14T09:08:35.738 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2023-10-14T09:08:35.738 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2023-10-14T09:08:35.738 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2023-10-14T09:08:35.738 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 2317, 2023-10-14T09:08:35.738 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:35.739 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.739 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2023-10-14T09:08:35.739 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:35.739 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:35.739 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:35.740 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:35.740 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:35.740 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:35.740 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:35.740 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:35.741 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:35.741 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:35.741 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:35.741 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:35.741 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:35.742 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:35.742 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:35.742 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:35.742 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:35.742 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:35.743 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:35.743 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:35.743 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:35.743 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:35.743 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:35.744 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:35.744 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:35.744 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:35.744 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:35.744 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:35.745 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:35.745 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:35.745 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:35.745 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2023-10-14T09:08:35.745 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 197228, 2023-10-14T09:08:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 262, 2023-10-14T09:08:35.746 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:35.747 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:35.747 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2023-10-14T09:08:35.747 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2023-10-14T09:08:35.747 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:35.747 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:35.748 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:35.748 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:35.748 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:35.748 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 160, 2023-10-14T09:08:35.748 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:35.749 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:35.749 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:35.749 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2023-10-14T09:08:35.749 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 891860, 2023-10-14T09:08:35.749 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 6978, 2023-10-14T09:08:35.749 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:35.750 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2023-10-14T09:08:35.750 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:35.750 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2023-10-14T09:08:35.750 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.750 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2023-10-14T09:08:35.751 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2023-10-14T09:08:35.751 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2023-10-14T09:08:35.751 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 3478, 2023-10-14T09:08:35.751 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 26, 2023-10-14T09:08:35.751 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 4, 2023-10-14T09:08:35.752 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 3478, 2023-10-14T09:08:35.752 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2023-10-14T09:08:35.752 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3478, 2023-10-14T09:08:35.752 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 14.145006809, 2023-10-14T09:08:35.752 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.004066994 2023-10-14T09:08:35.752 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.753 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2023-10-14T09:08:35.753 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2023-10-14T09:08:35.753 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3478, 2023-10-14T09:08:35.753 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 3479 2023-10-14T09:08:35.753 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.754 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 3478, 2023-10-14T09:08:35.754 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 3478, 2023-10-14T09:08:35.754 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2023-10-14T09:08:35.754 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2023-10-14T09:08:35.754 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2023-10-14T09:08:35.755 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 2021, 2023-10-14T09:08:35.755 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2023-10-14T09:08:35.755 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1454, 2023-10-14T09:08:35.755 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2023-10-14T09:08:35.755 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2023-10-14T09:08:35.755 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2023-10-14T09:08:35.756 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2023-10-14T09:08:35.756 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2023-10-14T09:08:35.756 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2023-10-14T09:08:35.756 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2023-10-14T09:08:35.756 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2023-10-14T09:08:35.757 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:35.757 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:35.757 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 2, 2023-10-14T09:08:35.757 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2023-10-14T09:08:35.757 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:35.757 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:35.758 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:35.758 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2023-10-14T09:08:35.758 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2023-10-14T09:08:35.758 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2023-10-14T09:08:35.758 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:35.759 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2023-10-14T09:08:35.759 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:35.759 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2023-10-14T09:08:35.759 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2023-10-14T09:08:35.759 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2023-10-14T09:08:35.760 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2023-10-14T09:08:35.760 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2023-10-14T09:08:35.760 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2023-10-14T09:08:35.760 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2023-10-14T09:08:35.760 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2023-10-14T09:08:35.761 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2023-10-14T09:08:35.761 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2023-10-14T09:08:35.761 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2023-10-14T09:08:35.761 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2023-10-14T09:08:35.761 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2023-10-14T09:08:35.761 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2023-10-14T09:08:35.762 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2023-10-14T09:08:35.762 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2023-10-14T09:08:35.762 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2023-10-14T09:08:35.762 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 84, 2023-10-14T09:08:35.762 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2023-10-14T09:08:35.763 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2023-10-14T09:08:35.763 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 5, 2023-10-14T09:08:35.763 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 6, 2023-10-14T09:08:35.763 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 1, 2023-10-14T09:08:35.763 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2023-10-14T09:08:35.764 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2023-10-14T09:08:35.764 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2023-10-14T09:08:35.764 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2023-10-14T09:08:35.764 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.764 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2023-10-14T09:08:35.764 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2023-10-14T09:08:35.765 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:35.765 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2023-10-14T09:08:35.765 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2023-10-14T09:08:35.765 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.765 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2023-10-14T09:08:35.766 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2023-10-14T09:08:35.766 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.766 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2023-10-14T09:08:35.766 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:35.766 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:35.767 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2023-10-14T09:08:35.767 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:35.767 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2023-10-14T09:08:35.767 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:35.767 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.768 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:35.768 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:35.768 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:35.768 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:35.768 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3811, 2023-10-14T09:08:35.768 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 17851991, 2023-10-14T09:08:35.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:35.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3811, 2023-10-14T09:08:35.769 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:35.769 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:35.769 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3811, 2023-10-14T09:08:35.770 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 17851991, 2023-10-14T09:08:35.770 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:35.770 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.770 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.770 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.771 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.771 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.771 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:35.771 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:35.771 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:35.772 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3478, 2023-10-14T09:08:35.773 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 16512842, 2023-10-14T09:08:35.773 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3478, 2023-10-14T09:08:35.773 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 16512842, 2023-10-14T09:08:35.773 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:35.773 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.774 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.774 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.774 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.774 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.774 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:35.775 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:35.775 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2023-10-14T09:08:35.775 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:35.775 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:35.775 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:35.776 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:35.776 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:35.776 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3478, 2023-10-14T09:08:35.776 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3478, 2023-10-14T09:08:35.776 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3478, 2023-10-14T09:08:35.777 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3478, 2023-10-14T09:08:35.777 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:35.777 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.777 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.777 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.778 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.778 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.778 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:35.778 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:35.778 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:35.779 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:35.779 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:35.779 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:35.779 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:35.779 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:35.779 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:35.780 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:35.780 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2023-10-14T09:08:35.780 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2023-10-14T09:08:35.780 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:35.780 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.781 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.781 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.781 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.781 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:35.781 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5578d9c1c960": { 2023-10-14T09:08:35.782 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:35.782 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:35.782 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:35.782 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:35.782 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:35.783 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:35.783 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:35.783 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:35.783 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:35.783 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2023-10-14T09:08:35.783 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2023-10-14T09:08:35.784 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:35.784 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:35.784 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:35.784 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:35.784 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.785 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:35.785 INFO:teuthology.orchestra.run.smithi178.stdout:} 2023-10-14T09:08:36.065 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-10-14T09:08:36.065 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-10-14T09:08:36.065 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-10-14T09:08:36.066 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-10-14T09:08:36.066 DEBUG:tasks.check_counter:Getting stats from f 2023-10-14T09:08:36.066 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-14T09:08:36.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:36 smithi178 ceph-mon[103612]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2023-10-14T09:08:36.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:36 smithi057 ceph-mon[103313]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2023-10-14T09:08:36.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:36 smithi006 ceph-mon[99452]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 17 op/s 2023-10-14T09:08:36.626 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T09:08:37.835 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2023-10-14T09:08:37.835 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:37.835 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1363, 2023-10-14T09:08:37.835 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1320, 2023-10-14T09:08:37.836 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1081568, 2023-10-14T09:08:37.836 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 491372, 2023-10-14T09:08:37.836 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:37.836 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 1, 2023-10-14T09:08:37.837 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.142106598, 2023-10-14T09:08:37.837 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.041466270, 2023-10-14T09:08:37.837 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.044724795, 2023-10-14T09:08:37.837 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.046057048, 2023-10-14T09:08:37.837 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:37.838 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1320, 2023-10-14T09:08:37.838 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.332569014, 2023-10-14T09:08:37.838 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000251946 2023-10-14T09:08:37.838 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.838 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:37.839 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.839 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.839 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.839 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.840 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 736160, 2023-10-14T09:08:37.840 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 171664 2023-10-14T09:08:37.840 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.840 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:37.841 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 4, 2023-10-14T09:08:37.841 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 218, 2023-10-14T09:08:37.841 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 876, 2023-10-14T09:08:37.842 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 537916, 2023-10-14T09:08:37.842 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:37.842 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:37.842 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.010955811, 2023-10-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.007367967, 2023-10-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.001670644, 2023-10-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000100222, 2023-10-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:37.843 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 216, 2023-10-14T09:08:37.844 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.086313943, 2023-10-14T09:08:37.844 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000399601 2023-10-14T09:08:37.844 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.844 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:37.845 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.845 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.845 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.845 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.845 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:37.846 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 537232 2023-10-14T09:08:37.846 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.846 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:37.846 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2247, 2023-10-14T09:08:37.846 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 2248, 2023-10-14T09:08:37.847 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4465072, 2023-10-14T09:08:37.847 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 698513, 2023-10-14T09:08:37.847 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2023-10-14T09:08:37.847 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:37.847 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.145040199, 2023-10-14T09:08:37.848 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.040678280, 2023-10-14T09:08:37.848 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.037317198, 2023-10-14T09:08:37.848 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.057957756, 2023-10-14T09:08:37.848 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:37.848 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2246, 2023-10-14T09:08:37.849 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.301045708, 2023-10-14T09:08:37.849 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000134036 2023-10-14T09:08:37.849 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.849 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:37.849 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.850 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.850 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.850 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.851 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-14T09:08:37.851 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2023-10-14T09:08:37.851 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.851 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2023-10-14T09:08:37.851 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2023-10-14T09:08:37.852 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2023-10-14T09:08:37.852 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.852 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2023-10-14T09:08:37.852 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:37.852 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:37.852 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5406, 2023-10-14T09:08:37.853 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.136485016, 2023-10-14T09:08:37.853 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000025246 2023-10-14T09:08:37.853 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.853 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.853 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:37.854 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:37.854 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:37.854 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.854 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.854 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.855 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.855 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.855 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2023-10-14T09:08:37.855 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2023-10-14T09:08:37.855 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2023-10-14T09:08:37.855 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2023-10-14T09:08:37.856 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.856 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.856 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.856 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.856 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2023-10-14T09:08:37.857 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2023-10-14T09:08:37.857 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:37.857 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:37.857 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2023-10-14T09:08:37.857 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2023-10-14T09:08:37.858 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2023-10-14T09:08:37.858 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 417, 2023-10-14T09:08:37.858 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 6, 2023-10-14T09:08:37.858 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 395, 2023-10-14T09:08:37.858 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 16, 2023-10-14T09:08:37.859 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 408, 2023-10-14T09:08:37.859 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2023-10-14T09:08:37.859 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2023-10-14T09:08:37.859 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2023-10-14T09:08:37.859 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 10, 2023-10-14T09:08:37.859 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2023-10-14T09:08:37.860 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2023-10-14T09:08:37.860 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2023-10-14T09:08:37.860 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2023-10-14T09:08:37.860 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:37.860 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:37.861 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2023-10-14T09:08:37.861 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2023-10-14T09:08:37.861 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2023-10-14T09:08:37.861 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2023-10-14T09:08:37.861 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2023-10-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2023-10-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2023-10-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:37.862 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 0, 2023-10-14T09:08:37.863 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 0, 2023-10-14T09:08:37.863 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2023-10-14T09:08:37.863 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:37.863 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:37.863 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:37.864 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:37.864 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:37.864 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:37.864 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:37.864 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:37.864 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:37.865 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2023-10-14T09:08:37.865 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2023-10-14T09:08:37.865 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:37.865 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:37.865 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:37.866 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2023-10-14T09:08:37.866 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2023-10-14T09:08:37.866 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2023-10-14T09:08:37.866 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2023-10-14T09:08:37.866 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.867 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2023-10-14T09:08:37.867 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2023-10-14T09:08:37.867 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2023-10-14T09:08:37.867 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2023-10-14T09:08:37.867 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2023-10-14T09:08:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2023-10-14T09:08:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2023-10-14T09:08:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2023-10-14T09:08:37.868 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2023-10-14T09:08:37.869 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:37.869 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2023-10-14T09:08:37.869 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:37.869 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:37.869 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:37.870 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2023-10-14T09:08:37.870 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2023-10-14T09:08:37.870 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:37.870 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2023-10-14T09:08:37.870 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2023-10-14T09:08:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2023-10-14T09:08:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2023-10-14T09:08:37.871 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2023-10-14T09:08:37.872 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2023-10-14T09:08:37.872 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2023-10-14T09:08:37.872 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2023-10-14T09:08:37.872 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 2365, 2023-10-14T09:08:37.872 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2023-10-14T09:08:37.873 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2023-10-14T09:08:37.873 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2023-10-14T09:08:37.873 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2023-10-14T09:08:37.873 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2023-10-14T09:08:37.873 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 4, 2023-10-14T09:08:37.873 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2023-10-14T09:08:37.874 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2023-10-14T09:08:37.874 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2023-10-14T09:08:37.874 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2023-10-14T09:08:37.874 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 8089080, 2023-10-14T09:08:37.874 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 8087929, 2023-10-14T09:08:37.875 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2023-10-14T09:08:37.875 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.875 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.875 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.875 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.876 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 2365 2023-10-14T09:08:37.876 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.876 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2023-10-14T09:08:37.876 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 130, 2023-10-14T09:08:37.876 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 600, 2023-10-14T09:08:37.876 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 470, 2023-10-14T09:08:37.877 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 24, 2023-10-14T09:08:37.877 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 52, 2023-10-14T09:08:37.877 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 28, 2023-10-14T09:08:37.877 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 417, 2023-10-14T09:08:37.877 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 642, 2023-10-14T09:08:37.878 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 225, 2023-10-14T09:08:37.878 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2023-10-14T09:08:37.878 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2023-10-14T09:08:37.878 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2023-10-14T09:08:37.878 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 50852, 2023-10-14T09:08:37.878 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 207152 2023-10-14T09:08:37.879 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.879 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2023-10-14T09:08:37.879 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2023-10-14T09:08:37.879 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:37.879 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2023-10-14T09:08:37.880 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2023-10-14T09:08:37.880 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2023-10-14T09:08:37.880 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2023-10-14T09:08:37.880 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.880 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2023-10-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.881 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.882 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.882 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.882 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:37.882 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.882 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.883 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.883 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.883 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2023-10-14T09:08:37.883 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.883 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.884 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.884 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.884 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2023-10-14T09:08:37.884 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.884 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.884 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.885 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.885 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:37.885 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.885 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.885 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.886 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.886 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2023-10-14T09:08:37.886 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.886 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.886 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.887 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.887 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2023-10-14T09:08:37.887 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.887 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.887 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.887 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.888 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:37.888 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.888 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.888 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.889 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.889 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:37.889 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.889 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.889 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.890 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.890 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2023-10-14T09:08:37.890 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.890 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.890 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.891 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.891 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2023-10-14T09:08:37.891 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.891 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.891 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.892 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.892 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2023-10-14T09:08:37.892 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.892 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.892 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.892 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.893 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2023-10-14T09:08:37.893 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.893 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.893 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.893 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.894 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2023-10-14T09:08:37.894 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.894 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.894 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.894 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.895 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2023-10-14T09:08:37.895 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.895 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.895 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.895 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.895 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2023-10-14T09:08:37.896 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.896 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.896 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.896 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.896 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:37.897 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.897 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.897 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.897 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.897 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:37.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.898 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.898 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.898 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2023-10-14T09:08:37.898 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.899 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.899 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.899 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.899 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:37.899 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.900 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.900 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.900 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.900 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:37.900 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.901 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.901 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.901 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.901 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2023-10-14T09:08:37.901 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.901 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.902 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.902 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.902 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:37.902 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.902 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.903 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.903 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.903 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:37.903 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.903 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.904 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.904 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.904 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2023-10-14T09:08:37.904 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.904 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.905 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.905 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.905 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2023-10-14T09:08:37.905 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.905 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.906 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.906 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.906 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2023-10-14T09:08:37.906 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.906 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.907 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.907 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.907 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2023-10-14T09:08:37.907 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.907 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.907 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.908 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.908 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:37.908 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:37.908 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:37.908 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.909 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.909 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.909 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.909 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.909 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2023-10-14T09:08:37.909 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2023-10-14T09:08:37.910 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 1, 2023-10-14T09:08:37.910 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 0, 2023-10-14T09:08:37.910 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2023-10-14T09:08:37.910 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2023-10-14T09:08:37.910 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2023-10-14T09:08:37.911 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2023-10-14T09:08:37.911 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 2320, 2023-10-14T09:08:37.911 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:37.911 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.911 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2023-10-14T09:08:37.911 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:37.912 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:37.913 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:37.914 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:37.915 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:37.916 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:37.916 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:37.916 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:37.916 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:37.916 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:37.916 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:37.917 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:37.917 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:37.917 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:37.917 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2023-10-14T09:08:37.918 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:37.918 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:37.918 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:37.918 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:37.918 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 187693, 2023-10-14T09:08:37.919 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 172, 2023-10-14T09:08:37.919 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:37.919 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:37.919 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2023-10-14T09:08:37.919 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2023-10-14T09:08:37.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:37.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:37.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:37.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:37.920 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:37.921 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 160, 2023-10-14T09:08:37.921 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:37.921 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:37.921 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:37.921 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2023-10-14T09:08:37.921 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 618010, 2023-10-14T09:08:37.922 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 4985, 2023-10-14T09:08:37.922 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:37.922 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2023-10-14T09:08:37.922 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:37.922 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2023-10-14T09:08:37.923 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.923 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2023-10-14T09:08:37.923 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2023-10-14T09:08:37.923 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2023-10-14T09:08:37.923 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 3276, 2023-10-14T09:08:37.924 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 21, 2023-10-14T09:08:37.924 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 3, 2023-10-14T09:08:37.924 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 3276, 2023-10-14T09:08:37.924 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2023-10-14T09:08:37.924 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3276, 2023-10-14T09:08:37.925 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 12.237005486, 2023-10-14T09:08:37.925 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003735349 2023-10-14T09:08:37.925 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.925 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2023-10-14T09:08:37.925 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2023-10-14T09:08:37.926 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3276, 2023-10-14T09:08:37.926 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 3277 2023-10-14T09:08:37.926 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.926 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 3276, 2023-10-14T09:08:37.926 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 3276, 2023-10-14T09:08:37.926 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2023-10-14T09:08:37.927 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2023-10-14T09:08:37.927 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2023-10-14T09:08:37.927 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 1966, 2023-10-14T09:08:37.927 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2023-10-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1308, 2023-10-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2023-10-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2023-10-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2023-10-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2023-10-14T09:08:37.928 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2023-10-14T09:08:37.929 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2023-10-14T09:08:37.929 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2023-10-14T09:08:37.929 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2023-10-14T09:08:37.929 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:37.929 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:37.930 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1, 2023-10-14T09:08:37.930 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2023-10-14T09:08:37.930 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:37.930 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:37.930 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:37.931 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2023-10-14T09:08:37.931 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2023-10-14T09:08:37.931 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2023-10-14T09:08:37.931 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:37.931 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2023-10-14T09:08:37.932 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:37.932 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2023-10-14T09:08:37.932 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2023-10-14T09:08:37.932 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2023-10-14T09:08:37.932 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2023-10-14T09:08:37.932 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2023-10-14T09:08:37.933 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2023-10-14T09:08:37.933 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2023-10-14T09:08:37.933 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2023-10-14T09:08:37.933 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2023-10-14T09:08:37.933 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2023-10-14T09:08:37.934 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2023-10-14T09:08:37.934 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2023-10-14T09:08:37.934 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2023-10-14T09:08:37.934 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2023-10-14T09:08:37.934 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2023-10-14T09:08:37.935 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2023-10-14T09:08:37.935 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2023-10-14T09:08:37.935 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 84, 2023-10-14T09:08:37.935 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2023-10-14T09:08:37.935 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2023-10-14T09:08:37.935 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 4, 2023-10-14T09:08:37.936 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 5, 2023-10-14T09:08:37.936 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 1, 2023-10-14T09:08:37.936 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2023-10-14T09:08:37.936 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2023-10-14T09:08:37.936 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2023-10-14T09:08:37.937 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2023-10-14T09:08:37.937 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.937 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2023-10-14T09:08:37.937 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2023-10-14T09:08:37.937 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:37.938 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2023-10-14T09:08:37.938 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2023-10-14T09:08:37.938 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.938 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2023-10-14T09:08:37.938 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2023-10-14T09:08:37.938 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.939 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2023-10-14T09:08:37.939 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:37.939 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:37.939 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2023-10-14T09:08:37.939 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:37.940 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2023-10-14T09:08:37.940 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:37.940 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.940 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:37.940 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:37.941 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:37.941 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:37.941 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3610, 2023-10-14T09:08:37.941 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 5202724, 2023-10-14T09:08:37.941 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:37.942 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3610, 2023-10-14T09:08:37.942 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:37.942 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:37.942 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3610, 2023-10-14T09:08:37.942 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 5202724, 2023-10-14T09:08:37.942 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:37.943 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.943 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.943 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.943 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.943 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.944 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:37.944 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:37.944 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:37.944 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:37.944 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:37.945 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:37.945 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:37.945 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:37.945 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3276, 2023-10-14T09:08:37.945 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3894781, 2023-10-14T09:08:37.945 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3276, 2023-10-14T09:08:37.946 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3894781, 2023-10-14T09:08:37.946 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:37.946 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.946 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.946 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.947 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.947 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.947 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:37.947 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:37.947 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2023-10-14T09:08:37.948 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:37.948 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:37.948 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:37.948 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:37.948 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:37.948 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3276, 2023-10-14T09:08:37.949 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3276, 2023-10-14T09:08:37.949 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3276, 2023-10-14T09:08:37.949 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3276, 2023-10-14T09:08:37.949 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:37.949 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.950 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.950 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.950 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.950 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.950 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:37.951 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:37.951 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:37.951 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:37.951 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:37.951 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:37.952 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:37.952 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:37.952 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:37.952 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:37.952 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2023-10-14T09:08:37.953 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2023-10-14T09:08:37.953 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:37.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.953 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.953 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.954 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:37.954 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5652f067e960": { 2023-10-14T09:08:37.954 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:37.954 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:37.954 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:37.955 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:37.955 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:37.955 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:37.955 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:37.955 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:37.956 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:37.956 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2023-10-14T09:08:37.956 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2023-10-14T09:08:37.956 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:37.956 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:37.957 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:37.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:37.957 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.957 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:37.957 INFO:teuthology.orchestra.run.smithi178.stdout:} 2023-10-14T09:08:38.268 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:38 smithi178 ceph-mon[103612]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 18 op/s 2023-10-14T09:08:38.269 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-10-14T09:08:38.270 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-10-14T09:08:38.270 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-10-14T09:08:38.270 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-10-14T09:08:38.271 DEBUG:tasks.check_counter:Getting stats from i 2023-10-14T09:08:38.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-14T09:08:38.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:38 smithi057 ceph-mon[103313]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 18 op/s 2023-10-14T09:08:38.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:38 smithi006 ceph-mon[99452]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 18 op/s 2023-10-14T09:08:38.827 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T09:08:40.174 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2023-10-14T09:08:40.174 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:40.175 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 10171, 2023-10-14T09:08:40.175 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 12304, 2023-10-14T09:08:40.175 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 3464996, 2023-10-14T09:08:40.175 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 12763389, 2023-10-14T09:08:40.176 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 10, 2023-10-14T09:08:40.176 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:40.176 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.611739961, 2023-10-14T09:08:40.176 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.208085751, 2023-10-14T09:08:40.177 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.314051912, 2023-10-14T09:08:40.177 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.112964022, 2023-10-14T09:08:40.177 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:40.177 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 12305, 2023-10-14T09:08:40.177 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 4.045464502, 2023-10-14T09:08:40.178 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000328765 2023-10-14T09:08:40.178 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.178 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:40.178 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 14371, 2023-10-14T09:08:40.178 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.002354803, 2023-10-14T09:08:40.179 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000163 2023-10-14T09:08:40.179 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.179 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-14T09:08:40.179 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2023-10-14T09:08:40.179 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.180 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:40.180 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 15190, 2023-10-14T09:08:40.180 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 19446, 2023-10-14T09:08:40.180 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 5661406, 2023-10-14T09:08:40.181 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 16243721, 2023-10-14T09:08:40.181 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 14, 2023-10-14T09:08:40.182 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 8, 2023-10-14T09:08:40.182 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.969157627, 2023-10-14T09:08:40.182 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.386198236, 2023-10-14T09:08:40.182 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.928640517, 2023-10-14T09:08:40.183 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.133146586, 2023-10-14T09:08:40.183 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:40.183 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 19443, 2023-10-14T09:08:40.183 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 4.013962730, 2023-10-14T09:08:40.184 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000206447 2023-10-14T09:08:40.184 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.184 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:40.184 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 24425, 2023-10-14T09:08:40.184 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.003717761, 2023-10-14T09:08:40.185 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000152 2023-10-14T09:08:40.185 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.185 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 4718560, 2023-10-14T09:08:40.186 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 9514464 2023-10-14T09:08:40.186 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.186 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:40.186 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 6937, 2023-10-14T09:08:40.186 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 10321, 2023-10-14T09:08:40.187 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 2314479, 2023-10-14T09:08:40.187 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 10049146, 2023-10-14T09:08:40.187 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 163, 2023-10-14T09:08:40.187 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 9, 2023-10-14T09:08:40.187 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.513815726, 2023-10-14T09:08:40.187 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.164559633, 2023-10-14T09:08:40.188 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.275666347, 2023-10-14T09:08:40.188 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.088371635, 2023-10-14T09:08:40.188 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:40.188 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 10319, 2023-10-14T09:08:40.188 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 2.655298748, 2023-10-14T09:08:40.189 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000257321 2023-10-14T09:08:40.189 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.189 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:40.189 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 11705, 2023-10-14T09:08:40.189 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.002154940, 2023-10-14T09:08:40.190 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000184 2023-10-14T09:08:40.190 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.190 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-14T09:08:40.190 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 456192 2023-10-14T09:08:40.190 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.191 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2023-10-14T09:08:40.191 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2023-10-14T09:08:40.191 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2023-10-14T09:08:40.191 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.191 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2023-10-14T09:08:40.192 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:40.192 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:40.192 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 8342, 2023-10-14T09:08:40.192 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 4.709174346, 2023-10-14T09:08:40.192 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000564513 2023-10-14T09:08:40.193 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.193 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.193 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:40.193 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:40.193 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:40.193 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 127, 2023-10-14T09:08:40.194 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.004579523, 2023-10-14T09:08:40.194 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000036059 2023-10-14T09:08:40.194 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.194 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.195 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2023-10-14T09:08:40.195 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 7382, 2023-10-14T09:08:40.195 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 7187, 2023-10-14T09:08:40.195 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2023-10-14T09:08:40.196 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 7187, 2023-10-14T09:08:40.196 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 75.328274528, 2023-10-14T09:08:40.196 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.010481184 2023-10-14T09:08:40.196 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.197 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2023-10-14T09:08:40.197 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 195, 2023-10-14T09:08:40.197 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 2, 2023-10-14T09:08:40.197 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:40.197 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 683, 2023-10-14T09:08:40.198 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 3, 2023-10-14T09:08:40.198 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2023-10-14T09:08:40.198 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 243, 2023-10-14T09:08:40.198 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 3, 2023-10-14T09:08:40.198 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 229, 2023-10-14T09:08:40.199 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 11, 2023-10-14T09:08:40.199 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 239, 2023-10-14T09:08:40.199 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 1883, 2023-10-14T09:08:40.199 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 213, 2023-10-14T09:08:40.199 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 213, 2023-10-14T09:08:40.200 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 16, 2023-10-14T09:08:40.200 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 23994, 2023-10-14T09:08:40.200 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 18181, 2023-10-14T09:08:40.200 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 192, 2023-10-14T09:08:40.201 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 17, 2023-10-14T09:08:40.201 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:40.201 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:40.201 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 2639, 2023-10-14T09:08:40.201 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 1530, 2023-10-14T09:08:40.202 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2023-10-14T09:08:40.202 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 55, 2023-10-14T09:08:40.202 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 1833, 2023-10-14T09:08:40.202 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 25, 2023-10-14T09:08:40.202 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 188, 2023-10-14T09:08:40.203 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:40.203 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 958, 2023-10-14T09:08:40.203 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:40.203 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 1038, 2023-10-14T09:08:40.203 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 1728944612, 2023-10-14T09:08:40.204 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2023-10-14T09:08:40.204 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 958, 2023-10-14T09:08:40.204 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:40.204 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:40.205 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:40.205 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 39, 2023-10-14T09:08:40.205 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 2, 2023-10-14T09:08:40.205 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 37, 2023-10-14T09:08:40.205 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 919, 2023-10-14T09:08:40.206 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 7, 2023-10-14T09:08:40.206 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 1929, 2023-10-14T09:08:40.208 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 3499, 2023-10-14T09:08:40.208 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:40.209 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:40.209 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:40.209 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 3878, 2023-10-14T09:08:40.209 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 1601, 2023-10-14T09:08:40.210 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 52, 2023-10-14T09:08:40.210 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 1506 2023-10-14T09:08:40.210 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.211 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2023-10-14T09:08:40.212 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 154, 2023-10-14T09:08:40.212 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 182, 2023-10-14T09:08:40.213 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 92, 2023-10-14T09:08:40.213 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 180, 2023-10-14T09:08:40.214 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 838, 2023-10-14T09:08:40.214 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2023-10-14T09:08:40.214 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:40.215 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:40.215 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 472, 2023-10-14T09:08:40.217 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 34, 2023-10-14T09:08:40.218 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 1748, 2023-10-14T09:08:40.218 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2023-10-14T09:08:40.218 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:40.219 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:40.219 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:40.219 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2023-10-14T09:08:40.220 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2023-10-14T09:08:40.220 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 2, 2023-10-14T09:08:40.220 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 55, 2023-10-14T09:08:40.221 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2023-10-14T09:08:40.221 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 3, 2023-10-14T09:08:40.221 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:40.222 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2023-10-14T09:08:40.222 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.222 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2023-10-14T09:08:40.223 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2023-10-14T09:08:40.223 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 5867, 2023-10-14T09:08:40.223 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 5813, 2023-10-14T09:08:40.224 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 5813, 2023-10-14T09:08:40.224 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 54, 2023-10-14T09:08:40.224 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2023-10-14T09:08:40.225 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 10, 2023-10-14T09:08:40.225 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 75, 2023-10-14T09:08:40.226 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 74, 2023-10-14T09:08:40.226 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 74, 2023-10-14T09:08:40.226 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 1, 2023-10-14T09:08:40.227 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 1, 2023-10-14T09:08:40.227 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2023-10-14T09:08:40.227 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 1, 2023-10-14T09:08:40.227 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 20454589, 2023-10-14T09:08:40.227 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 20718350, 2023-10-14T09:08:40.228 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2023-10-14T09:08:40.228 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2023-10-14T09:08:40.228 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3790, 2023-10-14T09:08:40.228 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 95.474824203, 2023-10-14T09:08:40.228 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.025191246 2023-10-14T09:08:40.229 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.229 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2023-10-14T09:08:40.229 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.229 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2023-10-14T09:08:40.229 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 237, 2023-10-14T09:08:40.230 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 1311, 2023-10-14T09:08:40.230 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 1074, 2023-10-14T09:08:40.230 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 55, 2023-10-14T09:08:40.230 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 166, 2023-10-14T09:08:40.231 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 111, 2023-10-14T09:08:40.231 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 243, 2023-10-14T09:08:40.231 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 3283, 2023-10-14T09:08:40.231 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 3040, 2023-10-14T09:08:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 213, 2023-10-14T09:08:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 1351, 2023-10-14T09:08:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 1138, 2023-10-14T09:08:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 68508, 2023-10-14T09:08:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 207152 2023-10-14T09:08:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.233 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2023-10-14T09:08:40.233 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 14396, 2023-10-14T09:08:40.233 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 133, 2023-10-14T09:08:40.233 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 7382, 2023-10-14T09:08:40.233 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 1069, 2023-10-14T09:08:40.234 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 250, 2023-10-14T09:08:40.234 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2023-10-14T09:08:40.234 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1075, 2023-10-14T09:08:40.234 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 50.122420272, 2023-10-14T09:08:40.234 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.046625507 2023-10-14T09:08:40.235 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.235 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2023-10-14T09:08:40.235 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 38, 2023-10-14T09:08:40.236 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.092995620, 2023-10-14T09:08:40.236 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002447253 2023-10-14T09:08:40.236 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.236 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:40.236 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.236 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.237 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.237 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.237 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2023-10-14T09:08:40.237 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 438, 2023-10-14T09:08:40.237 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.190834319, 2023-10-14T09:08:40.238 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002718799 2023-10-14T09:08:40.238 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.238 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2023-10-14T09:08:40.238 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2740, 2023-10-14T09:08:40.238 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 4.794794327, 2023-10-14T09:08:40.239 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001749924 2023-10-14T09:08:40.239 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.239 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:40.239 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.239 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.240 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.240 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.240 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2023-10-14T09:08:40.240 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1, 2023-10-14T09:08:40.241 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000217461, 2023-10-14T09:08:40.241 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000217461 2023-10-14T09:08:40.241 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.241 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2023-10-14T09:08:40.242 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.242 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.242 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.242 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.242 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:40.243 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.243 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.243 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.244 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.244 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:40.245 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.245 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.245 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.246 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.246 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2023-10-14T09:08:40.247 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.247 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.247 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.248 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.249 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2023-10-14T09:08:40.249 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 35, 2023-10-14T09:08:40.249 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.061902141, 2023-10-14T09:08:40.250 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001768632 2023-10-14T09:08:40.250 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.250 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2023-10-14T09:08:40.251 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.251 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.251 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.251 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.251 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2023-10-14T09:08:40.252 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.252 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.252 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.252 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.252 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2023-10-14T09:08:40.253 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 560, 2023-10-14T09:08:40.253 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.397096804, 2023-10-14T09:08:40.253 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000709101 2023-10-14T09:08:40.253 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.253 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2023-10-14T09:08:40.254 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 59, 2023-10-14T09:08:40.254 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.163664177, 2023-10-14T09:08:40.254 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002773969 2023-10-14T09:08:40.254 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.254 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2023-10-14T09:08:40.255 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1775, 2023-10-14T09:08:40.255 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 17.623568176, 2023-10-14T09:08:40.255 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.009928770 2023-10-14T09:08:40.255 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.255 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:40.255 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.256 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.256 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.256 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.256 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:40.256 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2023-10-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.257 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.258 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.258 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.258 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:40.258 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.258 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.259 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.259 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.259 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:40.259 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.259 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.260 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.260 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.260 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2023-10-14T09:08:40.260 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1, 2023-10-14T09:08:40.260 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001032756, 2023-10-14T09:08:40.260 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001032756 2023-10-14T09:08:40.261 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.261 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:40.261 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.261 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.261 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.262 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.262 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:40.262 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.262 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.262 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.263 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.263 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2023-10-14T09:08:40.263 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.263 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.263 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.263 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.264 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2023-10-14T09:08:40.264 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6, 2023-10-14T09:08:40.264 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.018128727, 2023-10-14T09:08:40.264 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003021454 2023-10-14T09:08:40.264 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.265 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2023-10-14T09:08:40.265 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.265 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.265 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.265 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.265 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2023-10-14T09:08:40.266 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 459, 2023-10-14T09:08:40.266 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.861619748, 2023-10-14T09:08:40.266 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001877167 2023-10-14T09:08:40.266 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.267 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:40.267 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:40.267 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:40.267 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.267 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2023-10-14T09:08:40.268 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2023-10-14T09:08:40.269 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2023-10-14T09:08:40.269 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2023-10-14T09:08:40.269 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2023-10-14T09:08:40.269 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2023-10-14T09:08:40.269 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 30, 2023-10-14T09:08:40.269 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 30, 2023-10-14T09:08:40.270 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 959, 2023-10-14T09:08:40.270 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:40.270 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.270 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2023-10-14T09:08:40.270 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 240, 2023-10-14T09:08:40.271 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 240, 2023-10-14T09:08:40.271 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:40.271 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:40.271 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:40.271 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:40.271 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:40.272 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:40.272 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:40.272 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:40.272 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:40.272 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:40.273 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:40.273 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:40.273 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:40.273 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:40.273 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:40.273 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:40.274 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:40.274 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:40.274 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:40.275 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:40.275 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:40.275 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:40.275 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:40.275 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:40.275 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:40.276 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:40.276 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:40.276 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:40.276 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:40.276 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2023-10-14T09:08:40.277 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:40.277 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:40.277 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:40.277 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:40.277 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 311876, 2023-10-14T09:08:40.277 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 330, 2023-10-14T09:08:40.278 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 264, 2023-10-14T09:08:40.278 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 3, 2023-10-14T09:08:40.278 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2023-10-14T09:08:40.278 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2023-10-14T09:08:40.278 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:40.279 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:40.279 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:40.279 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:40.279 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:40.279 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 160, 2023-10-14T09:08:40.279 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:40.280 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:40.280 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:40.280 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2023-10-14T09:08:40.280 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 868843, 2023-10-14T09:08:40.280 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 9033, 2023-10-14T09:08:40.281 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:40.281 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2023-10-14T09:08:40.281 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:40.281 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2023-10-14T09:08:40.281 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2023-10-14T09:08:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2023-10-14T09:08:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2023-10-14T09:08:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 8012, 2023-10-14T09:08:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 19552037, 2023-10-14T09:08:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 37, 2023-10-14T09:08:40.283 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 8012, 2023-10-14T09:08:40.283 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2023-10-14T09:08:40.283 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 8012, 2023-10-14T09:08:40.283 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 216.242905702, 2023-10-14T09:08:40.283 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.026989878 2023-10-14T09:08:40.284 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.284 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2023-10-14T09:08:40.284 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2023-10-14T09:08:40.284 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 8012, 2023-10-14T09:08:40.284 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 12495 2023-10-14T09:08:40.285 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.285 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 8012, 2023-10-14T09:08:40.285 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 975, 2023-10-14T09:08:40.285 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 7037, 2023-10-14T09:08:40.285 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2023-10-14T09:08:40.286 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2023-10-14T09:08:40.286 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 612, 2023-10-14T09:08:40.286 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 1508, 2023-10-14T09:08:40.286 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 13, 2023-10-14T09:08:40.286 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 3801, 2023-10-14T09:08:40.286 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 255, 2023-10-14T09:08:40.287 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2023-10-14T09:08:40.287 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2023-10-14T09:08:40.287 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2023-10-14T09:08:40.287 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 3, 2023-10-14T09:08:40.287 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 567, 2023-10-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2023-10-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 962, 2023-10-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 3016, 2023-10-14T09:08:40.288 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:40.289 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:40.289 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:40.289 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2023-10-14T09:08:40.289 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2023-10-14T09:08:40.289 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2023-10-14T09:08:40.290 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:40.290 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2023-10-14T09:08:40.290 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:40.290 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2023-10-14T09:08:40.290 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2023-10-14T09:08:40.291 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2023-10-14T09:08:40.291 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2023-10-14T09:08:40.291 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2023-10-14T09:08:40.291 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2023-10-14T09:08:40.291 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2023-10-14T09:08:40.291 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2023-10-14T09:08:40.292 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2023-10-14T09:08:40.292 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2023-10-14T09:08:40.292 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2023-10-14T09:08:40.292 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2023-10-14T09:08:40.292 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2023-10-14T09:08:40.293 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2023-10-14T09:08:40.293 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2023-10-14T09:08:40.293 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2023-10-14T09:08:40.293 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2023-10-14T09:08:40.293 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 84, 2023-10-14T09:08:40.294 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2023-10-14T09:08:40.294 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 3, 2023-10-14T09:08:40.294 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 12, 2023-10-14T09:08:40.294 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 12, 2023-10-14T09:08:40.294 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2023-10-14T09:08:40.294 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2023-10-14T09:08:40.295 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 1582, 2023-10-14T09:08:40.295 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 4, 2023-10-14T09:08:40.295 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 172 2023-10-14T09:08:40.295 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.295 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2023-10-14T09:08:40.296 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2023-10-14T09:08:40.296 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:40.296 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2023-10-14T09:08:40.296 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2023-10-14T09:08:40.296 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.296 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2023-10-14T09:08:40.297 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2023-10-14T09:08:40.297 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.297 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2023-10-14T09:08:40.297 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:40.297 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 19, 2023-10-14T09:08:40.298 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2023-10-14T09:08:40.298 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 6, 2023-10-14T09:08:40.298 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 34, 2023-10-14T09:08:40.298 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:40.298 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.299 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:40.299 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:40.299 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:40.299 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:40.299 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 32294, 2023-10-14T09:08:40.299 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 7977372, 2023-10-14T09:08:40.300 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:40.300 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 32294, 2023-10-14T09:08:40.300 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:40.300 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:40.300 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 32294, 2023-10-14T09:08:40.301 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 7977372, 2023-10-14T09:08:40.301 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:40.301 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.301 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.301 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.301 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.302 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.302 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:40.302 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:40.302 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:40.302 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:40.303 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:40.303 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:40.303 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:40.303 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:40.304 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 8012, 2023-10-14T09:08:40.304 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 19555439, 2023-10-14T09:08:40.304 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 8012, 2023-10-14T09:08:40.304 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 19555439, 2023-10-14T09:08:40.304 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:40.305 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.305 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.305 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.305 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.305 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.306 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:40.306 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:40.306 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2023-10-14T09:08:40.306 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:40.306 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:40.307 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:40.307 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:40.307 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:40.307 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 8012, 2023-10-14T09:08:40.307 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 8012, 2023-10-14T09:08:40.307 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 8012, 2023-10-14T09:08:40.308 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 8012, 2023-10-14T09:08:40.308 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:40.308 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.308 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.308 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.309 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.309 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.309 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:40.309 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:40.309 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:40.309 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:40.310 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 34, 2023-10-14T09:08:40.310 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 3434, 2023-10-14T09:08:40.310 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:40.310 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 34, 2023-10-14T09:08:40.310 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:40.311 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:40.311 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 11, 2023-10-14T09:08:40.311 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3434, 2023-10-14T09:08:40.311 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:40.311 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.311 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.312 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.312 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.312 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:40.312 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x563b73ff6640": { 2023-10-14T09:08:40.312 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:40.313 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:40.313 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:40.313 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 5867, 2023-10-14T09:08:40.313 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 16524046, 2023-10-14T09:08:40.313 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:40.313 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 5867, 2023-10-14T09:08:40.314 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:40.314 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:40.314 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3790, 2023-10-14T09:08:40.314 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 16524046, 2023-10-14T09:08:40.315 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:40.315 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:40.315 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:40.315 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:40.315 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.315 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:40.316 INFO:teuthology.orchestra.run.smithi178.stdout:} 2023-10-14T09:08:40.316 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:40 smithi178 ceph-mon[103612]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 17 op/s 2023-10-14T09:08:40.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:40 smithi057 ceph-mon[103313]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 17 op/s 2023-10-14T09:08:40.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:40 smithi006 ceph-mon[99452]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 17 op/s 2023-10-14T09:08:40.583 INFO:tasks.check_counter:Daemon mds.i mds.exported=55 2023-10-14T09:08:40.583 INFO:tasks.check_counter:Daemon mds.i mds.imported=25 2023-10-14T09:08:40.584 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=154 2023-10-14T09:08:40.584 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=182 2023-10-14T09:08:40.584 DEBUG:tasks.check_counter:Getting stats from l 2023-10-14T09:08:40.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 shell --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-14T09:08:41.144 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/mon.c/config 2023-10-14T09:08:42.347 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2023-10-14T09:08:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2023-10-14T09:08:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 329, 2023-10-14T09:08:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 295, 2023-10-14T09:08:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 707346, 2023-10-14T09:08:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 174029, 2023-10-14T09:08:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2023-10-14T09:08:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 1, 2023-10-14T09:08:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.041943801, 2023-10-14T09:08:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.014332397, 2023-10-14T09:08:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.018964545, 2023-10-14T09:08:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.007662716, 2023-10-14T09:08:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:42.351 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 294, 2023-10-14T09:08:42.351 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.068104594, 2023-10-14T09:08:42.351 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000231648 2023-10-14T09:08:42.351 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.351 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:42.352 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.352 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.352 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.352 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.353 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 706512, 2023-10-14T09:08:42.353 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 173712 2023-10-14T09:08:42.353 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.353 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2023-10-14T09:08:42.354 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 954, 2023-10-14T09:08:42.354 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1172, 2023-10-14T09:08:42.354 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 234534, 2023-10-14T09:08:42.354 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 835597, 2023-10-14T09:08:42.355 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2023-10-14T09:08:42.355 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2023-10-14T09:08:42.355 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.088706480, 2023-10-14T09:08:42.355 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.025064599, 2023-10-14T09:08:42.356 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.019199348, 2023-10-14T09:08:42.356 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.036109456, 2023-10-14T09:08:42.356 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:42.357 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1170, 2023-10-14T09:08:42.357 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.300697127, 2023-10-14T09:08:42.357 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000257006 2023-10-14T09:08:42.357 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.358 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:42.358 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.358 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.358 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.359 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.359 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-14T09:08:42.359 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 539520 2023-10-14T09:08:42.359 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.359 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2023-10-14T09:08:42.360 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2231, 2023-10-14T09:08:42.360 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 2231, 2023-10-14T09:08:42.360 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 3825877, 2023-10-14T09:08:42.360 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 693103, 2023-10-14T09:08:42.360 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 4, 2023-10-14T09:08:42.361 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2023-10-14T09:08:42.361 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.182496382, 2023-10-14T09:08:42.361 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.047836614, 2023-10-14T09:08:42.361 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.050447511, 2023-10-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.068448073, 2023-10-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2023-10-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2230, 2023-10-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.404287811, 2023-10-14T09:08:42.362 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000181294 2023-10-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2023-10-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.363 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2023-10-14T09:08:42.364 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2023-10-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2023-10-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2023-10-14T09:08:42.365 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2023-10-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5319, 2023-10-14T09:08:42.366 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.137840015, 2023-10-14T09:08:42.367 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000025914 2023-10-14T09:08:42.367 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.367 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.367 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2023-10-14T09:08:42.367 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2023-10-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2023-10-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.368 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2023-10-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2023-10-14T09:08:42.369 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2023-10-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2023-10-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.370 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2023-10-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2023-10-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2023-10-14T09:08:42.371 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2023-10-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2023-10-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2023-10-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2023-10-14T09:08:42.372 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 402, 2023-10-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 2, 2023-10-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 292, 2023-10-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 108, 2023-10-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 398, 2023-10-14T09:08:42.373 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 1, 2023-10-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2023-10-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2023-10-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 15, 2023-10-14T09:08:42.374 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2023-10-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2023-10-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2023-10-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2023-10-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2023-10-14T09:08:42.375 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2023-10-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2023-10-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2023-10-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2023-10-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2023-10-14T09:08:42.376 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2023-10-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2023-10-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2023-10-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2023-10-14T09:08:42.377 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2023-10-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2023-10-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 0, 2023-10-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 0, 2023-10-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2023-10-14T09:08:42.378 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2023-10-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2023-10-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2023-10-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2023-10-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2023-10-14T09:08:42.379 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2023-10-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2023-10-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2023-10-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2023-10-14T09:08:42.380 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2023-10-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2023-10-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2023-10-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-14T09:08:42.381 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2023-10-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2023-10-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2023-10-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2023-10-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.382 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2023-10-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2023-10-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2023-10-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2023-10-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2023-10-14T09:08:42.383 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2023-10-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2023-10-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2023-10-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2023-10-14T09:08:42.384 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2023-10-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2023-10-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2023-10-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2023-10-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2023-10-14T09:08:42.385 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2023-10-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2023-10-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2023-10-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2023-10-14T09:08:42.386 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2023-10-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2023-10-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2023-10-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2023-10-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2023-10-14T09:08:42.387 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2023-10-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2023-10-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2023-10-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2023-10-14T09:08:42.388 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2023-10-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2023-10-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 1083, 2023-10-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2023-10-14T09:08:42.389 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2023-10-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2023-10-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2023-10-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2023-10-14T09:08:42.390 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 3, 2023-10-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2023-10-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2023-10-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2023-10-14T09:08:42.391 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2023-10-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 7361128, 2023-10-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 7358511, 2023-10-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2023-10-14T09:08:42.392 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 1083 2023-10-14T09:08:42.393 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2023-10-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 403, 2023-10-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 870, 2023-10-14T09:08:42.394 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 467, 2023-10-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 34, 2023-10-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 34, 2023-10-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 0, 2023-10-14T09:08:42.395 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 402, 2023-10-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 878, 2023-10-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 476, 2023-10-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2023-10-14T09:08:42.396 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2023-10-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2023-10-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 49136, 2023-10-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 207152 2023-10-14T09:08:42.397 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2023-10-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2023-10-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2023-10-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2023-10-14T09:08:42.398 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2023-10-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2023-10-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2023-10-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.399 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2023-10-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.400 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2023-10-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.401 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2023-10-14T09:08:42.402 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2023-10-14T09:08:42.403 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2023-10-14T09:08:42.404 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2023-10-14T09:08:42.405 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.406 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2023-10-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.407 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2023-10-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.408 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2023-10-14T09:08:42.409 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.410 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2023-10-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.411 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2023-10-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.412 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2023-10-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.413 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2023-10-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.414 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2023-10-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.415 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2023-10-14T09:08:42.416 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.417 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2023-10-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.418 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2023-10-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.419 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2023-10-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.420 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2023-10-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.421 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2023-10-14T09:08:42.422 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.423 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2023-10-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.424 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2023-10-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.425 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2023-10-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.426 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2023-10-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.427 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2023-10-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.428 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2023-10-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.429 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2023-10-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.430 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2023-10-14T09:08:42.431 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2023-10-14T09:08:42.432 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2023-10-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2023-10-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.433 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2023-10-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2023-10-14T09:08:42.434 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2023-10-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2023-10-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2023-10-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2023-10-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2023-10-14T09:08:42.435 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2023-10-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 2329, 2023-10-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2023-10-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2023-10-14T09:08:42.436 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2023-10-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2023-10-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2023-10-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2023-10-14T09:08:42.437 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2023-10-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2023-10-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2023-10-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-14T09:08:42.438 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2023-10-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2023-10-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2023-10-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-14T09:08:42.439 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2023-10-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2023-10-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2023-10-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2023-10-14T09:08:42.440 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2023-10-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2023-10-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2023-10-14T09:08:42.441 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2023-10-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2023-10-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2023-10-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2023-10-14T09:08:42.442 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2023-10-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2023-10-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2023-10-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2023-10-14T09:08:42.443 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2023-10-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2023-10-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2023-10-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2023-10-14T09:08:42.444 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2023-10-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 204843, 2023-10-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 448, 2023-10-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2023-10-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2023-10-14T09:08:42.445 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2023-10-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2023-10-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2023-10-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2023-10-14T09:08:42.446 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2023-10-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2023-10-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 7624, 2023-10-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 160, 2023-10-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2023-10-14T09:08:42.447 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2023-10-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2023-10-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2023-10-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 1218017, 2023-10-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 10552, 2023-10-14T09:08:42.448 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2023-10-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2023-10-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2023-10-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2023-10-14T09:08:42.449 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2023-10-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2023-10-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2023-10-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 3180, 2023-10-14T09:08:42.450 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 21, 2023-10-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 3, 2023-10-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 3180, 2023-10-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2023-10-14T09:08:42.451 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3180, 2023-10-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 20.916009095, 2023-10-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.006577361 2023-10-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2023-10-14T09:08:42.452 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2023-10-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3180, 2023-10-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 3181 2023-10-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 3180, 2023-10-14T09:08:42.453 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 3180, 2023-10-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2023-10-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2023-10-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2023-10-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 1970, 2023-10-14T09:08:42.454 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2023-10-14T09:08:42.455 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1208, 2023-10-14T09:08:42.455 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2023-10-14T09:08:42.455 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2023-10-14T09:08:42.455 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2023-10-14T09:08:42.455 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2023-10-14T09:08:42.456 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2023-10-14T09:08:42.456 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2023-10-14T09:08:42.456 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2023-10-14T09:08:42.456 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2023-10-14T09:08:42.457 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2023-10-14T09:08:42.457 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2023-10-14T09:08:42.457 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1, 2023-10-14T09:08:42.457 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2023-10-14T09:08:42.458 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2023-10-14T09:08:42.458 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2023-10-14T09:08:42.458 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2023-10-14T09:08:42.458 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2023-10-14T09:08:42.458 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2023-10-14T09:08:42.459 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2023-10-14T09:08:42.459 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2023-10-14T09:08:42.459 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2023-10-14T09:08:42.459 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2023-10-14T09:08:42.459 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2023-10-14T09:08:42.460 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2023-10-14T09:08:42.460 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2023-10-14T09:08:42.460 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2023-10-14T09:08:42.460 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2023-10-14T09:08:42.461 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2023-10-14T09:08:42.461 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2023-10-14T09:08:42.461 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2023-10-14T09:08:42.461 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2023-10-14T09:08:42.461 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2023-10-14T09:08:42.462 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2023-10-14T09:08:42.462 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2023-10-14T09:08:42.462 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2023-10-14T09:08:42.462 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2023-10-14T09:08:42.463 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2023-10-14T09:08:42.463 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2023-10-14T09:08:42.463 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2023-10-14T09:08:42.463 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 84, 2023-10-14T09:08:42.463 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2023-10-14T09:08:42.464 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2023-10-14T09:08:42.464 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 5, 2023-10-14T09:08:42.464 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 6, 2023-10-14T09:08:42.464 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 1, 2023-10-14T09:08:42.465 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2023-10-14T09:08:42.465 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2023-10-14T09:08:42.465 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2023-10-14T09:08:42.465 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2023-10-14T09:08:42.465 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.466 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2023-10-14T09:08:42.466 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2023-10-14T09:08:42.466 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2023-10-14T09:08:42.467 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2023-10-14T09:08:42.467 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2023-10-14T09:08:42.467 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.467 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2023-10-14T09:08:42.468 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2023-10-14T09:08:42.468 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.468 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2023-10-14T09:08:42.469 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2023-10-14T09:08:42.469 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2023-10-14T09:08:42.469 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2023-10-14T09:08:42.469 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2023-10-14T09:08:42.470 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2023-10-14T09:08:42.470 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2023-10-14T09:08:42.470 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.470 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-14T09:08:42.471 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:42.471 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:42.471 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:42.471 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3510, 2023-10-14T09:08:42.473 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 4432112, 2023-10-14T09:08:42.473 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:42.473 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3510, 2023-10-14T09:08:42.473 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:42.474 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:42.474 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3510, 2023-10-14T09:08:42.474 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 4432112, 2023-10-14T09:08:42.474 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:42.475 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.475 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.475 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.475 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.476 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.476 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2023-10-14T09:08:42.476 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:42.476 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2023-10-14T09:08:42.476 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:42.477 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:42.477 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:42.477 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:42.477 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:42.478 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3180, 2023-10-14T09:08:42.478 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3166829, 2023-10-14T09:08:42.478 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3180, 2023-10-14T09:08:42.478 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3166829, 2023-10-14T09:08:42.479 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:42.479 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.479 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.480 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.480 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.480 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.480 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2023-10-14T09:08:42.480 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:42.481 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2023-10-14T09:08:42.481 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:42.481 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:42.481 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:42.482 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:42.482 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:42.482 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3180, 2023-10-14T09:08:42.483 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3180, 2023-10-14T09:08:42.483 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3180, 2023-10-14T09:08:42.483 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3180, 2023-10-14T09:08:42.483 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:42.484 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.484 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.484 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.484 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.485 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.485 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2023-10-14T09:08:42.485 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:42.485 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:42.485 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:42.486 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:42.486 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:42.486 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:42.486 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:42.487 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:42.487 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:42.487 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2023-10-14T09:08:42.487 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2023-10-14T09:08:42.488 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:42.488 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.488 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.488 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.488 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.489 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2023-10-14T09:08:42.489 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5587d00c0960": { 2023-10-14T09:08:42.489 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2023-10-14T09:08:42.489 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2023-10-14T09:08:42.489 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2023-10-14T09:08:42.490 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2023-10-14T09:08:42.490 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2023-10-14T09:08:42.490 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2023-10-14T09:08:42.490 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2023-10-14T09:08:42.491 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2023-10-14T09:08:42.491 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2023-10-14T09:08:42.491 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2023-10-14T09:08:42.491 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2023-10-14T09:08:42.491 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2023-10-14T09:08:42.492 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2023-10-14T09:08:42.492 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2023-10-14T09:08:42.492 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2023-10-14T09:08:42.493 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.493 INFO:teuthology.orchestra.run.smithi178.stdout: } 2023-10-14T09:08:42.493 INFO:teuthology.orchestra.run.smithi178.stdout:} 2023-10-14T09:08:42.706 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-14T09:08:42.706 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-14T09:08:42.706 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-10-14T09:08:42.706 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-10-14T09:08:42.707 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T09:08:42.718 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T09:08:42.718 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T09:08:42.719 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:08:42.742 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T09:08:42.742 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:08:42.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:08:42.873 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:42 smithi006 ceph-mon[99452]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 16 op/s 2023-10-14T09:08:42.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:42 smithi178 ceph-mon[103612]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 16 op/s 2023-10-14T09:08:42.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:42 smithi057 ceph-mon[103313]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 16 op/s 2023-10-14T09:08:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 -- 172.21.15.6:0/2562656272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 msgr2=0x7f1d5c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 --2- 172.21.15.6:0/2562656272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c101430 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1d500099c0 tx=0x7f1d50009cd0 comp rx=0 tx=0).stop 2023-10-14T09:08:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 -- 172.21.15.6:0/2562656272 shutdown_connections 2023-10-14T09:08:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 --2- 172.21.15.6:0/2562656272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5c101970 0x7f1d5c108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:42.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 --2- 172.21.15.6:0/2562656272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d5c0ffde0 0x7f1d5c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 --2- 172.21.15.6:0/2562656272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c101430 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 -- 172.21.15.6:0/2562656272 >> 172.21.15.6:0/2562656272 conn(0x7f1d5c0fb310 msgr2=0x7f1d5c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 -- 172.21.15.6:0/2562656272 shutdown_connections 2023-10-14T09:08:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.981+0000 7f1d61730700 1 -- 172.21.15.6:0/2562656272 wait complete. 2023-10-14T09:08:42.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 Processor -- start 2023-10-14T09:08:42.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 -- start start 2023-10-14T09:08:42.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d5c0ffde0 0x7f1d5c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5c101970 0x7f1d5c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19e6e0 con 0x7f1d5c100fd0 2023-10-14T09:08:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19e820 con 0x7f1d5c0ffde0 2023-10-14T09:08:42.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d61730700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19e9b0 con 0x7f1d5c101970 2023-10-14T09:08:42.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.982+0000 7f1d5a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:42.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36472/0 (socket says 172.21.15.6:36472) 2023-10-14T09:08:42.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 -- 172.21.15.6:0/306523503 learned_addr learned my addr 172.21.15.6:0/306523503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:42.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5b7fe700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5c101970 0x7f1d5c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:42.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5affd700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d5c0ffde0 0x7f1d5c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 -- 172.21.15.6:0/306523503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5c101970 msgr2=0x7f1d5c19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5c101970 0x7f1d5c19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 -- 172.21.15.6:0/306523503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d5c0ffde0 msgr2=0x7f1d5c196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d5c0ffde0 0x7f1d5c196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:42.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 -- 172.21.15.6:0/306523503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500095f0 con 0x7f1d5c100fd0 2023-10-14T09:08:42.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d5a7fc700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c1970a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1d500036f0 tx=0x7f1d50005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:42.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5001d070 con 0x7f1d5c100fd0 2023-10-14T09:08:42.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d50003f90 con 0x7f1d5c100fd0 2023-10-14T09:08:42.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c19ec30 con 0x7f1d5c100fd0 2023-10-14T09:08:42.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50022cb0 con 0x7f1d5c100fd0 2023-10-14T09:08:42.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.983+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5c19f0b0 con 0x7f1d5c100fd0 2023-10-14T09:08:42.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.984+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5c10b600 con 0x7f1d5c100fd0 2023-10-14T09:08:42.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.985+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f1d50022470 con 0x7f1d5c100fd0 2023-10-14T09:08:42.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.986+0000 7f1d43fff700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d440a1500 0x7f1d440a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.986+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f1d500ce800 con 0x7f1d5c100fd0 2023-10-14T09:08:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.986+0000 7f1d5affd700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d440a1500 0x7f1d440a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.987+0000 7f1d5affd700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d440a1500 0x7f1d440a39c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c100e30 tx=0x7f1d4c007a30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:42.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:42.990+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d50097ef0 con 0x7f1d5c100fd0 2023-10-14T09:08:43.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.197+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d5c19f240 con 0x7f1d5c100fd0 2023-10-14T09:08:43.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.198+0000 7f1d43fff700 1 -- 172.21.15.6:0/306523503 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7f1d50027090 con 0x7f1d5c100fd0 2023-10-14T09:08:43.200 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:43.201 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:08:43.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.200+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d440a1500 msgr2=0x7f1d440a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.200+0000 7f1d61730700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d440a1500 0x7f1d440a39c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c100e30 tx=0x7f1d4c007a30 comp rx=0 tx=0).stop 2023-10-14T09:08:43.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.200+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 msgr2=0x7f1d5c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c1970a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1d500036f0 tx=0x7f1d50005740 comp rx=0 tx=0).stop 2023-10-14T09:08:43.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 shutdown_connections 2023-10-14T09:08:43.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5c101970 0x7f1d5c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f1d440a1500 0x7f1d440a39c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d5c0ffde0 0x7f1d5c196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 --2- 172.21.15.6:0/306523503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d5c100fd0 0x7f1d5c1970a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 >> 172.21.15.6:0/306523503 conn(0x7f1d5c0fb310 msgr2=0x7f1d5c0681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 shutdown_connections 2023-10-14T09:08:43.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.201+0000 7f1d61730700 1 -- 172.21.15.6:0/306523503 wait complete. 2023-10-14T09:08:43.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T08:47:15.888745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T08:51:14.784539+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T08:51:15.631017+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T09:08:43.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T09:08:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 -- 172.21.15.6:0/375761512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101a10 msgr2=0x7f37f0108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 --2- 172.21.15.6:0/375761512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101a10 0x7f37f0108330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f37e800b0a0 tx=0x7f37e800b3b0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 -- 172.21.15.6:0/375761512 shutdown_connections 2023-10-14T09:08:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 --2- 172.21.15.6:0/375761512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101a10 0x7f37f0108330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 --2- 172.21.15.6:0/375761512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f00ffe70 0x7f37f0100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 --2- 172.21.15.6:0/375761512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37f0101050 0x7f37f01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 -- 172.21.15.6:0/375761512 >> 172.21.15.6:0/375761512 conn(0x7f37f00fb410 msgr2=0x7f37f00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 -- 172.21.15.6:0/375761512 shutdown_connections 2023-10-14T09:08:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 -- 172.21.15.6:0/375761512 wait complete. 2023-10-14T09:08:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.383+0000 7f37f687f700 1 Processor -- start 2023-10-14T09:08:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 -- start start 2023-10-14T09:08:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37f00ffe70 0x7f37f010a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 0x7f37f0108e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f0101a10 0x7f37f0109360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0109b00 con 0x7f37f0101050 2023-10-14T09:08:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0109c70 con 0x7f37f0101a10 2023-10-14T09:08:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f687f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01a0db0 con 0x7f37f00ffe70 2023-10-14T09:08:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 0x7f37f0108e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 0x7f37f0108e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36486/0 (socket says 172.21.15.6:36486) 2023-10-14T09:08:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 -- 172.21.15.6:0/3837981970 learned_addr learned my addr 172.21.15.6:0/3837981970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37effff700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37f00ffe70 0x7f37f010a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f4e1c700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f0101a10 0x7f37f0109360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 -- 172.21.15.6:0/3837981970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37f00ffe70 msgr2=0x7f37f010a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37f00ffe70 0x7f37f010a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 -- 172.21.15.6:0/3837981970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f0101a10 msgr2=0x7f37f0109360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f0101a10 0x7f37f0109360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 -- 172.21.15.6:0/3837981970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e8009d00 con 0x7f37f0101050 2023-10-14T09:08:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37f4e1c700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f0101a10 0x7f37f0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:08:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37e7fff700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 0x7f37f0108e20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f37d800d980 tx=0x7f37d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.384+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8009930 con 0x7f37f0101050 2023-10-14T09:08:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.385+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f01a1090 con 0x7f37f0101050 2023-10-14T09:08:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.385+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37d8010460 con 0x7f37f0101050 2023-10-14T09:08:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.385+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d800f620 con 0x7f37f0101050 2023-10-14T09:08:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.385+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f01a1550 con 0x7f37f0101050 2023-10-14T09:08:43.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.385+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f0106d80 con 0x7f37f0101050 2023-10-14T09:08:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.387+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f37d8010860 con 0x7f37f0101050 2023-10-14T09:08:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.387+0000 7f37edffb700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37d00a1480 0x7f37d00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.387+0000 7f37effff700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37d00a1480 0x7f37d00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.387+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f37d80cc810 con 0x7f37f0101050 2023-10-14T09:08:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.388+0000 7f37effff700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37d00a1480 0x7f37d00a3940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f37f0100bc0 tx=0x7f37e000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:43.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.391+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f37d8095e70 con 0x7f37f0101050 2023-10-14T09:08:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.594+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37f010cab0 con 0x7f37f0101050 2023-10-14T09:08:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.594+0000 7f37edffb700 1 -- 172.21.15.6:0/3837981970 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37d80200a0 con 0x7f37f0101050 2023-10-14T09:08:43.596 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-10-14T09:08:43.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37d00a1480 msgr2=0x7f37d00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37d00a1480 0x7f37d00a3940 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f37f0100bc0 tx=0x7f37e000a3b0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 msgr2=0x7f37f0108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 0x7f37f0108e20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f37d800d980 tx=0x7f37d800dc90 comp rx=0 tx=0).stop 2023-10-14T09:08:43.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 shutdown_connections 2023-10-14T09:08:43.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f37d00a1480 0x7f37d00a3940 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37f0101a10 0x7f37f0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37f00ffe70 0x7f37f010a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 --2- 172.21.15.6:0/3837981970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37f0101050 0x7f37f0108e20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 >> 172.21.15.6:0/3837981970 conn(0x7f37f00fb410 msgr2=0x7f37f00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:43.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 shutdown_connections 2023-10-14T09:08:43.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.596+0000 7f37f687f700 1 -- 172.21.15.6:0/3837981970 wait complete. 2023-10-14T09:08:43.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T09:08:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 -- 172.21.15.6:0/174533029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb340ffe80 msgr2=0x7feb341002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 --2- 172.21.15.6:0/174533029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb340ffe80 0x7feb341002a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009990 tx=0x7feb1c009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 -- 172.21.15.6:0/174533029 shutdown_connections 2023-10-14T09:08:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 --2- 172.21.15.6:0/174533029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb34101a20 0x7feb34108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 --2- 172.21.15.6:0/174533029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb340ffe80 0x7feb341002a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 --2- 172.21.15.6:0/174533029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 0x7feb341014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 -- 172.21.15.6:0/174533029 >> 172.21.15.6:0/174533029 conn(0x7feb340fb420 msgr2=0x7feb340fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 -- 172.21.15.6:0/174533029 shutdown_connections 2023-10-14T09:08:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 -- 172.21.15.6:0/174533029 wait complete. 2023-10-14T09:08:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 Processor -- start 2023-10-14T09:08:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.739+0000 7feb3a933700 1 -- start start 2023-10-14T09:08:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb3a933700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb340ffe80 0x7feb3410a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb3a933700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 0x7feb34108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb3a933700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 0x7feb34109370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb3a933700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34109b10 con 0x7feb34101a20 2023-10-14T09:08:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb3a933700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34109c80 con 0x7feb34101060 2023-10-14T09:08:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb3a933700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb341a0dd0 con 0x7feb340ffe80 2023-10-14T09:08:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 0x7feb34109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 0x7feb34109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36502/0 (socket says 172.21.15.6:36502) 2023-10-14T09:08:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 -- 172.21.15.6:0/3984902350 learned_addr learned my addr 172.21.15.6:0/3984902350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb33fff700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb340ffe80 0x7feb3410a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb337fe700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 0x7feb34108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 -- 172.21.15.6:0/3984902350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb340ffe80 msgr2=0x7feb3410a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb340ffe80 0x7feb3410a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 -- 172.21.15.6:0/3984902350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 msgr2=0x7feb34108e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 0x7feb34108e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 -- 172.21.15.6:0/3984902350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0095f0 con 0x7feb34101a20 2023-10-14T09:08:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb337fe700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 0x7feb34108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T09:08:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.740+0000 7feb38ed0700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 0x7feb34109370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007ee0 tx=0x7feb2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.741+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c017070 con 0x7feb34101a20 2023-10-14T09:08:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.741+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb2c00f040 con 0x7feb34101a20 2023-10-14T09:08:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.741+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb341a10b0 con 0x7feb34101a20 2023-10-14T09:08:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.741+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c005740 con 0x7feb34101a20 2023-10-14T09:08:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.741+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb341a1570 con 0x7feb34101a20 2023-10-14T09:08:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.742+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb34107490 con 0x7feb34101a20 2023-10-14T09:08:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.743+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7feb2c0058a0 con 0x7feb34101a20 2023-10-14T09:08:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.743+0000 7feb317fa700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7feb200a1480 0x7feb200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.743+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7feb2c0ccc40 con 0x7feb34101a20 2023-10-14T09:08:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.743+0000 7feb33fff700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7feb200a1480 0x7feb200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.744+0000 7feb33fff700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7feb200a1480 0x7feb200a3940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00b5c0 tx=0x7feb1c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.747+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feb2c0962a0 con 0x7feb34101a20 2023-10-14T09:08:43.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:43 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/306523503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:43.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:43 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/306523503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.952+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb3410cb30 con 0x7feb34101a20 2023-10-14T09:08:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.952+0000 7feb317fa700 1 -- 172.21.15.6:0/3984902350 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb2c0998c0 con 0x7feb34101a20 2023-10-14T09:08:43.954 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-10-14T09:08:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.954+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7feb200a1480 msgr2=0x7feb200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.954+0000 7feb3a933700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7feb200a1480 0x7feb200a3940 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00b5c0 tx=0x7feb1c005fb0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.954+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 msgr2=0x7feb34109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.954+0000 7feb3a933700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 0x7feb34109370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007ee0 tx=0x7feb2c00d3b0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 shutdown_connections 2023-10-14T09:08:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb34101a20 0x7feb34109370 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb340ffe80 0x7feb3410a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7feb200a1480 0x7feb200a3940 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 --2- 172.21.15.6:0/3984902350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb34101060 0x7feb34108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 >> 172.21.15.6:0/3984902350 conn(0x7feb340fb420 msgr2=0x7feb341045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 shutdown_connections 2023-10-14T09:08:43.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:43.955+0000 7feb3a933700 1 -- 172.21.15.6:0/3984902350 wait complete. 2023-10-14T09:08:43.968 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:43 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/306523503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:43.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T09:08:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 -- 172.21.15.6:0/3478925545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc1011e0 msgr2=0x7f3fcc107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 --2- 172.21.15.6:0/3478925545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc1011e0 0x7f3fcc107a90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400c240 tx=0x7f3fc400c550 comp rx=0 tx=0).stop 2023-10-14T09:08:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 -- 172.21.15.6:0/3478925545 shutdown_connections 2023-10-14T09:08:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 --2- 172.21.15.6:0/3478925545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc1011e0 0x7f3fcc107a90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 --2- 172.21.15.6:0/3478925545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc0ff650 0x7f3fcc0ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 --2- 172.21.15.6:0/3478925545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fcc100840 0x7f3fcc100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 -- 172.21.15.6:0/3478925545 >> 172.21.15.6:0/3478925545 conn(0x7f3fcc0fabc0 msgr2=0x7f3fcc0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:44.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 -- 172.21.15.6:0/3478925545 shutdown_connections 2023-10-14T09:08:44.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.097+0000 7f3fd1399700 1 -- 172.21.15.6:0/3478925545 wait complete. 2023-10-14T09:08:44.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 Processor -- start 2023-10-14T09:08:44.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 -- start start 2023-10-14T09:08:44.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc0ff650 0x7f3fcc196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 0x7f3fcc197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fcc1011e0 0x7f3fcc19e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc19e880 con 0x7f3fcc100840 2023-10-14T09:08:44.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc19e9f0 con 0x7f3fcc0ff650 2023-10-14T09:08:44.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fd1399700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc19ebb0 con 0x7f3fcc1011e0 2023-10-14T09:08:44.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fca7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 0x7f3fcc197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fca7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 0x7f3fcc197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36514/0 (socket says 172.21.15.6:36514) 2023-10-14T09:08:44.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fca7fc700 1 -- 172.21.15.6:0/1741707860 learned_addr learned my addr 172.21.15.6:0/1741707860 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:44.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fcaffd700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc0ff650 0x7f3fcc196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.098+0000 7f3fcb7fe700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fcc1011e0 0x7f3fcc19e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fca7fc700 1 -- 172.21.15.6:0/1741707860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fcc1011e0 msgr2=0x7f3fcc19e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fca7fc700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fcc1011e0 0x7f3fcc19e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fca7fc700 1 -- 172.21.15.6:0/1741707860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc0ff650 msgr2=0x7f3fcc196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fca7fc700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc0ff650 0x7f3fcc196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fca7fc700 1 -- 172.21.15.6:0/1741707860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc400ae10 con 0x7f3fcc100840 2023-10-14T09:08:44.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fca7fc700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 0x7f3fcc197280 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00d950 tx=0x7f3fbc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:44.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00f890 con 0x7f3fcc100840 2023-10-14T09:08:44.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fbc010460 con 0x7f3fcc100840 2023-10-14T09:08:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc19ee90 con 0x7f3fcc100840 2023-10-14T09:08:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00e610 con 0x7f3fcc100840 2023-10-14T09:08:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.099+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc19f310 con 0x7f3fcc100840 2023-10-14T09:08:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.100+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc106af0 con 0x7f3fcc100840 2023-10-14T09:08:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.101+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f3fbc0108d0 con 0x7f3fcc100840 2023-10-14T09:08:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.102+0000 7f3fb3fff700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb40a1500 0x7f3fb40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.102+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f3fbc0cca70 con 0x7f3fcc100840 2023-10-14T09:08:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.102+0000 7f3fcaffd700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb40a1500 0x7f3fb40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.102+0000 7f3fcaffd700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb40a1500 0x7f3fb40a39c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc198210 tx=0x7f3fc0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.105+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fbc0960d0 con 0x7f3fcc100840 2023-10-14T09:08:44.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.313+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fcc10a7d0 con 0x7f3fcc100840 2023-10-14T09:08:44.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.313+0000 7f3fb3fff700 1 -- 172.21.15.6:0/1741707860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fbc020020 con 0x7f3fcc100840 2023-10-14T09:08:44.315 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-10-14T09:08:44.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb40a1500 msgr2=0x7f3fb40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb40a1500 0x7f3fb40a39c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc198210 tx=0x7f3fc0007400 comp rx=0 tx=0).stop 2023-10-14T09:08:44.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 msgr2=0x7f3fcc197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 0x7f3fcc197280 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00d950 tx=0x7f3fbc00dc60 comp rx=0 tx=0).stop 2023-10-14T09:08:44.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 shutdown_connections 2023-10-14T09:08:44.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fcc1011e0 0x7f3fcc19e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f3fb40a1500 0x7f3fb40a39c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fcc0ff650 0x7f3fcc196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 --2- 172.21.15.6:0/1741707860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fcc100840 0x7f3fcc197280 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 >> 172.21.15.6:0/1741707860 conn(0x7f3fcc0fabc0 msgr2=0x7f3fcc103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:44.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 shutdown_connections 2023-10-14T09:08:44.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.315+0000 7f3fd1399700 1 -- 172.21.15.6:0/1741707860 wait complete. 2023-10-14T09:08:44.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T09:08:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/859468381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb481021a0 msgr2=0x7fbb48102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/859468381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb481021a0 0x7fbb48102600 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbb380099c0 tx=0x7fbb38009cd0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/859468381 shutdown_connections 2023-10-14T09:08:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/859468381 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb48102b40 0x7fbb481093f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/859468381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb48100fb0 0x7fbb481013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/859468381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb481021a0 0x7fbb48102600 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/859468381 >> 172.21.15.6:0/859468381 conn(0x7fbb480fc520 msgr2=0x7fbb480fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/859468381 shutdown_connections 2023-10-14T09:08:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.455+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/859468381 wait complete. 2023-10-14T09:08:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 Processor -- start 2023-10-14T09:08:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 -- start start 2023-10-14T09:08:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb48100fb0 0x7fbb48196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb481021a0 0x7fbb48197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 0x7fbb4819e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4819e860 con 0x7fbb48102b40 2023-10-14T09:08:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4819e9d0 con 0x7fbb48100fb0 2023-10-14T09:08:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb4dcd5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4819eb90 con 0x7fbb481021a0 2023-10-14T09:08:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 0x7fbb4819e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb47fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 0x7fbb4819e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36528/0 (socket says 172.21.15.6:36528) 2023-10-14T09:08:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb47fff700 1 -- 172.21.15.6:0/925002665 learned_addr learned my addr 172.21.15.6:0/925002665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb46ffd700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb481021a0 0x7fbb48197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.456+0000 7fbb477fe700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb48100fb0 0x7fbb48196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb47fff700 1 -- 172.21.15.6:0/925002665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb481021a0 msgr2=0x7fbb48197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb47fff700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb481021a0 0x7fbb48197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb47fff700 1 -- 172.21.15.6:0/925002665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb48100fb0 msgr2=0x7fbb48196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb47fff700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb48100fb0 0x7fbb48196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb47fff700 1 -- 172.21.15.6:0/925002665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380095f0 con 0x7fbb48102b40 2023-10-14T09:08:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb47fff700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 0x7fbb4819e290 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000ada0 tx=0x7fbb4000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000f070 con 0x7fbb48102b40 2023-10-14T09:08:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb40007b30 con 0x7fbb48102b40 2023-10-14T09:08:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40005280 con 0x7fbb48102b40 2023-10-14T09:08:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4819ee70 con 0x7fbb48102b40 2023-10-14T09:08:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.457+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4819f240 con 0x7fbb48102b40 2023-10-14T09:08:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.458+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb48108540 con 0x7fbb48102b40 2023-10-14T09:08:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.459+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fbb4000a090 con 0x7fbb48102b40 2023-10-14T09:08:44.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.460+0000 7fbb44ff9700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb300a1580 0x7fbb300a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:44.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.460+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fbb400cc720 con 0x7fbb48102b40 2023-10-14T09:08:44.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.460+0000 7fbb477fe700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb300a1580 0x7fbb300a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:44.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.460+0000 7fbb477fe700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb300a1580 0x7fbb300a3a40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbb481981f0 tx=0x7fbb3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:44.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.463+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb40095dd0 con 0x7fbb48102b40 2023-10-14T09:08:44.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.682+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb4802d1e0 con 0x7fbb48102b40 2023-10-14T09:08:44.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.683+0000 7fbb44ff9700 1 -- 172.21.15.6:0/925002665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+577 (secure 0 0 0) 0x7fbb400993f0 con 0x7fbb48102b40 2023-10-14T09:08:44.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/866757067 2023-10-15T08:45:03.352994+0000 2023-10-14T09:08:44.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3649860650 2023-10-15T08:45:03.352994+0000 2023-10-14T09:08:44.685 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/516951061 2023-10-15T08:45:03.352994+0000 2023-10-14T09:08:44.686 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/516951061 2023-10-15T08:45:03.352994+0000 2023-10-14T09:08:44.686 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3410563111 2023-10-15T08:44:36.985351+0000 2023-10-14T09:08:44.686 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3410563111 2023-10-15T08:44:36.985351+0000 2023-10-14T09:08:44.686 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/103686796 2023-10-15T08:44:36.985351+0000 2023-10-14T09:08:44.687 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1911805339 2023-10-15T08:44:36.985351+0000 2023-10-14T09:08:44.687 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/571590378 2023-10-15T08:44:36.985351+0000 2023-10-14T09:08:44.687 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/2188319244 2023-10-15T08:45:03.352994+0000 2023-10-14T09:08:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb300a1580 msgr2=0x7fbb300a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb300a1580 0x7fbb300a3a40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbb481981f0 tx=0x7fbb3c009260 comp rx=0 tx=0).stop 2023-10-14T09:08:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 msgr2=0x7fbb4819e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 0x7fbb4819e290 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000ada0 tx=0x7fbb4000c330 comp rx=0 tx=0).stop 2023-10-14T09:08:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 shutdown_connections 2023-10-14T09:08:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb48102b40 0x7fbb4819e290 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fbb300a1580 0x7fbb300a3a40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb48100fb0 0x7fbb48196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 --2- 172.21.15.6:0/925002665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb481021a0 0x7fbb48197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 >> 172.21.15.6:0/925002665 conn(0x7fbb480fc520 msgr2=0x7fbb48105680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 shutdown_connections 2023-10-14T09:08:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:44.685+0000 7fbb4dcd5700 1 -- 172.21.15.6:0/925002665 wait complete. 2023-10-14T09:08:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2023-10-14T09:08:44.698 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:44 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3837981970' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.698 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:44 smithi006 ceph-mon[99452]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 16 op/s 2023-10-14T09:08:44.699 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:44 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3984902350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.699 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:44 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/1741707860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.700 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T09:08:44.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:44.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /tmp/cephfs 2023-10-14T09:08:44.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T09:08:44.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:44.854 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-10-14T09:08:44.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:44 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3837981970' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:44 smithi178 ceph-mon[103612]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 16 op/s 2023-10-14T09:08:44.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:44 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3984902350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:44 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/1741707860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:44 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3837981970' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:44 smithi057 ceph-mon[103313]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 16 op/s 2023-10-14T09:08:44.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:44 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3984902350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-14T09:08:44.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:44 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/1741707860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-14T09:08:45.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:45.014 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-14T09:08:45.122 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-10-14T09:08:45.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:45.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-10-14T09:08:45.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:45.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-14T09:08:45.309 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T09:08:45.309 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-10-14T09:08:45.310 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T09:08:45.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19696 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/2bad942d9b6ce6cdc84640773739fe1adaf90bf79f22fae2dffb855a6345a14a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/2bad942d9b6ce6cdc84640773739fe1adaf90bf79f22fae2dffb855a6345a14a/diff,workdir=/var/lib/containers/storage/overlay/2bad942d9b6ce6cdc84640773739fe1adaf90bf79f22fae2dffb855a6345a14a/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a97ebf0e03271784c2a3b1125f839666933099e958fade70ed5fc80cff1bf5fc/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/a97ebf0e03271784c2a3b1125f839666933099e958fade70ed5fc80cff1bf5fc/diff,workdir=/var/lib/containers/storage/overlay/a97ebf0e03271784c2a3b1125f839666933099e958fade70ed5fc80cff1bf5fc/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/fa36b12dbf5b5139233329b1949749821622daeebcc13dbba5ad514893d9115e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/fa36b12dbf5b5139233329b1949749821622daeebcc13dbba5ad514893d9115e/diff,workdir=/var/lib/containers/storage/overlay/fa36b12dbf5b5139233329b1949749821622daeebcc13dbba5ad514893d9115e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5b4d6de6a4df1dbc7f4c6aedf8d33b30309e1d892bf41ee44d8edabdc9af7cab/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/5b4d6de6a4df1dbc7f4c6aedf8d33b30309e1d892bf41ee44d8edabdc9af7cab/diff,workdir=/var/lib/containers/storage/overlay/5b4d6de6a4df1dbc7f4c6aedf8d33b30309e1d892bf41ee44d8edabdc9af7cab/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8fed46762ab60d8c6402ef10f2f23f21abc34385f6b1264896e617d759c9e985/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/8fed46762ab60d8c6402ef10f2f23f21abc34385f6b1264896e617d759c9e985/diff,workdir=/var/lib/containers/storage/overlay/8fed46762ab60d8c6402ef10f2f23f21abc34385f6b1264896e617d759c9e985/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8f0fdffd300c0406deb3ff9f4d510c0de7b9bdffbc0b4b6afaa625f541290262/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/8f0fdffd300c0406deb3ff9f4d510c0de7b9bdffbc0b4b6afaa625f541290262/diff,workdir=/var/lib/containers/storage/overlay/8f0fdffd300c0406deb3ff9f4d510c0de7b9bdffbc0b4b6afaa625f541290262/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/23565e129ca8047998447ac22586b5d5c535eb8c47ce4e7f8601fa2c1dda80c1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/23565e129ca8047998447ac22586b5d5c535eb8c47ce4e7f8601fa2c1dda80c1/diff,workdir=/var/lib/containers/storage/overlay/23565e129ca8047998447ac22586b5d5c535eb8c47ce4e7f8601fa2c1dda80c1/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/da7d722694a8b704ccd0916965da1e430fa24554ae83dc8875e86efacc6fd3b2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/da7d722694a8b704ccd0916965da1e430fa24554ae83dc8875e86efacc6fd3b2/diff,workdir=/var/lib/containers/storage/overlay/da7d722694a8b704ccd0916965da1e430fa24554ae83dc8875e86efacc6fd3b2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/737a1644b127693795b9a0122cdeb71aec6a4e927bb01ed70878cdb5975c3749/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/737a1644b127693795b9a0122cdeb71aec6a4e927bb01ed70878cdb5975c3749/diff,workdir=/var/lib/containers/storage/overlay/737a1644b127693795b9a0122cdeb71aec6a4e927bb01ed70878cdb5975c3749/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f93c36553da392eacd284b5815b6a48114b6445ea9e38cd554ac3dd907ce9279/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/7YE7SZYGK7CYE624QFJBHLGTPS:/var/lib/containers/storage/overlay/l/7AS2GPYRO2CAHZTAGWBU726C3P,upperdir=/var/lib/containers/storage/overlay/f93c36553da392eacd284b5815b6a48114b6445ea9e38cd554ac3dd907ce9279/diff,workdir=/var/lib/containers/storage/overlay/f93c36553da392eacd284b5815b6a48114b6445ea9e38cd554ac3dd907ce9279/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-14T09:08:45.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:45.330 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-10-14T09:08:45.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T09:08:45.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-10-14T09:08:45.458 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-10-14T09:08:45.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:08:45.460 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-14T09:08:45.472 INFO:tasks.cephadm:Teardown begin 2023-10-14T09:08:45.473 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T09:08:45.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 -- 172.21.15.6:0/3531214833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8101970 msgr2=0x7fc7a8108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 --2- 172.21.15.6:0/3531214833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8101970 0x7fc7a8108220 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000b0d0 tx=0x7fc7a000b3e0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 -- 172.21.15.6:0/3531214833 shutdown_connections 2023-10-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 --2- 172.21.15.6:0/3531214833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8101970 0x7fc7a8108220 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 --2- 172.21.15.6:0/3531214833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a80ffde0 0x7fc7a8100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 --2- 172.21.15.6:0/3531214833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.626+0000 7fc7b004a700 1 -- 172.21.15.6:0/3531214833 >> 172.21.15.6:0/3531214833 conn(0x7fc7a80fb310 msgr2=0x7fc7a80fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 -- 172.21.15.6:0/3531214833 shutdown_connections 2023-10-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 -- 172.21.15.6:0/3531214833 wait complete. 2023-10-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 Processor -- start 2023-10-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 -- start start 2023-10-14T09:08:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a80ffde0 0x7fc7a8194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a8101970 0x7fc7a819c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a819c5d0 con 0x7fc7a8100fd0 2023-10-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a819c710 con 0x7fc7a8101970 2023-10-14T09:08:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7b004a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a819c8a0 con 0x7fc7a80ffde0 2023-10-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7ad5e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7ad5e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8194f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36540/0 (socket says 172.21.15.6:36540) 2023-10-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.627+0000 7fc7ad5e5700 1 -- 172.21.15.6:0/681153709 learned_addr learned my addr 172.21.15.6:0/681153709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ae5e7700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a8101970 0x7fc7a819c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7adde6700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a80ffde0 0x7fc7a8194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ad5e5700 1 -- 172.21.15.6:0/681153709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a80ffde0 msgr2=0x7fc7a8194a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ad5e5700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a80ffde0 0x7fc7a8194a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ad5e5700 1 -- 172.21.15.6:0/681153709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a8101970 msgr2=0x7fc7a819c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ad5e5700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a8101970 0x7fc7a819c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ad5e5700 1 -- 172.21.15.6:0/681153709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a0009d00 con 0x7fc7a8100fd0 2023-10-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7ad5e5700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8194f90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400abb0 tx=0x7fc7a400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4010070 con 0x7fc7a8100fd0 2023-10-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7a4007d80 con 0x7fc7a8100fd0 2023-10-14T09:08:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a819cb80 con 0x7fc7a8100fd0 2023-10-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4014d00 con 0x7fc7a8100fd0 2023-10-14T09:08:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.628+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a819d0e0 con 0x7fc7a8100fd0 2023-10-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.629+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a8106ce0 con 0x7fc7a8100fd0 2023-10-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.630+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fc7a40078c0 con 0x7fc7a8100fd0 2023-10-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.631+0000 7fc79effd700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7940a1500 0x7fc7940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:45.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.631+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fc7a40cbfe0 con 0x7fc7a8100fd0 2023-10-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.631+0000 7fc7adde6700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7940a1500 0x7fc7940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.631+0000 7fc7adde6700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7940a1500 0x7fc7940a39c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8100e30 tx=0x7fc798009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:45.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.634+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc7a4095640 con 0x7fc7a8100fd0 2023-10-14T09:08:45.731 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:45 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/925002665' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-14T09:08:45.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:45 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/925002665' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-14T09:08:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.883+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7a802d020 con 0x7fc7a8100fd0 2023-10-14T09:08:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.883+0000 7fc79effd700 1 -- 172.21.15.6:0/681153709 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11361 (secure 0 0 0) 0x7fc7a4014e60 con 0x7fc7a8100fd0 2023-10-14T09:08:45.886 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:45.886 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T09:08:27.871496+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":36,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:08:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7940a1500 msgr2=0x7fc7940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7940a1500 0x7fc7940a39c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8100e30 tx=0x7fc798009260 comp rx=0 tx=0).stop 2023-10-14T09:08:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 msgr2=0x7fc7a8194f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8194f90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400abb0 tx=0x7fc7a400aec0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 shutdown_connections 2023-10-14T09:08:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fc7940a1500 0x7fc7940a39c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a8101970 0x7fc7a819c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a80ffde0 0x7fc7a8194a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 --2- 172.21.15.6:0/681153709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7a8100fd0 0x7fc7a8194f90 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 >> 172.21.15.6:0/681153709 conn(0x7fc7a80fb310 msgr2=0x7fc7a80fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 shutdown_connections 2023-10-14T09:08:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:45.886+0000 7fc7b004a700 1 -- 172.21.15.6:0/681153709 wait complete. 2023-10-14T09:08:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 58 2023-10-14T09:08:45.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T09:08:45.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:45 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/925002665' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-14T09:08:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3073070570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 msgr2=0x7f7fe0101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3073070570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe0101800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009990 tx=0x7f7fdc009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3073070570 shutdown_connections 2023-10-14T09:08:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3073070570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe01009f0 0x7f7fe0108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3073070570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe0101800 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3073070570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fe0100030 0x7f7fe01004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3073070570 >> 172.21.15.6:0/3073070570 conn(0x7f7fe00faa80 msgr2=0x7f7fe00fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3073070570 shutdown_connections 2023-10-14T09:08:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.025+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3073070570 wait complete. 2023-10-14T09:08:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 Processor -- start 2023-10-14T09:08:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 -- start start 2023-10-14T09:08:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe0100030 0x7f7fe0196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fe01009f0 0x7f7fe0197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe019e770 con 0x7f7fe01013e0 2023-10-14T09:08:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe019e8b0 con 0x7f7fe01009f0 2023-10-14T09:08:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe87d6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe019ea40 con 0x7f7fe0100030 2023-10-14T09:08:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe019e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36556/0 (socket says 172.21.15.6:36556) 2023-10-14T09:08:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe5d71700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fe01009f0 0x7f7fe0197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 -- 172.21.15.6:0/3520353802 learned_addr learned my addr 172.21.15.6:0/3520353802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6572700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe0100030 0x7f7fe0196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 -- 172.21.15.6:0/3520353802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe0100030 msgr2=0x7f7fe0196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe0100030 0x7f7fe0196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 -- 172.21.15.6:0/3520353802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fe01009f0 msgr2=0x7f7fe0197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fe01009f0 0x7f7fe0197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.026+0000 7f7fe6d73700 1 -- 172.21.15.6:0/3520353802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0095f0 con 0x7f7fe01013e0 2023-10-14T09:08:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fe6572700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe0100030 0x7f7fe0196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:08:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fe6d73700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe019e1a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8007ee0 tx=0x7f7fd800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8017070 con 0x7f7fe01013e0 2023-10-14T09:08:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fd800f040 con 0x7f7fe01013e0 2023-10-14T09:08:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe019ed20 con 0x7f7fe01013e0 2023-10-14T09:08:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8005740 con 0x7f7fe01013e0 2023-10-14T09:08:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.027+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe019f220 con 0x7f7fe01013e0 2023-10-14T09:08:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.028+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe010b620 con 0x7f7fe01013e0 2023-10-14T09:08:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.029+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7fd800dc60 con 0x7f7fe01013e0 2023-10-14T09:08:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.029+0000 7f7fd37fe700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fcc0a1500 0x7f7fcc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.030+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f7fd80ccb20 con 0x7f7fe01013e0 2023-10-14T09:08:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.030+0000 7f7fe6572700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fcc0a1500 0x7f7fcc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.030+0000 7f7fe6572700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fcc0a1500 0x7f7fcc0a39c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:46.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.033+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7fd8096140 con 0x7f7fe01013e0 2023-10-14T09:08:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.284+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fe019f410 con 0x7f7fe01013e0 2023-10-14T09:08:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.285+0000 7f7fd37fe700 1 -- 172.21.15.6:0/3520353802 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11361 (secure 0 0 0) 0x7f7fd8099760 con 0x7f7fe01013e0 2023-10-14T09:08:46.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:46.287 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2026844490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2026844490},{"type":"v1","addr":"172.21.15.6:6835","nonce":2026844490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1177003632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1177003632},{"type":"v1","addr":"172.21.15.6:6837","nonce":1177003632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-14T08:51:16.279910+0000","modified":"2023-10-14T09:08:27.871496+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24508,"mds_1":24506,"mds_2":24473,"mds_3":24455,"mds_4":24434},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/977658940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":977658940},{"type":"v1","addr":"172.21.15.6:6839","nonce":977658940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/4202282219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":4202282219},{"type":"v1","addr":"172.21.15.6:6841","nonce":4202282219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24433":{"gid":24433,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/3050202963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3050202963},{"type":"v1","addr":"172.21.15.178:6833","nonce":3050202963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24434":{"gid":24434,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6833/1834864415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1834864415},{"type":"v1","addr":"172.21.15.57:6833","nonce":1834864415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":8,"addr":"172.21.15.57:6835/2935762756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2935762756},{"type":"v1","addr":"172.21.15.57:6835","nonce":2935762756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.57:6837/1275682296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1275682296},{"type":"v1","addr":"172.21.15.57:6837","nonce":1275682296}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24481":{"gid":24481,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/4072673445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4072673445},{"type":"v1","addr":"172.21.15.178:6835","nonce":4072673445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24493":{"gid":24493,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/4069767165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":4069767165},{"type":"v1","addr":"172.21.15.178:6837","nonce":4069767165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24506":{"gid":24506,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":36,"addr":"172.21.15.57:6839/2236865036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6838","nonce":2236865036},{"type":"v1","addr":"172.21.15.57:6839","nonce":2236865036}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24508":{"gid":24508,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6839/1495241908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":1495241908},{"type":"v1","addr":"172.21.15.178:6839","nonce":1495241908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T09:08:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fcc0a1500 msgr2=0x7f7fcc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fcc0a1500 0x7f7fcc0a39c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc005fb0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 msgr2=0x7f7fe019e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe019e1a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8007ee0 tx=0x7f7fd800d3b0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 shutdown_connections 2023-10-14T09:08:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fe01013e0 0x7f7fe019e1a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe0100030 0x7f7fe0196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7fcc0a1500 0x7f7fcc0a39c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 --2- 172.21.15.6:0/3520353802 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fe01009f0 0x7f7fe0197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 >> 172.21.15.6:0/3520353802 conn(0x7f7fe00faa80 msgr2=0x7f7fe00fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 shutdown_connections 2023-10-14T09:08:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.287+0000 7f7fe87d6700 1 -- 172.21.15.6:0/3520353802 wait complete. 2023-10-14T09:08:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 58 2023-10-14T09:08:46.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T09:08:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 -- 172.21.15.6:0/1031384858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c104290 msgr2=0x7fd90c106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 --2- 172.21.15.6:0/1031384858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c104290 0x7fd90c106680 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd900009990 tx=0x7fd900009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 -- 172.21.15.6:0/1031384858 shutdown_connections 2023-10-14T09:08:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 --2- 172.21.15.6:0/1031384858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd90c106bc0 0x7fd90c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 --2- 172.21.15.6:0/1031384858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c101960 0x7fd90c103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 --2- 172.21.15.6:0/1031384858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c104290 0x7fd90c106680 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 -- 172.21.15.6:0/1031384858 >> 172.21.15.6:0/1031384858 conn(0x7fd90c0fb310 msgr2=0x7fd90c0fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:46.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 -- 172.21.15.6:0/1031384858 shutdown_connections 2023-10-14T09:08:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.426+0000 7fd911ae1700 1 -- 172.21.15.6:0/1031384858 wait complete. 2023-10-14T09:08:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 Processor -- start 2023-10-14T09:08:46.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 -- start start 2023-10-14T09:08:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd90c101960 0x7fd90c1012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c104290 0x7fd90c0ff910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 0x7fd90c0ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c1005f0 con 0x7fd90c106bc0 2023-10-14T09:08:46.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c100760 con 0x7fd90c101960 2023-10-14T09:08:46.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.427+0000 7fd911ae1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c1a0c80 con 0x7fd90c104290 2023-10-14T09:08:46.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 0x7fd90c0ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 0x7fd90c0ffe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36570/0 (socket says 172.21.15.6:36570) 2023-10-14T09:08:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 -- 172.21.15.6:0/2438941631 learned_addr learned my addr 172.21.15.6:0/2438941631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90b7fe700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd90c101960 0x7fd90c1012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90affd700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c104290 0x7fd90c0ff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 -- 172.21.15.6:0/2438941631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c104290 msgr2=0x7fd90c0ff910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c104290 0x7fd90c0ff910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 -- 172.21.15.6:0/2438941631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd90c101960 msgr2=0x7fd90c1012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd90c101960 0x7fd90c1012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 -- 172.21.15.6:0/2438941631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000095f0 con 0x7fd90c106bc0 2023-10-14T09:08:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd90bfff700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 0x7fd90c0ffe50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b970 tx=0x7fd90400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:46.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400c930 con 0x7fd90c106bc0 2023-10-14T09:08:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd904014440 con 0x7fd90c106bc0 2023-10-14T09:08:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c1a0f60 con 0x7fd90c106bc0 2023-10-14T09:08:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9040075d0 con 0x7fd90c106bc0 2023-10-14T09:08:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.428+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c1a1410 con 0x7fd90c106bc0 2023-10-14T09:08:46.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.429+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c0fce90 con 0x7fd90c106bc0 2023-10-14T09:08:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.430+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7fd9040145b0 con 0x7fd90c106bc0 2023-10-14T09:08:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.431+0000 7fd908ff9700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd8f40a1480 0x7fd8f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.431+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7fd904006e40 con 0x7fd90c106bc0 2023-10-14T09:08:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.431+0000 7fd90b7fe700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd8f40a1480 0x7fd8f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.431+0000 7fd90b7fe700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd8f40a1480 0x7fd8f40a3940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009c60 tx=0x7fd8fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:46.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.436+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd90404f100 con 0x7fd90c106bc0 2023-10-14T09:08:46.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.641+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd90c10c790 con 0x7fd90c106bc0 2023-10-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.642+0000 7fd908ff9700 1 -- 172.21.15.6:0/2438941631 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22517 (secure 0 0 0) 0x7fd9040959e0 con 0x7fd90c106bc0 2023-10-14T09:08:46.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-10-14T09:08:46.645 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"af5a2e5a-6a6d-11ee-8db6-212e2dc638e7","created":"2023-10-14T08:44:01.633089+0000","modified":"2023-10-14T08:52:04.444514+0000","last_up_change":"2023-10-14T08:50:34.230503+0000","last_in_change":"2023-10-14T08:50:16.622889+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T08:47:15.888745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T08:51:14.784539+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T08:51:15.631017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ef84fd5-07bb-4e54-aaaa-b818f688ee47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6803","nonce":3964100626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6805","nonce":3964100626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6809","nonce":3964100626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3964100626},{"type":"v1","addr":"172.21.15.6:6807","nonce":3964100626}]},"public_addr":"172.21.15.6:6803/3964100626","cluster_addr":"172.21.15.6:6805/3964100626","heartbeat_back_addr":"172.21.15.6:6809/3964100626","heartbeat_front_addr":"172.21.15.6:6807/3964100626","state":["exists","up"]},{"osd":1,"uuid":"b566713f-39eb-446e-b9e4-e730ef64ecd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6801","nonce":3505442152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6803","nonce":3505442152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6807","nonce":3505442152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":3505442152},{"type":"v1","addr":"172.21.15.57:6805","nonce":3505442152}]},"public_addr":"172.21.15.57:6801/3505442152","cluster_addr":"172.21.15.57:6803/3505442152","heartbeat_back_addr":"172.21.15.57:6807/3505442152","heartbeat_front_addr":"172.21.15.57:6805/3505442152","state":["exists","up"]},{"osd":2,"uuid":"9ced53ca-e0e9-427a-9b59-8647d5cf2525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6801","nonce":1191550997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6803","nonce":1191550997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6807","nonce":1191550997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1191550997},{"type":"v1","addr":"172.21.15.178:6805","nonce":1191550997}]},"public_addr":"172.21.15.178:6801/1191550997","cluster_addr":"172.21.15.178:6803/1191550997","heartbeat_back_addr":"172.21.15.178:6807/1191550997","heartbeat_front_addr":"172.21.15.178:6805/1191550997","state":["exists","up"]},{"osd":3,"uuid":"c5d6f475-b22e-4032-8ec3-a0f06769ba76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6811","nonce":3136263459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6813","nonce":3136263459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6817","nonce":3136263459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3136263459},{"type":"v1","addr":"172.21.15.6:6815","nonce":3136263459}]},"public_addr":"172.21.15.6:6811/3136263459","cluster_addr":"172.21.15.6:6813/3136263459","heartbeat_back_addr":"172.21.15.6:6817/3136263459","heartbeat_front_addr":"172.21.15.6:6815/3136263459","state":["exists","up"]},{"osd":4,"uuid":"9b0fd0d1-1684-4766-9608-c2922016f050","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6809","nonce":4030613729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6811","nonce":4030613729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6815","nonce":4030613729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":4030613729},{"type":"v1","addr":"172.21.15.57:6813","nonce":4030613729}]},"public_addr":"172.21.15.57:6809/4030613729","cluster_addr":"172.21.15.57:6811/4030613729","heartbeat_back_addr":"172.21.15.57:6815/4030613729","heartbeat_front_addr":"172.21.15.57:6813/4030613729","state":["exists","up"]},{"osd":5,"uuid":"12d167c7-c93a-4cc7-bfc4-0fa500fa1ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6809","nonce":1403706440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6811","nonce":1403706440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6815","nonce":1403706440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1403706440},{"type":"v1","addr":"172.21.15.178:6813","nonce":1403706440}]},"public_addr":"172.21.15.178:6809/1403706440","cluster_addr":"172.21.15.178:6811/1403706440","heartbeat_back_addr":"172.21.15.178:6815/1403706440","heartbeat_front_addr":"172.21.15.178:6813/1403706440","state":["exists","up"]},{"osd":6,"uuid":"82017fe0-ae29-42fc-be07-a8a180d4d969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6819","nonce":1891012119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6821","nonce":1891012119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6825","nonce":1891012119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1891012119},{"type":"v1","addr":"172.21.15.6:6823","nonce":1891012119}]},"public_addr":"172.21.15.6:6819/1891012119","cluster_addr":"172.21.15.6:6821/1891012119","heartbeat_back_addr":"172.21.15.6:6825/1891012119","heartbeat_front_addr":"172.21.15.6:6823/1891012119","state":["exists","up"]},{"osd":7,"uuid":"f93b9770-08f4-4f9b-8141-317e455fd3a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6817","nonce":2223075763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6819","nonce":2223075763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6823","nonce":2223075763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":2223075763},{"type":"v1","addr":"172.21.15.57:6821","nonce":2223075763}]},"public_addr":"172.21.15.57:6817/2223075763","cluster_addr":"172.21.15.57:6819/2223075763","heartbeat_back_addr":"172.21.15.57:6823/2223075763","heartbeat_front_addr":"172.21.15.57:6821/2223075763","state":["exists","up"]},{"osd":8,"uuid":"ea8d4216-d791-4f3f-9448-c81af655c2ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6817","nonce":3668822662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6819","nonce":3668822662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6823","nonce":3668822662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":3668822662},{"type":"v1","addr":"172.21.15.178:6821","nonce":3668822662}]},"public_addr":"172.21.15.178:6817/3668822662","cluster_addr":"172.21.15.178:6819/3668822662","heartbeat_back_addr":"172.21.15.178:6823/3668822662","heartbeat_front_addr":"172.21.15.178:6821/3668822662","state":["exists","up"]},{"osd":9,"uuid":"2b54f460-3337-4f4a-8d74-02a945a81158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6827","nonce":1885446684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6829","nonce":1885446684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6833","nonce":1885446684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":1885446684},{"type":"v1","addr":"172.21.15.6:6831","nonce":1885446684}]},"public_addr":"172.21.15.6:6827/1885446684","cluster_addr":"172.21.15.6:6829/1885446684","heartbeat_back_addr":"172.21.15.6:6833/1885446684","heartbeat_front_addr":"172.21.15.6:6831/1885446684","state":["exists","up"]},{"osd":10,"uuid":"9a907667-59dc-4633-8f3d-735c2ed0fb6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6825","nonce":104741011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6827","nonce":104741011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6831","nonce":104741011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":104741011},{"type":"v1","addr":"172.21.15.57:6829","nonce":104741011}]},"public_addr":"172.21.15.57:6825/104741011","cluster_addr":"172.21.15.57:6827/104741011","heartbeat_back_addr":"172.21.15.57:6831/104741011","heartbeat_front_addr":"172.21.15.57:6829/104741011","state":["exists","up"]},{"osd":11,"uuid":"38288845-23b4-43cf-a07e-8a0e1e52342e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6825","nonce":1548169216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6827","nonce":1548169216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6831","nonce":1548169216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":1548169216},{"type":"v1","addr":"172.21.15.178:6829","nonce":1548169216}]},"public_addr":"172.21.15.178:6825/1548169216","cluster_addr":"172.21.15.178:6827/1548169216","heartbeat_back_addr":"172.21.15.178:6831/1548169216","heartbeat_front_addr":"172.21.15.178:6829/1548169216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:29.077430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:46:51.682679+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:13.230980+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:36.212615+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:47:58.512001+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:19.754780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:48:42.123717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:04.942618+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:26.390222+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:49:48.032803+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:10.738637+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T08:50:33.080380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/866757067":"2023-10-15T08:45:03.352994+0000","172.21.15.6:0/3649860650":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6801/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/516951061":"2023-10-15T08:45:03.352994+0000","172.21.15.6:6800/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:6801/3410563111":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/103686796":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/1911805339":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/571590378":"2023-10-15T08:44:36.985351+0000","172.21.15.6:0/2188319244":"2023-10-15T08:45:03.352994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T09:08:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd8f40a1480 msgr2=0x7fd8f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd8f40a1480 0x7fd8f40a3940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009c60 tx=0x7fd8fc009260 comp rx=0 tx=0).stop 2023-10-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 msgr2=0x7fd90c0ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 0x7fd90c0ffe50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd90400b970 tx=0x7fd90400bc80 comp rx=0 tx=0).stop 2023-10-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 shutdown_connections 2023-10-14T09:08:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c106bc0 0x7fd90c0ffe50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7fd8f40a1480 0x7fd8f40a3940 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd90c101960 0x7fd90c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 --2- 172.21.15.6:0/2438941631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c104290 0x7fd90c0ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 >> 172.21.15.6:0/2438941631 conn(0x7fd90c0fb310 msgr2=0x7fd90c1025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 shutdown_connections 2023-10-14T09:08:46.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.644+0000 7fd911ae1700 1 -- 172.21.15.6:0/2438941631 wait complete. 2023-10-14T09:08:46.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T09:08:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 -- 172.21.15.6:0/2851350485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7918100ff0 msgr2=0x7f7918101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 --2- 172.21.15.6:0/2851350485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7918100ff0 0x7f7918101470 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7914009990 tx=0x7f7914009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 -- 172.21.15.6:0/2851350485 shutdown_connections 2023-10-14T09:08:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 --2- 172.21.15.6:0/2851350485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 0x7f79181082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 --2- 172.21.15.6:0/2851350485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79180ffea0 0x7f79181002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 --2- 172.21.15.6:0/2851350485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7918100ff0 0x7f7918101470 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 -- 172.21.15.6:0/2851350485 >> 172.21.15.6:0/2851350485 conn(0x7f79180fb450 msgr2=0x7f79180fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:46.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 -- 172.21.15.6:0/2851350485 shutdown_connections 2023-10-14T09:08:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 -- 172.21.15.6:0/2851350485 wait complete. 2023-10-14T09:08:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 Processor -- start 2023-10-14T09:08:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.785+0000 7f792046e700 1 -- start start 2023-10-14T09:08:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 0x7f7918196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918100ff0 0x7f79181971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 0x7f791819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819e7b0 con 0x7f79180ffea0 2023-10-14T09:08:46.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819e920 con 0x7f79181019b0 2023-10-14T09:08:46.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791819eae0 con 0x7f7918100ff0 2023-10-14T09:08:46.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 0x7f7918196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 0x7f7918196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36580/0 (socket says 172.21.15.6:36580) 2023-10-14T09:08:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 -- 172.21.15.6:0/2858117660 learned_addr learned my addr 172.21.15.6:0/2858117660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791da09700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918100ff0 0x7f79181971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791ea0b700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 0x7f791819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 -- 172.21.15.6:0/2858117660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918100ff0 msgr2=0x7f79181971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918100ff0 0x7f79181971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 -- 172.21.15.6:0/2858117660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 msgr2=0x7f791819e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 0x7f791819e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 -- 172.21.15.6:0/2858117660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140095f0 con 0x7f79180ffea0 2023-10-14T09:08:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791da09700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918100ff0 0x7f79181971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:08:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791ea0b700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 0x7f791819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T09:08:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f791e20a700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 0x7f7918196c70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f790800d950 tx=0x7f790800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908009b40 con 0x7f79180ffea0 2023-10-14T09:08:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7908009ca0 con 0x7f79180ffea0 2023-10-14T09:08:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791819edc0 con 0x7f79180ffea0 2023-10-14T09:08:46.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800f620 con 0x7f79180ffea0 2023-10-14T09:08:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.786+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791819f210 con 0x7f79180ffea0 2023-10-14T09:08:46.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.787+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791810b6a0 con 0x7f79180ffea0 2023-10-14T09:08:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.789+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7908010460 con 0x7f79180ffea0 2023-10-14T09:08:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.790+0000 7f790f7fe700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f79040a1480 0x7f79040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:46.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.790+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8240+0+0 (secure 0 0 0) 0x7f79080cd0e0 con 0x7f79180ffea0 2023-10-14T09:08:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.790+0000 7f791da09700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f79040a1480 0x7f79040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.790+0000 7f791da09700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f79040a1480 0x7f79040a3940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f791400b5c0 tx=0x7f7914005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:46.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:46.794+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7908096700 con 0x7f79180ffea0 2023-10-14T09:08:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/681153709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T09:08:46.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:46 smithi178 ceph-mon[103612]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 14 op/s 2023-10-14T09:08:46.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:46 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/3520353802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T09:08:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/681153709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T09:08:46.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:46 smithi057 ceph-mon[103313]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 14 op/s 2023-10-14T09:08:46.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:46 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/3520353802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T09:08:46.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/681153709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T09:08:46.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:46 smithi006 ceph-mon[99452]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 14 op/s 2023-10-14T09:08:46.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:46 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/3520353802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-14T09:08:47.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.041+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f791810b880 con 0x7f79180ffea0 2023-10-14T09:08:47.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.043+0000 7f790f7fe700 1 -- 172.21.15.6:0/2858117660 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7908099d20 con 0x7f79180ffea0 2023-10-14T09:08:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.047+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f79040a1480 msgr2=0x7f79040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.047+0000 7f792046e700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f79040a1480 0x7f79040a3940 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f791400b5c0 tx=0x7f7914005a90 comp rx=0 tx=0).stop 2023-10-14T09:08:47.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.047+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 msgr2=0x7f7918196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.047+0000 7f792046e700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 0x7f7918196c70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f790800d950 tx=0x7f790800dd10 comp rx=0 tx=0).stop 2023-10-14T09:08:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 shutdown_connections 2023-10-14T09:08:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f79040a1480 0x7f79040a3940 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79181019b0 0x7f791819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180ffea0 0x7f7918196c70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 --2- 172.21.15.6:0/2858117660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918100ff0 0x7f79181971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 >> 172.21.15.6:0/2858117660 conn(0x7f79180fb450 msgr2=0x7f7918068fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 shutdown_connections 2023-10-14T09:08:47.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.051+0000 7f792046e700 1 -- 172.21.15.6:0/2858117660 wait complete. 2023-10-14T09:08:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T09:08:47.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 -- 172.21.15.6:0/2124846148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d481021c0 msgr2=0x7f7d48102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 --2- 172.21.15.6:0/2124846148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d481021c0 0x7f7d48102620 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0099c0 tx=0x7f7d3c009cd0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 -- 172.21.15.6:0/2124846148 shutdown_connections 2023-10-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 --2- 172.21.15.6:0/2124846148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d48102b60 0x7f7d48109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 --2- 172.21.15.6:0/2124846148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 0x7f7d481013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 --2- 172.21.15.6:0/2124846148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d481021c0 0x7f7d48102620 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 -- 172.21.15.6:0/2124846148 >> 172.21.15.6:0/2124846148 conn(0x7f7d480fc540 msgr2=0x7f7d480fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 -- 172.21.15.6:0/2124846148 shutdown_connections 2023-10-14T09:08:47.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.205+0000 7f7d4c809700 1 -- 172.21.15.6:0/2124846148 wait complete. 2023-10-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 Processor -- start 2023-10-14T09:08:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 -- start start 2023-10-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 0x7f7d48196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d481021c0 0x7f7d481971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 0x7f7d4819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819e7b0 con 0x7f7d48102b60 2023-10-14T09:08:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819e920 con 0x7f7d48100fd0 2023-10-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4c809700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4819eae0 con 0x7f7d481021c0 2023-10-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 0x7f7d4819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 0x7f7d48196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 0x7f7d4819e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36624/0 (socket says 172.21.15.6:36624) 2023-10-14T09:08:47.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 -- 172.21.15.6:0/4214987953 learned_addr learned my addr 172.21.15.6:0/4214987953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d45d9b700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d481021c0 0x7f7d481971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 -- 172.21.15.6:0/4214987953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d481021c0 msgr2=0x7f7d481971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d481021c0 0x7f7d481971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 -- 172.21.15.6:0/4214987953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 msgr2=0x7f7d48196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 0x7f7d48196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 -- 172.21.15.6:0/4214987953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0095f0 con 0x7f7d48102b60 2023-10-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d4659c700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 0x7f7d48196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.206+0000 7f7d46d9d700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 0x7f7d4819e1e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000ef30 tx=0x7f7d4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.207+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40018070 con 0x7f7d48102b60 2023-10-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.207+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4819ed60 con 0x7f7d48102b60 2023-10-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.207+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d4000f040 con 0x7f7d48102b60 2023-10-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.207+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000cd00 con 0x7f7d48102b60 2023-10-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.207+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4819f1b0 con 0x7f7d48102b60 2023-10-14T09:08:47.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.208+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d48107f00 con 0x7f7d48102b60 2023-10-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.209+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f7d40003a00 con 0x7f7d48102b60 2023-10-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.209+0000 7f7d377fe700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.209+0000 7f7d4659c700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:47.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.209+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8670+0+0 (secure 0 0 0) 0x7f7d400cc980 con 0x7f7d48102b60 2023-10-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.210+0000 7f7d4659c700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d48198140 tx=0x7f7d38009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:47.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.214+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7d40095ec0 con 0x7f7d48102b60 2023-10-14T09:08:47.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mds[142160]: -- 172.21.15.178:0/2458809394 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e949ca91e0 con 0x55e949c7e800 2023-10-14T09:08:47.385 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: starting mds.i at 2023-10-14T09:08:47.385 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c[141787]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.385 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c[141787]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.386 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mds[141811]: -- 172.21.15.178:0/357212627 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559401ad91e0 con 0x559401aae800 2023-10-14T09:08:47.386 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c[141787]: starting mds.c at 2023-10-14T09:08:47.389 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f[141448]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.390 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f[141448]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.390 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mds[141472]: -- 172.21.15.178:0/2014895880 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56110160d1e0 con 0x5611015e2c00 2023-10-14T09:08:47.390 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f[141448]: starting mds.f at 2023-10-14T09:08:47.390 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l[141106]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.391 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l[141106]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.391 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mds[141130]: -- 172.21.15.178:0/3762203938 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e2889e51e0 con 0x55e2889bb000 2023-10-14T09:08:47.391 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l[141106]: starting mds.l at 2023-10-14T09:08:47.445 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.445 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.445 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mds[140696]: -- 172.21.15.57:0/3121670733 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5582f920b1e0 con 0x5582f91e0800 2023-10-14T09:08:47.446 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: starting mds.b at 2023-10-14T09:08:47.446 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e[139985]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.446 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e[139985]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.446 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mds[140009]: -- 172.21.15.57:0/1199503846 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7a56d11e0 con 0x55a7a56a6800 2023-10-14T09:08:47.447 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e[139985]: starting mds.e at 2023-10-14T09:08:47.447 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h[140333]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.447 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h[140333]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.448 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h[140333]: starting mds.h at 2023-10-14T09:08:47.448 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k[139643]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.448 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k[139643]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.448 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mds[139667]: -- 172.21.15.57:0/1943681560 <== mon.2 v2:172.21.15.57:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55be7150d1e0 con 0x55be714e3000 2023-10-14T09:08:47.449 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k[139643]: starting mds.k at 2023-10-14T09:08:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:47.463+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7d4802d1a0 con 0x7f7d48102b60 2023-10-14T09:08:47.481 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T09:08:47.042+0000 7f9824e6b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:08:47.482 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a[150197]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.482 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a[150197]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.482 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mds[150221]: -- 172.21.15.6:0/2487498550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5621983c31e0 con 0x562198398c00 2023-10-14T09:08:47.483 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a[150197]: starting mds.a at 2023-10-14T09:08:47.483 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: ignoring --setuser ceph since I am not root 2023-10-14T09:08:47.483 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: ignoring --setgroup ceph since I am not root 2023-10-14T09:08:47.483 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mds[149833]: -- 172.21.15.6:0/2050938842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5636c756f1e0 con 0x5636c7545000 2023-10-14T09:08:47.484 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: starting mds.g at 2023-10-14T09:08:47.484 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: 2023-10-14T09:08:47.094+0000 7f73c09a5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6838/0: (98) Address already in use 2023-10-14T09:08:47.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2438941631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:47.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2858117660' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-14T09:08:47.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-14T09:08:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:08:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-14T09:08:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2858117660' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-14T09:08:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: osdmap e85: 12 total, 12 up, 12 in 2023-10-14T09:08:47.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-14T09:08:47.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:47 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/4214987953' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-14T09:08:47.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2438941631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:47.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2858117660' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-14T09:08:47.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-14T09:08:47.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:08:47.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-14T09:08:47.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2858117660' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-14T09:08:47.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: osdmap e85: 12 total, 12 up, 12 in 2023-10-14T09:08:47.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-14T09:08:47.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:47 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/4214987953' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-14T09:08:47.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2438941631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-14T09:08:47.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2858117660' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-14T09:08:47.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-14T09:08:47.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T09:08:47.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-10-14T09:08:47.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2858117660' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-14T09:08:47.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: osdmap e85: 12 total, 12 up, 12 in 2023-10-14T09:08:47.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-14T09:08:47.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:47 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4214987953' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-14T09:08:48.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.045+0000 7f7d377fe700 1 -- 172.21.15.6:0/4214987953 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d400994e0 con 0x7f7d48102b60 2023-10-14T09:08:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 msgr2=0x7f7d300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d48198140 tx=0x7f7d38009260 comp rx=0 tx=0).stop 2023-10-14T09:08:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 msgr2=0x7f7d4819e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 0x7f7d4819e1e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000ef30 tx=0x7f7d4000c3a0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 shutdown_connections 2023-10-14T09:08:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48102b60 0x7f7d4819e1e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f7d300a1480 0x7f7d300a3940 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d48100fd0 0x7f7d48196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 --2- 172.21.15.6:0/4214987953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d481021c0 0x7f7d481971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.048+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 >> 172.21.15.6:0/4214987953 conn(0x7f7d480fc540 msgr2=0x7f7d480fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.049+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 shutdown_connections 2023-10-14T09:08:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.049+0000 7f7d4c809700 1 -- 172.21.15.6:0/4214987953 wait complete. 2023-10-14T09:08:48.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T09:08:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 -- 172.21.15.6:0/3916521449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 msgr2=0x7f68cc106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:48.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 --2- 172.21.15.6:0/3916521449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc106780 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009990 tx=0x7f68c0009ca0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 -- 172.21.15.6:0/3916521449 shutdown_connections 2023-10-14T09:08:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 --2- 172.21.15.6:0/3916521449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc106cc0 0x7f68cc109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 --2- 172.21.15.6:0/3916521449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68cc101a60 0x7f68cc103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 --2- 172.21.15.6:0/3916521449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc106780 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 -- 172.21.15.6:0/3916521449 >> 172.21.15.6:0/3916521449 conn(0x7f68cc0fb410 msgr2=0x7f68cc0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 -- 172.21.15.6:0/3916521449 shutdown_connections 2023-10-14T09:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.206+0000 7f68d4498700 1 -- 172.21.15.6:0/3916521449 wait complete. 2023-10-14T09:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 Processor -- start 2023-10-14T09:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 -- start start 2023-10-14T09:08:48.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68cc101a60 0x7f68cc196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc106cc0 0x7f68cc19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc19e770 con 0x7f68cc104390 2023-10-14T09:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc19e8e0 con 0x7f68cc101a60 2023-10-14T09:08:48.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d4498700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc19eaa0 con 0x7f68cc106cc0 2023-10-14T09:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.207+0000 7f68d1a33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36640/0 (socket says 172.21.15.6:36640) 2023-10-14T09:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 -- 172.21.15.6:0/666924293 learned_addr learned my addr 172.21.15.6:0/666924293 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d2234700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68cc101a60 0x7f68cc196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:48.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d2a35700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc106cc0 0x7f68cc19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 -- 172.21.15.6:0/666924293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc106cc0 msgr2=0x7f68cc19e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc106cc0 0x7f68cc19e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 -- 172.21.15.6:0/666924293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68cc101a60 msgr2=0x7f68cc196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68cc101a60 0x7f68cc196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:48.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 -- 172.21.15.6:0/666924293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00095f0 con 0x7f68cc104390 2023-10-14T09:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d1a33700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc197170 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f68c0000c00 tx=0x7f68c000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c001d070 con 0x7f68cc104390 2023-10-14T09:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68c000fb50 con 0x7f68cc104390 2023-10-14T09:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc19ed20 con 0x7f68cc104390 2023-10-14T09:08:48.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00173f0 con 0x7f68cc104390 2023-10-14T09:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.208+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc19f1d0 con 0x7f68cc104390 2023-10-14T09:08:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.209+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0fcf90 con 0x7f68cc104390 2023-10-14T09:08:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.210+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f68c000fcc0 con 0x7f68cc104390 2023-10-14T09:08:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.211+0000 7f68cb7fe700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f68b40a1480 0x7f68b40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.211+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8670+0+0 (secure 0 0 0) 0x7f68c00ce070 con 0x7f68cc104390 2023-10-14T09:08:48.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.211+0000 7f68d2234700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f68b40a1480 0x7f68b40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.211+0000 7f68d2234700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f68b40a1480 0x7f68b40a3940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009550 tx=0x7f68bc0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.215+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f68c00975b0 con 0x7f68cc104390 2023-10-14T09:08:48.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:48.422+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68cc02d010 con 0x7f68cc104390 2023-10-14T09:08:48.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 14 op/s 2023-10-14T09:08:48.884 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-14T09:08:48.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-14T09:08:48.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: Cluster is now healthy 2023-10-14T09:08:48.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/4214987953' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-14T09:08:48.885 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.6:6838/1667252084,v1:172.21.15.6:6840/1667252084] up:boot 2023-10-14T09:08:48.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6834/1019965184,v1:172.21.15.57:6835/1019965184] up:boot 2023-10-14T09:08:48.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.6:6839/429625153,v1:172.21.15.6:6841/429625153] up:boot 2023-10-14T09:08:48.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6832/1809813930,v1:172.21.15.57:6833/1809813930] up:boot 2023-10-14T09:08:48.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6836/116533150,v1:172.21.15.57:6837/116533150] up:boot 2023-10-14T09:08:48.886 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6838/124308929,v1:172.21.15.178:6839/124308929] up:boot 2023-10-14T09:08:48.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.57:6838/1039510719,v1:172.21.15.57:6839/1039510719] up:boot 2023-10-14T09:08:48.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6832/2581318953,v1:172.21.15.178:6833/2581318953] up:boot 2023-10-14T09:08:48.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6834/3106712113,v1:172.21.15.178:6835/3106712113] up:boot 2023-10-14T09:08:48.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: mds.? [v2:172.21.15.178:6836/2922432989,v1:172.21.15.178:6837/2922432989] up:boot 2023-10-14T09:08:48.887 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: fsmap 12 up:standby 2023-10-14T09:08:48.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-14T09:08:48.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-14T09:08:48.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-14T09:08:48.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-14T09:08:48.888 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-14T09:08:48.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-14T09:08:48.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-14T09:08:48.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-14T09:08:48.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-14T09:08:48.889 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-14T09:08:48.890 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:48 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/666924293' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-14T09:08:48.944 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 14 op/s 2023-10-14T09:08:48.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-14T09:08:48.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-14T09:08:48.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: Cluster is now healthy 2023-10-14T09:08:48.945 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/4214987953' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-14T09:08:48.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.6:6838/1667252084,v1:172.21.15.6:6840/1667252084] up:boot 2023-10-14T09:08:48.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6834/1019965184,v1:172.21.15.57:6835/1019965184] up:boot 2023-10-14T09:08:48.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.6:6839/429625153,v1:172.21.15.6:6841/429625153] up:boot 2023-10-14T09:08:48.946 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6832/1809813930,v1:172.21.15.57:6833/1809813930] up:boot 2023-10-14T09:08:48.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6836/116533150,v1:172.21.15.57:6837/116533150] up:boot 2023-10-14T09:08:48.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6838/124308929,v1:172.21.15.178:6839/124308929] up:boot 2023-10-14T09:08:48.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.57:6838/1039510719,v1:172.21.15.57:6839/1039510719] up:boot 2023-10-14T09:08:48.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6832/2581318953,v1:172.21.15.178:6833/2581318953] up:boot 2023-10-14T09:08:48.947 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6834/3106712113,v1:172.21.15.178:6835/3106712113] up:boot 2023-10-14T09:08:48.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: mds.? [v2:172.21.15.178:6836/2922432989,v1:172.21.15.178:6837/2922432989] up:boot 2023-10-14T09:08:48.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: fsmap 12 up:standby 2023-10-14T09:08:48.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-14T09:08:48.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-14T09:08:48.948 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-14T09:08:48.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-14T09:08:48.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-14T09:08:48.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-14T09:08:48.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-14T09:08:48.949 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-14T09:08:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-14T09:08:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-14T09:08:48.950 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:48 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/666924293' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-14T09:08:48.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 14 op/s 2023-10-14T09:08:48.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-14T09:08:48.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-14T09:08:48.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: Cluster is now healthy 2023-10-14T09:08:48.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/4214987953' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-14T09:08:48.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.6:6838/1667252084,v1:172.21.15.6:6840/1667252084] up:boot 2023-10-14T09:08:48.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6834/1019965184,v1:172.21.15.57:6835/1019965184] up:boot 2023-10-14T09:08:48.983 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.6:6839/429625153,v1:172.21.15.6:6841/429625153] up:boot 2023-10-14T09:08:48.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6832/1809813930,v1:172.21.15.57:6833/1809813930] up:boot 2023-10-14T09:08:48.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6836/116533150,v1:172.21.15.57:6837/116533150] up:boot 2023-10-14T09:08:48.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6838/124308929,v1:172.21.15.178:6839/124308929] up:boot 2023-10-14T09:08:48.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.57:6838/1039510719,v1:172.21.15.57:6839/1039510719] up:boot 2023-10-14T09:08:48.984 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6832/2581318953,v1:172.21.15.178:6833/2581318953] up:boot 2023-10-14T09:08:48.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6834/3106712113,v1:172.21.15.178:6835/3106712113] up:boot 2023-10-14T09:08:48.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: mds.? [v2:172.21.15.178:6836/2922432989,v1:172.21.15.178:6837/2922432989] up:boot 2023-10-14T09:08:48.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: fsmap 12 up:standby 2023-10-14T09:08:48.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-14T09:08:48.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-14T09:08:48.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-14T09:08:48.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-14T09:08:48.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-14T09:08:48.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-14T09:08:48.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-14T09:08:48.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-14T09:08:48.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-14T09:08:48.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-14T09:08:48.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:48 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/666924293' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-14T09:08:49.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.047+0000 7f68cb7fe700 1 -- 172.21.15.6:0/666924293 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68c009abd0 con 0x7f68cc104390 2023-10-14T09:08:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f68b40a1480 msgr2=0x7f68b40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f68b40a1480 0x7f68b40a3940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009550 tx=0x7f68bc0091b0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 msgr2=0x7f68cc197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:49.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc197170 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f68c0000c00 tx=0x7f68c000f710 comp rx=0 tx=0).stop 2023-10-14T09:08:49.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 shutdown_connections 2023-10-14T09:08:49.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc106cc0 0x7f68cc19e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f68b40a1480 0x7f68b40a3940 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68cc101a60 0x7f68cc196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 --2- 172.21.15.6:0/666924293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68cc104390 0x7f68cc197170 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 >> 172.21.15.6:0/666924293 conn(0x7f68cc0fb410 msgr2=0x7f68cc1026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:49.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 shutdown_connections 2023-10-14T09:08:49.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.052+0000 7f68d4498700 1 -- 172.21.15.6:0/666924293 wait complete. 2023-10-14T09:08:49.057 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-10-14T09:08:49.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T09:08:49.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 -- 172.21.15.6:0/1637224338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c1021d0 msgr2=0x7f630c102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:49.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 --2- 172.21.15.6:0/1637224338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c1021d0 0x7f630c102630 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f63000099c0 tx=0x7f6300009cd0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 -- 172.21.15.6:0/1637224338 shutdown_connections 2023-10-14T09:08:49.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 --2- 172.21.15.6:0/1637224338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c102b70 0x7f630c109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 --2- 172.21.15.6:0/1637224338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c100fe0 0x7f630c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 --2- 172.21.15.6:0/1637224338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c1021d0 0x7f630c102630 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 -- 172.21.15.6:0/1637224338 >> 172.21.15.6:0/1637224338 conn(0x7f630c0fc530 msgr2=0x7f630c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 -- 172.21.15.6:0/1637224338 shutdown_connections 2023-10-14T09:08:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.208+0000 7f63126a0700 1 -- 172.21.15.6:0/1637224338 wait complete. 2023-10-14T09:08:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 Processor -- start 2023-10-14T09:08:49.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 -- start start 2023-10-14T09:08:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c100fe0 0x7f630c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c1021d0 0x7f630c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 0x7f630c19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:49.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c19e7c0 con 0x7f630c102b70 2023-10-14T09:08:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c19e930 con 0x7f630c100fe0 2023-10-14T09:08:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.209+0000 7f63126a0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c19eaf0 con 0x7f630c1021d0 2023-10-14T09:08:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 0x7f630c19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 0x7f630c19e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36656/0 (socket says 172.21.15.6:36656) 2023-10-14T09:08:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 -- 172.21.15.6:0/2428380379 learned_addr learned my addr 172.21.15.6:0/2428380379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-10-14T09:08:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f630bfff700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c100fe0 0x7f630c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f630b7fe700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c1021d0 0x7f630c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 -- 172.21.15.6:0/2428380379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c1021d0 msgr2=0x7f630c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c1021d0 0x7f630c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 -- 172.21.15.6:0/2428380379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c100fe0 msgr2=0x7f630c196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c100fe0 0x7f630c196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 -- 172.21.15.6:0/2428380379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000095f0 con 0x7f630c102b70 2023-10-14T09:08:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f6310c3d700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 0x7f630c19e1f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f630400ada0 tx=0x7f630400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400f070 con 0x7f630c102b70 2023-10-14T09:08:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6304007b30 con 0x7f630c102b70 2023-10-14T09:08:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c19edd0 con 0x7f630c102b70 2023-10-14T09:08:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304005280 con 0x7f630c102b70 2023-10-14T09:08:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.210+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c19f1d0 con 0x7f630c102b70 2023-10-14T09:08:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.211+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c107ee0 con 0x7f630c102b70 2023-10-14T09:08:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.213+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 136002+0+0 (secure 0 0 0) 0x7f630400c8d0 con 0x7f630c102b70 2023-10-14T09:08:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.213+0000 7f63097fa700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f40a1480 0x7f62f40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T09:08:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.213+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8087+0+0 (secure 0 0 0) 0x7f63040cc1b0 con 0x7f630c102b70 2023-10-14T09:08:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.213+0000 7f630bfff700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f40a1480 0x7f62f40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T09:08:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.214+0000 7f630bfff700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f40a1480 0x7f62f40a3940 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f630c198150 tx=0x7f62fc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T09:08:49.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.218+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6304099410 con 0x7f630c102b70 2023-10-14T09:08:49.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:49.419+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f630c10c800 con 0x7f630c102b70 2023-10-14T09:08:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.054+0000 7f63097fa700 1 -- 172.21.15.6:0/2428380379 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6304098fa0 con 0x7f630c102b70 2023-10-14T09:08:50.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f40a1480 msgr2=0x7f62f40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f40a1480 0x7f62f40a3940 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f630c198150 tx=0x7f62fc00a380 comp rx=0 tx=0).stop 2023-10-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 msgr2=0x7f630c19e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 0x7f630c19e1f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f630400ada0 tx=0x7f630400c330 comp rx=0 tx=0).stop 2023-10-14T09:08:50.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 shutdown_connections 2023-10-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f630c102b70 0x7f630c19e1f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.6:6800/827561147,v1:172.21.15.6:6801/827561147] conn(0x7f62f40a1480 0x7f62f40a3940 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f630c100fe0 0x7f630c196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 --2- 172.21.15.6:0/2428380379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f630c1021d0 0x7f630c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T09:08:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.057+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 >> 172.21.15.6:0/2428380379 conn(0x7f630c0fc530 msgr2=0x7f630c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.058+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 shutdown_connections 2023-10-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-10-14T09:08:50.058+0000 7f63126a0700 1 -- 172.21.15.6:0/2428380379 wait complete. 2023-10-14T09:08:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-10-14T09:08:50.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-14T09:08:50.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-14T09:08:50.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-14T09:08:50.245 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-14T09:08:50.246 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-14T09:08:50.263 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-14T09:08:50.281 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-14T09:08:50.303 INFO:tasks.cephadm:Stopping all daemons... 2023-10-14T09:08:50.303 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-14T09:08:50.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a 2023-10-14T09:08:50.328 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/666924293' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-14T09:08:50.328 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-mon[99452]: osdmap e86: 12 total, 12 up, 12 in 2023-10-14T09:08:50.328 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-mon[99452]: from='client.? 172.21.15.6:0/2428380379' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-14T09:08:50.329 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-mon[99452]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:08:50.329 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-mon[99452]: pgmap v789: 65 pgs: 65 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T09:08:50.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:50 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/666924293' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-14T09:08:50.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:50 smithi178 ceph-mon[103612]: osdmap e86: 12 total, 12 up, 12 in 2023-10-14T09:08:50.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:50 smithi178 ceph-mon[103612]: from='client.? 172.21.15.6:0/2428380379' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-14T09:08:50.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:50 smithi178 ceph-mon[103612]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:08:50.385 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:50 smithi178 ceph-mon[103612]: pgmap v789: 65 pgs: 65 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T09:08:50.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:50 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/666924293' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-14T09:08:50.444 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:50 smithi057 ceph-mon[103313]: osdmap e86: 12 total, 12 up, 12 in 2023-10-14T09:08:50.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:50 smithi057 ceph-mon[103313]: from='client.? 172.21.15.6:0/2428380379' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-14T09:08:50.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:50 smithi057 ceph-mon[103313]: from='mgr.14152 172.21.15.6:0/1543991151' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-14T09:08:50.445 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:50 smithi057 ceph-mon[103313]: pgmap v789: 65 pgs: 65 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-14T09:08:50.661 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 systemd[1]: Stopping Ceph mon.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:50.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T09:08:50.659+0000 7f982a676700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:08:50.982 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:50 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a[99428]: 2023-10-14T09:08:50.659+0000 7f982a676700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-14T09:08:51.482 INFO:journalctl@ceph.mon.a.smithi006.stdout:Oct 14 09:08:51 smithi006 bash[174621]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-a 2023-10-14T09:08:51.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.a.service' 2023-10-14T09:08:51.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:08:51.737 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-14T09:08:51.737 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-14T09:08:51.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.b 2023-10-14T09:08:52.103 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:51 smithi057 systemd[1]: Stopping Ceph mon.b for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:52.374 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-b[103289]: 2023-10-14T09:08:52.100+0000 7fb505b9a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:08:52.374 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-b[103289]: 2023-10-14T09:08:52.100+0000 7fb505b9a700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-14T09:08:52.646 INFO:journalctl@ceph.mon.b.smithi057.stdout:Oct 14 09:08:52 smithi057 bash[146041]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-b 2023-10-14T09:08:52.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.b.service' 2023-10-14T09:08:52.708 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:08:52.709 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-14T09:08:52.709 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-14T09:08:52.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.c 2023-10-14T09:08:53.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:52 smithi178 systemd[1]: Stopping Ceph mon.c for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:53.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-c[103588]: 2023-10-14T09:08:53.060+0000 7f32e64f2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:08:53.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-c[103588]: 2023-10-14T09:08:53.060+0000 7f32e64f2700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-14T09:08:53.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.c.service' 2023-10-14T09:08:53.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:53 smithi178 bash[148514]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mon-c 2023-10-14T09:08:53.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:53 smithi178 systemd[1]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mon.c.service: Succeeded. 2023-10-14T09:08:53.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Oct 14 09:08:53 smithi178 systemd[1]: Stopped Ceph mon.c for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T09:08:53.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:08:53.811 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-14T09:08:53.812 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-14T09:08:53.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x 2023-10-14T09:08:54.170 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 09:08:53 smithi006 systemd[1]: Stopping Ceph mgr.x for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:54.170 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 09:08:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T09:08:54.167+0000 7f994a0c4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:08:54.171 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 09:08:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x[99696]: 2023-10-14T09:08:54.167+0000 7f994a0c4700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-14T09:08:54.481 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Oct 14 09:08:54 smithi006 bash[174768]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-x 2023-10-14T09:08:54.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.x.service' 2023-10-14T09:08:54.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:08:54.648 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-14T09:08:54.649 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-14T09:08:54.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.y 2023-10-14T09:08:54.944 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 09:08:54 smithi057 systemd[1]: Stopping Ceph mgr.y for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:55.365 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 09:08:55 smithi057 bash[146191]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-y 2023-10-14T09:08:55.552 INFO:journalctl@ceph.mgr.y.smithi057.stdout:Oct 14 09:08:55 smithi057 systemd[1]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-14T09:08:55.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.y.service' 2023-10-14T09:08:55.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:08:55.594 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-14T09:08:55.595 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-14T09:08:55.595 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.z 2023-10-14T09:08:55.884 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 09:08:55 smithi178 systemd[1]: Stopping Ceph mgr.z for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:56.303 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 09:08:56 smithi178 bash[148664]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mgr-z 2023-10-14T09:08:56.483 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Oct 14 09:08:56 smithi178 systemd[1]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-14T09:08:56.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mgr.z.service' 2023-10-14T09:08:56.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:08:56.525 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-14T09:08:56.525 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-14T09:08:56.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.0 2023-10-14T09:08:56.929 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 09:08:56 smithi006 systemd[1]: Stopping Ceph osd.0 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:08:57.234 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 09:08:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0[118216]: 2023-10-14T09:08:56.926+0000 7f383cb81700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:08:57.235 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 09:08:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0[118216]: 2023-10-14T09:08:56.926+0000 7f383cb81700 -1 osd.0 87 *** Got signal Terminated *** 2023-10-14T09:08:57.235 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 09:08:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0[118216]: 2023-10-14T09:08:56.926+0000 7f383cb81700 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:02.982 INFO:journalctl@ceph.osd.0.smithi006.stdout:Oct 14 09:09:02 smithi006 bash[174913]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-0 2023-10-14T09:09:04.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.0.service' 2023-10-14T09:09:04.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:04.079 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-14T09:09:04.079 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-14T09:09:04.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.1 2023-10-14T09:09:04.445 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 09:09:04 smithi057 systemd[1]: Stopping Ceph osd.1 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:04.944 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 09:09:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1[108392]: 2023-10-14T09:09:04.447+0000 7f596cd0d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:04.945 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 09:09:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1[108392]: 2023-10-14T09:09:04.447+0000 7f596cd0d700 -1 osd.1 87 *** Got signal Terminated *** 2023-10-14T09:09:04.945 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 09:09:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1[108392]: 2023-10-14T09:09:04.447+0000 7f596cd0d700 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:10.694 INFO:journalctl@ceph.osd.1.smithi057.stdout:Oct 14 09:09:10 smithi057 bash[146337]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-1 2023-10-14T09:09:11.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.1.service' 2023-10-14T09:09:11.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:11.834 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-14T09:09:11.835 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-14T09:09:11.835 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.2 2023-10-14T09:09:12.134 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 09:09:11 smithi178 systemd[1]: Stopping Ceph osd.2 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:12.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 09:09:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2[109415]: 2023-10-14T09:09:12.199+0000 7fd2f27f7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:12.634 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 09:09:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2[109415]: 2023-10-14T09:09:12.199+0000 7fd2f27f7700 -1 osd.2 87 *** Got signal Terminated *** 2023-10-14T09:09:12.635 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 09:09:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2[109415]: 2023-10-14T09:09:12.199+0000 7fd2f27f7700 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:18.384 INFO:journalctl@ceph.osd.2.smithi178.stdout:Oct 14 09:09:17 smithi178 bash[148816]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-2 2023-10-14T09:09:19.347 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.2.service' 2023-10-14T09:09:19.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:19.388 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-14T09:09:19.388 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-14T09:09:19.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.3 2023-10-14T09:09:19.731 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 09:09:19 smithi006 systemd[1]: Stopping Ceph osd.3 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:20.231 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 09:09:19 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T09:09:19.789+0000 7f2873060700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:20.232 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 09:09:19 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T09:09:19.789+0000 7f2873060700 -1 osd.3 87 *** Got signal Terminated *** 2023-10-14T09:09:20.232 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 09:09:19 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T09:09:19.789+0000 7f2873060700 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:23.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:23.156+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:24.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:23 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:23.923+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:24.231 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 09:09:23 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3[126198]: 2023-10-14T09:09:23.976+0000 7f286de53700 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.605525+0000 front 2023-10-14T09:08:58.605556+0000 (oldest deadline 2023-10-14T09:09:23.305749+0000) 2023-10-14T09:09:24.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:23 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:23.936+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:24.384 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:24.132+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:24.981 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:24 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:24.911+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:24.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:24 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:24.661+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:25.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:24 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:24.915+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:25.542 INFO:journalctl@ceph.osd.3.smithi006.stdout:Oct 14 09:09:25 smithi006 bash[175178]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-3 2023-10-14T09:09:25.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:25 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:25.141+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:25.981 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:25 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:25.692+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:25.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:25 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:25.921+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:26.444 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:25 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:25.952+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:26.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:26 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:26.169+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:26.809 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:26 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:26.678+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:26.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.3.service' 2023-10-14T09:09:26.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:26.859 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-14T09:09:26.859 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-14T09:09:26.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.4 2023-10-14T09:09:27.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:26 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:26.758+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:27.194 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 09:09:26 smithi057 systemd[1]: Stopping Ceph osd.4 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:27.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:26 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:26.910+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:27.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:26 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:26.958+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:27.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:27 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:27.144+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:27.694 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 09:09:27 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4[116945]: 2023-10-14T09:09:27.217+0000 7f9bf48fe700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:27.695 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 09:09:27 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4[116945]: 2023-10-14T09:09:27.217+0000 7f9bf48fe700 -1 osd.4 87 *** Got signal Terminated *** 2023-10-14T09:09:27.695 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 09:09:27 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4[116945]: 2023-10-14T09:09:27.217+0000 7f9bf48fe700 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:27.981 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:27 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:27.633+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:28.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:27 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:27.757+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:28.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:27 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:27.872+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:28.481 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:27 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:27.995+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:28.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:28 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:28.151+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:28.981 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:28.612+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:29.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:28 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:28.720+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:29.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:28 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:28.840+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:29.481 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:28 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:28.994+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:29.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:29 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:29.159+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:29.961 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:29.586+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:30.130 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:29 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:29.672+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:30.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:29 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:29.790+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:30.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:29 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:29.960+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:30.384 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:30 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:30.129+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:30.919 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:30.625+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:31.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:30 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:30.682+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:31.153 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:30 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:30.768+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:31.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:30.917+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:31.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:30 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:30.917+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:31.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:31 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:31.151+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:31.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:31 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:31.155+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:31.914 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:31 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:31.624+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:32.120 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:31 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:31.727+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:32.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:31 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:31.670+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:32.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:31 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:31.670+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:32.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:31 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:31.913+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:32.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:31 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:31.913+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:32.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:32 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:32.119+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:32.634 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:32 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:32.200+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:32.877 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:32.590+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:33.076 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:32 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:32.726+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:33.076 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:32 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:32.726+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:33.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:32 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:32.700+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:33.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:32 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:32.700+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:33.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:32.876+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:33.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:32.876+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:33.444 INFO:journalctl@ceph.osd.4.smithi057.stdout:Oct 14 09:09:33 smithi057 bash[146613]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-4 2023-10-14T09:09:33.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:33 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:33.162+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:33.583 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:33 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:33.161+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:33.845 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:33.573+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:33.845 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:33.573+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:33.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:33 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:33.696+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:33.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:33 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:33.696+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:33.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:33 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:33.580+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:33.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:33 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:33.772+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:33.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:33 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:33.772+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:34.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:33.843+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:34.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:33 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:33.843+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:34.368 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:34 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:34.183+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:34.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.4.service' 2023-10-14T09:09:34.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:34.415 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-14T09:09:34.415 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-14T09:09:34.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.5 2023-10-14T09:09:34.446 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:34.191+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:34.446 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:34.191+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.696947+0000 front 2023-10-14T09:09:08.696827+0000 (oldest deadline 2023-10-14T09:09:33.297640+0000) 2023-10-14T09:09:34.771 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:34.547+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:34.772 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:34.656+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:34.772 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:34.656+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:34.772 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:34 smithi178 systemd[1]: Stopping Ceph osd.5 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:34.859 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:34.578+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:34.859 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:34.578+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:35.134 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:34.769+0000 7f17085f2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:35.134 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:34.769+0000 7f17085f2700 -1 osd.5 87 *** Got signal Terminated *** 2023-10-14T09:09:35.134 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:34 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:34.769+0000 7f17085f2700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:35.186 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:34 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:34.779+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:35.187 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:34 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:34.779+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:35.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:34.857+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:35.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:34.857+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:35.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:35 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:35.185+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:35.581 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:35 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:35.225+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:35.581 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:35 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:35.225+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.696947+0000 front 2023-10-14T09:09:08.696827+0000 (oldest deadline 2023-10-14T09:09:33.297640+0000) 2023-10-14T09:09:35.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:35 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:35.578+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:35.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:35 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:35.647+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:35.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:35 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:35.647+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:35.981 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:35.628+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:35.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:35.628+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:35.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:35.850+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:35.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:35 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:35.850+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:36.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:35 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:35.742+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:36.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:35 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:35.742+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:36.574 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:36 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:36.195+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:36.574 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:36 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:36.195+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.696947+0000 front 2023-10-14T09:09:08.696827+0000 (oldest deadline 2023-10-14T09:09:33.297640+0000) 2023-10-14T09:09:36.694 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:36 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:36.194+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:36.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:36 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:36.572+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:36.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:36 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:36.664+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:36.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:36 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:36.664+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:36.900 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:36.632+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:36.900 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:36.632+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:37.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:36 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:36.706+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:37.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:36 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:36.706+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:37.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:36.899+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:37.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:36 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:36.899+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:37.604 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:37 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:37.183+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:37.605 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:37 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:37.183+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.696947+0000 front 2023-10-14T09:09:08.696827+0000 (oldest deadline 2023-10-14T09:09:33.297640+0000) 2023-10-14T09:09:37.694 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:37 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:37.196+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:37.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:37 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:37.603+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:37.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:37 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:37.680+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:37.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:37 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:37.680+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:37.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:37 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:37.652+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:37.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:37 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:37.652+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:37.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:37 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:37.887+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:37.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:37 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:37.887+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:38.169 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:37 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:37.729+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:38.169 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:37 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:37.729+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:38.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:38 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:38.167+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:38.605 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:38 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:38.180+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:38.605 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:38 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:38.180+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.696947+0000 front 2023-10-14T09:09:08.696827+0000 (oldest deadline 2023-10-14T09:09:33.297640+0000) 2023-10-14T09:09:38.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:38 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:38.603+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:38.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:38 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:38.632+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:38.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:38 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:38.632+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:38.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:38 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:38.640+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:38.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:38 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:38.640+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:38.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:38 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:38.845+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:38.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:38 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:38.845+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:38.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:38 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:38.845+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:39.125 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:38 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:38.749+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:39.125 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:38 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:38.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:39.126 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:38 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:38.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:39.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:39 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:39.123+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:39.620 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:39.143+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:59.895368+0000 front 2023-10-14T09:08:59.895317+0000 (oldest deadline 2023-10-14T09:09:22.795721+0000) 2023-10-14T09:09:39.620 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:39.143+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.696947+0000 front 2023-10-14T09:09:08.696827+0000 (oldest deadline 2023-10-14T09:09:33.297640+0000) 2023-10-14T09:09:39.621 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5[117364]: 2023-10-14T09:09:39.143+0000 7f1703be6700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.598694+0000 front 2023-10-14T09:09:15.598721+0000 (oldest deadline 2023-10-14T09:09:39.098829+0000) 2023-10-14T09:09:39.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:39.618+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:39.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:39.654+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:39.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:39.654+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:39.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:39 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:39.654+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:39.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:39.645+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:39.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:39.645+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:39.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:39.810+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:39.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:39.810+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:39.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:39.810+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:40.115 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:39 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:39.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:40.116 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:39 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:39.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:40.116 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:39 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:39.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:40.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:40 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:40.114+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:40.630 INFO:journalctl@ceph.osd.5.smithi178.stdout:Oct 14 09:09:40 smithi178 bash[149086]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-5 2023-10-14T09:09:40.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:40 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:40.649+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:40.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:40 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:40.649+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:40.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:40 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:40.627+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:40.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:40 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:40.628+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:40.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:40 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:40.628+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:40.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:40 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:40.627+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:40.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:40 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:40.627+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:40.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:40 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:40.627+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:40.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:40 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:40.841+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:40.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:40 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:40.841+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:40.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:40 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:40.841+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:41.113 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:40 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:40.800+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:41.114 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:40 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:40.800+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:41.114 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:40 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:40.800+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:41.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:41 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:41.111+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:41.804 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:41 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:41.620+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:41.804 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:41 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:41.620+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:41.805 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:41 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:41.636+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:41.805 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:41 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:41.636+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:41.805 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:41 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:41.636+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:41.812 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.5.service' 2023-10-14T09:09:41.891 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:41.892 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-14T09:09:41.892 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-14T09:09:41.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.6 2023-10-14T09:09:41.926 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:41.807+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:41.926 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:41.807+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:41.926 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:41.807+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:41.927 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:41.616+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:41.927 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:41.616+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:41.927 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:41 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:41.616+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:42.128 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:41 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:41.807+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:42.129 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:41 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:41.807+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:42.129 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:41 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:41.807+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:42.231 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:41 smithi006 systemd[1]: Stopping Ceph osd.6 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:42.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:42 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:42.127+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:42.660 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:42.261+0000 7f1b7368d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:42.660 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:42.261+0000 7f1b7368d700 -1 osd.6 87 *** Got signal Terminated *** 2023-10-14T09:09:42.660 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:42.261+0000 7f1b7368d700 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:42.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:42 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:42.587+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:42.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:42 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:42.587+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:42.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:42 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:42.618+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:42.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:42 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:42.618+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:42.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:42 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:42.618+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:42.981 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:42.658+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:42.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:42.658+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:42.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:42.658+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:42.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:42.843+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:42.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:42.843+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:42.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:42 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:42.843+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:43.160 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:42 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:42.786+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:43.161 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:42 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:42.786+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:43.161 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:42 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:42.786+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:43.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:43 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:43.159+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:43.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:43 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:43.159+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:43.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:43 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:43.606+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:43.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:43 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:43.606+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:43.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:43 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:43.618+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:43.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:43 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:43.618+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:43.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:43 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:43.618+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:43.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:43.669+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:43.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:43.669+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:43.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:43.669+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:43.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:43.819+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:43.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:43.819+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:43.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:43 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:43.819+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:44.157 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:43 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:43.744+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:44.158 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:43 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:43.744+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:44.158 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:43 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:43.744+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:44.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:44.156+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:44.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:44.156+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:44.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:44 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:44.570+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:44.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:44 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:44.570+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:44.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:44 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:44.638+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:44.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:44 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:44.638+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:44.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:44 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:44.638+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:44.981 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:44 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:44.642+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:44.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:44 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:44.642+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:44.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:44 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:44.642+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:44.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:44 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:44.860+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:44.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:44 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:44.860+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:44.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:44 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:44.860+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:45.156 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:44.738+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:45.156 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:44.738+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:45.156 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:44.738+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:45.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:45 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:45.154+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:45.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:45 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:45.154+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:45.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:45 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:45.586+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:45.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:45 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:45.586+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:45.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:45 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:45.586+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:45.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:45 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:45.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:45.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:45 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:45.596+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:45.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:45 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:45.596+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:45.981 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:45 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:45.886+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:45.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:45 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:45.886+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:45.982 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:45 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:45.886+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:45.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:45 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:45.664+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:45.983 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:45 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:45.664+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:45.983 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:45 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:45.664+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:46.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:45 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:45.768+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:46.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:45 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:45.768+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:46.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:45 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:45.768+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:46.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:45 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:45.768+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:46.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:46.192+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:46.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:46.192+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:46.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:46.192+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:46.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:46.539+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:46.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:46.539+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:46.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:46.539+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:46.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:46.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:46.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:46.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:46.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:46 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:46.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:46.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:46 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:46.671+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:08:58.831015+0000 front 2023-10-14T09:08:58.830947+0000 (oldest deadline 2023-10-14T09:09:24.131114+0000) 2023-10-14T09:09:46.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:46 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:46.671+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.333156+0000 front 2023-10-14T09:09:09.332921+0000 (oldest deadline 2023-10-14T09:09:32.832704+0000) 2023-10-14T09:09:46.982 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:46 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6[134142]: 2023-10-14T09:09:46.671+0000 7f1b6ec81700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.133878+0000 front 2023-10-14T09:09:15.133864+0000 (oldest deadline 2023-10-14T09:09:40.433687+0000) 2023-10-14T09:09:46.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:46 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:46.855+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:46.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:46 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:46.855+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:46.983 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:46 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:46.855+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:47.162 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:46.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:47.162 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:46.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:47.162 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:46.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:47.162 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:46 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:46.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:47.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:47.160+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:47.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:47.160+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:47.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:47.160+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:47.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:47.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:47.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:47.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:47.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:47.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:47.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:47.540+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:47.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:47.540+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:47.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:47 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:47.540+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:48.159 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:47.787+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:48.160 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:47.787+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:48.160 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:47.787+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:48.160 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:47 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:47.787+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:48.232 INFO:journalctl@ceph.osd.6.smithi006.stdout:Oct 14 09:09:47 smithi006 bash[175453]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-6 2023-10-14T09:09:48.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:47.891+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:48.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:47.891+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:48.233 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:47 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:47.891+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:48.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:48.158+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:48.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:48.158+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:48.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:48.158+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:48.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:48 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:48.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:48.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:48 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:48.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:48.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:48 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:48.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:48.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:48 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:48.565+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:48.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:48 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:48.565+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:48.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:48 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:48.565+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:49.112 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:48 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:48.879+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:49.113 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:48 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:48.879+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:49.113 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:48 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:48.879+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:49.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:48.772+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:49.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:48.772+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:49.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:48.772+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:49.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:48.772+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:49.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.6.service' 2023-10-14T09:09:49.515 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:49.516 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-14T09:09:49.516 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-14T09:09:49.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.7 2023-10-14T09:09:49.548 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:49.201+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:49.548 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:49.201+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:49.548 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:49.201+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:49.818 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 systemd[1]: Stopping Ceph osd.7 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:49.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:49 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:49.511+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:49.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:49 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:49.511+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:49.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:49 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:49.511+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:49.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:49 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:49.547+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:49.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:49 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:49.547+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:49.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:49 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:49.547+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:50.163 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:49.873+0000 7fb140bdd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:50.163 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:49.873+0000 7fb140bdd700 -1 osd.7 87 *** Got signal Terminated *** 2023-10-14T09:09:50.163 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:49.873+0000 7fb140bdd700 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:50.164 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:50.161+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:50.164 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:49.817+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:50.164 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:49.817+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:50.164 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:49.817+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:50.165 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:49 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:49.817+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:50.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:49 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:49.925+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:50.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:49 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:49.925+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:50.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:49 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:49.925+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:50.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:50.161+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:50.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:50.161+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:50.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:50 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:50.583+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:50.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:50 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:50.583+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:50.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:50 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:50.583+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:50.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:50 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:50.518+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:50.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:50 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:50.518+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:50.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:50 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:50.518+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:51.118 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:50.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:51.119 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:50.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:51.119 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:50.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:51.119 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:50 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:50.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:51.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:50 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:50.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:51.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:50 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:50.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:51.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:50 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:50.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:51.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:50 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:50.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:51.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:51.117+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:51.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:51.117+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:51.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:51.117+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:51.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:51 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:51.587+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:51.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:51 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:51.587+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:51.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:51 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:51.587+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:51.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:51 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:51.484+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:51.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:51 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:51.484+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:51.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:51 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:51.484+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:52.132 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:51.775+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:52.133 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:51.775+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:52.133 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:51.775+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:52.133 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:51 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:51.775+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:52.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:51 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:51.923+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:52.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:51 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:51.923+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:52.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:51 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:51.923+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:52.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:51 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:51.923+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:52.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:52.131+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:52.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:52.131+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:52.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:52.131+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:52.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:52 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:52.589+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:52.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:52 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:52.589+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:52.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:52 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:52.589+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:52.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:52 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:52.518+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:52.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:52 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:52.518+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:52.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:52 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:52.518+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:53.113 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:52.804+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:53.113 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:52.804+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:53.114 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:52.804+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:53.114 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:52.804+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:53.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:52 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:52.880+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:53.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:52 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:52.880+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:53.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:52 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:52.880+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:53.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:52 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:52.880+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:53.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:53.111+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:53.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:53.111+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:53.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:53.111+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:53.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:53.573+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:53.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:53.573+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:53.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:53.573+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:53.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:53.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:53.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:53.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:53.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:53 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:53.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:54.070 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:53.765+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:54.070 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:53.765+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:54.071 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:53.765+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:54.071 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:53 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:53.765+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:54.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:53 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:53.892+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:54.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:53 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:53.892+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:54.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:53 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:53.892+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:54.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:53 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:53.892+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:54.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:54.069+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:07.135048+0000 front 2023-10-14T09:09:07.135013+0000 (oldest deadline 2023-10-14T09:09:30.635265+0000) 2023-10-14T09:09:54.444 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:54.069+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.536499+0000 front 2023-10-14T09:09:16.536559+0000 (oldest deadline 2023-10-14T09:09:42.436343+0000) 2023-10-14T09:09:54.445 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7[124888]: 2023-10-14T09:09:54.069+0000 7fb13d1d3700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:22.436860+0000 front 2023-10-14T09:09:22.437086+0000 (oldest deadline 2023-10-14T09:09:45.337051+0000) 2023-10-14T09:09:54.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:54.528+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:54.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:54.528+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:54.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:54.528+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:54.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:54.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:54.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:54.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:54.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:54.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:54.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:54 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:54.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:09:55.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:54.722+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:55.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:54.722+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:55.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:54.722+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:55.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:54.722+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:55.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:54 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:54.722+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:09:55.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:54.942+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:55.239 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:54.942+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:55.240 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:54.942+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:55.240 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:54.942+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:55.240 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:54 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:54.942+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:09:55.663 INFO:journalctl@ceph.osd.7.smithi057.stdout:Oct 14 09:09:55 smithi057 bash[146881]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-7 2023-10-14T09:09:55.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:55.525+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:55.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:55.525+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:55.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:55.525+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:55.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:55.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:55.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:55.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:55.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:55.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:55.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:55 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:55.564+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:09:56.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:55 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:55.732+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:56.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:55 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:55.732+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:56.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:55 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:55.732+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:56.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:55 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:55.732+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:56.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:55 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:55.732+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:09:56.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:55.908+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:56.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:55.908+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:56.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:55.908+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:56.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:55.908+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:56.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:55 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:55.908+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:09:56.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:56.499+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:56.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:56.499+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:56.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:56.499+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:56.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:56.499+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:09:56.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:56.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:56.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:56.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:56.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:56.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:56.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:56 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:56.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:09:56.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:56.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:56.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:56.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:56.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:56.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:56.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:56.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:56.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:56.776+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:09:57.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.7.service' 2023-10-14T09:09:57.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:09:57.122 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-14T09:09:57.122 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-14T09:09:57.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.8 2023-10-14T09:09:57.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:56.953+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:57.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:56.953+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:57.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:56.953+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:57.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:56.953+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:57.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:56 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:56.953+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:09:57.473 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 systemd[1]: Stopping Ceph osd.8 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:09:57.474 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.471+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:57.474 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.471+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:57.474 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.471+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:57.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:57.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:57.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:57.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:57.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:57.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:57.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:57.517+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:09:57.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.471+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:09:57.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.481+0000 7ff6cd276700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:09:57.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.481+0000 7ff6cd276700 -1 osd.8 87 *** Got signal Terminated *** 2023-10-14T09:09:57.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:57 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:57.481+0000 7ff6cd276700 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:09:58.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:57 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:57.803+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:58.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:57 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:57.803+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:58.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:57 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:57.803+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:58.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:57 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:57.803+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:58.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:57 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:57.803+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:09:58.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:57 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:57.945+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:58.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:57 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:57.945+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:58.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:57 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:57.945+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:58.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:57 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:57.945+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:58.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:57 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:57.945+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:09:58.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:58.444+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:58.884 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:58.444+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:58.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:58.444+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:58.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:58.444+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:09:58.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:58.534+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:58.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:58.534+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:58.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:58.534+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:58.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:58 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:58.534+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:09:59.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:58.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:09:59.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:58.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:09:59.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:58.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:09:59.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:58.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:09:59.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:58 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:58.762+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:09:59.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:58.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:09:59.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:58.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:09:59.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:58.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:09:59.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:58.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:09:59.233 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:58 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:58.964+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:09:59.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:59.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:09:59.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:59.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:09:59.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:59.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:09:59.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:09:59.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:09:59.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:59.405+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:09:59.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:59.405+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:09:59.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:59.405+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:09:59.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:09:59 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:09:59.405+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:10:00.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:59 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:59.715+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:00.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:59 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:59.715+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:00.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:59 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:59.715+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:00.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:59 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:59.715+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:00.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:09:59 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:09:59.715+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:00.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:59.957+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:00.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:59.957+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:00.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:59.957+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:00.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:59.957+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:00.233 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:09:59 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:09:59.957+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:00.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:00.588+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:00.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:00.588+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:00.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:00.588+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:00.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:00.588+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:00.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:00.443+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:10:00.885 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:00.443+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:10:00.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:00.443+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:10:00.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:00.443+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:10:00.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:00 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:00.675+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:00.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:00 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:00.675+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:00.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:00 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:00.675+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:00.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:00 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:00.675+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:00.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:00 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:00.675+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:01.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:01.003+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:01.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:01.003+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:01.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:01.003+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:01.483 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:01.003+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:01.483 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:01 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:01.003+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:01.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:01.592+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:01.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:01.592+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:01.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:01.592+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:01.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:01.592+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:01.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:01.407+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:10:01.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:01.407+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:10:01.886 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:01.407+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:10:01.887 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:01 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:01.407+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:10:02.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:01 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:01.724+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:02.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:01 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:01.724+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:02.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:01 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:01.724+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:02.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:01 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:01.724+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:02.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:01 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:01.724+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:02.481 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:02.046+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:02.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:02.046+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:02.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:02.046+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:02.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:02.046+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:02.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:02 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:02.046+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:02.641 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:02.428+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:08.750142+0000 front 2023-10-14T09:09:08.750197+0000 (oldest deadline 2023-10-14T09:09:32.850170+0000) 2023-10-14T09:10:02.642 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:02.428+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:15.651832+0000 front 2023-10-14T09:09:15.651804+0000 (oldest deadline 2023-10-14T09:09:39.752135+0000) 2023-10-14T09:10:02.642 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:02.428+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:23.754123+0000 front 2023-10-14T09:09:23.754099+0000 (oldest deadline 2023-10-14T09:09:45.453855+0000) 2023-10-14T09:10:02.642 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:02.428+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:27.754894+0000 front 2023-10-14T09:09:27.754838+0000 (oldest deadline 2023-10-14T09:09:55.955421+0000) 2023-10-14T09:10:02.642 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8[126096]: 2023-10-14T09:10:02.428+0000 7ff6c7868700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.756979+0000 front 2023-10-14T09:09:38.756870+0000 (oldest deadline 2023-10-14T09:10:02.257051+0000) 2023-10-14T09:10:02.981 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:02.637+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:02.981 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:02.637+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:02.981 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:02.637+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:02.981 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:02 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:02.637+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:03.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:02.712+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:03.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:02.712+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:03.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:02.712+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:03.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:02.712+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:03.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:02.712+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:03.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:02 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:02.712+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:03.259 INFO:journalctl@ceph.osd.8.smithi178.stdout:Oct 14 09:10:03 smithi178 bash[149349]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-8 2023-10-14T09:10:03.484 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:03 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:03.065+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:03.484 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:03 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:03.065+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:03.485 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:03 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:03.065+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:03.485 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:03 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:03.065+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:03.485 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:03 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:03.065+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:03.853 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:03 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:03.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:03.854 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:03 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:03.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:03.854 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:03 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:03.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:03.854 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:03 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:03.591+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:04.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:03.758+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:04.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:03.758+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:04.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:03.758+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:04.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:03.758+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:04.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:03.758+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:04.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:03 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:03.758+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:04.481 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.084+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:04.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.084+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:04.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.084+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:04.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.084+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:04.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.084+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:04.522 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.8.service' 2023-10-14T09:10:04.563 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:04.564 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-14T09:10:04.564 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-14T09:10:04.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.9 2023-10-14T09:10:04.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:04 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:04.601+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:04.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:04 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:04.601+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:04.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:04 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:04.601+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:04.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:04 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:04.601+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:04.927 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 systemd[1]: Stopping Ceph osd.9 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:05.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:04.740+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:05.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:04.740+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:05.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:04.740+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:05.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:04.740+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:05.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:04.740+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:05.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:04 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:04.740+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:05.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.924+0000 7f8ff2f5d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:05.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.924+0000 7f8ff2f5d700 -1 osd.9 87 *** Got signal Terminated *** 2023-10-14T09:10:05.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:04 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:04.924+0000 7f8ff2f5d700 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:10:05.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:05 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:05.069+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:05.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:05 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:05.069+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:05.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:05 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:05.069+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:05.233 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:05 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:05.069+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:05.233 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:05 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:05.069+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:05.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:05.602+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:05.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:05.602+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:05.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:05.602+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:05.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:05.602+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:05.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:05 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:05.602+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:06.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:05.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:06.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:05.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:06.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:05.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:06.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:05.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:06.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:05.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:06.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:05 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:05.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:06.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.020+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:06.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.020+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:06.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.020+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:06.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.020+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:06.483 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.020+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:06.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:06.580+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:06.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:06.580+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:06.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:06.580+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:06.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:06.580+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:06.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:06 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:06.580+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:07.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:06 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:06.713+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:07.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:06 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:06.713+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:07.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:06 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:06.713+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:07.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:06 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:06.713+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:07.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:06 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:06.713+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:07.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:06 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:06.713+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:07.481 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:07.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:07.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:07.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:07.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:06 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:06.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:07.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:07.589+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:07.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:07.589+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:07.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:07.589+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:07.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:07.589+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:07.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:07.589+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:08.197 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:07.702+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:08.197 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:07.702+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:08.197 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:07.702+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:08.198 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:07.702+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:08.198 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:07.702+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:08.198 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:07 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:07.702+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:08.231 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:07 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:07.959+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:08.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:07 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:07.959+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:08.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:07 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:07.959+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:08.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:07 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:07.959+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:08.232 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:07 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:07.959+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:08.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:08.551+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:08.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:08.551+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:08.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:08.551+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:08.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:08.551+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:08.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:08 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:08.551+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:08.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:08.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:08.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:08.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:08.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:08.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:08.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:08.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:08.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:08.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:08.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:08 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:08.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:09.481 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:08.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:01.146957+0000 front 2023-10-14T09:09:01.146901+0000 (oldest deadline 2023-10-14T09:09:23.347809+0000) 2023-10-14T09:10:09.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:08.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.248851+0000 front 2023-10-14T09:09:06.248743+0000 (oldest deadline 2023-10-14T09:09:30.348733+0000) 2023-10-14T09:10:09.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:08.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:16.150574+0000 front 2023-10-14T09:09:16.150526+0000 (oldest deadline 2023-10-14T09:09:38.450554+0000) 2023-10-14T09:10:09.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:08.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:24.351900+0000 front 2023-10-14T09:09:24.351948+0000 (oldest deadline 2023-10-14T09:09:50.152545+0000) 2023-10-14T09:10:09.482 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:08.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.153227+0000 front 2023-10-14T09:09:30.153258+0000 (oldest deadline 2023-10-14T09:09:54.853018+0000) 2023-10-14T09:10:09.483 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:08 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9[142178]: 2023-10-14T09:10:08.984+0000 7f8fedd50700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:46.856316+0000 front 2023-10-14T09:09:46.856383+0000 (oldest deadline 2023-10-14T09:10:08.556363+0000) 2023-10-14T09:10:09.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:09.513+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:09.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:09.513+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:09.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:09.513+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:09.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:09.513+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:09.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:09 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:09.513+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:10.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:09.764+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:10.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:09.764+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:10.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:09.764+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:10.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:09.764+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:10.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:09.764+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:10.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:09 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:09.764+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:10.812 INFO:journalctl@ceph.osd.9.smithi006.stdout:Oct 14 09:10:10 smithi006 bash[175723]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-9 2023-10-14T09:10:10.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:10.464+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:10.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:10.464+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:10.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:10.464+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:10.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:10.464+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:10.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:10.464+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:10.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:10 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:10.464+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:11.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:11.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:11.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:11.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:11.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:11.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:11.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:10 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:10.733+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:11.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:11.485+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:11.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:11.485+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:11.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:11.485+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:11.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:11.485+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:11.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:11.485+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:11.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:11 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:11.485+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:12.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.9.service' 2023-10-14T09:10:12.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:12.132 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-14T09:10:12.132 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-14T09:10:12.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.10 2023-10-14T09:10:12.165 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:12.165 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:12.165 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:12.165 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:12.166 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:12.166 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:12.166 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:11 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:11.734+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:12.444 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 systemd[1]: Stopping Ceph osd.10 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:12.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:12.483+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:12.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:12.483+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:12.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:12.483+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:12.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:12.483+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:12.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:12.483+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:12.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:12.483+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:12.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.512+0000 7f93ebbe2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:12.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.512+0000 7f93ebbe2700 -1 osd.10 87 *** Got signal Terminated *** 2023-10-14T09:10:12.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.512+0000 7f93ebbe2700 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:10:12.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:12.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:12.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:12.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:12.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:12.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:12.946 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:12 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:12.688+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:13.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:13 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:13.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:13.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:13 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:13.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:13.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:13 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:13.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:13.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:13 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:13.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:13.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:13 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:13.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:13.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:13 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:13.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:14.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:14.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:14.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:14.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:14.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:14.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:14.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:13 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:13.725+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:14.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:14.516+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:14.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:14.516+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:14.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:14.516+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:14.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:14.516+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:14.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:14.516+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:14.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:14 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:14.516+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:15.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:15.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:15.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:15.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:15.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:15.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:15.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:14 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:14.728+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:15.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:15 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:15.549+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:15.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:15 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:15.549+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:15.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:15 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:15.549+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:15.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:15 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:15.549+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:15.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:15 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:15.549+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:15.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:15 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:15.549+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:16.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:16.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:16.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:16.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:16.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:16.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:16.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:15 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:15.750+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:16.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:16 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:16.575+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:16.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:16 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:16.575+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:16.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:16 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:16.575+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:16.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:16 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:16.575+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:16.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:16 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:16.575+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:16.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:16 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:16.575+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:17.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.312378+0000 front 2023-10-14T09:09:00.312253+0000 (oldest deadline 2023-10-14T09:09:23.812447+0000) 2023-10-14T09:10:17.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:09.113540+0000 front 2023-10-14T09:09:09.113564+0000 (oldest deadline 2023-10-14T09:09:32.013774+0000) 2023-10-14T09:10:17.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:14.914936+0000 front 2023-10-14T09:09:14.914847+0000 (oldest deadline 2023-10-14T09:09:38.415008+0000) 2023-10-14T09:10:17.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-10-14T09:09:21.316188+0000 front 2023-10-14T09:09:21.316172+0000 (oldest deadline 2023-10-14T09:09:45.416155+0000) 2023-10-14T09:10:17.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:29.517176+0000 front 2023-10-14T09:09:29.517241+0000 (oldest deadline 2023-10-14T09:09:54.217396+0000) 2023-10-14T09:10:17.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:38.318718+0000 front 2023-10-14T09:09:38.318572+0000 (oldest deadline 2023-10-14T09:10:02.418555+0000) 2023-10-14T09:10:17.196 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:16 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10[133547]: 2023-10-14T09:10:16.780+0000 7f93e71d6700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:44.119742+0000 front 2023-10-14T09:09:44.119661+0000 (oldest deadline 2023-10-14T09:10:10.019568+0000) 2023-10-14T09:10:17.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:17 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:17.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:17.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:17 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:17.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:17.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:17 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:17.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:17.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:17 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:17.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:17.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:17 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:17.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:17.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:17 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:17.526+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:18.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:18.502+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:18.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:18.502+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:18.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:18.502+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:18.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:18.502+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:18.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:18.502+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:18.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:18 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:18.502+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:18.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Oct 14 09:10:18 smithi057 bash[147154]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-10 2023-10-14T09:10:19.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.10.service' 2023-10-14T09:10:19.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:19.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:19.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:19.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:19.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:19.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:19.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:19.548+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2023-10-14T09:09:53.380122+0000 front 2023-10-14T09:09:53.380045+0000 (oldest deadline 2023-10-14T09:10:18.679906+0000) 2023-10-14T09:10:19.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:19.940 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-14T09:10:19.941 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-14T09:10:19.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.11 2023-10-14T09:10:20.297 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:19 smithi178 systemd[1]: Stopping Ceph osd.11 for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:20.298 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.294+0000 7f17e5f0c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:20.596 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.294+0000 7f17e5f0c700 -1 osd.11 87 *** Got signal Terminated *** 2023-10-14T09:10:20.597 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.294+0000 7f17e5f0c700 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-14T09:10:20.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:20.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:20.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:20.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:20.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:20.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:20.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:20 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:20.595+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2023-10-14T09:09:53.380122+0000 front 2023-10-14T09:09:53.380045+0000 (oldest deadline 2023-10-14T09:10:18.679906+0000) 2023-10-14T09:10:21.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:21.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:21.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:21.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:21.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:21.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:21.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:21 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:21.565+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2023-10-14T09:09:53.380122+0000 front 2023-10-14T09:09:53.380045+0000 (oldest deadline 2023-10-14T09:10:18.679906+0000) 2023-10-14T09:10:22.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:22.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:22.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:22.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:22.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:22.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:22.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:22 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:22.557+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2023-10-14T09:09:53.380122+0000 front 2023-10-14T09:09:53.380045+0000 (oldest deadline 2023-10-14T09:10:18.679906+0000) 2023-10-14T09:10:23.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:23.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:23.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:23.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:23.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:23.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:23.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2023-10-14T09:09:53.380122+0000 front 2023-10-14T09:09:53.380045+0000 (oldest deadline 2023-10-14T09:10:18.679906+0000) 2023-10-14T09:10:23.886 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:23 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:23.546+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2023-10-14T09:09:58.680378+0000 front 2023-10-14T09:09:58.680411+0000 (oldest deadline 2023-10-14T09:10:23.380422+0000) 2023-10-14T09:10:24.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-10-14T09:09:00.971441+0000 front 2023-10-14T09:09:00.971616+0000 (oldest deadline 2023-10-14T09:09:26.271317+0000) 2023-10-14T09:10:24.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6804 osd.1 since back 2023-10-14T09:09:06.272065+0000 front 2023-10-14T09:09:06.271947+0000 (oldest deadline 2023-10-14T09:09:31.571878+0000) 2023-10-14T09:10:24.884 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2023-10-14T09:09:12.672900+0000 front 2023-10-14T09:09:12.672925+0000 (oldest deadline 2023-10-14T09:09:39.073693+0000) 2023-10-14T09:10:24.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6812 osd.4 since back 2023-10-14T09:09:30.176046+0000 front 2023-10-14T09:09:30.175965+0000 (oldest deadline 2023-10-14T09:09:53.576375+0000) 2023-10-14T09:10:24.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2023-10-14T09:09:39.477197+0000 front 2023-10-14T09:09:39.477228+0000 (oldest deadline 2023-10-14T09:10:04.777355+0000) 2023-10-14T09:10:24.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-10-14T09:09:45.878490+0000 front 2023-10-14T09:09:45.878473+0000 (oldest deadline 2023-10-14T09:10:09.878891+0000) 2023-10-14T09:10:24.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.57:6820 osd.7 since back 2023-10-14T09:09:53.380122+0000 front 2023-10-14T09:09:53.380045+0000 (oldest deadline 2023-10-14T09:10:18.679906+0000) 2023-10-14T09:10:24.885 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:24 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11[134925]: 2023-10-14T09:10:24.515+0000 7f17e0cff700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2023-10-14T09:09:58.680378+0000 front 2023-10-14T09:09:58.680411+0000 (oldest deadline 2023-10-14T09:10:23.380422+0000) 2023-10-14T09:10:26.134 INFO:journalctl@ceph.osd.11.smithi178.stdout:Oct 14 09:10:26 smithi178 bash[149627]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-osd-11 2023-10-14T09:10:27.344 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@osd.11.service' 2023-10-14T09:10:27.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:27.385 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-14T09:10:27.386 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-14T09:10:27.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.a 2023-10-14T09:10:27.731 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:10:27 smithi006 systemd[1]: Stopping Ceph mds.a for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:28.232 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:10:27 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a[150197]: 2023-10-14T09:10:27.739+0000 7f67831c1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:28.232 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:10:27 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a[150197]: 2023-10-14T09:10:27.739+0000 7f67831c1700 -1 mds.a *** got signal Terminated *** 2023-10-14T09:10:31.631 INFO:journalctl@ceph.mds.a.smithi006.stdout:Oct 14 09:10:31 smithi006 bash[175985]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-a 2023-10-14T09:10:31.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.a.service' 2023-10-14T09:10:31.674 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:31.675 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-14T09:10:31.675 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-14T09:10:31.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.d 2023-10-14T09:10:31.981 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 09:10:31 smithi006 systemd[1]: Stopping Ceph mds.d for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:32.482 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 09:10:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-d[149240]: 2023-10-14T09:10:32.047+0000 7f04d7f77700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:32.482 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 09:10:32 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-d[149240]: 2023-10-14T09:10:32.047+0000 7f04d7f77700 -1 mds.d *** got signal Terminated *** 2023-10-14T09:10:34.109 INFO:journalctl@ceph.mds.d.smithi006.stdout:Oct 14 09:10:33 smithi006 bash[176131]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-d 2023-10-14T09:10:34.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.d.service' 2023-10-14T09:10:34.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:34.151 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-14T09:10:34.151 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-14T09:10:34.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.g 2023-10-14T09:10:34.481 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:10:34 smithi006 systemd[1]: Stopping Ceph mds.g for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:34.981 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:10:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: 2023-10-14T09:10:34.521+0000 7f73be9a1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:34.982 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:10:34 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g[149809]: 2023-10-14T09:10:34.521+0000 7f73be9a1700 -1 mds.g *** got signal Terminated *** 2023-10-14T09:10:38.981 INFO:journalctl@ceph.mds.g.smithi006.stdout:Oct 14 09:10:38 smithi006 bash[176266]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-g 2023-10-14T09:10:39.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.g.service' 2023-10-14T09:10:39.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:39.087 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-14T09:10:39.088 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-14T09:10:39.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.j 2023-10-14T09:10:39.464 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 09:10:39 smithi006 systemd[1]: Stopping Ceph mds.j for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:39.731 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 09:10:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-j[148858]: 2023-10-14T09:10:39.462+0000 7f2ee6c4a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:39.732 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 09:10:39 smithi006 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-j[148858]: 2023-10-14T09:10:39.462+0000 7f2ee6c4a700 -1 mds.j *** got signal Terminated *** 2023-10-14T09:10:43.980 INFO:journalctl@ceph.mds.j.smithi006.stdout:Oct 14 09:10:43 smithi006 bash[176416]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-j 2023-10-14T09:10:43.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.j.service' 2023-10-14T09:10:44.024 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:44.025 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-14T09:10:44.025 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-14T09:10:44.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.b 2023-10-14T09:10:44.383 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:10:44 smithi057 systemd[1]: Stopping Ceph mds.b for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:44.694 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:10:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: 2023-10-14T09:10:44.380+0000 7f6cadf15700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:44.694 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:10:44 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b[140672]: 2023-10-14T09:10:44.380+0000 7f6cadf15700 -1 mds.b *** got signal Terminated *** 2023-10-14T09:10:47.444 INFO:journalctl@ceph.mds.b.smithi057.stdout:Oct 14 09:10:47 smithi057 bash[147422]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-b 2023-10-14T09:10:47.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.b.service' 2023-10-14T09:10:47.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:47.689 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-14T09:10:47.690 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-14T09:10:47.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.e 2023-10-14T09:10:47.944 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:10:47 smithi057 systemd[1]: Stopping Ceph mds.e for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:48.444 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:10:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e[139985]: 2023-10-14T09:10:48.072+0000 7f1d52802700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:48.444 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:10:48 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e[139985]: 2023-10-14T09:10:48.072+0000 7f1d52802700 -1 mds.e *** got signal Terminated *** 2023-10-14T09:10:51.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.e.service' 2023-10-14T09:10:51.766 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:10:51 smithi057 bash[147558]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-e 2023-10-14T09:10:51.766 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:10:51 smithi057 systemd[1]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.e.service: Succeeded. 2023-10-14T09:10:51.766 INFO:journalctl@ceph.mds.e.smithi057.stdout:Oct 14 09:10:51 smithi057 systemd[1]: Stopped Ceph mds.e for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7. 2023-10-14T09:10:51.777 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:51.778 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-14T09:10:51.778 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-14T09:10:51.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.h 2023-10-14T09:10:52.156 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:10:51 smithi057 systemd[1]: Stopping Ceph mds.h for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:52.444 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:10:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h[140333]: 2023-10-14T09:10:52.155+0000 7f6e42b6a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:52.444 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:10:52 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h[140333]: 2023-10-14T09:10:52.155+0000 7f6e42b6a700 -1 mds.h *** got signal Terminated *** 2023-10-14T09:10:55.429 INFO:journalctl@ceph.mds.h.smithi057.stdout:Oct 14 09:10:55 smithi057 bash[147698]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-h 2023-10-14T09:10:55.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.h.service' 2023-10-14T09:10:55.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:55.661 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-14T09:10:55.662 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-14T09:10:55.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.k 2023-10-14T09:10:55.944 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:10:55 smithi057 systemd[1]: Stopping Ceph mds.k for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:10:56.444 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:10:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k[139643]: 2023-10-14T09:10:56.038+0000 7fbaf6ae8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:10:56.444 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:10:56 smithi057 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k[139643]: 2023-10-14T09:10:56.038+0000 7fbaf6ae8700 -1 mds.k *** got signal Terminated *** 2023-10-14T09:10:59.646 INFO:journalctl@ceph.mds.k.smithi057.stdout:Oct 14 09:10:59 smithi057 bash[147836]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-k 2023-10-14T09:10:59.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.k.service' 2023-10-14T09:10:59.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:10:59.690 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-14T09:10:59.690 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-14T09:10:59.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.c 2023-10-14T09:11:00.039 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:10:59 smithi178 systemd[1]: Stopping Ceph mds.c for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:11:00.384 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:11:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c[141787]: 2023-10-14T09:11:00.036+0000 7fd95579d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:11:00.384 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:11:00 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c[141787]: 2023-10-14T09:11:00.036+0000 7fd95579d700 -1 mds.c *** got signal Terminated *** 2023-10-14T09:11:03.634 INFO:journalctl@ceph.mds.c.smithi178.stdout:Oct 14 09:11:03 smithi178 bash[149885]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-c 2023-10-14T09:11:03.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.c.service' 2023-10-14T09:11:03.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:11:03.724 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-14T09:11:03.724 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-14T09:11:03.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.f 2023-10-14T09:11:04.105 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:11:03 smithi178 systemd[1]: Stopping Ceph mds.f for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:11:04.384 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:11:04 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f[141448]: 2023-10-14T09:11:04.102+0000 7f1f23c40700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:11:04.384 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:11:04 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f[141448]: 2023-10-14T09:11:04.102+0000 7f1f23c40700 -1 mds.f *** got signal Terminated *** 2023-10-14T09:11:07.549 INFO:journalctl@ceph.mds.f.smithi178.stdout:Oct 14 09:11:07 smithi178 bash[150038]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-f 2023-10-14T09:11:07.555 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.f.service' 2023-10-14T09:11:07.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:11:07.589 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-14T09:11:07.590 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-14T09:11:07.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.i 2023-10-14T09:11:07.884 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:11:07 smithi178 systemd[1]: Stopping Ceph mds.i for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:11:08.384 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:11:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: 2023-10-14T09:11:07.959+0000 7f7d758c5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:11:08.385 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:11:07 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i[142136]: 2023-10-14T09:11:07.959+0000 7f7d758c5700 -1 mds.i *** got signal Terminated *** 2023-10-14T09:11:11.828 INFO:journalctl@ceph.mds.i.smithi178.stdout:Oct 14 09:11:11 smithi178 bash[150176]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-i 2023-10-14T09:11:11.833 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.i.service' 2023-10-14T09:11:11.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:11:11.866 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-14T09:11:11.867 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-14T09:11:11.867 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.l 2023-10-14T09:11:12.134 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:11:11 smithi178 systemd[1]: Stopping Ceph mds.l for af5a2e5a-6a6d-11ee-8db6-212e2dc638e7... 2023-10-14T09:11:12.634 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:11:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l[141106]: 2023-10-14T09:11:12.233+0000 7f6fd959d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-14T09:11:12.634 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:11:12 smithi178 ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l[141106]: 2023-10-14T09:11:12.233+0000 7f6fd959d700 -1 mds.l *** got signal Terminated *** 2023-10-14T09:11:15.634 INFO:journalctl@ceph.mds.l.smithi178.stdout:Oct 14 09:11:15 smithi178 bash[150322]: ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7-mds-l 2023-10-14T09:11:15.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-af5a2e5a-6a6d-11ee-8db6-212e2dc638e7@mds.l.service' 2023-10-14T09:11:15.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-14T09:11:15.749 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-14T09:11:15.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-14T09:11:16.069 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T09:11:17.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-14T09:11:18.040 INFO:teuthology.orchestra.run.smithi057.stdout:Deleting cluster with fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T09:11:19.647 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --force --keep-logs 2023-10-14T09:11:19.953 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T09:11:21.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-14T09:11:21.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-14T09:11:21.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-14T09:11:21.617 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-14T09:11:21.619 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi006/crash 2023-10-14T09:11:21.620 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash -- . 2023-10-14T09:11:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-14T09:11:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2023-10-14T09:11:21.662 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi057/crash 2023-10-14T09:11:21.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash -- . 2023-10-14T09:11:21.714 INFO:teuthology.orchestra.run.smithi057.stderr:tar: /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-14T09:11:21.714 INFO:teuthology.orchestra.run.smithi057.stderr:tar: Error is not recoverable: exiting now 2023-10-14T09:11:21.716 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi178/crash 2023-10-14T09:11:21.717 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash -- . 2023-10-14T09:11:21.753 INFO:teuthology.orchestra.run.smithi178.stderr:tar: /var/lib/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-14T09:11:21.753 INFO:teuthology.orchestra.run.smithi178.stderr:tar: Error is not recoverable: exiting now 2023-10-14T09:11:21.754 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-14T09:11:21.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-14T09:11:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:grep: /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph.log: No such file or directory 2023-10-14T09:11:21.793 INFO:tasks.cephadm:Compressing logs... 2023-10-14T09:11:21.793 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:11:21.836 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:11:21.838 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T09:11:21.864 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.0.log 2023-10-14T09:11:21.864 INFO:teuthology.orchestra.run.smithi006.stderr:: No such file or directory 2023-10-14T09:11:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.g.log 2023-10-14T09:11:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.a.log 2023-10-14T09:11:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.0.log: /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.6.log 2023-10-14T09:11:21.868 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.3.log 2023-10-14T09:11:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.d.log 2023-10-14T09:11:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.x.log 2023-10-14T09:11:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.5.log 2023-10-14T09:11:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:: No such file or directory 2023-10-14T09:11:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.2.log 2023-10-14T09:11:21.870 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.11.log 2023-10-14T09:11:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.z.log 2023-10-14T09:11:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.8.log 2023-10-14T09:11:21.871 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.f.log 2023-10-14T09:11:21.872 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.c.log 2023-10-14T09:11:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.d.log: /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.x.log: 94.4% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.d.log.gz 2023-10-14T09:11:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.9.log 2023-10-14T09:11:21.875 INFO:teuthology.orchestra.run.smithi057.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-14T09:11:21.875 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.10.log 2023-10-14T09:11:21.876 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.h.log 2023-10-14T09:11:21.876 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.e.log 2023-10-14T09:11:21.876 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.10.log: /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.4.log 2023-10-14T09:11:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.1.log 2023-10-14T09:11:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.k.log 2023-10-14T09:11:21.877 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.1.log: /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-14T09:11:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.f.log: /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.i.log 2023-10-14T09:11:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.i.log: 93.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-14T09:11:21.878 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.c.log 2023-10-14T09:11:21.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-14T09:11:21.882 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-14T09:11:21.883 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.7.log 2023-10-14T09:11:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.b.log 2023-10-14T09:11:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-14T09:11:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.j.log 2023-10-14T09:11:21.888 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log 2023-10-14T09:11:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.b.log 2023-10-14T09:11:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.j.log: 94.4% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.j.log.gz 2023-10-14T09:11:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.a.log 2023-10-14T09:11:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-14T09:11:21.903 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.l.log 2023-10-14T09:11:21.913 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.y.log 2023-10-14T09:11:21.921 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-14T09:11:21.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/cephadm.log: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-14T09:11:21.932 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-volume.log.gz 2023-10-14T09:11:21.935 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-14T09:11:21.947 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-14T09:11:21.953 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.y.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-14T09:11:21.954 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-14T09:11:21.972 INFO:teuthology.orchestra.run.smithi006.stderr: 93.5% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.g.log.gz 2023-10-14T09:11:22.029 INFO:teuthology.orchestra.run.smithi006.stderr: 95.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.a.log.gz 2023-10-14T09:11:22.103 INFO:teuthology.orchestra.run.smithi006.stderr: 90.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-14T09:11:22.184 INFO:teuthology.orchestra.run.smithi178.stderr: 93.4% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.f.log.gz 2023-10-14T09:11:22.232 INFO:teuthology.orchestra.run.smithi178.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.l.log.gz 2023-10-14T09:11:22.409 INFO:teuthology.orchestra.run.smithi178.stderr: 91.9% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.c.log.gz 2023-10-14T09:11:22.452 INFO:teuthology.orchestra.run.smithi178.stderr: 94.6% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.c.log.gz 2023-10-14T09:11:22.465 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.b.log.gz 2023-10-14T09:11:22.503 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.k.log.gz 2023-10-14T09:11:22.885 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mon.a.log.gz 2023-10-14T09:11:23.022 INFO:teuthology.orchestra.run.smithi057.stderr: 94.5% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.h.log.gz 2023-10-14T09:11:23.504 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.b.log.gz 2023-10-14T09:11:24.385 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.e.log.gz 2023-10-14T09:11:31.664 INFO:teuthology.orchestra.run.smithi178.stderr: 94.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-mds.i.log.gz 2023-10-14T09:11:33.685 INFO:teuthology.orchestra.run.smithi006.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.9.log.gz 2023-10-14T09:11:35.328 INFO:teuthology.orchestra.run.smithi006.stderr: 94.5% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.6.log.gz 2023-10-14T09:11:37.083 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.4.log.gz 2023-10-14T09:11:39.987 INFO:teuthology.orchestra.run.smithi178.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.2.log.gz 2023-10-14T09:11:43.703 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.10.log.gz 2023-10-14T09:11:46.241 INFO:teuthology.orchestra.run.smithi006.stderr: 94.2% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.0.log.gz 2023-10-14T09:11:46.296 INFO:teuthology.orchestra.run.smithi178.stderr: 94.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.8.log.gz 2023-10-14T09:11:46.910 INFO:teuthology.orchestra.run.smithi178.stderr: 94.2% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.11.log.gz 2023-10-14T09:11:46.918 INFO:teuthology.orchestra.run.smithi178.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.5.log.gz 2023-10-14T09:11:46.920 INFO:teuthology.orchestra.run.smithi178.stderr: 2023-10-14T09:11:46.920 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m25.065s 2023-10-14T09:11:46.920 INFO:teuthology.orchestra.run.smithi178.stderr:user 1m40.003s 2023-10-14T09:11:46.921 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m3.752s 2023-10-14T09:11:49.681 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.1.log.gz 2023-10-14T09:11:51.066 INFO:teuthology.orchestra.run.smithi057.stderr: 94.2% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.7.log.gz 2023-10-14T09:11:51.068 INFO:teuthology.orchestra.run.smithi057.stderr: 2023-10-14T09:11:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m29.213s 2023-10-14T09:11:51.068 INFO:teuthology.orchestra.run.smithi057.stderr:user 1m36.435s 2023-10-14T09:11:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m3.361s 2023-10-14T09:11:57.559 INFO:teuthology.orchestra.run.smithi006.stderr: 94.1% -- replaced with /var/log/ceph/af5a2e5a-6a6d-11ee-8db6-212e2dc638e7/ceph-osd.3.log.gz 2023-10-14T09:11:57.561 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-10-14T09:11:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m35.710s 2023-10-14T09:11:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:user 1m23.653s 2023-10-14T09:11:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m3.057s 2023-10-14T09:11:57.562 INFO:tasks.cephadm:Archiving logs... 2023-10-14T09:11:57.562 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi006/log 2023-10-14T09:11:57.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:12:09.371 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi057/log 2023-10-14T09:12:09.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:12:22.459 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi178/log 2023-10-14T09:12:22.460 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T09:12:35.852 INFO:tasks.cephadm:Removing cluster... 2023-10-14T09:12:35.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --force 2023-10-14T09:12:36.167 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T09:12:36.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --force 2023-10-14T09:12:37.067 INFO:teuthology.orchestra.run.smithi057.stdout:Deleting cluster with fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T09:12:37.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 --force 2023-10-14T09:12:37.971 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: af5a2e5a-6a6d-11ee-8db6-212e2dc638e7 2023-10-14T09:12:38.565 INFO:tasks.cephadm:Removing cephadm ... 2023-10-14T09:12:38.565 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-14T09:12:38.588 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-14T09:12:38.610 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-14T09:12:38.628 INFO:tasks.cephadm:Teardown complete 2023-10-14T09:12:38.629 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T09:12:38.640 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T09:12:38.640 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:12:38.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:12:38.652 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T09:12:38.772 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T09:12:38.785 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T09:12:38.786 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:12:38.789 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:12:38.792 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T09:12:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-10-14T09:12:38.808 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2023-10-14T09:12:38.809 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2023-10-14T09:12:38.810 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:12:38.810 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-10-14T09:12:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 0 +1265us[+1265us] +/- 76ms 2023-10-14T09:12:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 -1029us[ -988us] +/- 58ms 2023-10-14T09:12:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +167us[ +205us] +/- 71ms 2023-10-14T09:12:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:12:38.814 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:12:38.814 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-10-14T09:12:38.815 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 64 +1247us[+1294us] +/- 75ms 2023-10-14T09:12:38.815 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv02.front.sepia.ceph.com 3 6 377 0 -1025us[ -977us] +/- 58ms 2023-10-14T09:12:38.815 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +162us[ +209us] +/- 71ms 2023-10-14T09:12:38.816 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:12:38.817 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T09:12:38.817 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-10-14T09:12:38.817 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 0 +1312us[+1312us] +/- 76ms 2023-10-14T09:12:38.818 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -1017us[ -982us] +/- 58ms 2023-10-14T09:12:38.818 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +222us[ +222us] +/- 72ms 2023-10-14T09:12:38.818 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T09:12:38.818 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T09:12:38.830 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T09:12:38.831 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T09:12:38.842 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T09:12:38.964 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T09:12:39.072 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T09:12:39.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:12:39.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:12:39.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:12:39.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:12:39.239 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T09:12:39.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:12:39.272 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T09:12:39.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T09:12:39.293 INFO:teuthology.task.internal:Duration was 2503.574912 seconds 2023-10-14T09:12:39.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T09:12:39.304 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T09:12:39.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:12:39.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:12:39.309 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T09:12:39.354 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:12:39.357 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:12:39.359 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T09:12:39.708 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T09:12:39.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-10-14T09:12:39.709 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:12:39.735 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2023-10-14T09:12:39.735 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:12:39.761 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2023-10-14T09:12:39.762 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T09:12:39.783 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T09:12:39.784 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:12:39.786 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:12:39.803 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T09:12:39.872 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T09:12:39.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:12:39.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:12:39.877 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T09:12:39.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T09:12:40.002 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T09:12:40.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:12:40.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:12:40.060 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T09:12:40.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T09:12:40.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:12:40.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:12:40.117 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:12:40.138 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-10-14T09:12:40.141 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2023-10-14T09:12:40.154 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2023-10-14T09:12:40.178 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:12:40.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:12:40.209 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:12:40.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:12:40.235 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T09:12:40.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T09:12:40.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T09:12:40.263 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T09:12:40.264 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi006 2023-10-14T09:12:40.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:12:40.307 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi057 2023-10-14T09:12:40.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:12:40.347 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117/remote/smithi178 2023-10-14T09:12:40.348 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T09:12:40.387 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T09:12:40.387 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:12:40.390 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:12:40.393 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T09:12:40.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T09:12:40.452 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T09:12:40.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T09:12:40.466 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T09:12:40.467 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:12:40.470 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:12:40.472 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T09:12:40.484 INFO:teuthology.orchestra.run.smithi006.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 09:12 /home/ubuntu/cephtest 2023-10-14T09:12:40.487 INFO:teuthology.orchestra.run.smithi057.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 09:12 /home/ubuntu/cephtest 2023-10-14T09:12:40.494 INFO:teuthology.orchestra.run.smithi178.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 09:12 /home/ubuntu/cephtest 2023-10-14T09:12:40.496 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T09:12:40.512 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T09:12:40.538 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T09:12:40.561 DEBUG:teuthology.nuke:shortname: smithi006 2023-10-14T09:12:40.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:12:40.582 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:25:16.156531', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T09:12:40.586 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-14T09:12:40.586 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:12:40.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:25:16.158101', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T09:12:40.612 DEBUG:teuthology.nuke:shortname: smithi178 2023-10-14T09:12:40.613 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T09:12:40.632 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425117', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 08:25:16.155012', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T09:12:40.642 INFO:teuthology.orchestra.console.smithi006:Power off 2023-10-14T09:12:40.643 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:12:40.668 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-10-14T09:12:40.669 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:40.686 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-14T09:12:40.686 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:12:40.701 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-14T09:12:40.711 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-14T09:12:40.712 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:40.728 INFO:teuthology.orchestra.console.smithi178:Power off 2023-10-14T09:12:40.728 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T09:12:40.739 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-14T09:12:40.751 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-10-14T09:12:40.751 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:40.776 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-10-14T09:12:44.703 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:44.740 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:44.778 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:44.814 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-14T09:12:44.849 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-14T09:12:44.888 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-10-14T09:12:48.822 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:48.850 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:48.889 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:48.932 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-10-14T09:12:48.963 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-14T09:12:49.000 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-10-14T09:12:49.064 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-14T09:12:49.100 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-10-14T09:12:52.934 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T09:12:53.044 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-10-14T09:12:53.145 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-10-14T09:12:53.250 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/postgres}} duration: 2503.5749118328094 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2023-10-14T09:12:53.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T09:12:53.334 INFO:teuthology.run:FAIL